vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #219
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12client # Disk image does not exist, creating the virtualisation disk image...13client # Formatting '/build/vm-state-client/tmp.r7z3DkxItJ', fmt=raw size=107374182414client: QEMU running (pid 49)15worker2 # Disk image does not exist, creating the virtualisation disk image...16client # mke2fs 1.47.4 (6-Mar-2025)17worker2 # Formatting '/build/vm-state-worker2/tmp.WDWqWCnJtT', fmt=raw size=107374182418client # Discarding device blocks: 0/262144 done19worker2 # mke2fs 1.47.4 (6-Mar-2025)20client # Creating filesystem with 262144 4k blocks and 65536 inodes21worker2 # Discarding device blocks: 0/262144 done22client # Filesystem UUID: 875a1e2f-f83b-47b5-8007-d3b886c4ab8023client # Superblock backups stored on blocks:24worker2: QEMU running (pid 51)25lb # Disk image does not exist, creating the virtualisation disk image...26worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes27client # 32768, 98304, 163840, 22937628lb: QEMU running (pid 52)29lb # Formatting '/build/vm-state-lb/tmp.twI9B7Xxe9', fmt=raw size=107374182430worker2 # Filesystem UUID: 21775a09-076f-4478-b718-10bf1a73ad5731lb # mke2fs 1.47.4 (6-Mar-2025)32worker2 # Superblock backups stored on blocks:33lb # Discarding device blocks: 0/262144 done34worker2 # 32768, 98304, 163840, 22937635lb # Creating filesystem with 262144 4k blocks and 65536 inodes36worker2 # 37lb # Filesystem UUID: 93a5ad0c-fba5-4139-a6ec-38a15c1128d438worker2 # Allocating group tables: 0/8 done39lb # Superblock backups stored on blocks:40worker2 # Writing inode tables: 0/8 done41lb # 32768, 98304, 163840, 22937642worker2 # Creating journal (8192 blocks): done43lb # 44worker2 # Writing superblocks and filesystem accounting information: 0/8 done45lb # Allocating group tables: 0/8 done46worker2 # 47lb # Writing inode tables: 0/8 done48worker2 # Virtualisation disk image created.49lb # Creating journal (8192 blocks): done50client # 51lb # Writing superblocks and filesystem accounting information: 0/8 done52client # Allocating group tables: 0/8 done53lb # 54client # Writing inode tables: 0/8 done55lb # Virtualisation disk image created.56client # Creating journal (8192 blocks): done57client # Writing superblocks and filesystem accounting information: 0/8 done58client # 59client # Virtualisation disk image created.60worker1 # Disk image does not exist, creating the virtualisation disk image...61worker1: QEMU running (pid 50)62worker1 # Formatting '/build/vm-state-worker1/tmp.JgjKOgvPty', fmt=raw size=107374182463worker1 # mke2fs 1.47.4 (6-Mar-2025)64(finished: start all VMs, in 0.32 seconds)65worker1 # Discarding device blocks: 0/262144 done66client: waiting for unit network-addresses-eth1.service67worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes68client: waiting for the VM to finish booting69worker1 # Filesystem UUID: ccdcf5cf-c637-4cc9-862d-d8d01a907cc670worker1 # Superblock backups stored on blocks:71worker1 # 32768, 98304, 163840, 22937672worker1 # 73worker1 # Allocating group tables: 0/8 done74worker1 # Writing inode tables: 0/8 done75worker1 # Creating journal (8192 blocks): done76worker1 # Writing superblocks and filesystem accounting information: 0/8 done77worker1 # 78worker1 # Virtualisation disk image created.79lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83lb # 84lb # 85lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086worker2 # 87worker2 # 88client # 89client # 90worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0091client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0092lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...93lb # 94lb # 95lb # 96lb # 97lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0098worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...99worker1 # 100worker2 # 101worker1 # 102worker2 # 103client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...104worker2 # 105client # 106worker2 # 107client # 108client # 109client # 110worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00111worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00112client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00113lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...114lb # 115lb # 116worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...117worker1 # 118worker1 # 119worker1 # 120worker1 # 121client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...122client # 123client # 124worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...125worker2 # 126worker2 # 127worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129worker1 # 130worker1 # 131lb # Booting from ROM...132worker2 # Booting from ROM...133client # Booting from ROM...134worker1 # Booting from ROM...135lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0137lb # [ 0.000000] BIOS-provided physical RAM map:138lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved140lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved141lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable142lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved143lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved144lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved145lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved146lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved147lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved148lb # [ 0.000000] NX (Execute Disable) protection: active149lb # [ 0.000000] APIC: Static calls initialized150lb # [ 0.000000] SMBIOS 2.8 present.151lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014152lb # [ 0.000000] DMI: Memory slots populated: 1/1153lb # [ 0.000000] Hypervisor detected: KVM154lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000155lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00156lb # [ 0.000001] kvm-clock: using sched offset of 483470345 cycles157lb # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns158lb # [ 0.000006] tsc: Detected 2400.012 MHz processor159lb # [ 0.000877] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000160lb # [ 0.000907] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs161worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026162lb # [ 0.000911] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT163lb # [ 0.002987] found SMP MP-table at [mem 0x000f5450-0x000f545f]164lb # [ 0.003002] Using GB pages for direct mapping165lb # [ 0.003114] RAMDISK: [mem 0x5e367000-0x5ffcffff]166lb # [ 0.003123] ACPI: Early table checksum verification disabled167lb # [ 0.003127] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )168worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5gvfnra4was8hpb2pdr85k0qxik5a2im-nixos-system-worker2-test/init regInfo=/nix/store/3qxpdql66chbxfrvp4n8dwgr7b5vrx84-closure-info/registration console=ttyS0,115200n8 console=tty0169worker2 # [ 0.000000] BIOS-provided physical RAM map:170lb # [ 0.003131] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)171worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable172lb # [ 0.003137] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)173worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved174lb # [ 0.003144] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)175worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved176lb # [ 0.003147] ACPI: FACS 0x000000005FFE0000 000040177client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026178worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable179lb # [ 0.003148] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)180worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved181lb # [ 0.003150] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)182worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved183lb # [ 0.003152] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)184worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved185lb # [ 0.003153] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)186client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ijm1776g0x4za8fwxfblr76ijh2zrxxx-nixos-system-client-test/init regInfo=/nix/store/81sk0a0mzys5hyxxvr6qiq7dg97dww42-closure-info/registration console=ttyS0,115200n8 console=tty0187worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved188client # [ 0.000000] BIOS-provided physical RAM map:189worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026190lb # [ 0.003155] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]191worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved192client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable193lb # [ 0.003156] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]194worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved195client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved196worker2 # [ 0.000000] NX (Execute Disable) protection: active197lb # [ 0.003157] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]198worker2 # [ 0.000000] APIC: Static calls initialized199client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved200worker2 # [ 0.000000] SMBIOS 2.8 present.201lb # [ 0.003157] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]202client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable203lb # [ 0.003158] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]204worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cmrv3f8fz8mb3lpy3i9w36i6vslrbplp-nixos-system-worker1-test/init regInfo=/nix/store/xw95vv9lbaj73kk1m5ydg4706ny76n9f-closure-info/registration console=ttyS0,115200n8 console=tty0205worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014206client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved207worker1 # [ 0.000000] BIOS-provided physical RAM map:208lb # [ 0.003158] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]209worker2 # [ 0.000000] DMI: Memory slots populated: 1/1210worker2 # [ 0.000000] Hypervisor detected: KVM211client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved212worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable213lb # [ 0.003159] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]214worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000215lb # [ 0.003420] No NUMA configuration found216client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved217worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved218worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00219lb # [ 0.003420] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]220worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved221client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved222worker2 # [ 0.000000] kvm-clock: using sched offset of 501646832 cycles223lb # [ 0.003423] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]224lb # [ 0.005929] Zone ranges:225worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable226client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved227worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns228lb # [ 0.005930] DMA [mem 0x0000000000001000-0x0000000000ffffff]229worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved230client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved231worker2 # [ 0.000006] tsc: Detected 2400.012 MHz processor232lb # [ 0.005931] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]233client # [ 0.000000] NX (Execute Disable) protection: active234worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved235lb # [ 0.005933] Normal empty236worker2 # [ 0.000877] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000237lb # [ 0.005934] Device empty238client # [ 0.000000] APIC: Static calls initialized239client # [ 0.000000] SMBIOS 2.8 present.240worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved241lb # [ 0.005934] Movable zone start for each node242worker2 # [ 0.000907] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs243lb # [ 0.005935] Early memory node ranges244worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved245worker2 # [ 0.000910] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT246lb # [ 0.005936] node 0: [mem 0x0000000000001000-0x000000000009efff]247client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014248worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved249client # [ 0.000000] DMI: Memory slots populated: 1/1250worker2 # [ 0.002935] found SMP MP-table at [mem 0x000f5450-0x000f545f]251lb # [ 0.005937] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]252worker2 # [ 0.002951] Using GB pages for direct mapping253client # [ 0.000000] Hypervisor detected: KVM254worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved255lb # [ 0.005938] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]256worker2 # [ 0.003070] RAMDISK: [mem 0x5e367000-0x5ffcffff]257client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000258worker1 # [ 0.000000] NX (Execute Disable) protection: active259lb # [ 0.005969] On node 0, zone DMA: 1 pages in unavailable ranges260client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00261worker1 # [ 0.000000] APIC: Static calls initialized262worker2 # [ 0.003081] ACPI: Early table checksum verification disabled263worker1 # [ 0.000000] SMBIOS 2.8 present.264client # [ 0.000000] kvm-clock: using sched offset of 506771216 cycles265worker2 # [ 0.003085] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )266lb # [ 0.006256] On node 0, zone DMA: 97 pages in unavailable ranges267lb # [ 0.035788] On node 0, zone DMA32: 40 pages in unavailable ranges268worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014269worker2 # [ 0.003090] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)270lb # [ 0.036314] ACPI: PM-Timer IO Port: 0x608271client # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns272worker1 # [ 0.000000] DMI: Memory slots populated: 1/1273lb # [ 0.036330] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])274worker1 # [ 0.000000] Hypervisor detected: KVM275worker2 # [ 0.003095] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)276client # [ 0.000006] tsc: Detected 2400.012 MHz processor277client # [ 0.000863] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000278worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000279lb # [ 0.036363] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23280worker2 # [ 0.003103] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)281worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00282lb # [ 0.036366] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)283client # [ 0.000894] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs284worker2 # [ 0.003105] ACPI: FACS 0x000000005FFE0000 000040285worker1 # [ 0.000001] kvm-clock: using sched offset of 507217724 cycles286lb # [ 0.036368] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)287client # [ 0.000897] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT288worker2 # [ 0.003107] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)289lb # [ 0.036369] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)290worker1 # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns291client # [ 0.002906] found SMP MP-table at [mem 0x000f5450-0x000f545f]292worker2 # [ 0.003109] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)293lb # [ 0.036370] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)294client # [ 0.002924] Using GB pages for direct mapping295worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor296client # [ 0.003050] RAMDISK: [mem 0x5e366000-0x5ffcffff]297worker1 # [ 0.000858] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000298lb # [ 0.036371] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)299worker2 # [ 0.003110] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)300client # [ 0.003061] ACPI: Early table checksum verification disabled301lb # [ 0.036373] ACPI: Using ACPI (MADT) for SMP configuration information302worker1 # [ 0.000887] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs303worker2 # [ 0.003112] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)304client # [ 0.003065] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )305lb # [ 0.036374] ACPI: HPET id: 0x8086a201 base: 0xfed00000306worker1 # [ 0.000890] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT307lb # [ 0.036380] TSC deadline timer available308worker2 # [ 0.003113] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]309client # [ 0.003070] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)310lb # [ 0.036384] CPU topo: Max. logical packages: 1311worker1 # [ 0.002879] found SMP MP-table at [mem 0x000f5450-0x000f545f]312worker2 # [ 0.003114] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]313lb # [ 0.036385] CPU topo: Max. logical dies: 1314worker1 # [ 0.002893] Using GB pages for direct mapping315client # [ 0.003075] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)316lb # [ 0.036386] CPU topo: Max. dies per package: 1317worker1 # [ 0.002969] RAMDISK: [mem 0x5e367000-0x5ffcffff]318worker2 # [ 0.003115] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]319lb # [ 0.036390] CPU topo: Max. threads per core: 1320worker1 # [ 0.002979] ACPI: Early table checksum verification disabled321client # [ 0.003084] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)322lb # [ 0.036391] CPU topo: Num. cores per package: 1323worker2 # [ 0.003115] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]324client # [ 0.003086] ACPI: FACS 0x000000005FFE0000 000040325worker1 # [ 0.002983] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )326lb # [ 0.036391] CPU topo: Num. threads per package: 1327worker2 # [ 0.003116] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]328lb # [ 0.036392] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs329client # [ 0.003088] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)330worker1 # [ 0.002988] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)331worker2 # [ 0.003116] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]332lb # [ 0.036560] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()333client # [ 0.003090] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)334worker1 # [ 0.002994] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)335worker2 # [ 0.003117] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]336worker2 # [ 0.003380] No NUMA configuration found337lb # [ 0.036599] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]338client # [ 0.003091] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)339worker1 # [ 0.003003] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)340worker2 # [ 0.003381] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]341lb # [ 0.036601] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]342worker1 # [ 0.003006] ACPI: FACS 0x000000005FFE0000 000040343client # [ 0.003093] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)344worker2 # [ 0.003383] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]345lb # [ 0.036603] [mem 0x60000000-0xafffffff] available for PCI devices346worker2 # [ 0.005935] Zone ranges:347worker1 # [ 0.003007] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)348lb # [ 0.036604] Booting paravirtualized kernel on KVM349client # [ 0.003094] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]350worker2 # [ 0.005936] DMA [mem 0x0000000000001000-0x0000000000ffffff]351client # [ 0.003095] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]352worker1 # [ 0.003009] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)353worker2 # [ 0.005938] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]354lb # [ 0.036608] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns355worker2 # [ 0.005939] Normal empty356client # [ 0.003096] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]357worker2 # [ 0.005940] Device empty358worker1 # [ 0.003011] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)359lb # [ 0.041379] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1360worker2 # [ 0.005941] Movable zone start for each node361client # [ 0.003096] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]362worker2 # [ 0.005942] Early memory node ranges363lb # [ 0.043739] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152364worker1 # [ 0.003012] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)365worker2 # [ 0.005942] node 0: [mem 0x0000000000001000-0x000000000009efff]366client # [ 0.003097] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]367lb # [ 0.043791] kvm-guest: PV spinlocks disabled, single CPU368worker1 # [ 0.003014] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]369worker2 # [ 0.005943] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]370client # [ 0.003097] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]371worker1 # [ 0.003015] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]372worker2 # [ 0.005945] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]373client # [ 0.003098] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]374worker1 # [ 0.003015] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]375client # [ 0.003358] No NUMA configuration found376worker2 # [ 0.005971] On node 0, zone DMA: 1 pages in unavailable ranges377worker1 # [ 0.003016] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]378worker2 # [ 0.006279] On node 0, zone DMA: 97 pages in unavailable ranges379client # [ 0.003359] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]380worker2 # [ 0.035691] On node 0, zone DMA32: 40 pages in unavailable ranges381worker1 # [ 0.003016] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]382lb # [ 0.043793] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0383client # [ 0.003362] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]384client # [ 0.005839] Zone ranges:385worker2 # [ 0.036194] ACPI: PM-Timer IO Port: 0x608386worker1 # [ 0.003017] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]387client # [ 0.005841] DMA [mem 0x0000000000001000-0x0000000000ffffff]388worker2 # [ 0.036211] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])389worker1 # [ 0.003017] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]390lb # [ 0.043894] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.391client # [ 0.005843] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]392worker2 # [ 0.036259] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23393worker1 # [ 0.003262] No NUMA configuration found394lb # [ 0.043909] random: crng init done395client # [ 0.005844] Normal empty396client # [ 0.005845] Device empty397worker2 # [ 0.036262] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)398worker1 # [ 0.003263] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]399client # [ 0.005846] Movable zone start for each node400lb # [ 0.043910] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes401client # [ 0.005847] Early memory node ranges402worker2 # [ 0.036264] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)403worker1 # [ 0.003265] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]404lb # [ 0.046555] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)405worker1 # [ 0.005899] Zone ranges:406client # [ 0.005847] node 0: [mem 0x0000000000001000-0x000000000009efff]407worker2 # [ 0.036266] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)408worker1 # [ 0.005901] DMA [mem 0x0000000000001000-0x0000000000ffffff]409lb # [ 0.047636] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)410client # [ 0.005849] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]411worker2 # [ 0.036267] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)412lb # [ 0.047678] Fallback order for Node 0: 0413worker1 # [ 0.005903] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]414worker1 # [ 0.005904] Normal empty415client # [ 0.005850] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]416worker2 # [ 0.036268] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)417lb # [ 0.047681] Built 1 zonelists, mobility grouping on. Total pages: 393078418worker1 # [ 0.005905] Device empty419lb # [ 0.047682] Policy zone: DMA32420client # [ 0.005873] On node 0, zone DMA: 1 pages in unavailable ranges421worker1 # [ 0.005905] Movable zone start for each node422worker2 # [ 0.036271] ACPI: Using ACPI (MADT) for SMP configuration information423worker1 # [ 0.005906] Early memory node ranges424client # [ 0.006166] On node 0, zone DMA: 97 pages in unavailable ranges425lb # [ 0.050361] mem auto-init: stack:all(zero), heap alloc:on, heap free:off426worker2 # [ 0.036272] ACPI: HPET id: 0x8086a201 base: 0xfed00000427worker2 # [ 0.036277] TSC deadline timer available428worker1 # [ 0.005907] node 0: [mem 0x0000000000001000-0x000000000009efff]429client # [ 0.037577] On node 0, zone DMA32: 40 pages in unavailable ranges430lb # [ 0.053969] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1431worker2 # [ 0.036282] CPU topo: Max. logical packages: 1432client # [ 0.038081] ACPI: PM-Timer IO Port: 0x608433lb # [ 0.057858] allocated 3145728 bytes of page_ext434worker1 # [ 0.005908] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]435worker2 # [ 0.036283] CPU topo: Max. logical dies: 1436client # [ 0.038098] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])437lb # [ 0.068759] ftrace: allocating 48731 entries in 192 pages438worker2 # [ 0.036283] CPU topo: Max. dies per package: 1439worker1 # [ 0.005909] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]440lb # [ 0.068763] ftrace: allocated 192 pages with 2 groups441client # [ 0.038136] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23442worker2 # [ 0.036287] CPU topo: Max. threads per core: 1443worker1 # [ 0.005931] On node 0, zone DMA: 1 pages in unavailable ranges444lb # [ 0.069714] Dynamic Preempt: lazy445worker2 # [ 0.036288] CPU topo: Num. cores per package: 1446client # [ 0.038140] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)447lb # [ 0.069862] rcu: Preemptible hierarchical RCU implementation.448worker1 # [ 0.006225] On node 0, zone DMA: 97 pages in unavailable ranges449worker2 # [ 0.036289] CPU topo: Num. threads per package: 1450lb # [ 0.069862] rcu: RCU event tracing is enabled.451client # [ 0.038142] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)452worker1 # [ 0.036918] On node 0, zone DMA32: 40 pages in unavailable ranges453worker2 # [ 0.036289] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs454worker1 # [ 0.037418] ACPI: PM-Timer IO Port: 0x608455lb # [ 0.069863] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.456client # [ 0.038143] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)457worker2 # [ 0.036318] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()458worker1 # [ 0.037434] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])459lb # [ 0.069865] Trampoline variant of Tasks RCU enabled.460client # [ 0.038144] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)461lb # [ 0.069865] Rude variant of Tasks RCU enabled.462worker2 # [ 0.036359] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]463worker1 # [ 0.037465] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23464lb # [ 0.069865] Tracing variant of Tasks RCU enabled.465client # [ 0.038145] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)466worker1 # [ 0.037468] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)467worker2 # [ 0.036361] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]468client # [ 0.038148] ACPI: Using ACPI (MADT) for SMP configuration information469lb # [ 0.069866] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.470worker1 # [ 0.037470] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)471worker2 # [ 0.036362] [mem 0x60000000-0xafffffff] available for PCI devices472client # [ 0.038149] ACPI: HPET id: 0x8086a201 base: 0xfed00000473lb # [ 0.069867] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1474client # [ 0.038154] TSC deadline timer available475worker2 # [ 0.036364] Booting paravirtualized kernel on KVM476worker1 # [ 0.037471] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)477client # [ 0.038158] CPU topo: Max. logical packages: 1478lb # [ 0.069892] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.479worker1 # [ 0.037472] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)480client # [ 0.038159] CPU topo: Max. logical dies: 1481worker2 # [ 0.036369] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns482client # [ 0.038160] CPU topo: Max. dies per package: 1483worker1 # [ 0.037473] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)484lb # [ 0.069894] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.485worker2 # [ 0.041157] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1486client # [ 0.038166] CPU topo: Max. threads per core: 1487worker1 # [ 0.037476] ACPI: Using ACPI (MADT) for SMP configuration information488client # [ 0.038166] CPU topo: Num. cores per package: 1489worker2 # [ 0.043652] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152490lb # [ 0.069895] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.491worker1 # [ 0.037477] ACPI: HPET id: 0x8086a201 base: 0xfed00000492client # [ 0.038167] CPU topo: Num. threads per package: 1493worker2 # [ 0.043708] kvm-guest: PV spinlocks disabled, single CPU494worker1 # [ 0.037482] TSC deadline timer available495lb # [ 0.074590] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16496client # [ 0.038167] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs497worker1 # [ 0.037487] CPU topo: Max. logical packages: 1498lb # [ 0.074889] rcu: srcu_init: Setting srcu_struct sizes based on contention.499worker1 # [ 0.037488] CPU topo: Max. logical dies: 1500client # [ 0.038197] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()501worker1 # [ 0.037488] CPU topo: Max. dies per package: 1502lb # [ 0.074897] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns503client # [ 0.038239] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]504worker1 # [ 0.037493] CPU topo: Max. threads per core: 1505worker1 # [ 0.037494] CPU topo: Num. cores per package: 1506client # [ 0.038240] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]507lb # [ 0.075028] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)508worker1 # [ 0.037494] CPU topo: Num. threads per package: 1509lb # [ 0.078812] Console: colour VGA+ 80x25510worker2 # [ 0.043710] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5gvfnra4was8hpb2pdr85k0qxik5a2im-nixos-system-worker2-test/init regInfo=/nix/store/3qxpdql66chbxfrvp4n8dwgr7b5vrx84-closure-info/registration console=ttyS0,115200n8 console=tty0511client # [ 0.038242] [mem 0x60000000-0xafffffff] available for PCI devices512worker1 # [ 0.037494] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs513lb # [ 0.078815] printk: legacy console [tty0] enabled514client # [ 0.038244] Booting paravirtualized kernel on KVM515lb # [ 0.109645] printk: legacy console [ttyS0] enabled516worker1 # [ 0.037522] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()517worker2 # [ 0.043817] Unknown kernel command line parameters "regInfo=/nix/store/3qxpdql66chbxfrvp4n8dwgr7b5vrx84-closure-info/registration", will be passed to user space.518lb # [ 0.207935] ACPI: Core revision 20250807519client # [ 0.038249] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns520worker2 # [ 0.043831] random: crng init done521worker1 # [ 0.037564] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]522client # [ 0.043104] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1523worker2 # [ 0.043832] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes524worker1 # [ 0.037565] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]525lb # [ 0.208832] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns526client # [ 0.045583] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152527worker1 # [ 0.037567] [mem 0x60000000-0xafffffff] available for PCI devices528worker2 # [ 0.046253] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)529lb # [ 0.210379] APIC: Switch to symmetric I/O mode setup530client # [ 0.045638] kvm-guest: PV spinlocks disabled, single CPU531worker1 # [ 0.037569] Booting paravirtualized kernel on KVM532worker2 # [ 0.047467] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)533lb # [ 0.211379] x2apic enabled534worker2 # [ 0.047508] Fallback order for Node 0: 0535worker1 # [ 0.037574] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns536lb # [ 0.212135] APIC: Switched APIC routing to: physical x2apic537worker2 # [ 0.047511] Built 1 zonelists, mobility grouping on. Total pages: 393078538worker1 # [ 0.042316] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1539worker2 # [ 0.047512] Policy zone: DMA32540worker1 # [ 0.044783] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152541worker2 # [ 0.050377] mem auto-init: stack:all(zero), heap alloc:on, heap free:off542worker1 # [ 0.044829] kvm-guest: PV spinlocks disabled, single CPU543lb # [ 0.214003] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1544client # [ 0.045639] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/ijm1776g0x4za8fwxfblr76ijh2zrxxx-nixos-system-client-test/init regInfo=/nix/store/81sk0a0mzys5hyxxvr6qiq7dg97dww42-closure-info/registration console=ttyS0,115200n8 console=tty0545worker2 # [ 0.054253] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1546worker2 # [ 0.058037] allocated 3145728 bytes of page_ext547worker2 # [ 0.069460] ftrace: allocating 48731 entries in 192 pages548lb # [ 0.215021] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns549client # [ 0.045754] Unknown kernel command line parameters "regInfo=/nix/store/81sk0a0mzys5hyxxvr6qiq7dg97dww42-closure-info/registration", will be passed to user space.550worker2 # [ 0.069463] ftrace: allocated 192 pages with 2 groups551client # [ 0.045768] random: crng init done552worker2 # [ 0.070498] Dynamic Preempt: lazy553lb # [ 0.216701] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)554worker2 # [ 0.070660] rcu: Preemptible hierarchical RCU implementation.555client # [ 0.045769] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes556worker2 # [ 0.070661] rcu: RCU event tracing is enabled.557worker1 # [ 0.044831] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cmrv3f8fz8mb3lpy3i9w36i6vslrbplp-nixos-system-worker1-test/init regInfo=/nix/store/xw95vv9lbaj73kk1m5ydg4706ny76n9f-closure-info/registration console=ttyS0,115200n8 console=tty0558lb # [ 0.217788] x86/cpu: User Mode Instruction Prevention (UMIP) activated559client # [ 0.048186] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)560worker2 # [ 0.070662] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.561worker2 # [ 0.070663] Trampoline variant of Tasks RCU enabled.562client # [ 0.049735] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)563lb # [ 0.219621] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127564worker1 # [ 0.044940] Unknown kernel command line parameters "regInfo=/nix/store/xw95vv9lbaj73kk1m5ydg4706ny76n9f-closure-info/registration", will be passed to user space.565client # [ 0.049783] Fallback order for Node 0: 0566worker2 # [ 0.070664] Rude variant of Tasks RCU enabled.567worker1 # [ 0.044955] random: crng init done568lb # [ 0.220390] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0569worker2 # [ 0.070664] Tracing variant of Tasks RCU enabled.570client # [ 0.049788] Built 1 zonelists, mobility grouping on. Total pages: 393078571client # [ 0.049789] Policy zone: DMA32572worker1 # [ 0.044956] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes573worker2 # [ 0.070665] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.574client # [ 0.052660] mem auto-init: stack:all(zero), heap alloc:on, heap free:off575lb # [ 0.221456] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto576worker1 # [ 0.047382] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)577worker2 # [ 0.070666] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1578client # [ 0.056534] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1579worker1 # [ 0.048982] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)580client # [ 0.060357] allocated 3145728 bytes of page_ext581worker2 # [ 0.070685] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.582lb # [ 0.222698] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl583worker1 # [ 0.049028] Fallback order for Node 0: 0584client # [ 0.071801] ftrace: allocating 48731 entries in 192 pages585worker1 # [ 0.049033] Built 1 zonelists, mobility grouping on. Total pages: 393078586worker2 # [ 0.070687] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.587client # [ 0.071803] ftrace: allocated 192 pages with 2 groups588lb # [ 0.223698] Transient Scheduler Attacks: Vulnerable: No microcode589worker1 # [ 0.049034] Policy zone: DMA32590client # [ 0.072812] Dynamic Preempt: lazy591lb # [ 0.225426] Spectre V2 : Mitigation: Enhanced / Automatic IBRS592worker2 # [ 0.070688] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.593worker1 # [ 0.051908] mem auto-init: stack:all(zero), heap alloc:on, heap free:off594client # [ 0.072958] rcu: Preemptible hierarchical RCU implementation.595client # [ 0.072959] rcu: RCU event tracing is enabled.596worker2 # [ 0.075438] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16597lb # [ 0.226384] Speculative Return Stack Overflow: Mitigation: Safe RET598worker1 # [ 0.055782] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1599worker1 # [ 0.059510] allocated 3145728 bytes of page_ext600client # [ 0.072960] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.601worker2 # [ 0.075746] rcu: srcu_init: Setting srcu_struct sizes based on contention.602worker1 # [ 0.070930] ftrace: allocating 48731 entries in 192 pages603client # [ 0.072961] Trampoline variant of Tasks RCU enabled.604client # [ 0.072962] Rude variant of Tasks RCU enabled.605worker1 # [ 0.070932] ftrace: allocated 192 pages with 2 groups606worker2 # [ 0.075757] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns607worker1 # [ 0.071906] Dynamic Preempt: lazy608client # [ 0.072962] Tracing variant of Tasks RCU enabled.609worker1 # [ 0.072071] rcu: Preemptible hierarchical RCU implementation.610worker2 # [ 0.075884] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)611client # [ 0.072963] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.612worker1 # [ 0.072071] rcu: RCU event tracing is enabled.613worker2 # [ 0.079646] Console: colour VGA+ 80x25614lb # [ 0.226698] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization615client # [ 0.072964] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1616worker2 # [ 0.079650] printk: legacy console [tty0] enabled617worker1 # [ 0.072072] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.618lb # [ 0.228706] Spectre V2 : Enabling IBPB for BPF619worker2 # [ 0.109245] printk: legacy console [ttyS0] enabled620worker1 # [ 0.072074] Trampoline variant of Tasks RCU enabled.621client # [ 0.073031] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.622worker2 # [ 0.210341] ACPI: Core revision 20250807623worker1 # [ 0.072074] Rude variant of Tasks RCU enabled.624lb # [ 0.229699] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier625worker1 # [ 0.072075] Tracing variant of Tasks RCU enabled.626client # [ 0.073033] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.627lb # [ 0.230698] active return thunk: srso_alias_return_thunk628worker1 # [ 0.072075] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.629worker2 # [ 0.211249] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns630client # [ 0.073034] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.631worker1 # [ 0.072076] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1632lb # [ 0.232364] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'633worker2 # [ 0.212882] APIC: Switch to symmetric I/O mode setup634client # [ 0.078094] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16635worker2 # [ 0.213864] x2apic enabled636worker1 # [ 0.072137] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.637client # [ 0.078408] rcu: srcu_init: Setting srcu_struct sizes based on contention.638lb # [ 0.233598] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'639worker2 # [ 0.214620] APIC: Switched APIC routing to: physical x2apic640lb # [ 0.234449] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'641worker1 # [ 0.072140] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.642client # [ 0.078418] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns643lb # [ 0.235444] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'644worker1 # [ 0.072141] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.645client # [ 0.078541] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)646worker2 # [ 0.216476] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1647client # [ 0.082189] Console: colour VGA+ 80x25648lb # [ 0.236466] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'649worker1 # [ 0.077080] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16650client # [ 0.082193] printk: legacy console [tty0] enabled651worker1 # [ 0.077356] rcu: srcu_init: Setting srcu_struct sizes based on contention.652lb # [ 0.237443] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'653client # [ 0.111796] printk: legacy console [ttyS0] enabled654worker2 # [ 0.217447] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns655client # [ 0.213839] ACPI: Core revision 20250807656worker1 # [ 0.077365] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns657lb # [ 0.238480] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'658worker2 # [ 0.219095] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)659lb # [ 0.239698] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256660worker1 # [ 0.077488] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)661client # [ 0.214790] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns662worker1 # [ 0.081066] Console: colour VGA+ 80x25663worker2 # [ 0.220184] x86/cpu: User Mode Instruction Prevention (UMIP) activated664lb # [ 0.240698] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64665worker1 # [ 0.081070] printk: legacy console [tty0] enabled666client # [ 0.216349] APIC: Switch to symmetric I/O mode setup667worker1 # [ 0.110651] printk: legacy console [ttyS0] enabled668worker2 # [ 0.221229] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127669lb # [ 0.241698] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512670client # [ 0.217343] x2apic enabled671worker1 # [ 0.211930] ACPI: Core revision 20250807672lb # [ 0.242698] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024673worker2 # [ 0.222809] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0674client # [ 0.218088] APIC: Switched APIC routing to: physical x2apic675lb # [ 0.243698] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8676worker1 # [ 0.212859] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns677worker2 # [ 0.223891] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto678client # [ 0.219944] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1679worker1 # [ 0.214455] APIC: Switch to symmetric I/O mode setup680lb # [ 0.244653] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.681worker1 # [ 0.215424] x2apic enabled682worker2 # [ 0.225092] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl683client # [ 0.220928] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns684worker1 # [ 0.216233] APIC: Switched APIC routing to: physical x2apic685worker2 # [ 0.226092] Transient Scheduler Attacks: Vulnerable: No microcode686worker2 # [ 0.227091] Spectre V2 : Mitigation: Enhanced / Automatic IBRS687client # [ 0.222644] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)688worker1 # [ 0.218164] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1689worker2 # [ 0.228092] Speculative Return Stack Overflow: Mitigation: Safe RET690client # [ 0.223732] x86/cpu: User Mode Instruction Prevention (UMIP) activated691client # [ 0.225575] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127692worker1 # [ 0.219222] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns693client # [ 0.226355] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0694worker1 # [ 0.220956] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)695worker2 # [ 0.229090] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization696client # [ 0.227439] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto697worker1 # [ 0.222978] x86/cpu: User Mode Instruction Prevention (UMIP) activated698worker2 # [ 0.230101] Spectre V2 : Enabling IBPB for BPF699worker1 # [ 0.224095] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127700client # [ 0.228641] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl701worker2 # [ 0.230851] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier702client # [ 0.230641] Transient Scheduler Attacks: Vulnerable: No microcode703worker1 # [ 0.224953] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0704worker2 # [ 0.232093] active return thunk: srso_alias_return_thunk705client # [ 0.231640] Spectre V2 : Mitigation: Enhanced / Automatic IBRS706worker1 # [ 0.225957] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto707client # [ 0.232640] Speculative Return Stack Overflow: Mitigation: Safe RET708worker2 # [ 0.233105] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'709worker2 # [ 0.234092] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'710worker1 # [ 0.226953] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl711worker2 # [ 0.235091] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'712worker1 # [ 0.227953] Transient Scheduler Attacks: Vulnerable: No microcode713worker2 # [ 0.236091] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'714worker1 # [ 0.228953] Spectre V2 : Mitigation: Enhanced / Automatic IBRS715client # [ 0.233640] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization716worker2 # [ 0.237091] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'717worker1 # [ 0.229953] Speculative Return Stack Overflow: Mitigation: Safe RET718client # [ 0.235650] Spectre V2 : Enabling IBPB for BPF719worker2 # [ 0.238091] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'720client # [ 0.236391] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier721worker2 # [ 0.239928] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'722client # [ 0.237641] active return thunk: srso_alias_return_thunk723worker2 # [ 0.241092] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256724client # [ 0.238663] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'725worker1 # [ 0.230952] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization726worker2 # [ 0.242091] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64727worker1 # [ 0.232961] Spectre V2 : Enabling IBPB for BPF728client # [ 0.239640] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'729worker2 # [ 0.243092] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512730client # [ 0.240640] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'731worker2 # [ 0.244091] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024732worker1 # [ 0.234527] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier733client # [ 0.241640] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'734worker1 # [ 0.234953] active return thunk: srso_alias_return_thunk735worker2 # [ 0.245092] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8736client # [ 0.242640] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'737worker1 # [ 0.235974] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'738worker2 # [ 0.246094] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.739client # [ 0.243640] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'740worker1 # [ 0.236952] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'741client # [ 0.245485] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'742worker1 # [ 0.237952] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'743client # [ 0.246641] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256744worker1 # [ 0.238952] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'745client # [ 0.247640] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64746worker1 # [ 0.239952] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'747client # [ 0.248640] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512748worker1 # [ 0.240952] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'749client # [ 0.249641] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024750worker1 # [ 0.241952] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'751client # [ 0.250640] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8752worker1 # [ 0.243953] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256753client # [ 0.251640] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.754worker1 # [ 0.244953] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64755worker1 # [ 0.245953] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512756lb # [ 0.281208] Freeing SMP alternatives memory: 44K757worker1 # [ 0.246952] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024758lb # [ 0.281702] pid_max: default: 32768 minimum: 301759worker1 # [ 0.247952] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8760lb # [ 0.282842] LSM: initializing lsm=capability,landlock,yama,bpf,ima761worker1 # [ 0.248952] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.762lb # [ 0.283816] landlock: Up and running.763lb # [ 0.285156] Yama: becoming mindful.764lb # [ 0.285930] LSM support for eBPF active765lb # [ 0.286814] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)766lb # [ 0.287744] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)767lb # [ 0.290658] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)768lb # [ 0.291320] Performance Events: Fam17h+ core perfctr, AMD PMU driver.769lb # [ 0.291703] ... version: 2770lb # [ 0.292410] ... bit width: 48771lb # [ 0.292701] ... generic counters: 6772lb # [ 0.293424] ... generic bitmap: 000000000000003f773lb # [ 0.293711] ... fixed-purpose counters: 0774lb # [ 0.294412] ... fixed-purpose bitmap: 0000000000000000775lb # [ 0.294700] ... value mask: 0000ffffffffffff776lb # [ 0.295599] ... max period: 00007fffffffffff777lb # [ 0.296375] ... global_ctrl mask: 000000000000003f778lb # [ 0.296826] signal: max sigframe size: 3376779lb # [ 0.297625] rcu: Hierarchical SRCU implementation.780lb # [ 0.298290] rcu: Max phase no-delay instances is 400.781lb # [ 0.303481] smp: Bringing up secondary CPUs ...782worker2 # [ 0.283866] Freeing SMP alternatives memory: 44K783lb # [ 0.303716] smp: Brought up 1 node, 1 CPU784worker2 # [ 0.284698] pid_max: default: 32768 minimum: 301785lb # [ 0.304401] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)786worker2 # [ 0.285216] LSM: initializing lsm=capability,landlock,yama,bpf,ima787worker2 # [ 0.286201] landlock: Up and running.788worker2 # [ 0.287092] Yama: becoming mindful.789lb # [ 0.304931] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)790worker2 # [ 0.288317] LSM support for eBPF active791lb # [ 0.305967] devtmpfs: initialized792worker2 # [ 0.289123] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)793lb # [ 0.306833] x86/mm: Memory block size: 128MB794worker2 # [ 0.290132] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)795client # [ 0.290059] Freeing SMP alternatives memory: 44K796lb # [ 0.308709] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)797client # [ 0.290646] pid_max: default: 32768 minimum: 301798lb # [ 0.309729] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).799worker2 # [ 0.292813] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)800client # [ 0.291753] LSM: initializing lsm=capability,landlock,yama,bpf,ima801lb # [ 0.310790] pinctrl core: initialized pinctrl subsystem802client # [ 0.292771] landlock: Up and running.803worker2 # [ 0.293663] Performance Events: Fam17h+ core perfctr, AMD PMU driver.804client # [ 0.293641] Yama: becoming mindful.805lb # [ 0.311968] PM: RTC time: 08:03:03, date: 2026-09-20806worker2 # [ 0.294097] ... version: 2807worker1 # [ 0.286704] Freeing SMP alternatives memory: 44K808client # [ 0.294500] LSM support for eBPF active809worker2 # [ 0.294821] ... bit width: 48810worker1 # [ 0.286957] pid_max: default: 32768 minimum: 301811worker2 # [ 0.295094] ... generic counters: 6812client # [ 0.295237] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)813worker1 # [ 0.288065] LSM: initializing lsm=capability,landlock,yama,bpf,ima814worker2 # [ 0.295827] ... generic bitmap: 000000000000003f815worker1 # [ 0.289080] landlock: Up and running.816client # [ 0.296680] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)817worker1 # [ 0.289711] Yama: becoming mindful.818worker2 # [ 0.296143] ... fixed-purpose counters: 0819lb # [ 0.315689] NET: Registered PF_NETLINK/PF_ROUTE protocol family820worker2 # [ 0.296885] ... fixed-purpose bitmap: 0000000000000000821worker1 # [ 0.289951] LSM support for eBPF active822worker2 # [ 0.297094] ... value mask: 0000ffffffffffff823lb # [ 0.317066] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations824worker1 # [ 0.290078] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)825worker2 # [ 0.298048] ... max period: 00007fffffffffff826client # [ 0.298849] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)827worker2 # [ 0.298776] ... global_ctrl mask: 000000000000003f828lb # [ 0.317723] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations829worker1 # [ 0.292003] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)830worker2 # [ 0.299230] signal: max sigframe size: 3376831client # [ 0.300252] Performance Events: Fam17h+ core perfctr, AMD PMU driver.832lb # [ 0.319000] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations833client # [ 0.300651] ... version: 2834worker2 # [ 0.300079] rcu: Hierarchical SRCU implementation.835client # [ 0.301372] ... bit width: 48836lb # [ 0.319712] audit: initializing netlink subsys (disabled)837worker2 # [ 0.300704] rcu: Max phase no-delay instances is 400.838worker1 # [ 0.294403] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)839client # [ 0.301643] ... generic counters: 6840lb # [ 0.320892] thermal_sys: Registered thermal governor 'fair_share'841client # [ 0.302383] ... generic bitmap: 000000000000003f842worker1 # [ 0.295562] Performance Events: Fam17h+ core perfctr, AMD PMU driver.843client # [ 0.302643] ... fixed-purpose counters: 0844lb # [ 0.320894] thermal_sys: Registered thermal governor 'bang_bang'845worker1 # [ 0.295958] ... version: 2846client # [ 0.303354] ... fixed-purpose bitmap: 0000000000000000847worker1 # [ 0.296671] ... bit width: 48848lb # [ 0.321702] thermal_sys: Registered thermal governor 'step_wise'849worker1 # [ 0.296955] ... generic counters: 6850client # [ 0.303642] ... value mask: 0000ffffffffffff851lb # [ 0.322672] thermal_sys: Registered thermal governor 'user_space'852worker1 # [ 0.297676] ... generic bitmap: 000000000000003f853client # [ 0.304557] ... max period: 00007fffffffffff854worker1 # [ 0.297962] ... fixed-purpose counters: 0855lb # [ 0.323442] audit: type=2000 audit(1789891383.706:1): state=initialized audit_enabled=0 res=1856worker2 # [ 0.305905] smp: Bringing up secondary CPUs ...857client # [ 0.305340] ... global_ctrl mask: 000000000000003f858worker2 # [ 0.306657] smp: Brought up 1 node, 1 CPU859worker1 # [ 0.298669] ... fixed-purpose bitmap: 0000000000000000860client # [ 0.305752] signal: max sigframe size: 3376861lb # [ 0.324703] thermal_sys: Registered thermal governor 'power_allocator'862worker1 # [ 0.298955] ... value mask: 0000ffffffffffff863lb # [ 0.324729] cpuidle: using governor menu864worker2 # [ 0.307107] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)865client # [ 0.306575] rcu: Hierarchical SRCU implementation.866worker1 # [ 0.299816] ... max period: 00007fffffffffff867client # [ 0.307231] rcu: Max phase no-delay instances is 400.868lb # [ 0.326943] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5869worker1 # [ 0.300592] ... global_ctrl mask: 000000000000003f870worker2 # [ 0.308248] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)871worker1 # [ 0.301061] signal: max sigframe size: 3376872lb # [ 0.327937] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]873worker1 # [ 0.301851] rcu: Hierarchical SRCU implementation.874worker2 # [ 0.309449] devtmpfs: initialized875worker1 # [ 0.302550] rcu: Max phase no-delay instances is 400.876lb # [ 0.328704] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry877worker2 # [ 0.310299] x86/mm: Memory block size: 128MB878lb # [ 0.329713] PCI: Using configuration type 1 for base access879worker2 # [ 0.312156] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)880client # [ 0.312454] smp: Bringing up secondary CPUs ...881lb # [ 0.330820] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.882client # [ 0.313231] smp: Brought up 1 node, 1 CPU883worker2 # [ 0.313124] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).884client # [ 0.313644] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)885worker2 # [ 0.314178] pinctrl core: initialized pinctrl subsystem886worker1 # [ 0.307819] smp: Bringing up secondary CPUs ...887worker2 # [ 0.315338] PM: RTC time: 08:03:03, date: 2026-09-20888worker1 # [ 0.308500] smp: Brought up 1 node, 1 CPU889client # [ 0.314802] Memory: 1454548K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)890worker1 # [ 0.308955] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)891client # [ 0.316046] devtmpfs: initialized892client # [ 0.316784] x86/mm: Memory block size: 128MB893worker1 # [ 0.310115] Memory: 1454572K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)894lb # [ 0.337954] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages895worker2 # [ 0.319132] NET: Registered PF_NETLINK/PF_ROUTE protocol family896worker1 # [ 0.311329] devtmpfs: initialized897client # [ 0.318618] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)898lb # [ 0.338702] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page899worker1 # [ 0.312138] x86/mm: Memory block size: 128MB900worker2 # [ 0.320630] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations901client # [ 0.319582] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).902worker2 # [ 0.321134] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations903client # [ 0.320743] pinctrl core: initialized pinctrl subsystem904worker1 # [ 0.314015] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)905client # [ 0.321922] PM: RTC time: 08:03:03, date: 2026-09-20906worker2 # [ 0.322393] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations907worker1 # [ 0.314981] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).908worker2 # [ 0.323109] audit: initializing netlink subsys (disabled)909lb # [ 0.343703] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages910worker1 # [ 0.316062] pinctrl core: initialized pinctrl subsystem911worker2 # [ 0.324370] thermal_sys: Registered thermal governor 'fair_share'912lb # [ 0.344702] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page913worker1 # [ 0.317279] PM: RTC time: 08:03:03, date: 2026-09-20914worker2 # [ 0.324372] thermal_sys: Registered thermal governor 'bang_bang'915client # [ 0.325681] NET: Registered PF_NETLINK/PF_ROUTE protocol family916worker2 # [ 0.325099] audit: type=2000 audit(1789891383.729:1): state=initialized audit_enabled=0 res=1917client # [ 0.327215] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations918worker2 # [ 0.327096] thermal_sys: Registered thermal governor 'step_wise'919worker1 # [ 0.320987] NET: Registered PF_NETLINK/PF_ROUTE protocol family920worker2 # [ 0.327097] thermal_sys: Registered thermal governor 'user_space'921client # [ 0.327669] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations922worker2 # [ 0.328094] thermal_sys: Registered thermal governor 'power_allocator'923worker1 # [ 0.322485] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations924client # [ 0.328960] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations925worker2 # [ 0.329097] cpuidle: using governor menu926client # [ 0.329661] audit: initializing netlink subsys (disabled)927worker1 # [ 0.322983] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations928worker2 # [ 0.331352] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5929client # [ 0.330907] thermal_sys: Registered thermal governor 'fair_share'930lb # [ 0.353687] ACPI: Added _OSI(Module Device)931worker1 # [ 0.324260] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations932client # [ 0.330909] thermal_sys: Registered thermal governor 'bang_bang'933worker2 # [ 0.332349] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]934lb # [ 0.354208] ACPI: Added _OSI(Processor Device)935worker1 # [ 0.324971] audit: initializing netlink subsys (disabled)936client # [ 0.331645] thermal_sys: Registered thermal governor 'step_wise'937lb # [ 0.354701] ACPI: Added _OSI(Processor Aggregator Device)938worker2 # [ 0.333098] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry939worker1 # [ 0.326133] thermal_sys: Registered thermal governor 'fair_share'940client # [ 0.332591] thermal_sys: Registered thermal governor 'user_space'941worker2 # [ 0.334109] PCI: Using configuration type 1 for base access942worker1 # [ 0.326136] thermal_sys: Registered thermal governor 'bang_bang'943client # [ 0.333401] audit: type=2000 audit(1789891383.739:1): state=initialized audit_enabled=0 res=1944worker1 # [ 0.326956] thermal_sys: Registered thermal governor 'step_wise'945worker2 # [ 0.335232] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.946client # [ 0.334646] thermal_sys: Registered thermal governor 'power_allocator'947worker1 # [ 0.327898] thermal_sys: Registered thermal governor 'user_space'948client # [ 0.334665] cpuidle: using governor menu949worker1 # [ 0.328691] audit: type=2000 audit(1789891383.741:1): state=initialized audit_enabled=0 res=1950client # [ 0.336918] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5951worker1 # [ 0.329957] thermal_sys: Registered thermal governor 'power_allocator'952worker1 # [ 0.329976] cpuidle: using governor menu953client # [ 0.337895] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]954worker1 # [ 0.332195] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5955worker2 # [ 0.340411] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages956client # [ 0.338647] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry957worker2 # [ 0.341096] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page958client # [ 0.339659] PCI: Using configuration type 1 for base access959lb # [ 0.364220] ACPI: 1 ACPI AML tables successfully acquired and loaded960worker1 # [ 0.333231] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]961worker2 # [ 0.342097] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages962worker1 # [ 0.333959] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry963client # [ 0.340807] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.964worker1 # [ 0.334971] PCI: Using configuration type 1 for base access965worker1 # [ 0.336076] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.966lb # [ 0.368133] ACPI: Interpreter enabled967lb # [ 0.368721] ACPI: PM: (supports S0 S3 S4 S5)968lb # [ 0.369471] ACPI: Using IOAPIC for interrupt routing969client # [ 0.345887] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages970worker2 # [ 0.349098] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page971client # [ 0.346647] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page972lb # [ 0.372784] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug973lb # [ 0.373703] PCI: Using E820 reservations for host bridge windows974worker1 # [ 0.343206] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages975worker1 # [ 0.343958] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page976client # [ 0.351646] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages977lb # [ 0.376850] ACPI: Enabled 2 GPEs in block 00 to 3F978client # [ 0.352643] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page979worker2 # [ 0.357493] ACPI: Added _OSI(Module Device)980worker2 # [ 0.358096] ACPI: Added _OSI(Processor Device)981worker1 # [ 0.348956] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages982worker2 # [ 0.358864] ACPI: Added _OSI(Processor Aggregator Device)983worker1 # [ 0.349957] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page984lb # [ 0.384951] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])985lb # [ 0.385710] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]986client # [ 0.362916] ACPI: Added _OSI(Module Device)987lb # [ 0.386782] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]988client # [ 0.363634] ACPI: Added _OSI(Processor Device)989client # [ 0.364212] ACPI: Added _OSI(Processor Aggregator Device)990lb # [ 0.387827] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]991lb # [ 0.389063] PCI host bridge to bus 0000:00992worker2 # [ 0.367936] ACPI: 1 ACPI AML tables successfully acquired and loaded993lb # [ 0.389706] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]994worker1 # [ 0.360457] ACPI: Added _OSI(Module Device)995worker1 # [ 0.360957] ACPI: Added _OSI(Processor Device)996lb # [ 0.390701] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]997worker1 # [ 0.361681] ACPI: Added _OSI(Processor Aggregator Device)998lb # [ 0.391701] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]999worker2 # [ 0.371893] ACPI: Interpreter enabled1000lb # [ 0.392701] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1001worker2 # [ 0.372112] ACPI: PM: (supports S0 S3 S4 S5)1002worker2 # [ 0.372860] ACPI: Using IOAPIC for interrupt routing1003lb # [ 0.393700] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1004lb # [ 0.394700] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1005worker2 # [ 0.373157] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1006lb # [ 0.395707] pci_bus 0000:00: root bus resource [bus 00-ff]1007client # [ 0.373532] ACPI: 1 ACPI AML tables successfully acquired and loaded1008lb # [ 0.396686] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1009lb # [ 0.398218] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1010worker2 # [ 0.378094] PCI: Using E820 reservations for host bridge windows1011client # [ 0.378103] ACPI: Interpreter enabled1012worker2 # [ 0.379254] ACPI: Enabled 2 GPEs in block 00 to 3F1013worker1 # [ 0.371526] ACPI: 1 ACPI AML tables successfully acquired and loaded1014client # [ 0.378660] ACPI: PM: (supports S0 S3 S4 S5)1015client # [ 0.379403] ACPI: Using IOAPIC for interrupt routing1016worker1 # [ 0.373009] ACPI: Interpreter enabled1017worker1 # [ 0.373688] ACPI: PM: (supports S0 S3 S4 S5)1018client # [ 0.379713] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1019worker1 # [ 0.373956] ACPI: Using IOAPIC for interrupt routing1020client # [ 0.380644] PCI: Using E820 reservations for host bridge windows1021worker1 # [ 0.374850] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1022lb # [ 0.400780] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1023client # [ 0.383765] ACPI: Enabled 2 GPEs in block 00 to 3F1024lb # [ 0.401714] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1025lb # [ 0.402711] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1026worker2 # [ 0.387601] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1027worker2 # [ 0.388104] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1028lb # [ 0.403924] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1029worker1 # [ 0.379955] PCI: Using E820 reservations for host bridge windows1030worker1 # [ 0.381054] ACPI: Enabled 2 GPEs in block 00 to 3F1031worker2 # [ 0.389172] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1032lb # [ 0.405486] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1033worker2 # [ 0.390220] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1034worker2 # [ 0.391466] PCI host bridge to bus 0000:001035worker2 # [ 0.392099] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1036lb # [ 0.407710] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1037worker2 # [ 0.393094] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1038client # [ 0.392589] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1039lb # [ 0.408569] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1040worker2 # [ 0.394094] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1041lb # [ 0.409461] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1042client # [ 0.393400] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1043lb # [ 0.410536] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1044worker2 # [ 0.395094] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1045worker1 # [ 0.389297] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1046worker2 # [ 0.396094] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1047lb # [ 0.412044] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1048client # [ 0.396172] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1049worker2 # [ 0.397094] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1050worker1 # [ 0.389965] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1051client # [ 0.396769] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1052worker2 # [ 0.398095] pci_bus 0000:00: root bus resource [bus 00-ff]1053worker1 # [ 0.391036] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1054client # [ 0.398010] PCI host bridge to bus 0000:001055lb # [ 0.413711] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1056worker2 # [ 0.399083] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1057worker1 # [ 0.392079] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1058client # [ 0.398648] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1059lb # [ 0.414566] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1060worker1 # [ 0.393380] PCI host bridge to bus 0000:001061client # [ 0.399643] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1062lb # [ 0.415428] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1063worker2 # [ 0.400538] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1064worker1 # [ 0.393961] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1065client # [ 0.400643] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1066lb # [ 0.416288] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1067worker1 # [ 0.394958] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1068client # [ 0.401643] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1069worker1 # [ 0.395956] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1070client # [ 0.402650] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1071worker1 # [ 0.396955] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1072client # [ 0.403675] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1073worker1 # [ 0.397955] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1074lb # [ 0.418844] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1075client # [ 0.404644] pci_bus 0000:00: root bus resource [bus 00-ff]1076lb # [ 0.419711] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1077worker1 # [ 0.398955] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1078client # [ 0.405679] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1079worker1 # [ 0.399964] pci_bus 0000:00: root bus resource [bus 00-ff]1080lb # [ 0.420673] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1081client # [ 0.407108] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1082worker1 # [ 0.400932] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1083lb # [ 0.422161] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1084worker2 # [ 0.403168] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1085worker1 # [ 0.402491] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1086worker2 # [ 0.404118] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1087lb # [ 0.423721] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1088worker2 # [ 0.405116] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1089lb # [ 0.424591] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1090lb # [ 0.425427] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1091worker2 # [ 0.406539] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1092lb # [ 0.426298] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1093worker2 # [ 0.407922] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1094lb # [ 0.428711] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1095lb # [ 0.429557] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1096worker2 # [ 0.411115] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1097client # [ 0.409737] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1098lb # [ 0.430423] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1099worker2 # [ 0.411965] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1100client # [ 0.410656] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1101client # [ 0.411635] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1102worker2 # [ 0.412836] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1103lb # [ 0.431280] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1104worker1 # [ 0.405151] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1105worker2 # [ 0.413101] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1106worker1 # [ 0.405969] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1107client # [ 0.412868] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1108worker1 # [ 0.406927] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1109worker2 # [ 0.414674] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1110worker1 # [ 0.407931] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1111client # [ 0.414487] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1112lb # [ 0.433721] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1113lb # [ 0.434715] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1114worker2 # [ 0.416104] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1115lb # [ 0.435673] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1116worker1 # [ 0.409804] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1117worker2 # [ 0.416973] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1118client # [ 0.416674] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1119lb # [ 0.437119] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1120worker2 # [ 0.417861] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1121client # [ 0.417557] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1122worker1 # [ 0.412979] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1123client # [ 0.418665] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1124lb # [ 0.438709] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1125worker2 # [ 0.419523] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1126worker1 # [ 0.413849] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1127client # [ 0.419650] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1128lb # [ 0.439563] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1129worker1 # [ 0.414977] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1130lb # [ 0.440418] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1131worker1 # [ 0.415961] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1132client # [ 0.421277] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1133lb # [ 0.440707] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1134worker2 # [ 0.421103] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1135worker2 # [ 0.421967] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1136worker1 # [ 0.417533] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1137worker2 # [ 0.422888] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1138lb # [ 0.442209] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1139client # [ 0.422678] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1140client # [ 0.423535] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1141worker1 # [ 0.418981] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1142worker2 # [ 0.424611] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1143lb # [ 0.444645] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1144client # [ 0.424411] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1145worker1 # [ 0.419828] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1146lb # [ 0.445428] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1147worker1 # [ 0.420704] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1148lb # [ 0.447163] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1149client # [ 0.426572] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1150worker1 # [ 0.421525] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1151worker2 # [ 0.427116] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1152lb # [ 0.448721] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1153worker2 # [ 0.428101] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1154client # [ 0.428651] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1155client # [ 0.429497] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1156lb # [ 0.449580] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1157worker2 # [ 0.429065] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1158worker1 # [ 0.422981] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1159client # [ 0.430393] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1160worker1 # [ 0.423825] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1161lb # [ 0.450432] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1162worker2 # [ 0.430527] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1163worker1 # [ 0.424692] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1164client # [ 0.431305] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1165lb # [ 0.451272] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1166worker1 # [ 0.425538] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1167worker2 # [ 0.432103] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1168lb # [ 0.452709] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1169worker2 # [ 0.432989] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1170lb # [ 0.453549] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1171worker2 # [ 0.433879] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1172lb # [ 0.454435] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1173client # [ 0.433883] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1174client # [ 0.434650] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1175worker1 # [ 0.428198] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1176worker2 # [ 0.435598] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1177lb # [ 0.455299] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1178worker1 # [ 0.428962] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1179client # [ 0.435642] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1180worker1 # [ 0.429918] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1181lb # [ 0.456387] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1182client # [ 0.437246] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1183worker2 # [ 0.438105] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1184worker2 # [ 0.438984] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1185worker1 # [ 0.431510] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1186lb # [ 0.456960] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1187worker2 # [ 0.439823] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1188client # [ 0.438674] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1189lb # [ 0.458276] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1190client # [ 0.439528] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1191worker1 # [ 0.432982] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1192worker2 # [ 0.440722] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1193client # [ 0.440377] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1194worker1 # [ 0.433864] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1195worker1 # [ 0.434692] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1196client # [ 0.441419] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1197worker2 # [ 0.443012] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1198worker1 # [ 0.435538] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1199worker2 # [ 0.444102] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1200client # [ 0.443677] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1201worker2 # [ 0.445044] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1202worker1 # [ 0.437992] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1203client # [ 0.444573] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1204worker2 # [ 0.445921] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1205worker1 # [ 0.438868] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1206client # [ 0.445417] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1207worker1 # [ 0.439703] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1208worker2 # [ 0.447413] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1209client # [ 0.447154] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1210worker1 # [ 0.440540] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1211worker2 # [ 0.449107] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1212lb # [ 0.458954] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1213worker2 # [ 0.450053] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1214lb # [ 0.461306] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1215client # [ 0.448674] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1216client # [ 0.449649] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1217worker1 # [ 0.442991] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1218worker2 # [ 0.451446] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1219lb # [ 0.461946] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1220client # [ 0.450608] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1221worker1 # [ 0.443961] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1222client # [ 0.451495] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1223worker1 # [ 0.444918] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1224lb # [ 0.463273] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1225worker2 # [ 0.453102] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1226worker1 # [ 0.445777] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1227worker2 # [ 0.453959] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1228lb # [ 0.463934] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1229client # [ 0.453005] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1230worker2 # [ 0.454823] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1231worker1 # [ 0.447309] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1232lb # [ 0.465011] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1233client # [ 0.454599] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1234worker2 # [ 0.455650] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1235lb # [ 0.465976] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1236client # [ 0.455444] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1237worker1 # [ 0.448899] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1238worker1 # [ 0.449727] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1239lb # [ 0.467574] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1240worker2 # [ 0.457102] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1241client # [ 0.457044] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1242lb # [ 0.468323] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1243worker2 # [ 0.457925] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1244worker1 # [ 0.451485] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1245lb # [ 0.469032] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1246client # [ 0.458688] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1247worker2 # [ 0.458790] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1248client # [ 0.459559] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1249worker1 # [ 0.452973] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1250lb # [ 0.470360] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1251worker2 # [ 0.460477] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1252client # [ 0.460429] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1253worker1 # [ 0.453846] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1254worker1 # [ 0.454707] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1255worker2 # [ 0.461806] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1256client # [ 0.462048] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1257worker2 # [ 0.462307] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1258worker1 # [ 0.455552] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1259lb # [ 0.473715] ACPI: PCI: Interrupt link LNKA configured for IRQ 101260lb # [ 0.474800] ACPI: PCI: Interrupt link LNKB configured for IRQ 101261worker2 # [ 0.463707] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1262client # [ 0.464490] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1263lb # [ 0.475804] ACPI: PCI: Interrupt link LNKC configured for IRQ 111264worker1 # [ 0.456991] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1265lb # [ 0.476802] ACPI: PCI: Interrupt link LNKD configured for IRQ 111266client # [ 0.465362] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1267worker1 # [ 0.457962] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1268lb # [ 0.477800] ACPI: PCI: Interrupt link LNKE configured for IRQ 101269client # [ 0.465665] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1270lb # [ 0.478804] ACPI: PCI: Interrupt link LNKF configured for IRQ 101271worker1 # [ 0.458989] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1272client # [ 0.467278] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1273lb # [ 0.479813] ACPI: PCI: Interrupt link LNKG configured for IRQ 111274lb # [ 0.480811] ACPI: PCI: Interrupt link LNKH configured for IRQ 111275worker1 # [ 0.460722] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1276client # [ 0.468277] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1277lb # [ 0.481741] ACPI: PCI: Interrupt link GSIA configured for IRQ 161278client # [ 0.468869] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1279worker1 # [ 0.462713] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1280lb # [ 0.482716] ACPI: PCI: Interrupt link GSIB configured for IRQ 171281lb # [ 0.483664] ACPI: PCI: Interrupt link GSIC configured for IRQ 181282client # [ 0.470298] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1283worker1 # [ 0.464001] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1284lb # [ 0.484444] ACPI: PCI: Interrupt link GSID configured for IRQ 191285lb # [ 0.484713] ACPI: PCI: Interrupt link GSIE configured for IRQ 201286worker1 # [ 0.465923] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1287lb # [ 0.485692] ACPI: PCI: Interrupt link GSIF configured for IRQ 211288worker2 # [ 0.464287] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1289lb # [ 0.486434] ACPI: PCI: Interrupt link GSIG configured for IRQ 221290lb # [ 0.486713] ACPI: PCI: Interrupt link GSIH configured for IRQ 231291worker2 # [ 0.466934] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1292lb # [ 0.488881] iommu: Default domain type: Translated1293worker2 # [ 0.467969] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1294lb # [ 0.489670] iommu: DMA domain TLB invalidation policy: lazy mode1295worker2 # [ 0.469681] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1296lb # [ 0.490803] ACPI: bus type USB registered1297lb # [ 0.491546] usbcore: registered new interface driver usbfs1298worker2 # [ 0.470395] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1299lb # [ 0.492395] usbcore: registered new interface driver hub1300lb # [ 0.492711] usbcore: registered new device driver usb1301worker2 # [ 0.471385] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1302lb # [ 0.494550] NetLabel: Initializing1303worker2 # [ 0.472369] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1304client # [ 0.470841] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1305lb # [ 0.495140] NetLabel: domain hash size = 1281306lb # [ 0.495701] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1307lb # [ 0.496633] NetLabel: unlabeled traffic allowed by default1308worker2 # [ 0.474123] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1309worker1 # [ 0.466832] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1310lb # [ 0.497379] PCI: Using ACPI for IRQ routing1311worker2 # [ 0.475101] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1312client # [ 0.473705] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1313worker2 # [ 0.476359] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1314client # [ 0.474891] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1315worker2 # [ 0.477773] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1316worker1 # [ 0.469701] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1317client # [ 0.476653] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1318worker1 # [ 0.470380] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1319client # [ 0.477918] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1320client # [ 0.478944] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1321worker1 # [ 0.471968] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1322client # [ 0.479913] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1323worker2 # [ 0.481171] ACPI: PCI: Interrupt link LNKA configured for IRQ 101324worker1 # [ 0.473308] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1325worker2 # [ 0.482259] ACPI: PCI: Interrupt link LNKB configured for IRQ 101326worker1 # [ 0.474259] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1327worker2 # [ 0.483201] ACPI: PCI: Interrupt link LNKC configured for IRQ 111328worker2 # [ 0.484196] ACPI: PCI: Interrupt link LNKD configured for IRQ 111329worker1 # [ 0.475231] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1330worker2 # [ 0.485196] ACPI: PCI: Interrupt link LNKE configured for IRQ 101331client # [ 0.483319] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1332worker2 # [ 0.486193] ACPI: PCI: Interrupt link LNKF configured for IRQ 101333client # [ 0.483651] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1334worker2 # [ 0.487196] ACPI: PCI: Interrupt link LNKG configured for IRQ 111335worker1 # [ 0.477004] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1336worker2 # [ 0.488191] ACPI: PCI: Interrupt link LNKH configured for IRQ 111337client # [ 0.484969] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1338worker1 # [ 0.477906] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1339worker2 # [ 0.489128] ACPI: PCI: Interrupt link GSIA configured for IRQ 161340worker2 # [ 0.490076] ACPI: PCI: Interrupt link GSIB configured for IRQ 171341worker1 # [ 0.479168] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1342client # [ 0.486672] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1343worker2 # [ 0.490822] ACPI: PCI: Interrupt link GSIC configured for IRQ 181344worker2 # [ 0.491107] ACPI: PCI: Interrupt link GSID configured for IRQ 191345worker2 # [ 0.492057] ACPI: PCI: Interrupt link GSIE configured for IRQ 201346worker2 # [ 0.492812] ACPI: PCI: Interrupt link GSIF configured for IRQ 211347client # [ 0.490638] ACPI: PCI: Interrupt link LNKA configured for IRQ 101348worker2 # [ 0.493110] ACPI: PCI: Interrupt link GSIG configured for IRQ 221349worker1 # [ 0.481015] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1350worker2 # [ 0.494040] ACPI: PCI: Interrupt link GSIH configured for IRQ 231351client # [ 0.491761] ACPI: PCI: Interrupt link LNKB configured for IRQ 101352client # [ 0.492747] ACPI: PCI: Interrupt link LNKC configured for IRQ 111353worker2 # [ 0.496117] iommu: Default domain type: Translated1354client # [ 0.493745] ACPI: PCI: Interrupt link LNKD configured for IRQ 111355worker2 # [ 0.496898] iommu: DMA domain TLB invalidation policy: lazy mode1356client # [ 0.494742] ACPI: PCI: Interrupt link LNKE configured for IRQ 101357worker2 # [ 0.498102] ACPI: bus type USB registered1358client # [ 0.495747] ACPI: PCI: Interrupt link LNKF configured for IRQ 101359worker1 # [ 0.485652] ACPI: PCI: Interrupt link LNKA configured for IRQ 101360worker2 # [ 0.498837] usbcore: registered new interface driver usbfs1361client # [ 0.496749] ACPI: PCI: Interrupt link LNKG configured for IRQ 111362worker1 # [ 0.486098] ACPI: PCI: Interrupt link LNKB configured for IRQ 101363worker2 # [ 0.499111] usbcore: registered new interface driver hub1364client # [ 0.497745] ACPI: PCI: Interrupt link LNKH configured for IRQ 111365worker2 # [ 0.500106] usbcore: registered new device driver usb1366worker1 # [ 0.487090] ACPI: PCI: Interrupt link LNKC configured for IRQ 111367client # [ 0.498682] ACPI: PCI: Interrupt link GSIA configured for IRQ 161368worker1 # [ 0.488091] ACPI: PCI: Interrupt link LNKD configured for IRQ 111369client # [ 0.499650] ACPI: PCI: Interrupt link GSIB configured for IRQ 171370worker2 # [ 0.502137] NetLabel: Initializing1371worker2 # [ 0.502758] NetLabel: domain hash size = 1281372client # [ 0.500619] ACPI: PCI: Interrupt link GSIC configured for IRQ 181373worker1 # [ 0.489085] ACPI: PCI: Interrupt link LNKE configured for IRQ 101374worker2 # [ 0.503113] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1375client # [ 0.501539] ACPI: PCI: Interrupt link GSID configured for IRQ 191376worker2 # [ 0.504052] NetLabel: unlabeled traffic allowed by default1377worker1 # [ 0.490094] ACPI: PCI: Interrupt link LNKF configured for IRQ 101378client # [ 0.502406] ACPI: PCI: Interrupt link GSIE configured for IRQ 201379worker2 # [ 0.504833] PCI: Using ACPI for IRQ routing1380client # [ 0.503367] ACPI: PCI: Interrupt link GSIF configured for IRQ 211381worker1 # [ 0.491115] ACPI: PCI: Interrupt link LNKG configured for IRQ 111382client # [ 0.503657] ACPI: PCI: Interrupt link GSIG configured for IRQ 221383worker1 # [ 0.492092] ACPI: PCI: Interrupt link LNKH configured for IRQ 111384client # [ 0.504623] ACPI: PCI: Interrupt link GSIH configured for IRQ 231385worker1 # [ 0.493012] ACPI: PCI: Interrupt link GSIA configured for IRQ 161386worker1 # [ 0.493977] ACPI: PCI: Interrupt link GSIB configured for IRQ 171387client # [ 0.506607] iommu: Default domain type: Translated1388worker1 # [ 0.494976] ACPI: PCI: Interrupt link GSIC configured for IRQ 181389client # [ 0.507259] iommu: DMA domain TLB invalidation policy: lazy mode1390worker1 # [ 0.495978] ACPI: PCI: Interrupt link GSID configured for IRQ 191391client # [ 0.508040] ACPI: bus type USB registered1392worker1 # [ 0.496981] ACPI: PCI: Interrupt link GSIE configured for IRQ 201393client # [ 0.508708] usbcore: registered new interface driver usbfs1394client # [ 0.509599] usbcore: registered new interface driver hub1395worker1 # [ 0.497981] ACPI: PCI: Interrupt link GSIF configured for IRQ 211396client # [ 0.510274] usbcore: registered new device driver usb1397worker1 # [ 0.499000] ACPI: PCI: Interrupt link GSIG configured for IRQ 221398lb # [ 0.542942] pci 0000:00:01.0: vgaarb: setting as boot VGA device1399worker1 # [ 0.499984] ACPI: PCI: Interrupt link GSIH configured for IRQ 231400lb # [ 0.543697] pci 0000:00:01.0: vgaarb: bridge control possible1401client # [ 0.511618] NetLabel: Initializing1402client # [ 0.512117] NetLabel: domain hash size = 1281403lb # [ 0.543697] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1404client # [ 0.512643] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1405lb # [ 0.543706] vgaarb: loaded1406worker1 # [ 0.502506] iommu: Default domain type: Translated1407client # [ 0.513567] NetLabel: unlabeled traffic allowed by default1408lb # [ 0.544451] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01409client # [ 0.514337] PCI: Using ACPI for IRQ routing1410worker1 # [ 0.502977] iommu: DMA domain TLB invalidation policy: lazy mode1411lb # [ 0.544703] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1412worker1 # [ 0.504425] ACPI: bus type USB registered1413worker1 # [ 0.505020] usbcore: registered new interface driver usbfs1414worker1 # [ 0.505916] usbcore: registered new interface driver hub1415worker1 # [ 0.506660] usbcore: registered new device driver usb1416lb # [ 0.547821] clocksource: Switched to clocksource kvm-clock1417worker1 # [ 0.507919] NetLabel: Initializing1418lb # [ 0.549585] VFS: Disk quotas dquot_6.6.01419worker1 # [ 0.508506] NetLabel: domain hash size = 1281420worker1 # [ 0.508955] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1421worker1 # [ 0.509944] NetLabel: unlabeled traffic allowed by default1422worker1 # [ 0.510662] PCI: Using ACPI for IRQ routing1423lb # [ 0.552165] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1424lb # [ 0.553563] pnp: PnP ACPI init1425lb # [ 0.554390] ACPI: IRQ 4 override to edge(!), high(!)1426lb # [ 0.555423] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1427lb # [ 0.556956] pnp: PnP ACPI: found 6 devices1428lb # [ 0.564576] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1429lb # [ 0.566035] clocksource: Switched to clocksource acpi_pm1430lb # [ 0.566994] NET: Registered PF_INET protocol family1431lb # [ 0.568154] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1432worker2 # [ 0.548571] pci 0000:00:01.0: vgaarb: setting as boot VGA device1433worker2 # [ 0.549090] pci 0000:00:01.0: vgaarb: bridge control possible1434worker2 # [ 0.549090] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1435worker2 # [ 0.549100] vgaarb: loaded1436worker2 # [ 0.549873] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01437worker2 # [ 0.550094] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1438worker2 # [ 0.553212] clocksource: Switched to clocksource kvm-clock1439lb # [ 0.585202] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1440worker2 # [ 0.556961] VFS: Disk quotas dquot_6.6.01441lb # [ 0.586791] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1442worker2 # [ 0.557699] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1443worker2 # [ 0.559080] pnp: PnP ACPI init1444client # [ 0.558760] pci 0000:00:01.0: vgaarb: setting as boot VGA device1445lb # [ 0.588158] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1446worker2 # [ 0.560031] ACPI: IRQ 4 override to edge(!), high(!)1447client # [ 0.559639] pci 0000:00:01.0: vgaarb: bridge control possible1448lb # [ 0.589533] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1449worker2 # [ 0.561035] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1450client # [ 0.559639] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1451lb # [ 0.590833] TCP: Hash tables configured (established 16384 bind 16384)1452client # [ 0.559650] vgaarb: loaded1453worker2 # [ 0.562660] pnp: PnP ACPI: found 6 devices1454lb # [ 0.591969] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1455client # [ 0.560416] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01456client # [ 0.561228] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1457lb # [ 0.593306] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1458lb # [ 0.594457] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1459lb # [ 0.595739] NET: Registered PF_UNIX/PF_LOCAL protocol family1460lb # [ 0.596756] NET: Registered PF_XDP protocol family1461client # [ 0.564771] clocksource: Switched to clocksource kvm-clock1462lb # [ 0.597654] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1463lb # [ 0.598711] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1464worker1 # [ 0.556395] pci 0000:00:01.0: vgaarb: setting as boot VGA device1465lb # [ 0.599766] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1466worker1 # [ 0.556951] pci 0000:00:01.0: vgaarb: bridge control possible1467worker2 # [ 0.570533] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1468lb # [ 0.600904] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1469client # [ 0.568711] VFS: Disk quotas dquot_6.6.01470worker1 # [ 0.556951] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1471worker2 # [ 0.572193] clocksource: Switched to clocksource acpi_pm1472worker1 # [ 0.556962] vgaarb: loaded1473lb # [ 0.602065] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1474client # [ 0.569447] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1475worker2 # [ 0.573212] NET: Registered PF_INET protocol family1476lb # [ 0.603195] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1477worker1 # [ 0.557871] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01478client # [ 0.570943] pnp: PnP ACPI init1479worker2 # [ 0.574477] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1480worker1 # [ 0.558620] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1481client # [ 0.571799] ACPI: IRQ 4 override to edge(!), high(!)1482lb # [ 0.605098] ACPI: \_SB_.GSIA: Enabled at IRQ 161483client # [ 0.572884] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1484client # [ 0.574675] pnp: PnP ACPI: found 6 devices1485lb # [ 0.607827] ACPI: \_SB_.GSIB: Enabled at IRQ 171486lb # [ 0.609840] ACPI: \_SB_.GSIC: Enabled at IRQ 181487worker1 # [ 0.565084] clocksource: Switched to clocksource kvm-clock1488lb # [ 0.612513] ACPI: \_SB_.GSID: Enabled at IRQ 191489lb # [ 0.614316] PCI: CLS 0 bytes, default 641490worker1 # [ 0.569066] VFS: Disk quotas dquot_6.6.01491client # [ 0.582505] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1492lb # [ 0.615260] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1493client # [ 0.584041] clocksource: Switched to clocksource acpi_pm1494worker1 # [ 0.570009] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1495lb # [ 0.617072] Trying to unpack rootfs image as initramfs...1496client # [ 0.585105] NET: Registered PF_INET protocol family1497worker1 # [ 0.571675] pnp: PnP ACPI init1498worker1 # [ 0.572616] ACPI: IRQ 4 override to edge(!), high(!)1499client # [ 0.586421] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1500worker1 # [ 0.573825] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1501worker2 # [ 0.591967] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1502worker1 # [ 0.575476] pnp: PnP ACPI: found 6 devices1503worker2 # [ 0.593637] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1504worker2 # [ 0.594994] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1505worker2 # [ 0.596394] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1506worker2 # [ 0.597736] TCP: Hash tables configured (established 16384 bind 16384)1507worker2 # [ 0.599026] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1508worker2 # [ 0.600449] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1509worker1 # [ 0.583351] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1510worker2 # [ 0.601641] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1511worker1 # [ 0.584852] clocksource: Switched to clocksource acpi_pm1512worker2 # [ 0.602911] NET: Registered PF_UNIX/PF_LOCAL protocol family1513worker1 # [ 0.585875] NET: Registered PF_INET protocol family1514worker2 # [ 0.603926] NET: Registered PF_XDP protocol family1515worker1 # [ 0.587126] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1516worker2 # [ 0.604794] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1517worker2 # [ 0.605832] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1518worker2 # [ 0.606855] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1519worker2 # [ 0.607977] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1520client # [ 0.604861] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1521worker2 # [ 0.609124] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1522client # [ 0.606519] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1523worker2 # [ 0.610239] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1524client # [ 0.607874] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1525worker2 # [ 0.612125] ACPI: \_SB_.GSIA: Enabled at IRQ 161526client # [ 0.609267] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1527client # [ 0.610545] TCP: Hash tables configured (established 16384 bind 16384)1528worker2 # [ 0.614506] ACPI: \_SB_.GSIB: Enabled at IRQ 171529client # [ 0.611709] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1530worker2 # [ 0.616732] ACPI: \_SB_.GSIC: Enabled at IRQ 181531client # [ 0.613057] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1532client # [ 0.614174] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1533worker2 # [ 0.618909] ACPI: \_SB_.GSID: Enabled at IRQ 191534client # [ 0.615448] NET: Registered PF_UNIX/PF_LOCAL protocol family1535client # [ 0.616461] NET: Registered PF_XDP protocol family1536worker2 # [ 0.620770] PCI: CLS 0 bytes, default 641537client # [ 0.617363] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1538client # [ 0.618412] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1539worker2 # [ 0.621766] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1540client # [ 0.619454] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1541worker2 # [ 0.623565] Trying to unpack rootfs image as initramfs...1542client # [ 0.620590] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1543client # [ 0.621739] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1544worker1 # [ 0.607904] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1545client # [ 0.622879] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1546worker1 # [ 0.609728] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1547client # [ 0.624712] ACPI: \_SB_.GSIA: Enabled at IRQ 161548worker1 # [ 0.611284] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1549client # [ 0.627051] ACPI: \_SB_.GSIB: Enabled at IRQ 171550worker1 # [ 0.612791] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1551worker1 # [ 0.614176] TCP: Hash tables configured (established 16384 bind 16384)1552client # [ 0.629187] ACPI: \_SB_.GSIC: Enabled at IRQ 181553worker1 # [ 0.615362] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1554worker1 # [ 0.616812] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1555client # [ 0.631307] ACPI: \_SB_.GSID: Enabled at IRQ 191556worker1 # [ 0.617991] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1557client # [ 0.633080] PCI: CLS 0 bytes, default 641558worker1 # [ 0.619316] NET: Registered PF_UNIX/PF_LOCAL protocol family1559worker1 # [ 0.620426] NET: Registered PF_XDP protocol family1560client # [ 0.634055] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1561worker1 # [ 0.621453] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1562client # [ 0.635908] Trying to unpack rootfs image as initramfs...1563worker1 # [ 0.622659] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1564worker1 # [ 0.623784] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1565worker1 # [ 0.624927] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1566lb # [ 0.672296] Initialise system trusted keyrings1567worker1 # [ 0.626046] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1568lb # [ 0.673354] workingset: timestamp_bits=40 max_order=19 bucket_order=01569worker1 # [ 0.627162] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1570worker1 # [ 0.628980] ACPI: \_SB_.GSIA: Enabled at IRQ 161571worker1 # [ 0.631241] ACPI: \_SB_.GSIB: Enabled at IRQ 171572worker1 # [ 0.633282] ACPI: \_SB_.GSIC: Enabled at IRQ 181573worker1 # [ 0.635330] ACPI: \_SB_.GSID: Enabled at IRQ 191574worker1 # [ 0.637100] PCI: CLS 0 bytes, default 641575worker1 # [ 0.638036] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1576worker1 # [ 0.639824] Trying to unpack rootfs image as initramfs...1577lb # [ 0.697778] Key type asymmetric registered1578lb # [ 0.698586] Asymmetric key parser 'x509' registered1579worker2 # [ 0.670827] Initialise system trusted keyrings1580lb # [ 0.700902] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1581worker2 # [ 0.671846] workingset: timestamp_bits=40 max_order=19 bucket_order=01582lb # [ 0.703891] io scheduler mq-deadline registered1583lb # [ 0.704683] io scheduler kyber registered1584lb # [ 0.708854] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1585lb # [ 0.710140] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1586lb # [ 0.715683] Linux agpgart interface v0.1031587lb # [ 0.716493] ACPI: bus type drm_connector registered1588client # [ 0.683973] Initialise system trusted keyrings1589client # [ 0.685003] workingset: timestamp_bits=40 max_order=19 bucket_order=01590lb # [ 0.721370] usbcore: registered new interface driver usbserial_generic1591lb # [ 0.722500] usbserial: USB Serial support registered for generic1592worker2 # [ 0.695724] Key type asymmetric registered1593worker2 # [ 0.696463] Asymmetric key parser 'x509' registered1594lb # [ 0.725835] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1595worker2 # [ 0.697307] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1596lb # [ 0.725835] Please enable it if your BIOS has the CPPC option.1597lb # [ 0.728059] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1598worker2 # [ 0.700493] io scheduler mq-deadline registered1599worker2 # [ 0.701238] io scheduler kyber registered1600lb # [ 0.731975] drop_monitor: Initializing network drop monitor service1601lb # [ 0.733150] NET: Registered PF_INET6 protocol family1602worker1 # [ 0.687390] Initialise system trusted keyrings1603worker2 # [ 0.705391] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1604lb # [ 0.736352] Segment Routing with IPv61605worker2 # [ 0.706652] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1606worker1 # [ 0.690663] workingset: timestamp_bits=40 max_order=19 bucket_order=01607lb # [ 0.738858] In-situ OAM (IOAM) with IPv61608client # [ 0.706414] Key type asymmetric registered1609lb # [ 0.739888] IPI shorthand broadcast: enabled1610client # [ 0.707134] Asymmetric key parser 'x509' registered1611client # [ 0.708020] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1612worker2 # [ 0.712302] Linux agpgart interface v0.1031613worker2 # [ 0.713087] ACPI: bus type drm_connector registered1614worker2 # [ 0.715852] usbcore: registered new interface driver usbserial_generic1615client # [ 0.713423] io scheduler mq-deadline registered1616worker2 # [ 0.716888] usbserial: USB Serial support registered for generic1617client # [ 0.714174] io scheduler kyber registered1618lb # [ 0.748268] sched_clock: Marking stable (611013888, 136800461)->(822246888, -74432539)1619worker2 # [ 0.720369] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1620worker2 # [ 0.720369] Please enable it if your BIOS has the CPPC option.1621client # [ 0.718277] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1622worker2 # [ 0.722474] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1623client # [ 0.719539] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1624lb # [ 0.754033] registered taskstats version 11625lb # [ 0.754983] Loading compiled-in X.509 certificates1626worker2 # [ 0.726538] drop_monitor: Initializing network drop monitor service1627worker2 # [ 0.727685] NET: Registered PF_INET6 protocol family1628client # [ 0.725147] Linux agpgart interface v0.1031629worker1 # [ 0.712024] Key type asymmetric registered1630client # [ 0.725946] ACPI: bus type drm_connector registered1631worker2 # [ 0.730904] Segment Routing with IPv61632client # [ 0.728744] usbcore: registered new interface driver usbserial_generic1633worker1 # [ 0.715631] Asymmetric key parser 'x509' registered1634worker2 # [ 0.733377] In-situ OAM (IOAM) with IPv61635client # [ 0.729813] usbserial: USB Serial support registered for generic1636worker1 # [ 0.716499] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1637worker2 # [ 0.734443] IPI shorthand broadcast: enabled1638worker1 # [ 0.717956] io scheduler mq-deadline registered1639worker1 # [ 0.718729] io scheduler kyber registered1640client # [ 0.732256] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1641client # [ 0.732256] Please enable it if your BIOS has the CPPC option.1642client # [ 0.734389] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1643worker1 # [ 0.722826] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1644worker1 # [ 0.724100] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1645client # [ 0.738442] drop_monitor: Initializing network drop monitor service1646lb # [ 0.771575] Demotion targets for Node 0: null1647client # [ 0.739619] NET: Registered PF_INET6 protocol family1648worker2 # [ 0.742856] sched_clock: Marking stable (603015193, 139334083)->(824465628, -82116352)1649lb # [ 0.773876] Key type .fscrypt registered1650lb # [ 0.774544] Key type fscrypt-provisioning registered1651lb # [ 0.775469] ima: No TPM chip found, activating TPM-bypass!1652worker1 # [ 0.729873] Linux agpgart interface v0.1031653client # [ 0.744398] Segment Routing with IPv61654worker1 # [ 0.730644] ACPI: bus type drm_connector registered1655client # [ 0.745056] In-situ OAM (IOAM) with IPv61656worker2 # [ 0.748601] registered taskstats version 11657worker2 # [ 0.749550] Loading compiled-in X.509 certificates1658lb # [ 0.779841] ima: Allocated hash algorithm: sha11659lb # [ 0.780610] ima: No architecture policies found1660worker1 # [ 0.733974] usbcore: registered new interface driver usbserial_generic1661client # [ 0.748571] IPI shorthand broadcast: enabled1662worker1 # [ 0.735027] usbserial: USB Serial support registered for generic1663lb # [ 0.782832] PM: Magic number: 10:880:681664lb # [ 0.784451] RAS: Correctable Errors collector initialized.1665worker1 # [ 0.737622] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1666worker1 # [ 0.737622] Please enable it if your BIOS has the CPPC option.1667worker1 # [ 0.739794] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1668client # [ 0.755010] sched_clock: Marking stable (614018780, 140222139)->(834873656, -80632737)1669worker1 # [ 0.743854] drop_monitor: Initializing network drop monitor service1670client # [ 0.758476] registered taskstats version 11671worker1 # [ 0.745050] NET: Registered PF_INET6 protocol family1672client # [ 0.759463] Loading compiled-in X.509 certificates1673lb # [ 0.793537] clk: Disabling unused clocks1674worker1 # [ 0.748155] Segment Routing with IPv61675lb # [ 0.796837] PM: genpd: Disabling unused power domains1676worker1 # [ 0.750656] In-situ OAM (IOAM) with IPv61677worker2 # [ 0.768366] Demotion targets for Node 0: null1678worker1 # [ 0.751755] IPI shorthand broadcast: enabled1679worker2 # [ 0.769357] Key type .fscrypt registered1680worker2 # [ 0.770059] Key type fscrypt-provisioning registered1681worker2 # [ 0.771064] ima: No TPM chip found, activating TPM-bypass!1682worker2 # [ 0.776372] ima: Allocated hash algorithm: sha11683worker2 # [ 0.777174] ima: No architecture policies found1684worker1 # [ 0.760128] sched_clock: Marking stable (621014811, 138587382)->(848478818, -88876625)1685worker2 # [ 0.778220] PM: Magic number: 10:880:681686worker2 # [ 0.781974] RAS: Correctable Errors collector initialized.1687client # [ 0.779441] Demotion targets for Node 0: null1688worker1 # [ 0.765870] registered taskstats version 11689client # [ 0.780390] Key type .fscrypt registered1690worker1 # [ 0.766852] Loading compiled-in X.509 certificates1691client # [ 0.781053] Key type fscrypt-provisioning registered1692client # [ 0.784379] ima: No TPM chip found, activating TPM-bypass!1693client # [ 0.785282] ima: Allocated hash algorithm: sha11694client # [ 0.786044] ima: No architecture policies found1695worker2 # [ 0.790779] clk: Disabling unused clocks1696client # [ 0.788463] PM: Magic number: 10:880:681697worker2 # [ 0.793364] PM: genpd: Disabling unused power domains1698client # [ 0.790145] RAS: Correctable Errors collector initialized.1699client # [ 0.798972] clk: Disabling unused clocks1700worker1 # [ 0.785879] Demotion targets for Node 0: null1701worker1 # [ 0.786839] Key type .fscrypt registered1702worker1 # [ 0.787481] Key type fscrypt-provisioning registered1703client # [ 0.802278] PM: genpd: Disabling unused power domains1704worker1 # [ 0.790753] ima: No TPM chip found, activating TPM-bypass!1705worker1 # [ 0.791662] ima: Allocated hash algorithm: sha11706worker1 # [ 0.792431] ima: No architecture policies found1707worker1 # [ 0.794887] PM: Magic number: 10:880:681708worker1 # [ 0.798650] RAS: Correctable Errors collector initialized.1709worker1 # [ 0.807475] clk: Disabling unused clocks1710worker1 # [ 0.808197] PM: genpd: Disabling unused power domains1711lb # [ 0.967271] Freeing initrd memory: 29092K1712lb # [ 0.970576] Freeing unused decrypted memory: 2028K1713lb # [ 0.973168] Freeing unused kernel image (initmem) memory: 3644K1714lb # [ 0.974237] Write protecting the kernel read-only data: 32768k1715lb # [ 0.976104] Freeing unused kernel image (text/rodata gap) memory: 1208K1716lb # [ 0.977608] Freeing unused kernel image (rodata/data gap) memory: 752K1717worker2 # [ 0.977141] Freeing initrd memory: 29092K1718worker2 # [ 0.980511] Freeing unused decrypted memory: 2028K1719worker2 # [ 0.983260] Freeing unused kernel image (initmem) memory: 3644K1720worker2 # [ 0.984358] Write protecting the kernel read-only data: 32768k1721worker2 # [ 0.986258] Freeing unused kernel image (text/rodata gap) memory: 1208K1722worker2 # [ 0.987805] Freeing unused kernel image (rodata/data gap) memory: 752K1723client # [ 0.993413] Freeing initrd memory: 29096K1724client # [ 0.996745] Freeing unused decrypted memory: 2028K1725lb # [ 1.030389] x86/mm: Checked W+X mappings: passed, no W+X pages found.1726lb # [ 1.031492] Run /init as init process1727client # [ 0.999496] Freeing unused kernel image (initmem) memory: 3644K1728client # [ 1.000570] Write protecting the kernel read-only data: 32768k1729client # [ 1.002451] Freeing unused kernel image (text/rodata gap) memory: 1208K1730client # [ 1.003972] Freeing unused kernel image (rodata/data gap) memory: 752K1731lb # [ 1.041625] systemd[1]: Inserted module 'autofs4'1732worker1 # [ 1.000792] Freeing initrd memory: 29092K1733worker1 # [ 1.004110] Freeing unused decrypted memory: 2028K1734worker1 # [ 1.006927] Freeing unused kernel image (initmem) memory: 3644K1735worker1 # [ 1.007996] Write protecting the kernel read-only data: 32768k1736worker1 # [ 1.009898] Freeing unused kernel image (text/rodata gap) memory: 1208K1737lb # [ 1.058335] fuse: init (API version 7.45)1738worker1 # [ 1.011500] Freeing unused kernel image (rodata/data gap) memory: 752K1739lb # [ 1.064507] ACPI: \_SB_.GSIG: Enabled at IRQ 221740lb # [ 1.067186] ACPI: \_SB_.GSIH: Enabled at IRQ 231741worker2 # [ 1.039133] x86/mm: Checked W+X mappings: passed, no W+X pages found.1742worker2 # [ 1.040227] Run /init as init process1743lb # [ 1.070382] ACPI: \_SB_.GSIE: Enabled at IRQ 201744lb # [ 1.072854] ACPI: \_SB_.GSIF: Enabled at IRQ 211745worker2 # [ 1.051137] systemd[1]: Inserted module 'autofs4'1746client # [ 1.055027] x86/mm: Checked W+X mappings: passed, no W+X pages found.1747client # [ 1.056183] Run /init as init process1748worker2 # [ 1.067761] fuse: init (API version 7.45)1749client # [ 1.067378] systemd[1]: Inserted module 'autofs4'1750lb # [ 1.102426] systemd[1]: Successfully made /usr/ read-only.1751worker2 # [ 1.073728] ACPI: \_SB_.GSIG: Enabled at IRQ 221752worker2 # [ 1.076384] ACPI: \_SB_.GSIH: Enabled at IRQ 231753worker2 # [ 1.079506] ACPI: \_SB_.GSIE: Enabled at IRQ 201754worker1 # [ 1.062387] x86/mm: Checked W+X mappings: passed, no W+X pages found.1755worker1 # [ 1.063451] Run /init as init process1756worker2 # [ 1.081826] ACPI: \_SB_.GSIF: Enabled at IRQ 211757client # [ 1.084057] fuse: init (API version 7.45)1758worker1 # [ 1.073232] systemd[1]: Inserted module 'autofs4'1759client # [ 1.090051] ACPI: \_SB_.GSIG: Enabled at IRQ 221760client # [ 1.092530] ACPI: \_SB_.GSIH: Enabled at IRQ 231761client # [ 1.095490] ACPI: \_SB_.GSIE: Enabled at IRQ 201762client # [ 1.097703] ACPI: \_SB_.GSIF: Enabled at IRQ 211763worker1 # [ 1.090061] fuse: init (API version 7.45)1764worker2 # [ 1.109238] systemd[1]: Successfully made /usr/ read-only.1765worker1 # [ 1.096116] ACPI: \_SB_.GSIG: Enabled at IRQ 221766worker1 # [ 1.098547] ACPI: \_SB_.GSIH: Enabled at IRQ 231767worker1 # [ 1.102069] ACPI: \_SB_.GSIE: Enabled at IRQ 201768worker1 # [ 1.104368] ACPI: \_SB_.GSIF: Enabled at IRQ 211769client # [ 1.123139] systemd[1]: Successfully made /usr/ read-only.1770worker1 # [ 1.129529] systemd[1]: Successfully made /usr/ read-only.1771lb # [ 1.438578] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772lb # [ 1.444000] systemd[1]: Detected virtualization kvm.1773lb # [ 1.444974] systemd[1]: Detected architecture x86-64.1774lb # [ 1.445925] systemd[1]: Running in initrd.1775lb # [ 1.447360] systemd[1]: Initializing machine ID from random generator.1776lb # [ 1.448711] systemd[1]: Hostname set to <lb>.1777worker2 # [ 1.444924] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778worker2 # [ 1.450082] systemd[1]: Detected virtualization kvm.1779worker2 # [ 1.450983] systemd[1]: Detected architecture x86-64.1780worker2 # [ 1.451944] systemd[1]: Running in initrd.1781worker2 # [ 1.453156] systemd[1]: Initializing machine ID from random generator.1782worker2 # [ 1.454424] systemd[1]: Hostname set to <worker2>.1783client # [ 1.458617] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1784client # [ 1.463677] systemd[1]: Detected virtualization kvm.1785client # [ 1.464538] systemd[1]: Detected architecture x86-64.1786client # [ 1.465414] systemd[1]: Running in initrd.1787client # [ 1.466599] systemd[1]: Initializing machine ID from random generator.1788client # [ 1.467823] systemd[1]: Hostname set to <client>.1789worker1 # [ 1.465083] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790worker1 # [ 1.469916] systemd[1]: Detected virtualization kvm.1791worker1 # [ 1.470770] systemd[1]: Detected architecture x86-64.1792worker1 # [ 1.471606] systemd[1]: Running in initrd.1793worker1 # [ 1.472757] systemd[1]: Initializing machine ID from random generator.1794worker1 # [ 1.473904] systemd[1]: Hostname set to <worker1>.1795lb # [ 1.668772] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796client # [ 1.662786] systemd[1]: bpf-restrict-fs: LSM BPF program attached1797worker2 # [ 1.671916] systemd[1]: bpf-restrict-fs: LSM BPF program attached1798lb # [ 1.724100] systemd[1]: Queued start job for default target Initrd Default Target.1799lb # [ 1.728315] systemd[1]: Created slice Slice /system/modprobe.1800worker1 # [ 1.680842] systemd[1]: bpf-restrict-fs: LSM BPF program attached1801lb # [ 1.729480] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1802lb # [ 1.730843] systemd[1]: Expecting device /dev/disk/by-label/nixos...1803lb # [ 1.731884] systemd[1]: Reached target Path Units.1804lb # [ 1.732702] systemd[1]: Reached target Slice Units.1805lb # [ 1.733550] systemd[1]: Reached target Swaps.1806lb # [ 1.734319] systemd[1]: Reached target Timer Units.1807lb # [ 1.735323] systemd[1]: Listening on D-Bus System Message Bus Socket.1808lb # [ 1.736537] systemd[1]: Listening on Journal Socket (/dev/log).1809lb # [ 1.737742] systemd[1]: Listening on Journal Sockets.1810lb # [ 1.738708] systemd[1]: Listening on udev Control Socket.1811client # [ 1.705811] systemd[1]: Queued start job for default target Initrd Default Target.1812lb # [ 1.739714] systemd[1]: Listening on udev Kernel Socket.1813lb # [ 1.740708] systemd[1]: Reached target Socket Units.1814client # [ 1.709791] systemd[1]: Created slice Slice /system/modprobe.1815lb # [ 1.743047] systemd[1]: Starting Create List of Static Device Nodes...1816client # [ 1.711158] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1817client # [ 1.712693] systemd[1]: Expecting device /dev/disk/by-label/nixos...1818client # [ 1.713873] systemd[1]: Reached target Path Units.1819client # [ 1.714783] systemd[1]: Reached target Slice Units.1820client # [ 1.715687] systemd[1]: Reached target Swaps.1821lb # [ 1.748935] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1822client # [ 1.716513] systemd[1]: Reached target Timer Units.1823client # [ 1.717499] systemd[1]: Listening on D-Bus System Message Bus Socket.1824client # [ 1.718772] systemd[1]: Listening on Journal Socket (/dev/log).1825client # [ 1.719953] systemd[1]: Listening on Journal Sockets.1826lb # [ 1.753203] systemd[1]: Starting Load Kernel Module configfs...1827client # [ 1.721004] systemd[1]: Listening on udev Control Socket.1828client # [ 1.722150] systemd[1]: Listening on udev Kernel Socket.1829worker2 # [ 1.725307] systemd[1]: Queued start job for default target Initrd Default Target.1830client # [ 1.723146] systemd[1]: Reached target Socket Units.1831client # [ 1.725429] systemd[1]: Starting Create List of Static Device Nodes...1832worker2 # [ 1.729763] systemd[1]: Created slice Slice /system/modprobe.1833worker2 # [ 1.730920] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1834worker2 # [ 1.732271] systemd[1]: Expecting device /dev/disk/by-label/nixos...1835worker2 # [ 1.733451] systemd[1]: Reached target Path Units.1836worker2 # [ 1.734296] systemd[1]: Reached target Slice Units.1837worker2 # [ 1.735157] systemd[1]: Reached target Swaps.1838client # [ 1.731329] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1839worker2 # [ 1.735951] systemd[1]: Reached target Timer Units.1840worker2 # [ 1.736905] systemd[1]: Listening on D-Bus System Message Bus Socket.1841worker2 # [ 1.738070] systemd[1]: Listening on Journal Socket (/dev/log).1842worker2 # [ 1.739197] systemd[1]: Listening on Journal Sockets.1843worker2 # [ 1.740177] systemd[1]: Listening on udev Control Socket.1844worker2 # [ 1.741170] systemd[1]: Listening on udev Kernel Socket.1845worker2 # [ 1.742207] systemd[1]: Reached target Socket Units.1846lb # [ 1.771924] systemd[1]: Starting Journal Service...1847client # [ 1.740368] systemd[1]: Starting Load Kernel Module configfs...1848worker2 # [ 1.744187] systemd[1]: Starting Create List of Static Device Nodes...1849worker1 # [ 1.729172] systemd[1]: Queued start job for default target Initrd Default Target.1850worker2 # [ 1.749442] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1851worker1 # [ 1.733000] systemd[1]: Created slice Slice /system/modprobe.1852worker1 # [ 1.734149] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1853worker1 # [ 1.735481] systemd[1]: Expecting device /dev/disk/by-label/nixos...1854lb # [ 1.783161] systemd[1]: Starting Load Kernel Modules...1855worker1 # [ 1.736510] systemd[1]: Reached target Path Units.1856worker2 # [ 1.754492] systemd[1]: Starting Load Kernel Module configfs...1857worker1 # [ 1.737353] systemd[1]: Reached target Slice Units.1858worker1 # [ 1.738202] systemd[1]: Reached target Swaps.1859worker1 # [ 1.739022] systemd[1]: Reached target Timer Units.1860worker1 # [ 1.739996] systemd[1]: Listening on D-Bus System Message Bus Socket.1861worker1 # [ 1.741158] systemd[1]: Listening on Journal Socket (/dev/log).1862worker1 # [ 1.742274] systemd[1]: Listening on Journal Sockets.1863client # [ 1.756348] systemd[1]: Starting Journal Service...1864worker1 # [ 1.743246] systemd[1]: Listening on udev Control Socket.1865worker1 # [ 1.744226] systemd[1]: Listening on udev Kernel Socket.1866worker1 # [ 1.745144] systemd[1]: Reached target Socket Units.1867worker1 # [ 1.747081] systemd[1]: Starting Create List of Static Device Nodes...1868worker2 # [ 1.769080] systemd[1]: Starting Journal Service...1869worker1 # [ 1.752759] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1870client # [ 1.770347] systemd[1]: Starting Load Kernel Modules...1871lb # [ 1.791967] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1872worker1 # [ 1.759675] systemd[1]: Starting Load Kernel Module configfs...1873lb # [ 1.810492] netfs: FS-Cache loaded1874worker2 # [ 1.782422] systemd[1]: Starting Load Kernel Modules...1875lb # [ 1.816097] 9pnet: Installing 9P2000 support1876client # [ 1.775342] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1877worker1 # [ 1.774221] systemd[1]: Starting Journal Service...1878client # [ 1.792297] netfs: FS-Cache loaded1879lb # [ 1.830126] systemd[1]: Starting Coldplug All udev Devices...1880client # [ 1.798055] 9pnet: Installing 9P2000 support1881worker2 # [ 1.789427] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1882worker1 # [ 1.787519] systemd[1]: Starting Load Kernel Modules...1883worker2 # [ 1.807964] netfs: FS-Cache loaded1884worker2 # [ 1.813019] 9pnet: Installing 9P2000 support1885client # [ 1.812461] systemd[1]: Starting Coldplug All udev Devices...1886lb # [ 1.845998] systemd[1]: Finished Create List of Static Device Nodes.1887worker1 # [ 1.788486] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1888lb # [ 1.853104] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1889worker1 # [ 1.808996] netfs: FS-Cache loaded1890worker2 # [ 1.827799] systemd[1]: Starting Coldplug All udev Devices...1891client # [ 1.827054] systemd-journald[67]: Collecting audit messages is disabled.1892worker1 # [ 1.813994] 9pnet: Installing 9P2000 support1893lb # [ 1.860935] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1894client # [ 1.829362] systemd[1]: Finished Create List of Static Device Nodes.1895lb # [ 1.867549] systemd[1]: modprobe@configfs.service: Deactivated successfully.1896client # [ 1.834964] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1897lb # [ 1.872403] systemd-journald[67]: Collecting audit messages is disabled.1898client # [ 1.843743] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1899lb # [ 1.878470] systemd[1]: Finished Load Kernel Module configfs.1900worker2 # [ 1.850542] systemd[1]: Finished Create List of Static Device Nodes.1901client # [ 1.849695] systemd[1]: modprobe@configfs.service: Deactivated successfully.1902worker1 # [ 1.838046] systemd[1]: Starting Coldplug All udev Devices...1903worker2 # [ 1.857494] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1904lb # [ 1.887576] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1905client # [ 1.856629] systemd[1]: Finished Load Kernel Module configfs.1906lb # [ 1.893206] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1907worker2 # [ 1.866914] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1908client # [ 1.864714] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1909lb # [ 1.901347] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1910client # [ 1.869615] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1911worker2 # [ 1.875503] systemd[1]: modprobe@configfs.service: Deactivated successfully.1912lb # [ 1.905112] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1913worker1 # [ 1.859810] systemd[1]: Finished Create List of Static Device Nodes.1914worker2 # [ 1.877912] systemd-journald[67]: Collecting audit messages is disabled.1915client # [ 1.875334] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1916client # [ 1.878264] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1917worker2 # [ 1.882896] systemd[1]: Finished Load Kernel Module configfs.1918worker1 # [ 1.867413] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1919worker2 # [ 1.892009] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1920worker1 # [ 1.876672] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1921worker1 # [ 1.878130] systemd-journald[67]: Collecting audit messages is disabled.1922worker2 # [ 1.896534] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1923worker1 # [ 1.882642] systemd[1]: modprobe@configfs.service: Deactivated successfully.1924worker2 # [ 1.904696] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1925worker1 # [ 1.890149] systemd[1]: Finished Load Kernel Module configfs.1926worker2 # [ 1.907399] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1927client # [ 1.909904] systemd[1]: Finished Load Kernel Modules.1928worker1 # [ 1.895170] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1929worker1 # [ 1.898347] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1930lb # [ 1.948963] systemd[1]: Finished Load Kernel Modules.1931client # [ 1.917501] systemd[1]: Starting Apply Kernel Variables...1932worker1 # [ 1.907857] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1933worker1 # [ 1.909408] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1934lb # [ 1.960221] systemd[1]: Starting Apply Kernel Variables...1935client # [ 1.931361] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1936worker2 # [ 1.942996] systemd[1]: Finished Load Kernel Modules.1937client # [ 1.942333] systemd[1]: Starting Create Static Device Nodes in /dev...1938lb # [ 1.978994] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1939worker2 # [ 1.952688] systemd[1]: Starting Apply Kernel Variables...1940client # [ 1.813329] systemd-modules-load[68]: Inserted module 'dm_mod'1941client # [ 1.816190] systemd-modules-load[68]: Inserted module 'virtio_balloon'1942worker1 # [ 1.944263] systemd[1]: Finished Load Kernel Modules.1943client # [ 1.958681] systemd[1]: Started Journal Service.1944lb # [ 1.991425] systemd[1]: Starting Create Static Device Nodes in /dev...1945client # [ 1.819419] systemd-modules-load[68]: Inserted module 'virtio_gpu'1946worker2 # [ 1.966482] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1947worker1 # [ 1.953696] systemd[1]: Starting Apply Kernel Variables...1948client # [ 1.828941] systemd[1]: Finished Apply Kernel Variables.1949worker2 # [ 1.978520] systemd[1]: Starting Create Static Device Nodes in /dev...1950lb # [ 2.009929] systemd[1]: Finished Apply Kernel Variables.1951lb # [ 2.017425] systemd[1]: Started Journal Service.1952worker1 # [ 1.971727] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1953client # [ 1.847078] systemd[1]: Finished Create Static Device Nodes in /dev.1954lb # [ 1.881651] systemd-modules-load[68]: Inserted module 'dm_mod'1955client # [ 1.848339] systemd[1]: Reached target Preparation for Local File Systems.1956lb # [ 1.885324] systemd-modules-load[68]: Inserted module 'virtio_balloon'1957client # [ 1.850830] systemd[1]: Reached target Local File Systems.1958lb # [ 1.887311] systemd-modules-load[68]: Inserted module 'virtio_gpu'1959client # [ 1.852337] systemd[1]: Starting Create System Files and Directories...1960worker1 # [ 1.981971] systemd[1]: Starting Create Static Device Nodes in /dev...1961worker2 # [ 2.000696] systemd[1]: Finished Apply Kernel Variables.1962client # [ 1.859143] systemd[1]: Starting Rule-based Manager for Device Events and Files...1963worker2 # [ 1.872634] systemd-modules-load[68]: Inserted module 'dm_mod'[ 2.013086] systemd[1]: Started Journal Service.1964lb # [ 1.907088] systemd[1]: Finished Create Static Device Nodes in /dev.1965worker2 # 1966lb # [ 1.908266] systemd[1]: Reached target Preparation for Local File Systems.1967lb # [ 1.909334] systemd[1]: Reached target Local File Systems.1968worker2 # [ 1.877328] systemd-modules-load[68]: Inserted module 'virtio_balloon'1969worker2 # [ 1.878402] systemd-modules-load[68]: Inserted module 'virtio_gpu'1970worker1 # [ 2.001688] systemd[1]: Finished Apply Kernel Variables.1971lb # [ 1.914103] systemd[1]: Starting Create System Files and Directories...1972lb # [ 1.918635] systemd[1]: Starting Rule-based Manager for Device Events and Files...1973worker1 # [ 2.009718] systemd[1]: Started Journal Service.1974worker2 # [ 1.887926] systemd[1]: Finished Create Static Device Nodes in /dev.1975worker1 # [ 1.872243] systemd-modules-load[68]: Inserted module 'dm_mod'1976client # [ 1.886192] systemd[1]: Finished Create System Files and Directories.1977worker2 # [ 1.890744] systemd[1]: Reached target Preparation for Local File Systems.1978worker1 # [ 1.876344] systemd-modules-load[68]: Inserted module 'virtio_balloon'1979worker2 # [ 1.894087] systemd[1]: Reached target Local File Systems.1980worker1 # [ 1.877485] systemd-modules-load[68]: Inserted module 'virtio_gpu'1981worker2 # [ 1.895159] systemd[1]: Starting Create System Files and Directories...1982worker2 # [ 1.902492] systemd[1]: Starting Rule-based Manager for Device Events and Files...1983worker1 # [ 1.889178] systemd[1]: Finished Create Static Device Nodes in /dev.1984worker1 # [ 1.890158] systemd[1]: Reached target Preparation for Local File Systems.1985worker1 # [ 1.891138] systemd[1]: Reached target Local File Systems.1986worker1 # [ 1.896086] systemd[1]: Starting Create System Files and Directories...1987client # [ 1.913277] systemd-udevd[83]: Using default interface naming scheme 'v261'.1988worker1 # [ 1.901372] systemd[1]: Starting Rule-based Manager for Device Events and Files...1989lb # [ 1.955806] systemd[1]: Finished Create System Files and Directories.1990worker2 # [ 1.933208] systemd[1]: Finished Create System Files and Directories.1991client # [ 1.936829] systemd[1]: Started Rule-based Manager for Device Events and Files.1992worker1 # [ 1.930224] systemd[1]: Finished Create System Files and Directories.1993lb # [ 1.979432] systemd-udevd[83]: Using default interface naming scheme 'v261'.1994worker2 # [ 1.955702] systemd-udevd[83]: Using default interface naming scheme 'v261'.1995worker1 # [ 1.953296] systemd-udevd[83]: Using default interface naming scheme 'v261'.1996lb # [ 2.005227] systemd[1]: Started Rule-based Manager for Device Events and Files.1997client # [ 1.977074] systemd[1]: Finished Coldplug All udev Devices.1998client # [ 1.977913] systemd[1]: Reached target System Initialization.1999worker2 # [ 1.982083] systemd[1]: Started Rule-based Manager for Device Events and Files.2000client # [ 1.978810] systemd[1]: Reached target Basic System.
loading 1,921 hidden lines…
3922lb # [ 12.348515] postgresql-pre-start[729]: running bootstrap script ... ok3923client # [ 12.341482] dhcpcd[567]: eth0: soliciting a DHCP lease3924client # [ 12.511529] NET: Registered PF_PACKET protocol family3925client # [ 12.377835] dhcpcd[567]: eth0: offered 10.0.2.15 from 10.0.2.23926client # [ 12.383374] dhcpcd[567]: eth0: probing address 10.0.2.15/243927client # [ 12.754265] dhcpcd[567]: eth0: soliciting an IPv6 router3928client # [ 12.757644] dhcpcd[567]: eth0: Router Advertisement from fe80::23929client # [ 12.759693] dhcpcd[567]: eth0: adding address fec0::5054:ff:fe12:3456/643930client # [ 12.761858] dhcpcd[567]: eth0: adding route to fec0::/643931client # [ 12.763816] dhcpcd[567]: eth0: adding default route via fe80::23932lb # [ 12.983586] postgresql-pre-start[729]: performing post-bootstrap initialization ... ok3933lb # [ 13.124323] postgresql-pre-start[729]: syncing data to disk ... ok3934lb # [ 13.125208] postgresql-pre-start[729]: initdb: warning: enabling "trust" authentication for local connections3935lb # [ 13.126403] postgresql-pre-start[729]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3936lb # [ 13.128267] postgresql-pre-start[729]: Success. You can now start the database server using:3937lb # [ 13.129321] postgresql-pre-start[729]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3938lb # [ 13.240161] postgres[791]: [791] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3939lb # [ 13.243957] postgres[791]: [791] LOG: listening on IPv6 address "::1", port 54323940lb # [ 13.245146] postgres[791]: [791] LOG: listening on IPv4 address "127.0.0.1", port 54323941lb # [ 13.248158] postgres[791]: [791] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3942lb # [ 13.260322] postgres[800]: [800] LOG: database system was shut down at 2026-09-20 08:03:17 GMT3943lb # [ 13.266193] postgres[791]: [791] LOG: database system is ready to accept connections3944lb # [ 13.271763] systemd[1]: Started PostgreSQL Server.3945lb # [ 13.278765] systemd[1]: Starting PostgreSQL Setup Scripts...3946lb # [ 13.466156] postgresql-setup-start[811]: CREATE DATABASE3947lb # [ 13.510929] postgresql-setup-start[816]: CREATE ROLE3948lb # [ 13.530135] postgresql-setup-start[818]: ALTER DATABASE3949lb # [ 13.535872] systemd[1]: Finished PostgreSQL Setup Scripts.3950lb # [ 13.537695] systemd[1]: Reached target PostgreSQL.3951lb # [ 14.911794] dhcpcd[708]: eth0: leased 10.0.2.15 for 86400 seconds3952lb # [ 14.913199] dhcpcd[708]: eth0: adding route to 10.0.2.0/243953lb # [ 14.914161] dhcpcd[708]: eth0: adding default route via 10.0.2.23954lb # [ 15.002323] systemd[1]: Started DHCP Client.3955lb # [ 15.004448] systemd[1]: Reached target Network is Online.3956lb # [ 15.008454] systemd[1]: Started Envoy reverse proxy.3957lb # [ 15.012925] systemd[1]: Started mock-oidc.service.3958lb # [ 15.116035] mock-oidc-server[900]: Mock OIDC Server running3959lb # [ 15.117066] mock-oidc-server[900]: OIDC Address: 192.168.1.2:80803960lb # [ 15.118212] mock-oidc-server[900]: Issue Address: 0.0.0.0:80813961lb # [ 15.119210] mock-oidc-server[900]: Issuer: http://192.168.1.2:8080/oidc3962lb # [ 15.120352] mock-oidc-server[900]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3963lb # [ 15.121648] mock-oidc-server[900]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3964lb # [ 15.123147] mock-oidc-server[900]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3965lb # [ 15.544350] envoy[899]: [2026-09-20 08:03:19.592][899][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3966lb # [ 15.546272] envoy[899]: [2026-09-20 08:03:19.594][899][info][main] [source/server/server.cc:469] statically linked extensions:3967lb # [ 15.547902] envoy[899]: [2026-09-20 08:03:19.594][899][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3968lb # [ 15.550282] envoy[899]: [2026-09-20 08:03:19.594][899][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3969lb # [ 15.551940] envoy[899]: [2026-09-20 08:03:19.594][899][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3970lb # [ 15.554817] envoy[899]: [2026-09-20 08:03:19.594][899][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3971lb # [ 15.557455] envoy[899]: [2026-09-20 08:03:19.594][899][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23972lb # [ 15.558963] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3973lb # [ 15.562872] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3974lb # [ 15.565095] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3975lb # [ 15.567086] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3976lb # [ 15.569075] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3977lb # [ 15.573378] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3978lb # [ 15.576119] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3979lb # [ 15.577776] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3980lb # [ 15.580182] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3981lb # [ 15.582090] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3982lb # [ 15.583815] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3983lb # [ 15.585542] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme3984lb # [ 15.588552] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3985lb # [ 15.590238] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls3986lb # [ 15.594243] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3987lb # [ 15.607697] envoy[899]: [2026-09-20 08:03:19.596][899][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin3988lb # [ 15.610582] envoy[899]: [2026-09-20 08:03:19.598][899][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query3989lb # [ 15.613311] envoy[899]: [2026-09-20 08:03:19.598][899][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory3990lb # [ 15.615520] envoy[899]: [2026-09-20 08:03:19.598][899][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3991lb # [ 15.617889] envoy[899]: [2026-09-20 08:03:19.598][899][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re23992lb # [ 15.619401] envoy[899]: [2026-09-20 08:03:19.598][899][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3993lb # [ 15.621594] envoy[899]: [2026-09-20 08:03:19.598][899][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config3994lb # [ 15.624742] envoy[899]: [2026-09-20 08:03:19.598][899][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3995lb # [ 15.626564] envoy[899]: [2026-09-20 08:03:19.598][899][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3996lb # [ 15.629310] envoy[899]: [2026-09-20 08:03:19.598][899][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3997lb # [ 15.633304] envoy[899]: [2026-09-20 08:03:19.598][899][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13998lb # [ 15.635276] envoy[899]: [2026-09-20 08:03:19.598][899][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret3999lb # [ 15.637544] envoy[899]: [2026-09-20 08:03:19.598][899][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24000lb # [ 15.639737] envoy[899]: [2026-09-20 08:03:19.602][899][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4001lb # [ 15.642353] envoy[899]: [2026-09-20 08:03:19.602][899][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4002lb # [ 15.644175] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4003lb # [ 15.649900] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4004lb # [ 15.653117] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4005lb # [ 15.655416] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4006lb # [ 15.657088] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4007lb # [ 15.660776] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4008lb # [ 15.662486] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4009lb # [ 15.666512] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4010lb # [ 15.668123] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4011lb # [ 15.669671] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4012lb # [ 15.673048] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4013lb # [ 15.676982] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4014lb # [ 15.678562] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4015lb # [ 15.680751] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4016lb # [ 15.686738] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4017lb # [ 15.697598] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4018lb # [ 15.699392] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4019lb # [ 15.701221] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4020lb # [ 15.710049] envoy[899]: [2026-09-20 08:03:19.603][899][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4021lb # [ 15.715419] envoy[899]: [2026-09-20 08:03:19.611][899][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4022lb # [ 15.717631] envoy[899]: [2026-09-20 08:03:19.611][899][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4023lb # [ 15.720060] envoy[899]: [2026-09-20 08:03:19.611][899][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4024lb # [ 15.722212] envoy[899]: [2026-09-20 08:03:19.611][899][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4025lb # [ 15.724938] envoy[899]: [2026-09-20 08:03:19.611][899][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4026lb # [ 15.726783] envoy[899]: [2026-09-20 08:03:19.611][899][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4027lb # [ 15.729214] envoy[899]: [2026-09-20 08:03:19.611][899][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4028lb # [ 15.730890] envoy[899]: [2026-09-20 08:03:19.611][899][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4029lb # [ 15.732625] envoy[899]: [2026-09-20 08:03:19.611][899][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4030lb # [ 15.739583] envoy[899]: [2026-09-20 08:03:19.611][899][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4031lb # [ 15.741312] envoy[899]: [2026-09-20 08:03:19.613][899][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4032lb # [ 15.743080] envoy[899]: [2026-09-20 08:03:19.613][899][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4033lb # [ 15.748307] envoy[899]: [2026-09-20 08:03:19.613][899][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4034lb # [ 15.752697] envoy[899]: [2026-09-20 08:03:19.613][899][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4035lb # [ 15.754838] envoy[899]: [2026-09-20 08:03:19.613][899][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4036lb # [ 15.756756] envoy[899]: [2026-09-20 08:03:19.613][899][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84037lb # [ 15.758617] envoy[899]: [2026-09-20 08:03:19.613][899][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4038lb # [ 15.760218] envoy[899]: [2026-09-20 08:03:19.613][899][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4039lb # [ 15.762319] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4040lb # [ 15.763903] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4041lb # [ 15.765541] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4042lb # [ 15.769527] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4043lb # [ 15.771206] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4044lb # [ 15.773128] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4045lb # [ 15.775308] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4046lb # [ 15.777154] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4047lb # [ 15.802115] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4048lb # [ 15.804338] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4049lb # [ 15.806072] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4050lb # [ 15.807851] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation4051lb # [ 15.809920] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4052lb # [ 15.812211] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4053lb # [ 15.813743] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4054lb # [ 15.815709] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4055lb # [ 15.817800] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4056lb # [ 15.819743] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4057lb # [ 15.821440] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4058lb # [ 15.823149] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4059lb # [ 15.825477] envoy[899]: [2026-09-20 08:03:19.615][899][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4060lb # [ 15.827695] envoy[899]: [2026-09-20 08:03:19.628][899][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4061lb # [ 15.829703] envoy[899]: [2026-09-20 08:03:19.628][899][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4062lb # [ 15.832127] envoy[899]: [2026-09-20 08:03:19.628][899][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4063lb # [ 15.834675] envoy[899]: [2026-09-20 08:03:19.628][899][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4064lb # [ 15.837070] envoy[899]: [2026-09-20 08:03:19.628][899][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4065lb # [ 15.838637] envoy[899]: [2026-09-20 08:03:19.628][899][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4066lb # [ 15.841885] envoy[899]: [2026-09-20 08:03:19.630][899][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4067lb # [ 15.847881] envoy[899]: [2026-09-20 08:03:19.630][899][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4068lb # [ 15.849605] envoy[899]: [2026-09-20 08:03:19.630][899][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4069lb # [ 15.851303] envoy[899]: [2026-09-20 08:03:19.630][899][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4070lb # [ 15.855930] envoy[899]: [2026-09-20 08:03:19.630][899][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4071lb # [ 15.857815] envoy[899]: [2026-09-20 08:03:19.779][899][info][main] [source/server/server.cc:531] HTTP header map info:4072lb # [ 15.859297] envoy[899]: [2026-09-20 08:03:19.817][899][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4073lb # [ 15.871901] envoy[899]: [2026-09-20 08:03:19.817][899][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4074lb # [ 15.873395] envoy[899]: [2026-09-20 08:03:19.817][899][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4075lb # [ 15.880835] envoy[899]: [2026-09-20 08:03:19.817][899][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4076lb # [ 15.920599] envoy[899]: [2026-09-20 08:03:19.968][899][info][main] [source/server/server.cc:968] runtime: {}4077lb # [ 15.927354] envoy[899]: [2026-09-20 08:03:19.975][899][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4078lb # [ 15.929550] envoy[899]: [2026-09-20 08:03:19.977][899][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014079lb # [ 15.932480] envoy[899]: [2026-09-20 08:03:19.980][899][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014080lb # [ 15.935982] envoy[899]: [2026-09-20 08:03:19.984][899][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4081lb # [ 15.937612] envoy[899]: [2026-09-20 08:03:19.985][899][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4082lb # [ 15.939098] envoy[899]: [2026-09-20 08:03:19.985][899][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4083worker1 # [ 15.952550] systemd[1]: Starting Nix worker-protocol over gRPC...4084lb # [ 16.003678] envoy[899]: [2026-09-20 08:03:20.051][899][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4085worker2 # [ 15.976884] systemd[1]: Starting Nix worker-protocol over gRPC...4086lb # [ 16.030238] envoy[899]: [2026-09-20 08:03:20.078][899][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4087lb # [ 16.032763] envoy[899]: [2026-09-20 08:03:20.081][899][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4088lb # [ 16.035859] envoy[899]: [2026-09-20 08:03:20.081][899][info][main] [source/server/server.cc:1077] starting main dispatch loop4089worker2 # [ 16.065812] dhcpcd[693]: eth0: leased 10.0.2.15 for 86400 seconds4090worker2 # [ 16.067277] dhcpcd[693]: eth0: adding route to 10.0.2.0/244091worker2 # [ 16.068434] dhcpcd[693]: eth0: adding default route via 10.0.2.24092worker1 # [ 16.139555] nix-grpc-daemon[726]: ts=2026-09-20T08:03:20Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4093worker1 # [ 16.150148] nix-grpc-daemon[726]: ts=2026-09-20T08:03:20Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14094worker2 # [ 16.188798] nix-grpc-daemon[728]: ts=2026-09-20T08:03:20Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4095worker1 # [ 16.185595] nix-grpc-daemon[726]: ts=2026-09-20T08:03:20Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4096worker2 # [ 16.202750] nix-grpc-daemon[728]: ts=2026-09-20T08:03:20Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14097worker1 # [ 16.189102] systemd[1]: Started Nix worker-protocol over gRPC.4098worker2 # [ 16.214289] systemd[1]: Started DHCP Client.4099worker2 # [ 16.216223] systemd[1]: Reached target Multi-User System.4100worker2 # [ 16.248708] nix-grpc-daemon[728]: ts=2026-09-20T08:03:20Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4101worker2 # [ 16.251898] systemd[1]: Started Nix worker-protocol over gRPC.4102worker1 # [ 16.235963] nix-grpc-daemon[726]: ts=2026-09-20T08:03:20Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4103worker2 # [ 16.255591] systemd[1]: Startup finished in 904ms (kernel) + 4.015s (initrd) + 11.333s (userspace) = 16.253s.4104lb # [ 16.286895] envoy[899]: [2026-09-20 08:03:20.334][899][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4105lb # [ 16.291832] envoy[899]: [2026-09-20 08:03:20.335][899][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4106lb # [ 16.296309] envoy[899]: [2026-09-20 08:03:20.335][899][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4107lb # [ 16.301374] envoy[899]: [2026-09-20 08:03:20.335][899][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4108worker2 # [ 16.304848] nix-grpc-daemon[728]: ts=2026-09-20T08:03:20Z level=info event=scheduler_connected addr=lb:500514109worker2 # [ 16.322655] nix-grpc-daemon[728]: ts=2026-09-20T08:03:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4110worker1 # [ 16.436877] nix-grpc-daemon[726]: ts=2026-09-20T08:03:20Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4111worker2 # [ 16.524734] nix-grpc-daemon[728]: ts=2026-09-20T08:03:20Z level=info event=scheduler_connected addr=lb:500514112worker2 # [ 16.536777] nix-grpc-daemon[728]: ts=2026-09-20T08:03:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4113worker1 # [ 16.551947] dhcpcd[691]: eth0: leased 10.0.2.15 for 86400 seconds4114worker1 # [ 16.555785] dhcpcd[691]: eth0: adding route to 10.0.2.0/244115worker1 # [ 16.557861] dhcpcd[691]: eth0: adding default route via 10.0.2.24116worker1 # [ 16.653475] systemd[1]: Started DHCP Client.4117worker1 # [ 16.655360] systemd[1]: Reached target Multi-User System.4118worker1 # [ 16.656460] systemd[1]: Startup finished in 928ms (kernel) + 4.117s (initrd) + 11.609s (userspace) = 16.656s.4119worker2 # [ 16.737427] nix-grpc-daemon[728]: ts=2026-09-20T08:03:20Z level=info event=scheduler_connected addr=lb:500514120worker2 # [ 16.740173] nix-grpc-daemon[728]: ts=2026-09-20T08:03:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4121worker1 # [ 16.837352] nix-grpc-daemon[726]: ts=2026-09-20T08:03:20Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4122worker2 # [ 16.940949] nix-grpc-daemon[728]: ts=2026-09-20T08:03:21Z level=info event=scheduler_connected addr=lb:500514123worker2 # [ 16.943922] nix-grpc-daemon[728]: ts=2026-09-20T08:03:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4124worker2 # [ 17.144601] nix-grpc-daemon[728]: ts=2026-09-20T08:03:21Z level=info event=scheduler_connected addr=lb:500514125worker2 # [ 17.147838] nix-grpc-daemon[728]: ts=2026-09-20T08:03:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4126worker2 # [ 17.348830] nix-grpc-daemon[728]: ts=2026-09-20T08:03:21Z level=info event=scheduler_connected addr=lb:500514127worker2 # [ 17.351413] nix-grpc-daemon[728]: ts=2026-09-20T08:03:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4128client # [ 17.439969] dhcpcd[567]: eth0: leased 10.0.2.15 for 86400 seconds4129client # [ 17.442829] dhcpcd[567]: eth0: adding route to 10.0.2.0/244130client # [ 17.445166] dhcpcd[567]: eth0: adding default route via 10.0.2.24131worker2 # [ 17.552291] nix-grpc-daemon[728]: ts=2026-09-20T08:03:21Z level=info event=scheduler_connected addr=lb:500514132worker2 # [ 17.555814] nix-grpc-daemon[728]: ts=2026-09-20T08:03:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4133client # [ 17.565157] systemd[1]: Started DHCP Client.4134client # [ 17.568482] systemd[1]: Reached target Multi-User System.4135client # [ 17.569761] systemd[1]: Startup finished in 919ms (kernel) + 4.790s (initrd) + 11.859s (userspace) = 17.569s.4136worker1 # [ 17.640229] nix-grpc-daemon[726]: ts=2026-09-20T08:03:21Z level=info event=scheduler_connected addr=lb:500514137worker1 # [ 17.643853] nix-grpc-daemon[726]: ts=2026-09-20T08:03:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4138worker2 # [ 17.756909] nix-grpc-daemon[728]: ts=2026-09-20T08:03:21Z level=info event=scheduler_connected addr=lb:500514139worker2 # [ 17.760156] nix-grpc-daemon[728]: ts=2026-09-20T08:03:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4140worker1 # [ 17.844583] nix-grpc-daemon[726]: ts=2026-09-20T08:03:21Z level=info event=scheduler_connected addr=lb:500514141worker1 # [ 17.847306] nix-grpc-daemon[726]: ts=2026-09-20T08:03:21Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4142worker2 # [ 17.960648] nix-grpc-daemon[728]: ts=2026-09-20T08:03:22Z level=info event=scheduler_connected addr=lb:500514143worker2 # [ 17.963239] nix-grpc-daemon[728]: ts=2026-09-20T08:03:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4144worker1 # [ 18.048066] nix-grpc-daemon[726]: ts=2026-09-20T08:03:22Z level=info event=scheduler_connected addr=lb:500514145worker1 # [ 18.050731] nix-grpc-daemon[726]: ts=2026-09-20T08:03:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4146worker2 # [ 18.164041] nix-grpc-daemon[728]: ts=2026-09-20T08:03:22Z level=info event=scheduler_connected addr=lb:500514147worker2 # [ 18.166576] nix-grpc-daemon[728]: ts=2026-09-20T08:03:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4148worker1 # [ 18.251291] nix-grpc-daemon[726]: ts=2026-09-20T08:03:22Z level=info event=scheduler_connected addr=lb:500514149worker1 # [ 18.253792] nix-grpc-daemon[726]: ts=2026-09-20T08:03:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4150worker2 # [ 18.367681] nix-grpc-daemon[728]: ts=2026-09-20T08:03:22Z level=info event=scheduler_connected addr=lb:500514151worker2 # [ 18.370057] nix-grpc-daemon[728]: ts=2026-09-20T08:03:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4152worker1 # [ 18.454650] nix-grpc-daemon[726]: ts=2026-09-20T08:03:22Z level=info event=scheduler_connected addr=lb:500514153worker1 # [ 18.457297] nix-grpc-daemon[726]: ts=2026-09-20T08:03:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4154worker2 # [ 18.571220] nix-grpc-daemon[728]: ts=2026-09-20T08:03:22Z level=info event=scheduler_connected addr=lb:500514155worker2 # [ 18.576400] nix-grpc-daemon[728]: ts=2026-09-20T08:03:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4156worker1 # [ 18.659148] nix-grpc-daemon[726]: ts=2026-09-20T08:03:22Z level=info event=scheduler_connected addr=lb:500514157worker1 # [ 18.663944] nix-grpc-daemon[726]: ts=2026-09-20T08:03:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4158worker2 # [ 18.777121] nix-grpc-daemon[728]: ts=2026-09-20T08:03:22Z level=info event=scheduler_connected addr=lb:500514159worker2 # [ 18.779446] nix-grpc-daemon[728]: ts=2026-09-20T08:03:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4160worker1 # [ 18.865133] nix-grpc-daemon[726]: ts=2026-09-20T08:03:22Z level=info event=scheduler_connected addr=lb:500514161worker1 # [ 18.870514] nix-grpc-daemon[726]: ts=2026-09-20T08:03:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4162worker2 # [ 18.980731] nix-grpc-daemon[728]: ts=2026-09-20T08:03:23Z level=info event=scheduler_connected addr=lb:500514163worker2 # [ 18.985840] nix-grpc-daemon[728]: ts=2026-09-20T08:03:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4164worker1 # [ 19.071544] nix-grpc-daemon[726]: ts=2026-09-20T08:03:23Z level=info event=scheduler_connected addr=lb:500514165worker1 # [ 19.076773] nix-grpc-daemon[726]: ts=2026-09-20T08:03:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4166worker2 # [ 19.186949] nix-grpc-daemon[728]: ts=2026-09-20T08:03:23Z level=info event=scheduler_connected addr=lb:500514167worker2 # [ 19.192433] nix-grpc-daemon[728]: ts=2026-09-20T08:03:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4168worker1 # [ 19.277818] nix-grpc-daemon[726]: ts=2026-09-20T08:03:23Z level=info event=scheduler_connected addr=lb:500514169worker1 # [ 19.282612] nix-grpc-daemon[726]: ts=2026-09-20T08:03:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4170worker2 # [ 19.393539] nix-grpc-daemon[728]: ts=2026-09-20T08:03:23Z level=info event=scheduler_connected addr=lb:500514171worker2 # [ 19.396102] nix-grpc-daemon[728]: ts=2026-09-20T08:03:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4172worker1 # [ 19.483810] nix-grpc-daemon[726]: ts=2026-09-20T08:03:23Z level=info event=scheduler_connected addr=lb:500514173worker1 # [ 19.488799] nix-grpc-daemon[726]: ts=2026-09-20T08:03:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4174worker2 # [ 19.596660] nix-grpc-daemon[728]: ts=2026-09-20T08:03:23Z level=info event=scheduler_connected addr=lb:500514175worker2 # [ 19.599156] nix-grpc-daemon[728]: ts=2026-09-20T08:03:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4176worker1 # [ 19.690737] nix-grpc-daemon[726]: ts=2026-09-20T08:03:23Z level=info event=scheduler_connected addr=lb:500514177worker1 # [ 19.696347] nix-grpc-daemon[726]: ts=2026-09-20T08:03:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4178worker2 # [ 19.800266] nix-grpc-daemon[728]: ts=2026-09-20T08:03:23Z level=info event=scheduler_connected addr=lb:500514179worker2 # [ 19.804933] nix-grpc-daemon[728]: ts=2026-09-20T08:03:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4180worker1 # [ 19.896224] nix-grpc-daemon[726]: ts=2026-09-20T08:03:23Z level=info event=scheduler_connected addr=lb:500514181worker1 # [ 19.899152] nix-grpc-daemon[726]: ts=2026-09-20T08:03:23Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4182worker2 # [ 20.005825] nix-grpc-daemon[728]: ts=2026-09-20T08:03:24Z level=info event=scheduler_connected addr=lb:500514183worker2 # [ 20.010963] nix-grpc-daemon[728]: ts=2026-09-20T08:03:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4184worker1 # [ 20.099919] nix-grpc-daemon[726]: ts=2026-09-20T08:03:24Z level=info event=scheduler_connected addr=lb:500514185worker1 # [ 20.102444] nix-grpc-daemon[726]: ts=2026-09-20T08:03:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4186worker2 # [ 20.211859] nix-grpc-daemon[728]: ts=2026-09-20T08:03:24Z level=info event=scheduler_connected addr=lb:500514187worker2 # [ 20.217193] nix-grpc-daemon[728]: ts=2026-09-20T08:03:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4188worker1 # [ 20.303380] nix-grpc-daemon[726]: ts=2026-09-20T08:03:24Z level=info event=scheduler_connected addr=lb:500514189worker1 # [ 20.308656] nix-grpc-daemon[726]: ts=2026-09-20T08:03:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4190worker2 # [ 20.418297] nix-grpc-daemon[728]: ts=2026-09-20T08:03:24Z level=info event=scheduler_connected addr=lb:500514191worker2 # [ 20.421115] nix-grpc-daemon[728]: ts=2026-09-20T08:03:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4192worker1 # [ 20.509720] nix-grpc-daemon[726]: ts=2026-09-20T08:03:24Z level=info event=scheduler_connected addr=lb:500514193worker1 # [ 20.514670] nix-grpc-daemon[726]: ts=2026-09-20T08:03:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4194worker2 # [ 20.622318] nix-grpc-daemon[728]: ts=2026-09-20T08:03:24Z level=info event=scheduler_connected addr=lb:500514195worker2 # [ 20.627278] nix-grpc-daemon[728]: ts=2026-09-20T08:03:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4196worker1 # [ 20.716681] nix-grpc-daemon[726]: ts=2026-09-20T08:03:24Z level=info event=scheduler_connected addr=lb:500514197worker1 # [ 20.722162] nix-grpc-daemon[726]: ts=2026-09-20T08:03:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4198worker2 # [ 20.828080] nix-grpc-daemon[728]: ts=2026-09-20T08:03:25Z level=info event=scheduler_connected addr=lb:500514199worker2 # [ 20.832998] nix-grpc-daemon[728]: ts=2026-09-20T08:03:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4200worker1 # [ 20.922943] nix-grpc-daemon[726]: ts=2026-09-20T08:03:24Z level=info event=scheduler_connected addr=lb:500514201worker1 # [ 20.927936] nix-grpc-daemon[726]: ts=2026-09-20T08:03:24Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4202worker2 # [ 21.033806] nix-grpc-daemon[728]: ts=2026-09-20T08:03:25Z level=info event=scheduler_connected addr=lb:500514203worker2 # [ 21.036911] nix-grpc-daemon[728]: ts=2026-09-20T08:03:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4204worker1 # [ 21.129079] nix-grpc-daemon[726]: ts=2026-09-20T08:03:25Z level=info event=scheduler_connected addr=lb:500514205worker1 # [ 21.134217] nix-grpc-daemon[726]: ts=2026-09-20T08:03:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4206worker2 # [ 21.237860] nix-grpc-daemon[728]: ts=2026-09-20T08:03:25Z level=info event=scheduler_connected addr=lb:500514207worker2 # [ 21.242898] nix-grpc-daemon[728]: ts=2026-09-20T08:03:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4208worker1 # [ 21.335357] nix-grpc-daemon[726]: ts=2026-09-20T08:03:25Z level=info event=scheduler_connected addr=lb:500514209worker1 # [ 21.340244] nix-grpc-daemon[726]: ts=2026-09-20T08:03:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4210worker2 # [ 21.445584] nix-grpc-daemon[728]: ts=2026-09-20T08:03:25Z level=info event=scheduler_connected addr=lb:500514211worker2 # [ 21.449292] nix-grpc-daemon[728]: ts=2026-09-20T08:03:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4212worker1 # [ 21.541361] nix-grpc-daemon[726]: ts=2026-09-20T08:03:25Z level=info event=scheduler_connected addr=lb:500514213worker1 # [ 21.546667] nix-grpc-daemon[726]: ts=2026-09-20T08:03:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4214worker2 # [ 21.647177] nix-grpc-daemon[728]: ts=2026-09-20T08:03:25Z level=info event=scheduler_connected addr=lb:500514215worker2 # [ 21.652237] nix-grpc-daemon[728]: ts=2026-09-20T08:03:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4216worker1 # [ 21.747722] nix-grpc-daemon[726]: ts=2026-09-20T08:03:25Z level=info event=scheduler_connected addr=lb:500514217worker1 # [ 21.750530] nix-grpc-daemon[726]: ts=2026-09-20T08:03:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4218worker2 # [ 21.853478] nix-grpc-daemon[728]: ts=2026-09-20T08:03:26Z level=info event=scheduler_connected addr=lb:500514219worker2 # [ 21.858972] nix-grpc-daemon[728]: ts=2026-09-20T08:03:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4220worker1 # [ 21.951632] nix-grpc-daemon[726]: ts=2026-09-20T08:03:25Z level=info event=scheduler_connected addr=lb:500514221worker1 # [ 21.957066] nix-grpc-daemon[726]: ts=2026-09-20T08:03:25Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4222worker2 # [ 22.059612] nix-grpc-daemon[728]: ts=2026-09-20T08:03:26Z level=info event=scheduler_connected addr=lb:500514223worker2 # [ 22.062810] nix-grpc-daemon[728]: ts=2026-09-20T08:03:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4224worker1 # [ 22.158312] nix-grpc-daemon[726]: ts=2026-09-20T08:03:26Z level=info event=scheduler_connected addr=lb:500514225worker1 # [ 22.163722] nix-grpc-daemon[726]: ts=2026-09-20T08:03:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4226worker2 # [ 22.263521] nix-grpc-daemon[728]: ts=2026-09-20T08:03:26Z level=info event=scheduler_connected addr=lb:500514227worker2 # [ 22.266504] nix-grpc-daemon[728]: ts=2026-09-20T08:03:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4228worker1 # [ 22.364664] nix-grpc-daemon[726]: ts=2026-09-20T08:03:26Z level=info event=scheduler_connected addr=lb:500514229worker1 # [ 22.369952] nix-grpc-daemon[726]: ts=2026-09-20T08:03:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4230worker2 # [ 22.469180] nix-grpc-daemon[728]: ts=2026-09-20T08:03:26Z level=info event=scheduler_connected addr=lb:500514231worker2 # [ 22.472898] nix-grpc-daemon[728]: ts=2026-09-20T08:03:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4232worker1 # [ 22.571161] nix-grpc-daemon[726]: ts=2026-09-20T08:03:26Z level=info event=scheduler_connected addr=lb:500514233worker1 # [ 22.576557] nix-grpc-daemon[726]: ts=2026-09-20T08:03:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4234worker2 # [ 22.673667] nix-grpc-daemon[728]: ts=2026-09-20T08:03:26Z level=info event=scheduler_connected addr=lb:500514235worker2 # [ 22.677674] nix-grpc-daemon[728]: ts=2026-09-20T08:03:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4236worker1 # [ 22.777573] nix-grpc-daemon[726]: ts=2026-09-20T08:03:26Z level=info event=scheduler_connected addr=lb:500514237worker1 # [ 22.780600] nix-grpc-daemon[726]: ts=2026-09-20T08:03:26Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4238worker2 # [ 22.878576] nix-grpc-daemon[728]: ts=2026-09-20T08:03:27Z level=info event=scheduler_connected addr=lb:500514239worker2 # [ 22.882579] nix-grpc-daemon[728]: ts=2026-09-20T08:03:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4240worker1 # [ 22.982390] nix-grpc-daemon[726]: ts=2026-09-20T08:03:27Z level=info event=scheduler_connected addr=lb:500514241worker1 # [ 22.985136] nix-grpc-daemon[726]: ts=2026-09-20T08:03:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4242worker2 # [ 23.083695] nix-grpc-daemon[728]: ts=2026-09-20T08:03:27Z level=info event=scheduler_connected addr=lb:500514243worker2 # [ 23.088948] nix-grpc-daemon[728]: ts=2026-09-20T08:03:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4244worker1 # [ 23.186117] nix-grpc-daemon[726]: ts=2026-09-20T08:03:27Z level=info event=scheduler_connected addr=lb:500514245worker1 # [ 23.191732] nix-grpc-daemon[726]: ts=2026-09-20T08:03:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4246worker2 # [ 23.289490] nix-grpc-daemon[728]: ts=2026-09-20T08:03:27Z level=info event=scheduler_connected addr=lb:500514247worker2 # [ 23.292370] nix-grpc-daemon[728]: ts=2026-09-20T08:03:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4248worker1 # [ 23.392531] nix-grpc-daemon[726]: ts=2026-09-20T08:03:27Z level=info event=scheduler_connected addr=lb:500514249worker1 # [ 23.395350] nix-grpc-daemon[726]: ts=2026-09-20T08:03:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4250worker2 # [ 23.493995] nix-grpc-daemon[728]: ts=2026-09-20T08:03:27Z level=info event=scheduler_connected addr=lb:500514251worker2 # [ 23.498681] nix-grpc-daemon[728]: ts=2026-09-20T08:03:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4252worker1 # [ 23.595949] nix-grpc-daemon[726]: ts=2026-09-20T08:03:27Z level=info event=scheduler_connected addr=lb:500514253worker1 # [ 23.598282] nix-grpc-daemon[726]: ts=2026-09-20T08:03:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4254worker2 # [ 23.699465] nix-grpc-daemon[728]: ts=2026-09-20T08:03:27Z level=info event=scheduler_connected addr=lb:500514255worker2 # [ 23.704326] nix-grpc-daemon[728]: ts=2026-09-20T08:03:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4256worker1 # [ 23.802482] nix-grpc-daemon[726]: ts=2026-09-20T08:03:27Z level=info event=scheduler_connected addr=lb:500514257worker1 # [ 23.806219] nix-grpc-daemon[726]: ts=2026-09-20T08:03:27Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4258worker2 # [ 23.904957] nix-grpc-daemon[728]: ts=2026-09-20T08:03:28Z level=info event=scheduler_connected addr=lb:500514259worker2 # [ 23.910075] nix-grpc-daemon[728]: ts=2026-09-20T08:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4260worker1 # [ 24.002547] nix-grpc-daemon[726]: ts=2026-09-20T08:03:28Z level=info event=scheduler_connected addr=lb:500514261worker1 # [ 24.005365] nix-grpc-daemon[726]: ts=2026-09-20T08:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4262worker2 # [ 24.110941] nix-grpc-daemon[728]: ts=2026-09-20T08:03:28Z level=info event=scheduler_connected addr=lb:500514263worker2 # [ 24.116248] nix-grpc-daemon[728]: ts=2026-09-20T08:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4264worker1 # [ 24.206665] nix-grpc-daemon[726]: ts=2026-09-20T08:03:28Z level=info event=scheduler_connected addr=lb:500514265worker1 # [ 24.211876] nix-grpc-daemon[726]: ts=2026-09-20T08:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4266worker2 # [ 24.317112] nix-grpc-daemon[728]: ts=2026-09-20T08:03:28Z level=info event=scheduler_connected addr=lb:500514267worker2 # [ 24.322349] nix-grpc-daemon[728]: ts=2026-09-20T08:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4268worker1 # [ 24.412442] nix-grpc-daemon[726]: ts=2026-09-20T08:03:28Z level=info event=scheduler_connected addr=lb:500514269worker1 # [ 24.415273] nix-grpc-daemon[726]: ts=2026-09-20T08:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4270worker2 # [ 24.523563] nix-grpc-daemon[728]: ts=2026-09-20T08:03:28Z level=info event=scheduler_connected addr=lb:500514271worker2 # [ 24.527931] nix-grpc-daemon[728]: ts=2026-09-20T08:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4272worker1 # [ 24.616096] nix-grpc-daemon[726]: ts=2026-09-20T08:03:28Z level=info event=scheduler_connected addr=lb:500514273worker1 # [ 24.618439] nix-grpc-daemon[726]: ts=2026-09-20T08:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4274worker2 # [ 24.729148] nix-grpc-daemon[728]: ts=2026-09-20T08:03:28Z level=info event=scheduler_connected addr=lb:500514275worker2 # [ 24.734372] nix-grpc-daemon[728]: ts=2026-09-20T08:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4276worker1 # [ 24.820333] nix-grpc-daemon[726]: ts=2026-09-20T08:03:28Z level=info event=scheduler_connected addr=lb:500514277worker1 # [ 24.824820] nix-grpc-daemon[726]: ts=2026-09-20T08:03:28Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4278worker2 # [ 24.935487] nix-grpc-daemon[728]: ts=2026-09-20T08:03:29Z level=info event=scheduler_connected addr=lb:500514279worker2 # [ 24.940963] nix-grpc-daemon[728]: ts=2026-09-20T08:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4280worker1 # [ 25.025909] nix-grpc-daemon[726]: ts=2026-09-20T08:03:29Z level=info event=scheduler_connected addr=lb:500514281worker1 # [ 25.031174] nix-grpc-daemon[726]: ts=2026-09-20T08:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4282worker2 # [ 25.141685] nix-grpc-daemon[728]: ts=2026-09-20T08:03:29Z level=info event=scheduler_connected addr=lb:500514283worker2 # [ 25.143981] nix-grpc-daemon[728]: ts=2026-09-20T08:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4284worker1 # [ 25.231978] nix-grpc-daemon[726]: ts=2026-09-20T08:03:29Z level=info event=scheduler_connected addr=lb:500514285worker1 # [ 25.237714] nix-grpc-daemon[726]: ts=2026-09-20T08:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4286worker2 # [ 25.344881] nix-grpc-daemon[728]: ts=2026-09-20T08:03:29Z level=info event=scheduler_connected addr=lb:500514287worker2 # [ 25.350219] nix-grpc-daemon[728]: ts=2026-09-20T08:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4288worker1 # [ 25.439181] nix-grpc-daemon[726]: ts=2026-09-20T08:03:29Z level=info event=scheduler_connected addr=lb:500514289worker1 # [ 25.444903] nix-grpc-daemon[726]: ts=2026-09-20T08:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4290worker2 # [ 25.552372] nix-grpc-daemon[728]: ts=2026-09-20T08:03:29Z level=info event=scheduler_connected addr=lb:500514291worker2 # [ 25.557213] nix-grpc-daemon[728]: ts=2026-09-20T08:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4292worker1 # [ 25.645941] nix-grpc-daemon[726]: ts=2026-09-20T08:03:29Z level=info event=scheduler_connected addr=lb:500514293worker1 # [ 25.651502] nix-grpc-daemon[726]: ts=2026-09-20T08:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4294worker2 # [ 25.758214] nix-grpc-daemon[728]: ts=2026-09-20T08:03:29Z level=info event=scheduler_connected addr=lb:500514295worker2 # [ 25.762886] nix-grpc-daemon[728]: ts=2026-09-20T08:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4296worker1 # [ 25.853928] nix-grpc-daemon[726]: ts=2026-09-20T08:03:29Z level=info event=scheduler_connected addr=lb:500514297worker1 # [ 25.859854] nix-grpc-daemon[726]: ts=2026-09-20T08:03:29Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4298worker2 # [ 25.964127] nix-grpc-daemon[728]: ts=2026-09-20T08:03:30Z level=info event=scheduler_connected addr=lb:500514299worker2 # [ 25.969635] nix-grpc-daemon[728]: ts=2026-09-20T08:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4300worker1 # [ 26.060488] nix-grpc-daemon[726]: ts=2026-09-20T08:03:30Z level=info event=scheduler_connected addr=lb:500514301worker1 # [ 26.062963] nix-grpc-daemon[726]: ts=2026-09-20T08:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4302worker2 # [ 26.170077] nix-grpc-daemon[728]: ts=2026-09-20T08:03:30Z level=info event=scheduler_connected addr=lb:500514303worker2 # [ 26.173324] nix-grpc-daemon[728]: ts=2026-09-20T08:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4304worker1 # [ 26.263494] nix-grpc-daemon[726]: ts=2026-09-20T08:03:30Z level=info event=scheduler_connected addr=lb:500514305worker1 # [ 26.266234] nix-grpc-daemon[726]: ts=2026-09-20T08:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4306worker2 # [ 26.374372] nix-grpc-daemon[728]: ts=2026-09-20T08:03:30Z level=info event=scheduler_connected addr=lb:500514307worker2 # [ 26.379470] nix-grpc-daemon[728]: ts=2026-09-20T08:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4308worker1 # [ 26.467433] nix-grpc-daemon[726]: ts=2026-09-20T08:03:30Z level=info event=scheduler_connected addr=lb:500514309worker1 # [ 26.472971] nix-grpc-daemon[726]: ts=2026-09-20T08:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4310worker2 # [ 26.581425] nix-grpc-daemon[728]: ts=2026-09-20T08:03:30Z level=info event=scheduler_connected addr=lb:500514311worker2 # [ 26.586337] nix-grpc-daemon[728]: ts=2026-09-20T08:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4312worker1 # [ 26.673792] nix-grpc-daemon[726]: ts=2026-09-20T08:03:30Z level=info event=scheduler_connected addr=lb:500514313worker1 # [ 26.678520] nix-grpc-daemon[726]: ts=2026-09-20T08:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4314worker2 # [ 26.787646] nix-grpc-daemon[728]: ts=2026-09-20T08:03:30Z level=info event=scheduler_connected addr=lb:500514315worker2 # [ 26.792825] nix-grpc-daemon[728]: ts=2026-09-20T08:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4316worker1 # [ 26.880415] nix-grpc-daemon[726]: ts=2026-09-20T08:03:30Z level=info event=scheduler_connected addr=lb:500514317worker1 # [ 26.885252] nix-grpc-daemon[726]: ts=2026-09-20T08:03:30Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4318worker2 # [ 26.993921] nix-grpc-daemon[728]: ts=2026-09-20T08:03:31Z level=info event=scheduler_connected addr=lb:500514319worker2 # [ 26.999189] nix-grpc-daemon[728]: ts=2026-09-20T08:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4320worker1 # [ 27.086344] nix-grpc-daemon[726]: ts=2026-09-20T08:03:31Z level=info event=scheduler_connected addr=lb:500514321worker1 # [ 27.088573] nix-grpc-daemon[726]: ts=2026-09-20T08:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4322worker2 # [ 27.200275] nix-grpc-daemon[728]: ts=2026-09-20T08:03:31Z level=info event=scheduler_connected addr=lb:500514323worker2 # [ 27.206498] nix-grpc-daemon[728]: ts=2026-09-20T08:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4324worker1 # [ 27.289474] nix-grpc-daemon[726]: ts=2026-09-20T08:03:31Z level=info event=scheduler_connected addr=lb:500514325worker1 # [ 27.294665] nix-grpc-daemon[726]: ts=2026-09-20T08:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4326worker2 # [ 27.407500] nix-grpc-daemon[728]: ts=2026-09-20T08:03:31Z level=info event=scheduler_connected addr=lb:500514327worker2 # [ 27.412972] nix-grpc-daemon[728]: ts=2026-09-20T08:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4328worker1 # [ 27.495874] nix-grpc-daemon[726]: ts=2026-09-20T08:03:31Z level=info event=scheduler_connected addr=lb:500514329worker1 # [ 27.501281] nix-grpc-daemon[726]: ts=2026-09-20T08:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4330worker2 # [ 27.614925] nix-grpc-daemon[728]: ts=2026-09-20T08:03:31Z level=info event=scheduler_connected addr=lb:500514331worker2 # [ 27.620584] nix-grpc-daemon[728]: ts=2026-09-20T08:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4332worker1 # [ 27.702365] nix-grpc-daemon[726]: ts=2026-09-20T08:03:31Z level=info event=scheduler_connected addr=lb:500514333worker1 # [ 27.707629] nix-grpc-daemon[726]: ts=2026-09-20T08:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4334worker2 # [ 27.821694] nix-grpc-daemon[728]: ts=2026-09-20T08:03:32Z level=info event=scheduler_connected addr=lb:500514335worker2 # [ 27.827329] nix-grpc-daemon[728]: ts=2026-09-20T08:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4336worker1 # [ 27.910798] nix-grpc-daemon[726]: ts=2026-09-20T08:03:31Z level=info event=scheduler_connected addr=lb:500514337worker1 # [ 27.915115] nix-grpc-daemon[726]: ts=2026-09-20T08:03:31Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4338worker2 # [ 28.028058] nix-grpc-daemon[728]: ts=2026-09-20T08:03:32Z level=info event=scheduler_connected addr=lb:500514339worker2 # [ 28.031051] nix-grpc-daemon[728]: ts=2026-09-20T08:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4340worker1 # [ 28.115712] nix-grpc-daemon[726]: ts=2026-09-20T08:03:32Z level=info event=scheduler_connected addr=lb:500514341worker1 # [ 28.120952] nix-grpc-daemon[726]: ts=2026-09-20T08:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4342worker2 # [ 28.231620] nix-grpc-daemon[728]: ts=2026-09-20T08:03:32Z level=info event=scheduler_connected addr=lb:500514343worker2 # [ 28.234230] nix-grpc-daemon[728]: ts=2026-09-20T08:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4344worker1 # [ 28.321963] nix-grpc-daemon[726]: ts=2026-09-20T08:03:32Z level=info event=scheduler_connected addr=lb:500514345worker1 # [ 28.326838] nix-grpc-daemon[726]: ts=2026-09-20T08:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4346worker2 # [ 28.434920] nix-grpc-daemon[728]: ts=2026-09-20T08:03:32Z level=info event=scheduler_connected addr=lb:500514347worker2 # [ 28.437541] nix-grpc-daemon[728]: ts=2026-09-20T08:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4348worker1 # [ 28.528087] nix-grpc-daemon[726]: ts=2026-09-20T08:03:32Z level=info event=scheduler_connected addr=lb:500514349worker1 # [ 28.533990] nix-grpc-daemon[726]: ts=2026-09-20T08:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4350worker2 # [ 28.638593] nix-grpc-daemon[728]: ts=2026-09-20T08:03:32Z level=info event=scheduler_connected addr=lb:500514351worker2 # [ 28.641105] nix-grpc-daemon[728]: ts=2026-09-20T08:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4352worker1 # [ 28.734964] nix-grpc-daemon[726]: ts=2026-09-20T08:03:32Z level=info event=scheduler_connected addr=lb:500514353worker1 # [ 28.739992] nix-grpc-daemon[726]: ts=2026-09-20T08:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4354worker2 # [ 28.841884] nix-grpc-daemon[728]: ts=2026-09-20T08:03:33Z level=info event=scheduler_connected addr=lb:500514355worker2 # [ 28.844331] nix-grpc-daemon[728]: ts=2026-09-20T08:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4356worker1 # [ 28.941099] nix-grpc-daemon[726]: ts=2026-09-20T08:03:32Z level=info event=scheduler_connected addr=lb:500514357worker1 # [ 28.944667] nix-grpc-daemon[726]: ts=2026-09-20T08:03:32Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4358worker2 # [ 29.045144] nix-grpc-daemon[728]: ts=2026-09-20T08:03:33Z level=info event=scheduler_connected addr=lb:500514359worker2 # [ 29.047693] nix-grpc-daemon[728]: ts=2026-09-20T08:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4360lb # [ 29.175171] rustfs-bucket-start[1037]: mb s3://farm4361lb # [ 29.184889] systemd[1]: Finished rustfs-bucket.service.4362worker1 # [ 29.145336] nix-grpc-daemon[726]: ts=2026-09-20T08:03:33Z level=info event=scheduler_connected addr=lb:500514363worker1 # [ 29.147644] nix-grpc-daemon[726]: ts=2026-09-20T08:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4364lb # [ 29.197405] systemd[1]: Starting niks3 server...4365worker2 # [ 29.248304] nix-grpc-daemon[728]: ts=2026-09-20T08:03:33Z level=info event=scheduler_connected addr=lb:500514366worker2 # [ 29.250841] nix-grpc-daemon[728]: ts=2026-09-20T08:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4367worker1 # [ 29.348589] nix-grpc-daemon[726]: ts=2026-09-20T08:03:33Z level=info event=scheduler_connected addr=lb:500514368worker1 # [ 29.352982] nix-grpc-daemon[726]: ts=2026-09-20T08:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4369lb # [ 29.434823] postgres[1053]: [1053] ERROR: relation "goose_db_version" does not exist at character 364370lb # [ 29.436746] postgres[1053]: [1053] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4371lb # [ 29.480391] niks3-server[1047]: 2026/09/20 08:03:33 OK 20241026095416_initial_model.sql (22.62ms)4372lb # [ 29.485911] niks3-server[1047]: 2026/09/20 08:03:33 OK 20251210153512_drop_unused_gin_index.sql (5.62ms)4373worker2 # [ 29.451890] nix-grpc-daemon[728]: ts=2026-09-20T08:03:33Z level=info event=scheduler_connected addr=lb:500514374worker2 # [ 29.457400] nix-grpc-daemon[728]: ts=2026-09-20T08:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4375lb # [ 29.492662] niks3-server[1047]: 2026/09/20 08:03:33 OK 20251218171726_add_pins.sql (6.81ms)4376lb # [ 29.499199] niks3-server[1047]: 2026/09/20 08:03:33 OK 20260628120000_add_object_size_and_stats.sql (4.84ms)4377lb # [ 29.503963] niks3-server[1047]: 2026/09/20 08:03:33 OK 20260905000000_add_claims.sql (4.84ms)4378lb # [ 29.508967] niks3-server[1047]: 2026/09/20 08:03:33 OK 20260920000000_drop_claims.sql (5.06ms)4379lb # [ 29.510743] niks3-server[1047]: 2026/09/20 08:03:33 goose: successfully migrated database to version: 202609200000004380lb # [ 29.517255] niks3-server[1047]: 2026/09/20 08:03:33 OK 1_commit_pending_closure.sql (6.55ms)4381lb # [ 29.520364] niks3-server[1047]: 2026/09/20 08:03:33 OK 2_object_stats_trigger.sql (3.07ms)4382lb # [ 29.521691] niks3-server[1047]: 2026/09/20 08:03:33 goose: up to current file version: 24383lb # [ 29.528242] niks3-server[1047]: 2026/09/20 08:03:33 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4384worker1 # [ 29.553284] nix-grpc-daemon[726]: ts=2026-09-20T08:03:33Z level=info event=scheduler_connected addr=lb:500514385worker1 # [ 29.556272] nix-grpc-daemon[726]: ts=2026-09-20T08:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4386lb # [ 29.606979] niks3-server[1047]: 2026/09/20 08:03:33 INFO Read proxy enabled — serving cache objects from S34387lb # [ 29.608855] niks3-server[1047]: 2026/09/20 08:03:33 INFO Using socket-activated listener address=0.0.0.0:57514388lb # [ 29.615423] niks3-server[1047]: 2026/09/20 08:03:33 INFO systemd watchdog enabled interval=15s4389lb # [ 29.616650] systemd[1]: Started niks3 server.4390lb # [ 29.618800] systemd[1]: Reached target Multi-User System.4391lb # [ 29.619936] niks3-server[1047]: 2026/09/20 08:03:33 INFO Starting HTTP server address=0.0.0.0:57514392lb # [ 29.621668] systemd[1]: Startup finished in 898ms (kernel) + 4.052s (initrd) + 24.668s (userspace) = 29.619s.4393lb # [ 29.627523] niks3-server[1047]: 2026/09/20 08:03:33 INFO lead: acquired remote=192.168.1.4:369884394worker2 # [ 29.602982] nix-grpc-daemon[728]: ts=2026-09-20T08:03:33Z level=info event=scheduler_take_over4395worker2 # [ 29.659693] nix-grpc-daemon[728]: ts=2026-09-20T08:03:33Z level=info event=scheduler_connected addr=lb:500514396worker2 # [ 29.666408] nix-grpc-daemon[728]: ts=2026-09-20T08:03:33Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04397worker1 # [ 29.756941] nix-grpc-daemon[726]: ts=2026-09-20T08:03:33Z level=info event=scheduler_connected addr=lb:500514398worker1 # [ 29.759888] nix-grpc-daemon[726]: ts=2026-09-20T08:03:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4399worker1 # [ 29.960987] nix-grpc-daemon[726]: ts=2026-09-20T08:03:33Z level=info event=scheduler_connected addr=lb:500514400worker2 # [ 29.980154] nix-grpc-daemon[728]: ts=2026-09-20T08:03:34Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04401lb: (finished: waiting for unit niks3.service, in 18.51 seconds)4402lb: waiting for TCP port 5751 on localhost4403lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4404lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds)4405lb: waiting for unit envoy.service4406lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4407lb: waiting for TCP port 50051 on localhost4408lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4409lb # [ 30.276537] envoy[899]: conn peer=[::1]:48212 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24410lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4411lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4412lb: must succeed: curl -sf localhost:9901/clusters4413lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4414lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds)4415subtest: one node schedules and both builders hold a WorkerSession on it4416lb: must succeed: curl -sf localhost:9901/clusters4417lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4418worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4419worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)4420lb: must succeed: curl -sf localhost:9901/clusters4421lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4422lb: must succeed: curl -sf localhost:9901/clusters4423lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4424worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true4425worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true, in 0.07 seconds)4426lb: must succeed: curl -sf localhost:9901/clusters4427lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4428lb: must succeed: curl -sf localhost:9901/clusters4429lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4430worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true4431worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="leader"} ' || true, in 0.06 seconds)4432worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="slots"' || true4433worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="slots"' || true, in 0.04 seconds)4434worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="free"' || true4435worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="free"' || true, in 0.04 seconds)4436worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="queued"' || true4437worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep '^nix_grpc_sched_system' | grep -F 'kind="queued"' || true, in 0.04 seconds)4438(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.55 seconds)4439subtest: balancer auth: client cert, bearer token, nothing, unknown CN4440worker2 # [ 31.260553] nix-grpc-daemon[728]: ts=2026-09-20T08:03:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:462344441worker2 # [ 31.267815] systemd[1]: Started Nix Daemon.4442worker2 # [ 31.466217] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4443worker2 # [ 31.503033] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 73 ms (attempt 1/5)4444worker2 # [ 31.578635] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 42 ms (attempt 2/5)4445worker2 # [ 31.623031] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 117 ms (attempt 3/5)4446worker2 # [ 31.742525] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 482 ms (attempt 4/5)4447worker2 # [ 32.230627] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4448worker1 # [ 32.242035] nix-grpc-daemon[726]: ts=2026-09-20T08:03:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:363164449worker1 # [ 32.249541] systemd[1]: Started Nix Daemon.4450worker1 # [ 32.456327] nix-daemon[845]: accepted connection from pid 726, user nix-grpc-daemon (trusted)4451worker1 # [ 32.485575] nix-grpc-daemon[726]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 91 ms (attempt 1/5)4452worker1 # [ 32.579190] nix-grpc-daemon[726]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 2/5)4453worker1 # [ 32.583510] nix-grpc-daemon[726]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 274 ms (attempt 3/5)4454worker1 # [ 32.860717] nix-grpc-daemon[726]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 518 ms (attempt 4/5)4455worker1 # [ 33.388198] nix-grpc-daemon[726]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4456worker1 # [ 33.402158] nix-grpc-daemon[726]: ts=2026-09-20T08:03:37Z level=debug event=path_info_miss path=ijm1776g0x4za8fwxfblr76ijh2zrxxx-nixos-system-client-test error="error: path '/nix/store/ijm1776g0x4za8fwxfblr76ijh2zrxxx-nixos-system-client-test' is required, but there is no substituter that can build it"4457worker1 # [ 33.411895] nix-grpc-daemon[726]: ts=2026-09-20T08:03:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:363164458worker1 # [ 33.420637] nix-grpc-daemon[726]: ts=2026-09-20T08:03:37Z level=debug event=path_info_miss path=ijm1776g0x4za8fwxfblr76ijh2zrxxx-nixos-system-client-test error="error: path '/nix/store/ijm1776g0x4za8fwxfblr76ijh2zrxxx-nixos-system-client-test' is required, but there is no substituter that can build it"4459client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4460client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.07 seconds)4461client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4462client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4463worker1 # [ 33.742193] nix-grpc-daemon[726]: ts=2026-09-20T08:03:37Z level=info event=oidc_jwks provider=mock keys=14464worker1 # [ 33.745930] nix-grpc-daemon[726]: ts=2026-09-20T08:03:37Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:363164465worker1 # [ 33.765865] nix-grpc-daemon[726]: ts=2026-09-20T08:03:37Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:363164466worker1 # [ 33.775827] nix-grpc-daemon[726]: ts=2026-09-20T08:03:37Z level=debug event=path_info_miss path=ijm1776g0x4za8fwxfblr76ijh2zrxxx-nixos-system-client-test error="error: path '/nix/store/ijm1776g0x4za8fwxfblr76ijh2zrxxx-nixos-system-client-test' is required, but there is no substituter that can build it"4467worker1 # [ 33.785499] nix-grpc-daemon[726]: ts=2026-09-20T08:03:37Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:363164468worker1 # [ 33.791429] nix-grpc-daemon[726]: ts=2026-09-20T08:03:37Z level=debug event=path_info_miss path=ijm1776g0x4za8fwxfblr76ijh2zrxxx-nixos-system-client-test error="error: path '/nix/store/ijm1776g0x4za8fwxfblr76ijh2zrxxx-nixos-system-client-test' is required, but there is no substituter that can build it"4469client: must succeed: rm -r /var/lib/nix-grpc-store4470client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.02 seconds)4471worker2 # [ 34.002853] nix-grpc-daemon[728]: ts=2026-09-20T08:03:38Z level=info event=denied method=QueryMissing cn=- role=none4472worker2 # [ 34.209092] nix-grpc-daemon[728]: ts=2026-09-20T08:03:38Z level=info event=denied method=QueryMissing cn=stranger role=none4473(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.24 seconds)4474subtest: DAG build is scheduled across workers and lands in the cache4475client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24476worker2 # [ 34.412200] nix-grpc-daemon[728]: ts=2026-09-20T08:03:38Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:462344477client # don't know how to build these paths:4478client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4479worker2 # [ 34.435491] nix-grpc-daemon[728]: ts=2026-09-20T08:03:38Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04480worker2 # [ 34.438404] nix-grpc-daemon[728]: ts=2026-09-20T08:03:38Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14481worker2 # [ 34.482809] nix-grpc-daemon[728]: ts=2026-09-20T08:03:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462344482worker2 # [ 34.501665] nix-grpc-daemon[728]: ts=2026-09-20T08:03:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462344483client # copying 1 paths to 'lb:50051'...4484worker2 # [ 34.509909] nix-grpc-daemon[728]: ts=2026-09-20T08:03:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462344485client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4486worker2 # [ 34.528679] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4487worker2 # [ 34.542286] nix-grpc-daemon[728]: ts=2026-09-20T08:03:38Z level=info event=niks3_push_started pid=8824488worker2 # [ 34.911121] nix-daemon[870]: accepted connection from pid 895, user nix-grpc-daemon (trusted)4489worker2 # [ 34.931554] nix-daemon[870]: reaped child process 898, status = succeeded4490worker2 # [ 35.057433] nix-daemon[870]: accepted connection from pid 900, user nix-grpc-daemon (trusted)4491worker2 # [ 35.072582] nix-daemon[870]: reaped child process 903, status = succeeded4492lb # [ 35.114264] niks3-server[1047]: 2026/09/20 08:03:39 INFO Received uploads request method=POST path=/api/pending_closures4493worker2 # [ 35.110967] nix-grpc-daemon[882]: time=2026-09-20T08:03:39.294Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4494worker2 # [ 35.113991] nix-grpc-daemon[882]: time=2026-09-20T08:03:39.297Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4495lb # [ 35.196036] niks3-server[1047]: 2026/09/20 08:03:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4496lb # [ 35.197606] niks3-server[1047]: 2026/09/20 08:03:39 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4497lb # [ 35.216424] niks3-server[1047]: 2026/09/20 08:03:39 INFO Signed narinfos id=1 count=14498worker2 # [ 35.186434] nix-grpc-daemon[882]: time=2026-09-20T08:03:39.370Z level=INFO msg="Uploading 1 narinfos"4499lb # [ 35.232079] niks3-server[1047]: 2026/09/20 08:03:39 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4500lb # [ 35.237266] niks3-server[1047]: 2026/09/20 08:03:39 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4501lb # [ 35.244647] niks3-server[1047]: 2026/09/20 08:03:39 INFO Completed upload id=14502worker2 # [ 35.213079] nix-grpc-daemon[882]: time=2026-09-20T08:03:39.397Z level=INFO msg="Upload complete. (441ms)"4503lb # [ 35.247795] niks3-server[1047]: 2026/09/20 08:03:39 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4504worker2 # [ 35.215705] nix-grpc-daemon[728]: ts=2026-09-20T08:03:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=0 paths=1 nar_bytes_in=5044505worker2 # [ 35.219297] nix-grpc-daemon[728]: ts=2026-09-20T08:03:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462344506worker2 # [ 35.227123] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4507worker2 # [ 35.228564] nix-daemon[870]: reaped child process 880, status = succeeded4508client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4509client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4510worker2 # [ 35.234634] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4511lb # [ 36.016559] envoy[899]: conn peer=[2001:db8:1::1]:57584 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=22164512lb # [ 36.020420] envoy[899]: conn peer=[2001:db8:1::1]:47726 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=794513lb # [ 36.023869] envoy[899]: conn peer=[2001:db8:1::1]:47736 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=134514lb # [ 36.027327] envoy[899]: conn peer=[2001:db8:1::1]:47738 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=64515client # farm-a> LOG-farm-a-t14516worker2 # [ 36.250554] nix-daemon[870]: reaped child process 907, status = succeeded4517worker2 # [ 36.363285] nix-daemon[870]: accepted connection from pid 923, user nix-grpc-daemon (trusted)4518worker2 # [ 36.378426] nix-daemon[870]: reaped child process 926, status = succeeded4519lb # [ 36.417936] niks3-server[1047]: 2026/09/20 08:03:40 INFO Received uploads request method=POST path=/api/pending_closures4520worker2 # [ 36.393071] nix-grpc-daemon[882]: time=2026-09-20T08:03:40.577Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4521worker2 # [ 36.394647] nix-grpc-daemon[882]: time=2026-09-20T08:03:40.579Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4522lb # [ 36.456320] niks3-server[1047]: 2026/09/20 08:03:40 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4523lb # [ 36.460465] niks3-server[1047]: 2026/09/20 08:03:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4524lb # [ 36.464473] niks3-server[1047]: 2026/09/20 08:03:40 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4525worker2 # [ 36.433112] nix-grpc-daemon[882]: time=2026-09-20T08:03:40.617Z level=INFO msg="Uploading 1 narinfos"4526lb # [ 36.466254] niks3-server[1047]: 2026/09/20 08:03:40 INFO Signed narinfos id=2 count=14527lb # [ 36.478074] niks3-server[1047]: 2026/09/20 08:03:40 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4528lb # [ 36.485055] niks3-server[1047]: 2026/09/20 08:03:40 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4529lb # [ 36.489162] niks3-server[1047]: 2026/09/20 08:03:40 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4530lb # [ 36.493296] niks3-server[1047]: 2026/09/20 08:03:40 INFO Completed upload id=24531worker2 # [ 36.461484] nix-grpc-daemon[882]: time=2026-09-20T08:03:40.645Z level=INFO msg="Upload complete. (217ms)"4532worker2 # [ 36.465367] nix-grpc-daemon[728]: ts=2026-09-20T08:03:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14533worker2 # [ 36.477098] nix-daemon[870]: reaped child process 905, status = succeeded4534worker2 # [ 36.479622] nix-grpc-daemon[728]: ts=2026-09-20T08:03:40Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04535worker2 # [ 36.482177] nix-grpc-daemon[728]: ts=2026-09-20T08:03:40Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14536worker2 # [ 36.524234] nix-grpc-daemon[728]: ts=2026-09-20T08:03:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462344537worker2 # [ 36.533118] nix-grpc-daemon[728]: ts=2026-09-20T08:03:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462344538worker2 # [ 36.542148] nix-grpc-daemon[882]: time=2026-09-20T08:03:40.726Z level=INFO msg="All 1 paths already cached"4539client # copying 1 paths to 'lb:50051'...4540worker2 # [ 36.548043] nix-grpc-daemon[728]: ts=2026-09-20T08:03:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462344541client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4542worker2 # [ 36.566363] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4543worker2 # [ 36.700816] nix-daemon[870]: accepted connection from pid 932, user nix-grpc-daemon (trusted)4544worker2 # [ 36.715561] nix-daemon[870]: reaped child process 935, status = succeeded4545worker2 # [ 36.845470] nix-daemon[870]: accepted connection from pid 937, user nix-grpc-daemon (trusted)4546worker2 # [ 36.860336] nix-daemon[870]: reaped child process 940, status = succeeded4547lb # [ 36.902884] niks3-server[1047]: 2026/09/20 08:03:40 INFO Received uploads request method=POST path=/api/pending_closures4548worker2 # [ 36.880127] nix-grpc-daemon[882]: time=2026-09-20T08:03:41.064Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4549worker2 # [ 36.881819] nix-grpc-daemon[882]: time=2026-09-20T08:03:41.064Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4550lb # [ 36.926840] niks3-server[1047]: 2026/09/20 08:03:40 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4551lb # [ 36.935611] niks3-server[1047]: 2026/09/20 08:03:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4552lb # [ 36.938785] niks3-server[1047]: 2026/09/20 08:03:40 INFO Signed narinfos id=3 count=14553worker2 # [ 36.909166] nix-grpc-daemon[882]: time=2026-09-20T08:03:41.093Z level=INFO msg="Uploading 1 narinfos"4554lb # [ 36.943436] niks3-server[1047]: 2026/09/20 08:03:40 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4555lb # [ 36.953648] niks3-server[1047]: 2026/09/20 08:03:41 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4556lb # [ 36.957078] niks3-server[1047]: 2026/09/20 08:03:41 INFO Completed upload id=34557worker2 # [ 36.925261] nix-grpc-daemon[882]: time=2026-09-20T08:03:41.109Z level=INFO msg="Upload complete. (351ms)"4558lb # [ 36.959202] niks3-server[1047]: 2026/09/20 08:03:41 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4559worker2 # [ 36.927712] nix-grpc-daemon[728]: ts=2026-09-20T08:03:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=0 paths=1 nar_bytes_in=6244560worker2 # [ 36.931458] nix-grpc-daemon[728]: ts=2026-09-20T08:03:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462344561worker2 # [ 36.938324] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4562worker2 # [ 36.945163] nix-daemon[870]: reaped child process 930, status = succeeded4563client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4564client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4565worker2 # [ 36.951073] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4566client # farm-b> LOG-farm-b-t14567worker2 # [ 37.976862] nix-daemon[870]: reaped child process 944, status = succeeded4568worker2 # [ 38.108111] nix-daemon[870]: accepted connection from pid 959, user nix-grpc-daemon (trusted)4569worker2 # [ 38.122924] nix-daemon[870]: reaped child process 962, status = succeeded4570lb # [ 38.166611] niks3-server[1047]: 2026/09/20 08:03:42 INFO Received uploads request method=POST path=/api/pending_closures4571worker2 # [ 38.144279] nix-grpc-daemon[882]: time=2026-09-20T08:03:42.328Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4572worker2 # [ 38.146871] nix-grpc-daemon[882]: time=2026-09-20T08:03:42.330Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4573lb # [ 38.203238] niks3-server[1047]: 2026/09/20 08:03:42 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4574lb # [ 38.217141] niks3-server[1047]: 2026/09/20 08:03:42 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4575lb # [ 38.230304] niks3-server[1047]: 2026/09/20 08:03:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4576worker2 # [ 38.203288] nix-grpc-daemon[882]: time=2026-09-20T08:03:42.387Z level=INFO msg="Uploading 1 narinfos"4577lb # [ 38.236127] niks3-server[1047]: 2026/09/20 08:03:42 INFO Signed narinfos id=4 count=14578lb # [ 38.241856] niks3-server[1047]: 2026/09/20 08:03:42 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4579lb # [ 38.251207] niks3-server[1047]: 2026/09/20 08:03:42 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4580lb # [ 38.259115] niks3-server[1047]: 2026/09/20 08:03:42 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4581lb # [ 38.262929] niks3-server[1047]: 2026/09/20 08:03:42 INFO Completed upload id=44582worker2 # [ 38.231622] nix-grpc-daemon[882]: time=2026-09-20T08:03:42.415Z level=INFO msg="Upload complete. (270ms)"4583worker2 # [ 38.242604] nix-grpc-daemon[728]: ts=2026-09-20T08:03:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14584worker2 # [ 38.251403] nix-grpc-daemon[728]: ts=2026-09-20T08:03:42Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04585worker2 # [ 38.256343] nix-grpc-daemon[728]: ts=2026-09-20T08:03:42Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14586worker2 # [ 38.267802] nix-daemon[870]: reaped child process 942, status = succeeded4587worker2 # [ 38.294321] nix-grpc-daemon[728]: ts=2026-09-20T08:03:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462344588worker2 # [ 38.308833] nix-grpc-daemon[728]: ts=2026-09-20T08:03:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462344589worker2 # [ 38.324413] nix-grpc-daemon[882]: time=2026-09-20T08:03:42.508Z level=INFO msg="All 2 paths already cached"4590client # copying 1 paths to 'lb:50051'...4591client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4592worker2 # [ 38.331280] nix-grpc-daemon[728]: ts=2026-09-20T08:03:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462344593worker2 # [ 38.335811] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4594worker2 # [ 38.480828] nix-daemon[870]: accepted connection from pid 968, user nix-grpc-daemon (trusted)4595worker2 # [ 38.497189] nix-daemon[870]: reaped child process 971, status = succeeded4596worker2 # [ 38.632565] nix-daemon[870]: accepted connection from pid 973, user nix-grpc-daemon (trusted)4597worker2 # [ 38.647458] nix-daemon[870]: reaped child process 976, status = succeeded4598lb # [ 38.694391] niks3-server[1047]: 2026/09/20 08:03:42 INFO Received uploads request method=POST path=/api/pending_closures4599worker2 # [ 38.672398] nix-grpc-daemon[882]: time=2026-09-20T08:03:42.856Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4600worker2 # [ 38.674128] nix-grpc-daemon[882]: time=2026-09-20T08:03:42.858Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4601lb # [ 38.726118] niks3-server[1047]: 2026/09/20 08:03:42 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4602lb # [ 38.733124] niks3-server[1047]: 2026/09/20 08:03:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4603worker2 # [ 38.704241] nix-grpc-daemon[882]: time=2026-09-20T08:03:42.888Z level=INFO msg="Uploading 1 narinfos"4604lb # [ 38.736395] niks3-server[1047]: 2026/09/20 08:03:42 INFO Signed narinfos id=5 count=14605lb # [ 38.742406] niks3-server[1047]: 2026/09/20 08:03:42 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4606lb # [ 38.748650] niks3-server[1047]: 2026/09/20 08:03:42 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4607lb # [ 38.756223] niks3-server[1047]: 2026/09/20 08:03:42 INFO Completed upload id=54608worker2 # [ 38.724373] nix-grpc-daemon[882]: time=2026-09-20T08:03:42.908Z level=INFO msg="Upload complete. (379ms)"4609lb # [ 38.758157] niks3-server[1047]: 2026/09/20 08:03:42 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4610worker2 # [ 38.727081] nix-grpc-daemon[728]: ts=2026-09-20T08:03:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=0 paths=1 nar_bytes_in=7524611worker2 # [ 38.733591] nix-grpc-daemon[728]: ts=2026-09-20T08:03:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462344612worker2 # [ 38.738839] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4613worker2 # [ 38.741629] nix-daemon[870]: reaped child process 966, status = succeeded4614client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4615client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4616worker2 # [ 38.748218] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4617client # farm-top> LOG-farm-top-t14618worker2 # [ 40.183323] nix-daemon[870]: reaped child process 980, status = succeeded4619worker2 # [ 40.319267] nix-daemon[870]: accepted connection from pid 996, user nix-grpc-daemon (trusted)4620worker2 # [ 40.334907] nix-daemon[870]: reaped child process 999, status = succeeded4621lb # [ 40.377266] niks3-server[1047]: 2026/09/20 08:03:44 INFO Received uploads request method=POST path=/api/pending_closures4622worker2 # [ 40.352469] nix-grpc-daemon[882]: time=2026-09-20T08:03:44.536Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4623worker2 # [ 40.355340] nix-grpc-daemon[882]: time=2026-09-20T08:03:44.538Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4624lb # [ 40.407113] niks3-server[1047]: 2026/09/20 08:03:44 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4625lb # [ 40.412948] niks3-server[1047]: 2026/09/20 08:03:44 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4626lb # [ 40.421248] niks3-server[1047]: 2026/09/20 08:03:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4627lb # [ 40.425361] niks3-server[1047]: 2026/09/20 08:03:44 INFO Signed narinfos id=6 count=14628worker2 # [ 40.395586] nix-grpc-daemon[882]: time=2026-09-20T08:03:44.579Z level=INFO msg="Uploading 1 narinfos"4629lb # [ 40.436072] niks3-server[1047]: 2026/09/20 08:03:44 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4630lb # [ 40.440967] niks3-server[1047]: 2026/09/20 08:03:44 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4631lb # [ 40.457213] niks3-server[1047]: 2026/09/20 08:03:44 INFO Completed upload id=64632worker2 # [ 40.425635] nix-grpc-daemon[882]: time=2026-09-20T08:03:44.610Z level=INFO msg="Upload complete. (267ms)"4633worker2 # [ 40.430471] nix-grpc-daemon[728]: ts=2026-09-20T08:03:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14634lb # [ 40.464974] niks3-server[1047]: 2026/09/20 08:03:44 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4635worker2 # [ 40.440753] nix-daemon[870]: reaped child process 978, status = succeeded4636client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 6.24 seconds)4637client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4638client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.19 seconds)4639client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4640client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds)4641client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4642client # copying 3 paths...4643client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4644client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4645client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4646client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.28 seconds)4647(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.79 seconds)4648subtest: repeat is answered Cached by the scheduler without building4649worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4650worker1 # finding garbage collector roots...4651worker1 # deleting specified paths...4652worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4653worker1 # deleting unused links...4654worker1 # note: hard linking is currently saving 0.0 KiB4655worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.24 seconds)4656worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4657worker2 # finding garbage collector roots...4658worker2 # deleting specified paths...4659worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4660worker2 # deleting unused links...4661worker2 # note: hard linking is currently saving 0.0 KiB4662worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.23 seconds)4663client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24664client # don't know how to build these paths:4665client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4666worker1 # [ 41.674812] nix-grpc-daemon[726]: ts=2026-09-20T08:03:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:363164667worker2 # [ 41.706357] nix-grpc-daemon[728]: ts=2026-09-20T08:03:45Z level=debug event=want client=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=14668worker2 # [ 41.715188] nix-grpc-daemon[728]: ts=2026-09-20T08:03:45Z level=debug event=want client=2 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=14669worker2 # [ 41.723911] nix-grpc-daemon[728]: ts=2026-09-20T08:03:45Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14670client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 0.26 seconds)4671client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4672client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.18 seconds)4673lb: must succeed: curl -sf localhost:9901/clusters4674lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4675lb: must succeed: curl -sf localhost:9901/clusters4676lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4677worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4678worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.04 seconds)4679(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.14 seconds)4680subtest: two clients wanting the same drv build it once4681client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4682client # [ 42.186951] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4683client # Running as unit: dedup1.service; invocation ID: 6f5a2b2b2a8f425194bba10fd20fcd134684client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.04 seconds)4685client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4686client # [ 42.387144] nix[871]: don't know how to build these paths:4687worker2 # [ 42.389938] nix-grpc-daemon[728]: ts=2026-09-20T08:03:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:462344688client # [ 42.388113] nix[871]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4689worker2 # [ 42.396168] nix-grpc-daemon[728]: ts=2026-09-20T08:03:46Z level=debug event=want client=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04690worker2 # [ 42.398287] nix-grpc-daemon[728]: ts=2026-09-20T08:03:46Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14691worker1 # [ 42.384914] nix-grpc-daemon[726]: ts=2026-09-20T08:03:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363164692worker1 # [ 42.399315] nix-grpc-daemon[726]: ts=2026-09-20T08:03:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363164693client # [ 42.420112] nix[871]: copying 1 paths to 'lb:50051'...4694client # [ 42.421053] nix[871]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4695worker1 # [ 42.408740] nix-grpc-daemon[726]: ts=2026-09-20T08:03:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363164696worker1 # [ 42.421367] nix-daemon[845]: accepted connection from pid 726, user nix-grpc-daemon (trusted)4697worker1 # [ 42.440633] nix-grpc-daemon[726]: ts=2026-09-20T08:03:46Z level=info event=niks3_push_started pid=8714698worker1 # [ 42.903836] nix-daemon[845]: accepted connection from pid 882, user nix-grpc-daemon (trusted)4699worker1 # [ 42.921844] nix-daemon[845]: reaped child process 886, status = succeeded4700worker1 # [ 43.094146] nix-daemon[845]: accepted connection from pid 888, user nix-grpc-daemon (trusted)4701worker1 # [ 43.109550] nix-daemon[845]: reaped child process 891, status = succeeded4702lb # [ 43.167078] niks3-server[1047]: 2026/09/20 08:03:47 INFO Received uploads request method=POST path=/api/pending_closures4703worker1 # [ 43.128796] nix-grpc-daemon[871]: time=2026-09-20T08:03:47.163Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4704worker1 # [ 43.131189] nix-grpc-daemon[871]: time=2026-09-20T08:03:47.166Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4705lb # [ 43.203273] niks3-server[1047]: 2026/09/20 08:03:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4706lb # [ 43.206178] niks3-server[1047]: 2026/09/20 08:03:47 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4707worker1 # [ 43.161894] nix-grpc-daemon[871]: time=2026-09-20T08:03:47.198Z level=INFO msg="Uploading 1 narinfos"4708lb # [ 43.210642] niks3-server[1047]: 2026/09/20 08:03:47 INFO Signed narinfos id=7 count=14709lb # [ 43.215262] niks3-server[1047]: 2026/09/20 08:03:47 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4710lb # [ 43.223078] niks3-server[1047]: 2026/09/20 08:03:47 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4711lb # [ 43.228257] niks3-server[1047]: 2026/09/20 08:03:47 INFO Completed upload id=74712worker1 # [ 43.180530] nix-grpc-daemon[871]: time=2026-09-20T08:03:47.216Z level=INFO msg="Upload complete. (451ms)"4713lb # [ 43.231114] niks3-server[1047]: 2026/09/20 08:03:47 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4714worker1 # [ 43.183259] nix-grpc-daemon[726]: ts=2026-09-20T08:03:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36316 duration_s=0 paths=1 nar_bytes_in=4324715worker1 # [ 43.189478] nix-grpc-daemon[726]: ts=2026-09-20T08:03:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363164716worker1 # [ 43.195112] nix-daemon[845]: accepted connection from pid 726, user nix-grpc-daemon (trusted)4717worker1 # [ 43.197852] nix-daemon[845]: reaped child process 869, status = succeeded4718client # [ 43.215718] nix[871]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4719worker1 # [ 43.203929] nix-daemon[845]: accepted connection from pid 726, user nix-grpc-daemon (trusted)4720client # [ 43.251993] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4721client # Running as unit: dedup2.service; invocation ID: faa1f51f99c14e2a9a825f24b7506bd54722client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.07 seconds)4723client # [ 43.500514] nix[888]: don't know how to build these paths:4724worker2 # [ 43.502802] nix-grpc-daemon[728]: ts=2026-09-20T08:03:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:462344725client # [ 43.501377] nix[888]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4726worker2 # [ 43.515191] nix-grpc-daemon[728]: ts=2026-09-20T08:03:47Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04727worker1 # [ 43.501294] nix-grpc-daemon[726]: ts=2026-09-20T08:03:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363164728client # [ 43.517167] nix[888]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4729client: must succeed: sleep 24730lb # [ 46.016507] envoy[899]: conn peer=[2001:db8:1::1]:47746 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9368 tx=3758 ms=60674731lb # [ 46.018695] envoy[899]: conn peer=[2001:db8:1::1]:47760 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1158 tx=481 ms=474732client: (finished: must succeed: sleep 2, in 2.03 seconds)4733client: waiting for success: ! systemctl is-active dedup1 dedup24734worker1 # [ 46.624980] nix-daemon[845]: reaped child process 895, status = succeeded4735worker1 # [ 46.741534] nix-daemon[845]: accepted connection from pid 924, user nix-grpc-daemon (trusted)4736worker1 # [ 46.755215] nix-daemon[845]: reaped child process 927, status = succeeded4737lb # [ 46.817834] niks3-server[1047]: 2026/09/20 08:03:50 INFO Received uploads request method=POST path=/api/pending_closures4738worker1 # [ 46.776701] nix-grpc-daemon[871]: time=2026-09-20T08:03:50.812Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4739worker1 # [ 46.778541] nix-grpc-daemon[871]: time=2026-09-20T08:03:50.814Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4740lb # [ 46.854686] niks3-server[1047]: 2026/09/20 08:03:50 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4741lb # [ 46.864796] niks3-server[1047]: 2026/09/20 08:03:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4742lb # [ 46.867706] niks3-server[1047]: 2026/09/20 08:03:50 INFO Signed narinfos id=8 count=14743worker1 # [ 46.820118] nix-grpc-daemon[871]: time=2026-09-20T08:03:50.855Z level=INFO msg="Uploading 1 narinfos"4744lb # [ 46.873070] niks3-server[1047]: 2026/09/20 08:03:50 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4745lb # [ 46.876148] niks3-server[1047]: 2026/09/20 08:03:50 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4746lb # [ 46.883488] niks3-server[1047]: 2026/09/20 08:03:50 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4747lb # [ 46.887991] niks3-server[1047]: 2026/09/20 08:03:50 INFO Completed upload id=84748worker1 # [ 46.842270] nix-grpc-daemon[871]: time=2026-09-20T08:03:50.878Z level=INFO msg="Upload complete. (225ms)"4749lb # [ 46.890860] niks3-server[1047]: 2026/09/20 08:03:50 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4750worker1 # [ 46.846555] nix-grpc-daemon[726]: ts=2026-09-20T08:03:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36316 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14751worker1 # [ 46.850201] nix-grpc-daemon[726]: ts=2026-09-20T08:03:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36316 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14752worker1 # [ 46.856714] nix-daemon[845]: reaped child process 893, status = succeeded4753client # [ 46.889357] systemd[1]: dedup1.service: Deactivated successfully.4754client # [ 46.891125] systemd[1]: dedup1.service: Consumed 111ms CPU time over 4.703s wall clock time, 37.3M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.4755client # [ 46.894242] systemd[1]: dedup2.service: Deactivated successfully.4756client # [ 46.895850] systemd[1]: dedup2.service: Consumed 133ms CPU time over 3.643s wall clock time, 31.2M memory peak, 7.5K incoming IP traffic, 6.5K outgoing IP traffic.4757client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.07 seconds)4758client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4759client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4760worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4761worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4762worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4763worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4764worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4765worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.04 seconds)4766worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4767worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.04 seconds)4768(finished: subtest: two clients wanting the same drv build it once, in 5.72 seconds)4769subtest: build hook: nix-daemon with builders = grpc://lb4770client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log4771client # [ 48.039802] systemd[1]: Started Nix Daemon.4772client # [ 48.232987] nix-daemon[930]: accepted connection from pid 927, user root (trusted)4773worker1 # [ 48.421222] nix-grpc-daemon[726]: ts=2026-09-20T08:03:52Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:363164774worker2 # [ 48.442888] nix-grpc-daemon[728]: ts=2026-09-20T08:03:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462344775worker2 # [ 48.452675] nix-grpc-daemon[728]: ts=2026-09-20T08:03:52Z level=debug event=want client=5 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04776worker2 # [ 48.455082] nix-grpc-daemon[728]: ts=2026-09-20T08:03:52Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14777worker2 # [ 48.496311] nix-grpc-daemon[728]: ts=2026-09-20T08:03:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462344778worker2 # [ 48.503509] nix-grpc-daemon[728]: ts=2026-09-20T08:03:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462344779worker2 # [ 48.509448] nix-grpc-daemon[728]: ts=2026-09-20T08:03:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462344780worker2 # [ 48.519085] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4781worker2 # [ 48.670218] nix-daemon[870]: accepted connection from pid 1057, user nix-grpc-daemon (trusted)4782worker2 # [ 48.686714] nix-daemon[870]: reaped child process 1060, status = succeeded4783worker2 # [ 48.814100] nix-daemon[870]: accepted connection from pid 1062, user nix-grpc-daemon (trusted)4784worker2 # [ 48.827959] nix-daemon[870]: reaped child process 1065, status = succeeded4785lb # [ 48.872147] niks3-server[1047]: 2026/09/20 08:03:52 INFO Received uploads request method=POST path=/api/pending_closures4786worker2 # [ 48.848249] nix-grpc-daemon[882]: time=2026-09-20T08:03:53.032Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4787worker2 # [ 48.850316] nix-grpc-daemon[882]: time=2026-09-20T08:03:53.034Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4788lb # [ 48.902462] niks3-server[1047]: 2026/09/20 08:03:52 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4789lb # [ 48.914359] niks3-server[1047]: 2026/09/20 08:03:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4790lb # [ 48.917475] niks3-server[1047]: 2026/09/20 08:03:52 INFO Signed narinfos id=9 count=14791worker2 # [ 48.885856] nix-grpc-daemon[882]: time=2026-09-20T08:03:53.070Z level=INFO msg="Uploading 1 narinfos"4792lb # [ 48.921821] niks3-server[1047]: 2026/09/20 08:03:52 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4793lb # [ 48.926983] niks3-server[1047]: 2026/09/20 08:03:52 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4794lb # [ 48.932437] niks3-server[1047]: 2026/09/20 08:03:52 INFO Completed upload id=94795worker2 # [ 48.902300] nix-grpc-daemon[882]: time=2026-09-20T08:03:53.086Z level=INFO msg="Upload complete. (378ms)"4796lb # [ 48.934409] niks3-server[1047]: 2026/09/20 08:03:52 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4797worker2 # [ 48.905094] nix-grpc-daemon[728]: ts=2026-09-20T08:03:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=0 paths=1 nar_bytes_in=5124798worker2 # [ 48.908269] nix-grpc-daemon[728]: ts=2026-09-20T08:03:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462344799worker2 # [ 48.915847] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4800worker2 # [ 48.926269] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4801worker2 # [ 48.929277] nix-daemon[870]: reaped child process 1055, status = succeeded4802worker2 # [ 49.944865] nix-daemon[870]: reaped child process 1069, status = succeeded4803worker2 # [ 50.063102] nix-daemon[870]: accepted connection from pid 1084, user nix-grpc-daemon (trusted)4804worker2 # [ 50.078291] nix-daemon[870]: reaped child process 1087, status = succeeded4805lb # [ 50.117657] niks3-server[1047]: 2026/09/20 08:03:54 INFO Received uploads request method=POST path=/api/pending_closures4806worker2 # [ 50.090898] nix-grpc-daemon[882]: time=2026-09-20T08:03:54.275Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4807worker2 # [ 50.095239] nix-grpc-daemon[882]: time=2026-09-20T08:03:54.276Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4808lb # [ 50.143744] niks3-server[1047]: 2026/09/20 08:03:54 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4809lb # [ 50.146394] niks3-server[1047]: 2026/09/20 08:03:54 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4810lb # [ 50.151066] niks3-server[1047]: 2026/09/20 08:03:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4811lb # [ 50.154107] niks3-server[1047]: 2026/09/20 08:03:54 INFO Signed narinfos id=10 count=14812worker2 # [ 50.122428] nix-grpc-daemon[882]: time=2026-09-20T08:03:54.306Z level=INFO msg="Uploading 1 narinfos"4813lb # [ 50.157841] niks3-server[1047]: 2026/09/20 08:03:54 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4814lb # [ 50.162062] niks3-server[1047]: 2026/09/20 08:03:54 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4815lb # [ 50.174235] niks3-server[1047]: 2026/09/20 08:03:54 INFO Completed upload id=104816worker2 # [ 50.142243] nix-grpc-daemon[882]: time=2026-09-20T08:03:54.326Z level=INFO msg="Upload complete. (207ms)"4817worker2 # [ 50.145473] nix-grpc-daemon[728]: ts=2026-09-20T08:03:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=5 outputs=14818lb # [ 50.182746] niks3-server[1047]: 2026/09/20 08:03:54 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4819worker2 # [ 50.153541] nix-daemon[870]: reaped child process 1067, status = succeeded4820worker1 # [ 50.135526] nix-grpc-daemon[726]: ts=2026-09-20T08:03:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:363164821worker1 # [ 50.148352] nix-grpc-daemon[726]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4822worker2 # [ 50.198458] nix-grpc-daemon[728]: ts=2026-09-20T08:03:54Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:462344823worker2 # [ 50.201608] nix-grpc-daemon[728]: ts=2026-09-20T08:03:54Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=0 paths=1 nar_bytes_out=1284824worker1 # [ 50.398483] nix-grpc-daemon[726]: ts=2026-09-20T08:03:54Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:363164825worker2 # [ 50.420593] nix-grpc-daemon[728]: ts=2026-09-20T08:03:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462344826worker2 # [ 50.426227] nix-grpc-daemon[882]: time=2026-09-20T08:03:54.610Z level=INFO msg="All 1 paths already cached"4827worker2 # [ 50.436344] nix-grpc-daemon[728]: ts=2026-09-20T08:03:54Z level=debug event=want client=6 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04828worker2 # [ 50.438813] nix-grpc-daemon[728]: ts=2026-09-20T08:03:54Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=14829worker2 # [ 50.441832] nix-grpc-daemon[728]: ts=2026-09-20T08:03:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462344830worker2 # [ 50.448347] nix-grpc-daemon[728]: ts=2026-09-20T08:03:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462344831worker2 # [ 50.454934] nix-grpc-daemon[882]: time=2026-09-20T08:03:54.639Z level=INFO msg="All 1 paths already cached"4832worker2 # [ 50.459231] nix-grpc-daemon[728]: ts=2026-09-20T08:03:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462344833worker2 # [ 50.467088] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4834worker2 # [ 50.590111] nix-daemon[870]: accepted connection from pid 1093, user nix-grpc-daemon (trusted)4835worker2 # [ 50.605349] nix-daemon[870]: reaped child process 1096, status = succeeded4836worker2 # [ 50.713124] nix-daemon[870]: accepted connection from pid 1098, user nix-grpc-daemon (trusted)4837worker2 # [ 50.727182] nix-daemon[870]: reaped child process 1101, status = succeeded4838lb # [ 50.766157] niks3-server[1047]: 2026/09/20 08:03:54 INFO Received uploads request method=POST path=/api/pending_closures4839worker2 # [ 50.760529] nix-grpc-daemon[882]: time=2026-09-20T08:03:54.944Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4840worker2 # [ 50.762526] nix-grpc-daemon[882]: time=2026-09-20T08:03:54.946Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4841lb # [ 50.804951] niks3-server[1047]: 2026/09/20 08:03:54 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4842lb # [ 50.808951] niks3-server[1047]: 2026/09/20 08:03:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4843lb # [ 50.811853] niks3-server[1047]: 2026/09/20 08:03:54 INFO Signed narinfos id=11 count=14844worker2 # [ 50.780402] nix-grpc-daemon[882]: time=2026-09-20T08:03:54.964Z level=INFO msg="Uploading 1 narinfos"4845lb # [ 50.815643] niks3-server[1047]: 2026/09/20 08:03:54 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4846lb # [ 50.820250] niks3-server[1047]: 2026/09/20 08:03:54 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4847lb # [ 50.824648] niks3-server[1047]: 2026/09/20 08:03:54 INFO Completed upload id=114848worker2 # [ 50.792668] nix-grpc-daemon[882]: time=2026-09-20T08:03:54.977Z level=INFO msg="Upload complete. (320ms)"4849lb # [ 50.826345] niks3-server[1047]: 2026/09/20 08:03:54 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4850worker2 # [ 50.796098] nix-grpc-daemon[728]: ts=2026-09-20T08:03:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=0 paths=1 nar_bytes_in=6244851worker2 # [ 50.800127] nix-grpc-daemon[728]: ts=2026-09-20T08:03:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462344852worker2 # [ 50.806991] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4853worker2 # [ 50.809450] nix-daemon[870]: reaped child process 1091, status = succeeded4854worker2 # [ 50.816840] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4855worker2 # [ 52.232804] nix-daemon[870]: reaped child process 1105, status = succeeded4856worker2 # [ 52.356626] nix-daemon[870]: accepted connection from pid 1120, user nix-grpc-daemon (trusted)4857worker2 # [ 52.371442] nix-daemon[870]: reaped child process 1123, status = succeeded4858lb # [ 52.413171] niks3-server[1047]: 2026/09/20 08:03:56 INFO Received uploads request method=POST path=/api/pending_closures4859worker2 # [ 52.388125] nix-grpc-daemon[882]: time=2026-09-20T08:03:56.572Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4860worker2 # [ 52.390608] nix-grpc-daemon[882]: time=2026-09-20T08:03:56.574Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4861lb # [ 52.446454] niks3-server[1047]: 2026/09/20 08:03:56 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4862lb # [ 52.452317] niks3-server[1047]: 2026/09/20 08:03:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4863lb # [ 52.455784] niks3-server[1047]: 2026/09/20 08:03:56 INFO Signed narinfos id=12 count=14864worker2 # [ 52.425822] nix-grpc-daemon[882]: time=2026-09-20T08:03:56.610Z level=INFO msg="Uploading 1 narinfos"4865lb # [ 52.460997] niks3-server[1047]: 2026/09/20 08:03:56 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4866lb # [ 52.467571] niks3-server[1047]: 2026/09/20 08:03:56 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4867lb # [ 52.471900] niks3-server[1047]: 2026/09/20 08:03:56 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4868lb # [ 52.476176] niks3-server[1047]: 2026/09/20 08:03:56 INFO Completed upload id=124869worker2 # [ 52.444332] nix-grpc-daemon[882]: time=2026-09-20T08:03:56.628Z level=INFO msg="Upload complete. (221ms)"4870worker2 # [ 52.447428] nix-grpc-daemon[728]: ts=2026-09-20T08:03:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=6 outputs=14871lb # [ 52.480235] niks3-server[1047]: 2026/09/20 08:03:56 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4872worker2 # [ 52.454453] nix-grpc-daemon[728]: ts=2026-09-20T08:03:56Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:462344873worker2 # [ 52.457776] nix-daemon[870]: reaped child process 1103, status = succeeded4874worker2 # [ 52.471271] nix-grpc-daemon[728]: ts=2026-09-20T08:03:56Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:462344875worker2 # [ 52.473411] nix-grpc-daemon[728]: ts=2026-09-20T08:03:56Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=0 paths=1 nar_bytes_out=1764876worker2 # [ 52.730339] nix-grpc-daemon[728]: ts=2026-09-20T08:03:56Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:462344877worker2 # [ 52.736294] nix-grpc-daemon[728]: ts=2026-09-20T08:03:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462344878worker2 # [ 52.746333] nix-grpc-daemon[882]: time=2026-09-20T08:03:56.930Z level=INFO msg="All 2 paths already cached"4879worker2 # [ 52.758332] nix-grpc-daemon[728]: ts=2026-09-20T08:03:56Z level=debug event=want client=7 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04880worker2 # [ 52.761047] nix-grpc-daemon[728]: ts=2026-09-20T08:03:56Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=14881worker2 # [ 52.764001] nix-grpc-daemon[728]: ts=2026-09-20T08:03:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462344882worker2 # [ 52.773279] nix-grpc-daemon[728]: ts=2026-09-20T08:03:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462344883worker2 # [ 52.780126] nix-grpc-daemon[882]: time=2026-09-20T08:03:56.964Z level=INFO msg="All 2 paths already cached"4884worker2 # [ 52.784509] nix-grpc-daemon[728]: ts=2026-09-20T08:03:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462344885worker2 # [ 52.790100] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4886worker2 # [ 52.925555] nix-daemon[870]: accepted connection from pid 1129, user nix-grpc-daemon (trusted)4887worker2 # [ 52.941157] nix-daemon[870]: reaped child process 1132, status = succeeded4888worker2 # [ 53.068135] nix-daemon[870]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)4889worker2 # [ 53.082805] nix-daemon[870]: reaped child process 1137, status = succeeded4890lb # [ 53.124179] niks3-server[1047]: 2026/09/20 08:03:57 INFO Received uploads request method=POST path=/api/pending_closures4891worker2 # [ 53.101104] nix-grpc-daemon[882]: time=2026-09-20T08:03:57.285Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4892worker2 # [ 53.102495] nix-grpc-daemon[882]: time=2026-09-20T08:03:57.285Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4893lb # [ 53.158956] niks3-server[1047]: 2026/09/20 08:03:57 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4894lb # [ 53.167812] niks3-server[1047]: 2026/09/20 08:03:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4895lb # [ 53.173119] niks3-server[1047]: 2026/09/20 08:03:57 INFO Signed narinfos id=13 count=14896worker2 # [ 53.144442] nix-grpc-daemon[882]: time=2026-09-20T08:03:57.328Z level=INFO msg="Uploading 1 narinfos"4897lb # [ 53.180656] niks3-server[1047]: 2026/09/20 08:03:57 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4898lb # [ 53.193301] niks3-server[1047]: 2026/09/20 08:03:57 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4899lb # [ 53.200560] niks3-server[1047]: 2026/09/20 08:03:57 INFO Completed upload id=134900worker2 # [ 53.168850] nix-grpc-daemon[882]: time=2026-09-20T08:03:57.353Z level=INFO msg="Upload complete. (371ms)"4901lb # [ 53.202222] niks3-server[1047]: 2026/09/20 08:03:57 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4902worker2 # [ 53.174179] nix-grpc-daemon[728]: ts=2026-09-20T08:03:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=0 paths=1 nar_bytes_in=7524903worker2 # [ 53.179857] nix-grpc-daemon[728]: ts=2026-09-20T08:03:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462344904worker2 # [ 53.191120] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4905worker2 # [ 53.196621] nix-daemon[870]: reaped child process 1127, status = succeeded4906worker2 # [ 53.202042] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)4907worker2 # [ 54.223943] nix-daemon[870]: reaped child process 1141, status = succeeded4908worker2 # [ 54.352116] nix-daemon[870]: accepted connection from pid 1156, user nix-grpc-daemon (trusted)4909worker2 # [ 54.367814] nix-daemon[870]: reaped child process 1159, status = succeeded4910lb # [ 54.409914] niks3-server[1047]: 2026/09/20 08:03:58 INFO Received uploads request method=POST path=/api/pending_closures4911worker2 # [ 54.395153] nix-grpc-daemon[882]: time=2026-09-20T08:03:58.579Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4912worker2 # [ 54.398247] nix-grpc-daemon[882]: time=2026-09-20T08:03:58.581Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4913lb # [ 54.449843] niks3-server[1047]: 2026/09/20 08:03:58 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4914lb # [ 54.468670] niks3-server[1047]: 2026/09/20 08:03:58 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4915lb # [ 54.475404] niks3-server[1047]: 2026/09/20 08:03:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4916worker2 # [ 54.448479] nix-grpc-daemon[882]: time=2026-09-20T08:03:58.632Z level=INFO msg="Uploading 1 narinfos"4917lb # [ 54.480073] niks3-server[1047]: 2026/09/20 08:03:58 INFO Signed narinfos id=14 count=14918lb # [ 54.484665] niks3-server[1047]: 2026/09/20 08:03:58 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4919lb # [ 54.493558] niks3-server[1047]: 2026/09/20 08:03:58 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4920lb # [ 54.511945] niks3-server[1047]: 2026/09/20 08:03:58 INFO Completed upload id=144921worker2 # [ 54.480562] nix-grpc-daemon[882]: time=2026-09-20T08:03:58.664Z level=INFO msg="Upload complete. (270ms)"4922worker2 # [ 54.484525] nix-grpc-daemon[728]: ts=2026-09-20T08:03:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=7 outputs=14923worker1 # [ 54.475503] nix-grpc-daemon[726]: ts=2026-09-20T08:03:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:363164924lb # [ 54.523187] niks3-server[1047]: 2026/09/20 08:03:58 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4925worker2 # [ 54.493730] nix-daemon[870]: reaped child process 1139, status = succeeded4926worker1 # [ 54.485854] nix-grpc-daemon[726]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4927worker1 # [ 54.492366] nix-grpc-daemon[726]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4928worker2 # [ 54.529526] nix-grpc-daemon[728]: ts=2026-09-20T08:03:58Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:462344929worker2 # [ 54.532327] nix-grpc-daemon[728]: ts=2026-09-20T08:03:58Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=0 paths=1 nar_bytes_out=2324930client # [ 54.598979] nix-daemon[930]: reaped child process 932, status = succeeded4931client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.73 seconds)4932client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4933client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)4934client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4935client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds)4936client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4937client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.02 seconds)4938(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.81 seconds)4939subtest: an input only one worker has still reaches the builder4940client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4941client # this derivation will be built:4942client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4943client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4944client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.43 seconds)4945client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4946client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.16 seconds)4947worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4948worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.15 seconds)4949worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4950worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4951client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24952client # [ 55.596678] nix-daemon[930]: accepted connection from pid 1013, user root (trusted)4953client # this derivation will be built:4954client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4955worker1 # [ 55.727754] nix-grpc-daemon[726]: ts=2026-09-20T08:03:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:363164956client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4957worker2 # [ 55.751182] nix-grpc-daemon[728]: ts=2026-09-20T08:03:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462344958client # copying 1 paths...4959client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...4960worker1 # [ 55.744138] nix-grpc-daemon[726]: ts=2026-09-20T08:03:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363164961worker1 # [ 55.749786] nix-daemon[845]: accepted connection from pid 726, user nix-grpc-daemon (trusted)4962worker1 # [ 55.861335] nix-daemon[845]: accepted connection from pid 950, user nix-grpc-daemon (trusted)4963worker1 # [ 55.874655] nix-daemon[845]: reaped child process 953, status = succeeded4964lb # [ 55.930866] niks3-server[1047]: 2026/09/20 08:03:59 INFO Received uploads request method=POST path=/api/pending_closures4965worker1 # [ 55.887442] nix-grpc-daemon[871]: time=2026-09-20T08:03:59.923Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4966worker1 # [ 55.889282] nix-grpc-daemon[871]: time=2026-09-20T08:03:59.925Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4967lb # [ 55.949684] niks3-server[1047]: 2026/09/20 08:03:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4968lb # [ 55.952053] niks3-server[1047]: 2026/09/20 08:04:00 INFO Signed narinfos id=15 count=14969worker1 # [ 55.903776] nix-grpc-daemon[871]: time=2026-09-20T08:03:59.940Z level=INFO msg="Uploading 1 narinfos"4970lb # [ 55.955671] niks3-server[1047]: 2026/09/20 08:04:00 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4971lb # [ 55.958988] niks3-server[1047]: 2026/09/20 08:04:00 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4972lb # [ 55.963256] niks3-server[1047]: 2026/09/20 08:04:00 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4973lb # [ 55.966698] niks3-server[1047]: 2026/09/20 08:04:00 INFO Completed upload id=154974worker1 # [ 55.918278] nix-grpc-daemon[871]: time=2026-09-20T08:03:59.954Z level=INFO msg="Upload complete. (163ms)"4975worker1 # [ 55.920260] nix-grpc-daemon[726]: ts=2026-09-20T08:03:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36316 duration_s=0 paths=1 nar_bytes_in=1204976lb # [ 55.969456] niks3-server[1047]: 2026/09/20 08:04:00 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4977worker1 # [ 55.926551] nix-daemon[845]: reaped child process 948, status = succeeded4978worker2 # [ 55.945161] nix-grpc-daemon[728]: ts=2026-09-20T08:04:00Z level=debug event=want client=8 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04979worker2 # [ 55.947790] nix-grpc-daemon[728]: ts=2026-09-20T08:04:00Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14980worker1 # [ 55.932751] nix-grpc-daemon[726]: ts=2026-09-20T08:03:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363164981worker1 # [ 55.938819] nix-grpc-daemon[726]: ts=2026-09-20T08:03:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363164982client # copying 2 paths to 'lb:50051'...4983client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4984worker1 # [ 55.948285] nix-grpc-daemon[726]: ts=2026-09-20T08:03:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363164985client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4986worker1 # [ 55.953498] nix-daemon[845]: accepted connection from pid 726, user nix-grpc-daemon (trusted)4987lb # [ 56.017457] envoy[899]: conn peer=[2001:db8:1::1]:47766 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2955 tx=1353 ms=44854988lb # [ 56.018989] envoy[899]: conn peer=[2001:db8:1::1]:57916 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1453 tx=1085 ms=33744989lb # [ 56.020440] envoy[899]: conn peer=[2001:db8:1::1]:57922 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3378 tx=1733 ms=17894990lb # [ 56.021909] envoy[899]: conn peer=[2001:db8:1::1]:57926 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=334991lb # [ 56.023278] envoy[899]: conn peer=[2001:db8:1::1]:57938 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3867 tx=1851 ms=21154992lb # [ 56.024665] envoy[899]: conn peer=[2001:db8:1::1]:57942 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=564993lb # [ 56.026070] envoy[899]: conn peer=[2001:db8:1::1]:57946 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4301 tx=2219 ms=18134994lb # [ 56.027546] envoy[899]: conn peer=[2001:db8:1::1]:51104 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=411 tx=410 ms=154995worker1 # [ 56.079753] nix-daemon[845]: accepted connection from pid 957, user nix-grpc-daemon (trusted)4996worker1 # [ 56.093958] nix-daemon[845]: reaped child process 960, status = succeeded4997worker1 # [ 56.221515] nix-daemon[845]: accepted connection from pid 963, user nix-grpc-daemon (trusted)4998worker1 # [ 56.234258] nix-daemon[845]: reaped child process 966, status = succeeded4999lb # [ 56.292278] niks3-server[1047]: 2026/09/20 08:04:00 INFO Received uploads request method=POST path=/api/pending_closures5000lb # [ 56.516112] niks3-server[1047]: 2026/09/20 08:04:00 INFO Received uploads request method=POST path=/api/pending_closures5001worker1 # [ 56.483365] nix-grpc-daemon[871]: time=2026-09-20T08:04:00.519Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5002worker1 # [ 56.484924] nix-grpc-daemon[871]: time=2026-09-20T08:04:00.521Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"5003worker1 # [ 56.487332] nix-grpc-daemon[871]: time=2026-09-20T08:04:00.523Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"5004lb # [ 56.567710] niks3-server[1047]: 2026/09/20 08:04:00 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst5005lb # [ 56.582544] niks3-server[1047]: 2026/09/20 08:04:00 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls5006lb # [ 56.590713] niks3-server[1047]: 2026/09/20 08:04:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign5007lb # [ 56.594845] niks3-server[1047]: 2026/09/20 08:04:00 INFO Signed narinfos id=16 count=15008lb # [ 56.598974] niks3-server[1047]: 2026/09/20 08:04:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign5009lb # [ 56.600482] niks3-server[1047]: 2026/09/20 08:04:00 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst5010lb # [ 56.604145] niks3-server[1047]: 2026/09/20 08:04:00 INFO Signed narinfos id=17 count=25011worker1 # [ 56.557828] nix-grpc-daemon[871]: time=2026-09-20T08:04:00.593Z level=INFO msg="Uploading 3 narinfos"5012lb # [ 56.611287] niks3-server[1047]: 2026/09/20 08:04:00 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5013lb # [ 56.626128] niks3-server[1047]: 2026/09/20 08:04:00 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete5014lb # [ 56.634252] niks3-server[1047]: 2026/09/20 08:04:00 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5015lb # [ 56.641514] niks3-server[1047]: 2026/09/20 08:04:00 INFO Completed upload id=165016lb # [ 56.643248] niks3-server[1047]: 2026/09/20 08:04:00 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete5017lb # [ 56.648580] niks3-server[1047]: 2026/09/20 08:04:00 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5018lb # [ 56.655113] niks3-server[1047]: 2026/09/20 08:04:00 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5019lb # [ 56.662244] niks3-server[1047]: 2026/09/20 08:04:00 INFO Completed upload id=175020worker1 # [ 56.615057] nix-grpc-daemon[871]: time=2026-09-20T08:04:00.651Z level=INFO msg="Upload complete. (653ms)"5021worker1 # [ 56.618091] nix-grpc-daemon[726]: ts=2026-09-20T08:04:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36316 duration_s=0 paths=2 nar_bytes_in=9765022worker1 # [ 56.620549] nix-grpc-daemon[726]: ts=2026-09-20T08:04:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363165023worker1 # [ 56.625713] nix-daemon[845]: accepted connection from pid 726, user nix-grpc-daemon (trusted)5024worker1 # [ 56.630486] nix-daemon[845]: reaped child process 955, status = succeeded5025client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5026worker1 # [ 56.636059] nix-daemon[845]: accepted connection from pid 726, user nix-grpc-daemon (trusted)5027client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5028worker1 # [ 57.654586] nix-daemon[845]: reaped child process 970, status = succeeded5029worker1 # [ 57.787169] nix-daemon[845]: accepted connection from pid 985, user nix-grpc-daemon (trusted)5030worker1 # [ 57.803356] nix-daemon[845]: reaped child process 988, status = succeeded5031lb # [ 57.861831] niks3-server[1047]: 2026/09/20 08:04:01 INFO Received uploads request method=POST path=/api/pending_closures5032worker1 # [ 57.819974] nix-grpc-daemon[871]: time=2026-09-20T08:04:01.856Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5033lb # [ 57.882772] niks3-server[1047]: 2026/09/20 08:04:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign5034lb # [ 57.887226] niks3-server[1047]: 2026/09/20 08:04:01 INFO Signed narinfos id=18 count=15035worker1 # [ 57.838977] nix-grpc-daemon[871]: time=2026-09-20T08:04:01.875Z level=INFO msg="Uploading 1 narinfos"5036lb # [ 57.891123] niks3-server[1047]: 2026/09/20 08:04:01 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5037lb # [ 57.895225] niks3-server[1047]: 2026/09/20 08:04:01 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5038lb # [ 57.902260] niks3-server[1047]: 2026/09/20 08:04:01 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete5039lb # [ 57.905326] niks3-server[1047]: 2026/09/20 08:04:01 INFO Completed upload id=185040worker1 # [ 57.858701] nix-grpc-daemon[871]: time=2026-09-20T08:04:01.895Z level=INFO msg="Upload complete. (215ms)"5041lb # [ 57.909335] niks3-server[1047]: 2026/09/20 08:04:01 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5042worker1 # [ 57.862365] nix-grpc-daemon[726]: ts=2026-09-20T08:04:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36316 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=8 outputs=15043worker1 # [ 57.869198] nix-daemon[845]: reaped child process 968, status = succeeded5044client # copying 1 paths...5045worker1 # [ 57.908539] nix-grpc-daemon[726]: ts=2026-09-20T08:04:01Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:363165046client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5047worker1 # [ 57.918649] nix-grpc-daemon[726]: ts=2026-09-20T08:04:01Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:363165048worker1 # [ 57.921440] nix-grpc-daemon[726]: ts=2026-09-20T08:04:01Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:36316 duration_s=0 paths=1 nar_bytes_out=1205049client # [ 58.040426] nix-daemon[930]: reaped child process 1016, status = succeeded5050client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.60 seconds)5051client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25052client # [ 58.207503] nix-daemon[930]: accepted connection from pid 1035, user root (trusted)5053client # this derivation will be built:5054client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5055worker1 # [ 58.347499] nix-grpc-daemon[726]: ts=2026-09-20T08:04:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:363165056worker2 # [ 58.369715] nix-grpc-daemon[728]: ts=2026-09-20T08:04:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462345057client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5058worker2 # [ 58.389722] nix-grpc-daemon[728]: ts=2026-09-20T08:04:02Z level=debug event=want client=9 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05059worker2 # [ 58.393163] nix-grpc-daemon[728]: ts=2026-09-20T08:04:02Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=15060worker2 # [ 58.396978] nix-grpc-daemon[728]: ts=2026-09-20T08:04:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462345061worker2 # [ 58.408083] nix-grpc-daemon[728]: ts=2026-09-20T08:04:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:462345062client # copying 1 paths to 'lb:50051'...5063client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5064worker2 # [ 58.423415] nix-grpc-daemon[728]: ts=2026-09-20T08:04:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:462345065worker2 # [ 58.430104] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)5066worker2 # [ 58.441575] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 74 ms (attempt 1/5)5067worker2 # [ 58.518976] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 2/5)5068worker2 # [ 58.608098] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 137 ms (attempt 3/5)5069worker2 # [ 58.749084] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 535 ms (attempt 4/5)5070worker2 # [ 59.288307] nix-grpc-daemon[728]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5071worker2 # [ 59.292505] nix-grpc-daemon[728]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5072worker2 # [ 59.488032] nix-daemon[870]: accepted connection from pid 1174, user nix-grpc-daemon (trusted)5073worker2 # [ 59.504437] nix-daemon[870]: reaped child process 1177, status = succeeded5074worker2 # [ 59.694199] nix-daemon[870]: accepted connection from pid 1179, user nix-grpc-daemon (trusted)5075worker2 # [ 59.717251] nix-daemon[870]: reaped child process 1182, status = succeeded5076lb # [ 59.758643] niks3-server[1047]: 2026/09/20 08:04:03 INFO Received uploads request method=POST path=/api/pending_closures5077worker2 # [ 59.734034] nix-grpc-daemon[882]: time=2026-09-20T08:04:03.917Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5078worker2 # [ 59.736089] nix-grpc-daemon[882]: time=2026-09-20T08:04:03.917Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5079lb # [ 59.780454] niks3-server[1047]: 2026/09/20 08:04:03 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5080lb # [ 59.787487] niks3-server[1047]: 2026/09/20 08:04:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5081lb # [ 59.790531] niks3-server[1047]: 2026/09/20 08:04:03 INFO Signed narinfos id=19 count=15082worker2 # [ 59.758876] nix-grpc-daemon[882]: time=2026-09-20T08:04:03.942Z level=INFO msg="Uploading 1 narinfos"5083lb # [ 59.796035] niks3-server[1047]: 2026/09/20 08:04:03 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5084lb # [ 59.803862] niks3-server[1047]: 2026/09/20 08:04:03 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5085lb # [ 59.809361] niks3-server[1047]: 2026/09/20 08:04:03 INFO Completed upload id=195086worker2 # [ 59.777878] nix-grpc-daemon[882]: time=2026-09-20T08:04:03.962Z level=INFO msg="Upload complete. (464ms)"5087lb # [ 59.812344] niks3-server[1047]: 2026/09/20 08:04:03 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5088worker2 # [ 59.781925] nix-grpc-daemon[728]: ts=2026-09-20T08:04:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=1 paths=1 nar_bytes_in=5605089worker2 # [ 59.787382] nix-grpc-daemon[728]: ts=2026-09-20T08:04:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:462345090worker2 # [ 59.796090] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)5091worker2 # [ 59.803677] nix-daemon[870]: reaped child process 1168, status = succeeded5092worker2 # [ 59.810815] nix-grpc-daemon[728]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...5093client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5094worker2 # [ 59.823682] nix-daemon[870]: accepted connection from pid 728, user nix-grpc-daemon (trusted)5095client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5096worker2 # [ 60.646344] nix-daemon[870]: reaped child process 1187, status = succeeded5097worker2 # [ 60.812741] nix-daemon[870]: accepted connection from pid 1202, user nix-grpc-daemon (trusted)5098worker2 # [ 60.834087] nix-daemon[870]: reaped child process 1205, status = succeeded5099lb # [ 60.876050] niks3-server[1047]: 2026/09/20 08:04:04 INFO Received uploads request method=POST path=/api/pending_closures5100worker2 # [ 60.849810] nix-grpc-daemon[882]: time=2026-09-20T08:04:05.033Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5101lb # [ 60.897553] niks3-server[1047]: 2026/09/20 08:04:04 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5102lb # [ 60.904594] niks3-server[1047]: 2026/09/20 08:04:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5103lb # [ 60.906938] niks3-server[1047]: 2026/09/20 08:04:04 INFO Signed narinfos id=20 count=15104worker2 # [ 60.877267] nix-grpc-daemon[882]: time=2026-09-20T08:04:05.061Z level=INFO msg="Uploading 1 narinfos"5105lb # [ 60.917803] niks3-server[1047]: 2026/09/20 08:04:04 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5106lb # [ 60.923360] niks3-server[1047]: 2026/09/20 08:04:04 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5107lb # [ 60.928494] niks3-server[1047]: 2026/09/20 08:04:04 INFO Completed upload id=205108worker2 # [ 60.897129] nix-grpc-daemon[882]: time=2026-09-20T08:04:05.081Z level=INFO msg="Upload complete. (262ms)"5109lb # [ 60.932402] niks3-server[1047]: 2026/09/20 08:04:04 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5110worker2 # [ 60.902430] nix-grpc-daemon[728]: ts=2026-09-20T08:04:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=9 outputs=15111worker2 # [ 60.912122] nix-daemon[870]: reaped child process 1184, status = succeeded5112client # copying 1 paths...5113worker2 # [ 60.947491] nix-grpc-daemon[728]: ts=2026-09-20T08:04:05Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:462345114client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5115worker2 # [ 60.966120] nix-grpc-daemon[728]: ts=2026-09-20T08:04:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:462345116worker2 # [ 60.968297] nix-grpc-daemon[728]: ts=2026-09-20T08:04:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=0 paths=1 nar_bytes_out=1205117client # [ 61.062758] nix-daemon[930]: reaped child process 1038, status = succeeded5118client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.02 seconds)5119client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25120client # [ 61.240345] nix-daemon[930]: accepted connection from pid 1057, user root (trusted)5121client # this derivation will be built:5122client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5123worker2 # [ 61.451886] nix-grpc-daemon[728]: ts=2026-09-20T08:04:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:462345124client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5125worker1 # [ 61.441825] nix-grpc-daemon[726]: ts=2026-09-20T08:04:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363165126worker1 # [ 61.673893] nix-grpc-daemon[871]: time=2026-09-20T08:04:05.709Z level=INFO msg="All 1 paths already cached"5127worker2 # [ 61.705408] nix-grpc-daemon[728]: ts=2026-09-20T08:04:05Z level=debug event=want client=10 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05128worker2 # [ 61.707575] nix-grpc-daemon[728]: ts=2026-09-20T08:04:05Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=15129worker1 # [ 61.734208] nix-grpc-daemon[726]: ts=2026-09-20T08:04:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363165130worker1 # [ 61.745494] nix-grpc-daemon[726]: ts=2026-09-20T08:04:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:363165131worker1 # [ 61.758357] nix-grpc-daemon[871]: time=2026-09-20T08:04:05.794Z level=INFO msg="All 1 paths already cached"5132client # copying 1 paths to 'lb:50051'...5133client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5134worker1 # [ 61.764816] nix-grpc-daemon[726]: ts=2026-09-20T08:04:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:363165135worker1 # [ 61.774345] nix-daemon[845]: accepted connection from pid 726, user nix-grpc-daemon (trusted)5136worker1 # [ 61.934234] nix-daemon[845]: accepted connection from pid 992, user nix-grpc-daemon (trusted)5137worker1 # [ 61.950950] nix-daemon[845]: reaped child process 995, status = succeeded5138worker1 # [ 62.127115] nix-daemon[845]: accepted connection from pid 997, user nix-grpc-daemon (trusted)5139worker1 # [ 62.141097] nix-daemon[845]: reaped child process 1000, status = succeeded5140lb # [ 62.204145] niks3-server[1047]: 2026/09/20 08:04:06 INFO Received uploads request method=POST path=/api/pending_closures5141worker1 # [ 62.162293] nix-grpc-daemon[871]: time=2026-09-20T08:04:06.198Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5142worker1 # [ 62.164590] nix-grpc-daemon[871]: time=2026-09-20T08:04:06.200Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5143lb # [ 62.226582] niks3-server[1047]: 2026/09/20 08:04:06 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5144lb # [ 62.234565] niks3-server[1047]: 2026/09/20 08:04:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5145lb # [ 62.237285] niks3-server[1047]: 2026/09/20 08:04:06 INFO Signed narinfos id=21 count=15146worker1 # [ 62.189244] nix-grpc-daemon[871]: time=2026-09-20T08:04:06.225Z level=INFO msg="Uploading 1 narinfos"5147lb # [ 62.243138] niks3-server[1047]: 2026/09/20 08:04:06 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5148lb # [ 62.248173] niks3-server[1047]: 2026/09/20 08:04:06 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5149lb # [ 62.253198] niks3-server[1047]: 2026/09/20 08:04:06 INFO Completed upload id=215150worker1 # [ 62.204857] nix-grpc-daemon[871]: time=2026-09-20T08:04:06.241Z level=INFO msg="Upload complete. (419ms)"5151lb # [ 62.257301] niks3-server[1047]: 2026/09/20 08:04:06 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5152worker1 # [ 62.209201] nix-grpc-daemon[726]: ts=2026-09-20T08:04:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36316 duration_s=0 paths=1 nar_bytes_in=5605153worker1 # [ 62.212883] nix-grpc-daemon[726]: ts=2026-09-20T08:04:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:363165154worker1 # [ 62.222223] nix-daemon[845]: accepted connection from pid 726, user nix-grpc-daemon (trusted)5155worker1 # [ 62.231145] nix-daemon[845]: reaped child process 990, status = succeeded5156client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5157client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5158worker1 # [ 62.238574] nix-daemon[845]: accepted connection from pid 726, user nix-grpc-daemon (trusted)5159worker1 # [ 63.257646] nix-daemon[845]: reaped child process 1004, status = succeeded5160worker1 # [ 63.403723] nix-daemon[845]: accepted connection from pid 1019, user nix-grpc-daemon (trusted)5161worker1 # [ 63.419679] nix-daemon[845]: reaped child process 1022, status = succeeded5162lb # [ 63.480760] niks3-server[1047]: 2026/09/20 08:04:07 INFO Received uploads request method=POST path=/api/pending_closures5163worker1 # [ 63.439045] nix-grpc-daemon[871]: time=2026-09-20T08:04:07.475Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5164lb # [ 63.508309] niks3-server[1047]: 2026/09/20 08:04:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5165lb # [ 63.510736] niks3-server[1047]: 2026/09/20 08:04:07 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5166lb # [ 63.513612] niks3-server[1047]: 2026/09/20 08:04:07 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5167worker1 # [ 63.468836] nix-grpc-daemon[871]: time=2026-09-20T08:04:07.505Z level=INFO msg="Uploading 1 narinfos"5168lb # [ 63.517233] niks3-server[1047]: 2026/09/20 08:04:07 INFO Signed narinfos id=22 count=15169lb # [ 63.528263] niks3-server[1047]: 2026/09/20 08:04:07 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5170lb # [ 63.533095] niks3-server[1047]: 2026/09/20 08:04:07 INFO Completed upload id=225171worker1 # [ 63.484726] nix-grpc-daemon[871]: time=2026-09-20T08:04:07.521Z level=INFO msg="Upload complete. (234ms)"5172worker1 # [ 63.488398] nix-grpc-daemon[726]: ts=2026-09-20T08:04:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36316 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=10 outputs=15173lb # [ 63.537931] niks3-server[1047]: 2026/09/20 08:04:07 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5174worker1 # [ 63.495961] nix-daemon[845]: reaped child process 1002, status = succeeded5175client # copying 1 paths...5176client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5177worker1 # [ 63.535137] nix-grpc-daemon[726]: ts=2026-09-20T08:04:07Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:363165178worker2 # [ 63.568947] nix-grpc-daemon[728]: ts=2026-09-20T08:04:07Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:462345179worker2 # [ 63.582804] nix-grpc-daemon[728]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5180worker2 # [ 63.597837] nix-grpc-daemon[728]: ts=2026-09-20T08:04:07Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46234 duration_s=0 paths=1 nar_bytes_out=1205181client # [ 63.704185] nix-daemon[930]: reaped child process 1060, status = succeeded5182client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.64 seconds)5183(finished: subtest: an input only one worker has still reaches the builder, in 9.02 seconds)5184subtest: upload whose reference the worker lacks is completed from the cache5185client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5186client # this derivation will be built:5187client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5188client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5189client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.38 seconds)5190client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5191client # this derivation will be built:5192client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5193client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5194client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.38 seconds)5195client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5196client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.16 seconds)5197worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5198worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.18 seconds)5199worker2 # [ 64.877757] systemd[1]: Stopping Nix worker-protocol over gRPC...5200worker2 # [ 65.272617] nix-grpc-daemon[728]: ts=2026-09-20T08:04:09Z level=info event=signal_exit5201worker2 # [ 65.533260] nix-grpc-daemon[728]: ts=2026-09-20T08:04:09Z level=info event=scheduler_yield5202worker2 # [ 65.538630] nix-grpc-daemon[728]: ts=2026-09-20T08:04:09Z level=info event=scheduler_restarting addr=lb:500515203worker1 # [ 65.520305] nix-grpc-daemon[726]: ts=2026-09-20T08:04:09Z level=info event=scheduler_restarting addr=lb:500515204worker2 # [ 65.541560] nix-grpc-daemon[728]: ts=2026-09-20T08:04:09Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:548965205lb # [ 65.572973] niks3-server[1047]: 2026/09/20 08:04:09 INFO lead: released remote=192.168.1.4:369885206worker2 # [ 65.543475] nix-grpc-daemon[728]: ts=2026-09-20T08:04:09Z level=info event=worker_gone addr=192.168.1.3:500515207worker2 # [ 65.545215] nix-grpc-daemon[728]: ts=2026-09-20T08:04:09Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:548965208worker2 # [ 65.547091] nix-grpc-daemon[728]: ts=2026-09-20T08:04:09Z level=info event=worker_gone addr=192.168.1.4:500515209worker1 # [ 65.719958] nix-grpc-daemon[726]: ts=2026-09-20T08:04:09Z level=info event=scheduler_connected addr=lb:500515210worker2 # [ 65.739327] nix-grpc-daemon[728]: ts=2026-09-20T08:04:09Z level=info event=scheduler_connected addr=lb:500515211worker1 # [ 65.724695] nix-grpc-daemon[726]: ts=2026-09-20T08:04:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5212worker2 # [ 65.748318] nix-grpc-daemon[728]: ts=2026-09-20T08:04:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5213worker1 # [ 65.925792] nix-grpc-daemon[726]: ts=2026-09-20T08:04:09Z level=info event=scheduler_connected addr=lb:500515214worker1 # [ 65.930050] nix-grpc-daemon[726]: ts=2026-09-20T08:04:09Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5215worker2 # [ 65.949546] nix-grpc-daemon[728]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500515216worker2 # [ 65.953078] nix-grpc-daemon[728]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5217lb # [ 66.018648] envoy[899]: conn peer=[2001:db8:1::1]:51106 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4201 tx=1748 ms=22475218lb # [ 66.021359] envoy[899]: conn peer=[2001:db8:1::1]:51116 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=535219lb # [ 66.023546] envoy[899]: conn peer=[2001:db8:1::1]:51120 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3710 tx=1806 ms=26575220lb # [ 66.025916] envoy[899]: conn peer=[2001:db8:1::1]:51130 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=525221lb # [ 66.028047] envoy[899]: conn peer=[2001:db8:1::1]:51144 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3716 tx=1819 ms=21995222lb # [ 66.030200] envoy[899]: conn peer=[2001:db8:1::1]:59598 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=845223worker1 # [ 66.130889] nix-grpc-daemon[726]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500515224worker1 # [ 66.134168] nix-grpc-daemon[726]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5225worker2 # [ 66.154265] nix-grpc-daemon[728]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500515226worker2 # [ 66.158173] nix-grpc-daemon[728]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5227worker1 # [ 66.334882] nix-grpc-daemon[726]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500515228worker1 # [ 66.338096] nix-grpc-daemon[726]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5229worker2 # [ 66.361081] nix-grpc-daemon[728]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500515230worker2 # [ 66.363527] nix-grpc-daemon[728]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5231worker2 # [ 66.536405] nix-grpc-daemon[728]: ts=2026-09-20T08:04:10Z level=info event=scheduler_restarting5232worker1 # [ 66.541794] nix-grpc-daemon[726]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500515233worker2 # [ 66.559325] nix-daemon[870]: reaped child process 872, status = succeeded5234worker1 # [ 66.545513] nix-grpc-daemon[726]: ts=2026-09-20T08:04:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5235worker2 # [ 66.575324] nix-grpc-daemon[728]: ts=2026-09-20T08:04:10Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5236worker1 # [ 66.746573] nix-grpc-daemon[726]: ts=2026-09-20T08:04:10Z level=info event=scheduler_connected addr=lb:500515237worker2 # [ 66.767105] nix-grpc-daemon[728]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5238worker2 # [ 66.769502] nix-grpc-daemon[728]: E0000 00:00:1789891450.950724 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5239worker2 # [ 67.386976] nix-grpc-daemon[728]: E0000 00:00:1789891451.570479 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5240worker2 # [ 67.390976] nix-grpc-daemon[728]: E0000 00:00:1789891451.575016 826 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5241worker1 # [ 67.893327] nix-grpc-daemon[726]: ts=2026-09-20T08:04:11Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5242worker2 # [ 67.923973] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5243worker2 # [ 67.926911] systemd[1]: Stopped Nix worker-protocol over gRPC.5244worker2 # [ 67.928183] systemd[1]: nix-grpc-daemon.service: Consumed 2.492s CPU time over 51.945s wall clock time, 57.9M memory peak, 85.3K incoming IP traffic, 199.4K outgoing IP traffic.5245worker2 # [ 67.935090] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5246worker2 # [ 67.937856] systemd[1]: Closed Nix worker-protocol over gRPC.5247worker2 # [ 67.940470] systemd[1]: nix-grpc-daemon.socket: Consumed 302us CPU time over 58.658s wall clock time, 256K memory peak, 115.1K incoming IP traffic, 88.9K outgoing IP traffic.5248lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5249lb: must succeed: curl -sf localhost:9901/clusters5250lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5251lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.06 seconds)5252client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25253worker1 # [ 68.093674] nix-grpc-daemon[726]: ts=2026-09-20T08:04:12Z level=info event=scheduler_connected addr=lb:500515254worker1 # [ 68.096795] nix-grpc-daemon[726]: ts=2026-09-20T08:04:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5255worker1 # [ 68.144148] nix-grpc-daemon[726]: ts=2026-09-20T08:04:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:363165256client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5257worker1 # [ 68.147293] nix-grpc-daemon[726]: ts=2026-09-20T08:04:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:363165258client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.18 seconds)5259worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5260worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5261worker2 # [ 68.239081] systemd[1]: Listening on Nix worker-protocol over gRPC.5262worker1 # [ 68.267089] systemd[1]: Stopping Nix worker-protocol over gRPC...5263worker1 # [ 68.297701] nix-grpc-daemon[726]: ts=2026-09-20T08:04:12Z level=info event=scheduler_connected addr=lb:500515264worker2 # [ 68.322031] systemd[1]: Starting Nix worker-protocol over gRPC...5265worker2 # [ 68.453233] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:12Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5266worker2 # [ 68.457252] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:12Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15267worker2 # [ 68.463265] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:12Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5268worker2 # [ 68.467590] systemd[1]: Started Nix worker-protocol over gRPC.5269worker2 # [ 68.478426] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:12Z level=info event=scheduler_take_over5270worker1 # [ 68.460854] nix-grpc-daemon[726]: ts=2026-09-20T08:04:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5271lb # [ 68.512418] niks3-server[1047]: 2026/09/20 08:04:12 INFO lead: acquired remote=192.168.1.4:435025272worker2 # [ 68.489333] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:12Z level=info event=scheduler_connected addr=lb:500515273worker2 # [ 68.492888] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5274worker1 # [ 68.661654] nix-grpc-daemon[726]: ts=2026-09-20T08:04:12Z level=info event=scheduler_connected addr=lb:500515275worker2 # [ 68.680709] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:12Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05276worker2 # [ 68.693658] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:12Z level=info event=scheduler_connected addr=lb:500515277worker2 # [ 68.696561] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5278worker2 # [ 68.897623] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:13Z level=info event=scheduler_connected addr=lb:500515279worker2 # [ 68.900352] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:13Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05280worker1 # [ 69.210837] nix-grpc-daemon[726]: ts=2026-09-20T08:04:13Z level=info event=signal_exit5281worker1 # [ 70.481917] nix-grpc-daemon[726]: ts=2026-09-20T08:04:14Z level=info event=scheduler_restarting5282worker2 # [ 70.506392] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:383605283worker2 # [ 70.508345] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:14Z level=info event=worker_gone addr=192.168.1.3:500515284worker1 # [ 70.496214] nix-grpc-daemon[726]: ts=2026-09-20T08:04:14Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5285worker1 # [ 70.511642] nix-daemon[845]: reaped child process 847, status = succeeded5286worker1 # [ 71.323320] nix-grpc-daemon[726]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5287worker1 # [ 71.325290] nix-grpc-daemon[726]: E0000 00:00:1789891455.359197 769 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5288worker1 # [ 71.328214] nix-grpc-daemon[726]: E0000 00:00:1789891455.359754 769 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5289worker1 # [ 71.869484] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5290worker1 # [ 71.872428] systemd[1]: Stopped Nix worker-protocol over gRPC.5291worker1 # [ 71.873340] systemd[1]: nix-grpc-daemon.service: Consumed 1.503s CPU time over 55.915s wall clock time, 47.7M memory peak, 56K incoming IP traffic, 103.3K outgoing IP traffic.5292worker1 # [ 71.877461] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5293worker1 # [ 71.879675] systemd[1]: Closed Nix worker-protocol over gRPC.5294worker1 # [ 71.881750] systemd[1]: nix-grpc-daemon.socket: Consumed 292us CPU time over 1min 2.442s wall clock time, 256K memory peak, 93.9K incoming IP traffic, 77.1K outgoing IP traffic.5295lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5296lb: must succeed: curl -sf localhost:9901/clusters5297lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5298lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.04 seconds)5299client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25300worker2 # [ 72.125474] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:383865301worker2 # [ 72.131856] nix-daemon[870]: accepted connection from pid 1229, user nix-grpc-daemon (trusted)5302worker2 # [ 72.141033] nix-grpc-daemon[1229]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 89 ms (attempt 1/5)5303worker2 # [ 72.232732] nix-grpc-daemon[1229]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 2/5)5304worker2 # [ 72.420335] nix-grpc-daemon[1229]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 10 ms (attempt 3/5)5305worker2 # [ 72.432897] nix-grpc-daemon[1229]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 502 ms (attempt 4/5)5306worker2 # [ 72.938041] nix-grpc-daemon[1229]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5307client # copying 2 paths...5308client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5309client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5310worker2 # [ 72.953077] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:383865311worker2 # [ 72.964183] nix-daemon[870]: accepted connection from pid 1229, user nix-grpc-daemon (trusted)5312worker2 # [ 73.015403] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:17Z level=info event=niks3_push_started pid=12855313worker2 # [ 73.304988] nix-daemon[870]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5314worker2 # [ 73.321055] nix-daemon[870]: reaped child process 1301, status = succeeded5315lb # [ 73.362552] niks3-server[1047]: 2026/09/20 08:04:17 INFO Received uploads request method=POST path=/api/pending_closures5316lb # [ 73.374137] niks3-server[1047]: 2026/09/20 08:04:17 INFO Received uploads request method=POST path=/api/pending_closures5317worker2 # [ 73.351336] nix-grpc-daemon[1285]: time=2026-09-20T08:04:17.535Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5318worker2 # [ 73.356212] nix-grpc-daemon[1285]: time=2026-09-20T08:04:17.537Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5319worker2 # [ 73.358398] nix-grpc-daemon[1285]: time=2026-09-20T08:04:17.537Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5320lb # [ 73.412400] niks3-server[1047]: 2026/09/20 08:04:17 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5321lb # [ 73.415464] niks3-server[1047]: 2026/09/20 08:04:17 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5322lb # [ 73.423102] niks3-server[1047]: 2026/09/20 08:04:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5323lb # [ 73.427337] niks3-server[1047]: 2026/09/20 08:04:17 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5324lb # [ 73.428832] niks3-server[1047]: 2026/09/20 08:04:17 INFO Signed narinfos id=24 count=25325lb # [ 73.431957] niks3-server[1047]: 2026/09/20 08:04:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5326lb # [ 73.434279] niks3-server[1047]: 2026/09/20 08:04:17 INFO Signed narinfos id=23 count=15327worker2 # [ 73.403119] nix-grpc-daemon[1285]: time=2026-09-20T08:04:17.586Z level=INFO msg="Uploading 3 narinfos"5328lb # [ 73.450906] niks3-server[1047]: 2026/09/20 08:04:17 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5329lb # [ 73.457070] niks3-server[1047]: 2026/09/20 08:04:17 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5330lb # [ 73.464833] niks3-server[1047]: 2026/09/20 08:04:17 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5331lb # [ 73.467076] niks3-server[1047]: 2026/09/20 08:04:17 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5332lb # [ 73.471910] niks3-server[1047]: 2026/09/20 08:04:17 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5333lb # [ 73.475422] niks3-server[1047]: 2026/09/20 08:04:17 INFO Completed upload id=235334lb # [ 73.476789] niks3-server[1047]: 2026/09/20 08:04:17 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5335lb # [ 73.480064] niks3-server[1047]: 2026/09/20 08:04:17 INFO Completed upload id=245336worker2 # [ 73.448423] nix-grpc-daemon[1285]: time=2026-09-20T08:04:17.632Z level=INFO msg="Upload complete. (275ms)"5337worker2 # [ 73.452375] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38386 duration_s=0 paths=2 nar_bytes_in=3125338worker2 # [ 73.458262] nix-daemon[870]: reaped child process 1283, status = succeeded5339client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.53 seconds)5340worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5341worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5342worker1 # [ 73.533116] systemd[1]: Listening on Nix worker-protocol over gRPC.5343worker1 # [ 73.537840] systemd[1]: Starting Nix worker-protocol over gRPC...5344worker1 # [ 73.687362] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5345worker1 # [ 73.691261] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15346worker1 # [ 73.697888] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5347worker1 # [ 73.702660] systemd[1]: Started Nix worker-protocol over gRPC.5348lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5349lb: must succeed: curl -sf localhost:9901/clusters5350worker1 # [ 73.721242] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:17Z level=info event=scheduler_connected addr=lb:500515351worker2 # [ 73.742622] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05352lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5353lb: must succeed: curl -sf localhost:9901/clusters5354lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5355lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.14 seconds)5356(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.15 seconds)5357subtest: scheduler down: the other node takes the lock and keeps it5358lb: must succeed: curl -sf localhost:9901/clusters5359lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5360lb: must succeed: curl -sf localhost:9901/clusters5361lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5362lb: must succeed: curl -sf localhost:9901/clusters5363lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5364lb: must succeed: curl -sf localhost:9901/clusters5365lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5366worker2 # [ 75.072443] systemd[1]: Stopping Nix worker-protocol over gRPC...5367worker2 # [ 75.470458] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:19Z level=info event=signal_exit5368worker2 # [ 75.482480] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:19Z level=info event=scheduler_yield5369worker1 # [ 75.468817] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:19Z level=info event=scheduler_restarting addr=lb:500515370lb # [ 75.517387] niks3-server[1047]: 2026/09/20 08:04:19 INFO lead: released remote=192.168.1.4:435025371worker2 # [ 75.488781] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:383605372worker2 # [ 75.490215] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:19Z level=info event=worker_gone addr=192.168.1.3:500515373worker2 # [ 75.491930] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:19Z level=info event=scheduler_restarting addr=lb:500515374worker2 # [ 75.493573] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:383605375worker2 # [ 75.494889] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:19Z level=info event=worker_gone addr=192.168.1.4:500515376worker1 # [ 75.669177] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:19Z level=info event=scheduler_connected addr=lb:500515377worker1 # [ 75.672539] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5378worker2 # [ 75.692699] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:19Z level=info event=scheduler_connected addr=lb:500515379worker2 # [ 75.695161] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5380worker1 # [ 75.873076] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:19Z level=info event=scheduler_connected addr=lb:500515381worker1 # [ 75.875192] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:19Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5382worker2 # [ 75.895721] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:20Z level=info event=scheduler_connected addr=lb:500515383worker2 # [ 75.899880] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5384lb # [ 76.018270] envoy[899]: conn peer=[2001:db8:1::4]:34384 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=15302 tx=3117 ms=502845385lb # [ 76.020058] envoy[899]: conn peer=[2001:db8:1::1]:59602 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=115386lb # [ 76.021512] envoy[899]: conn peer=[2001:db8:1::3]:43090 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=14924 tx=2866 ms=534255387lb # [ 76.022972] envoy[899]: conn peer=[2001:db8:1::1]:59610 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1006 tx=305 ms=13375388worker1 # [ 76.075982] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:20Z level=info event=scheduler_connected addr=lb:500515389worker2 # [ 76.100583] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:20Z level=info event=scheduler_connected addr=lb:500515390worker1 # [ 76.084152] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5391worker2 # [ 76.109416] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5392worker1 # [ 76.289289] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:20Z level=info event=scheduler_connected addr=lb:500515393worker1 # [ 76.291992] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5394worker2 # [ 76.311410] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:20Z level=info event=scheduler_connected addr=lb:500515395worker2 # [ 76.313740] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5396worker2 # [ 76.483897] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:20Z level=info event=scheduler_restarting5397worker2 # [ 76.498675] nix-daemon[870]: reaped child process 1278, status = succeeded5398worker1 # [ 76.494764] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:20Z level=info event=scheduler_connected addr=lb:500515399worker1 # [ 76.498619] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:20Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5400worker2 # [ 76.520188] nix-grpc-daemon[1229]: ts=2026-09-20T08:04:20Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5401worker1 # [ 76.699739] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:20Z level=info event=scheduler_connected addr=lb:500515402worker2 # [ 76.718048] nix-grpc-daemon[1229]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5403worker2 # [ 76.719990] nix-grpc-daemon[1229]: E0000 00:00:1789891460.902187 1272 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5404worker2 # [ 76.927299] nix-grpc-daemon[1229]: E0000 00:00:1789891461.111677 1272 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5405worker2 # [ 76.930242] nix-grpc-daemon[1229]: E0000 00:00:1789891461.114424 1272 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5406worker1 # [ 78.459331] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5407worker2 # [ 78.483324] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5408worker2 # [ 78.485551] systemd[1]: Stopped Nix worker-protocol over gRPC.5409worker2 # [ 78.486483] systemd[1]: nix-grpc-daemon.service: Consumed 340ms CPU time over 10.161s wall clock time, 30.6M memory peak, 17.5K incoming IP traffic, 22.9K outgoing IP traffic.5410worker2 # [ 78.493880] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5411worker2 # [ 78.497375] systemd[1]: Closed Nix worker-protocol over gRPC.5412worker2 # [ 78.500374] systemd[1]: nix-grpc-daemon.socket: Consumed 389us CPU time over 10.261s wall clock time, 256K memory peak, 27.5K incoming IP traffic, 20.8K outgoing IP traffic.5413worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5414worker1 # [ 78.659770] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:22Z level=info event=scheduler_connected addr=lb:500515415worker1 # [ 78.663078] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:22Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5416worker1 # [ 78.707576] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:22Z level=info event=scheduler_take_over5417lb # [ 78.756277] niks3-server[1047]: 2026/09/20 08:04:22 INFO lead: acquired remote=192.168.1.3:395265418worker1 # [ 78.863716] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:22Z level=info event=scheduler_connected addr=lb:500515419worker1 # [ 78.866634] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5420worker1 # [ 79.067632] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:23Z level=info event=scheduler_connected addr=lb:500515421worker1 # [ 79.072599] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:23Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05422worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 1.08 seconds)5423worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5424worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5425client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&25426worker1 # [ 79.811580] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:437365427worker1 # [ 79.823191] nix-daemon[845]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)5428client # don't know how to build these paths:5429client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5430worker1 # [ 79.846373] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:23Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05431worker1 # [ 79.852290] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:23Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15432worker1 # [ 79.894963] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437365433worker1 # [ 79.903342] nix-grpc-daemon[1045]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 12 ms (attempt 1/5)5434worker1 # [ 79.918470] nix-grpc-daemon[1045]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 156 ms (attempt 2/5)5435worker1 # [ 80.074879] nix-grpc-daemon[1045]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 360 ms (attempt 3/5)5436worker1 # [ 80.438182] nix-grpc-daemon[1045]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 481 ms (attempt 4/5)5437worker1 # [ 80.926097] nix-grpc-daemon[1045]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5438worker1 # [ 80.936816] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437365439client # copying 1 paths to 'lb:50051'...5440client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5441worker1 # [ 80.949701] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437365442worker1 # [ 80.957836] nix-daemon[845]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)5443worker1 # [ 80.975538] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:25Z level=info event=niks3_push_started pid=11205444worker1 # [ 81.284161] nix-daemon[845]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)5445worker1 # [ 81.296625] nix-daemon[845]: reaped child process 1136, status = succeeded5446worker1 # [ 81.439961] nix-daemon[845]: accepted connection from pid 1138, user nix-grpc-daemon (trusted)5447worker1 # [ 81.453107] nix-daemon[845]: reaped child process 1141, status = succeeded5448lb # [ 81.513577] niks3-server[1047]: 2026/09/20 08:04:25 INFO Received uploads request method=POST path=/api/pending_closures5449worker1 # [ 81.472350] nix-grpc-daemon[1120]: time=2026-09-20T08:04:25.508Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5450worker1 # [ 81.473817] nix-grpc-daemon[1120]: time=2026-09-20T08:04:25.508Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5451lb # [ 81.538067] niks3-server[1047]: 2026/09/20 08:04:25 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5452lb # [ 81.544421] niks3-server[1047]: 2026/09/20 08:04:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5453lb # [ 81.551086] niks3-server[1047]: 2026/09/20 08:04:25 INFO Signed narinfos id=25 count=15454worker1 # [ 81.505407] nix-grpc-daemon[1120]: time=2026-09-20T08:04:25.541Z level=INFO msg="Uploading 1 narinfos"5455lb # [ 81.560269] niks3-server[1047]: 2026/09/20 08:04:25 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5456lb # [ 81.563812] niks3-server[1047]: 2026/09/20 08:04:25 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5457lb # [ 81.567888] niks3-server[1047]: 2026/09/20 08:04:25 INFO Completed upload id=255458worker1 # [ 81.519522] nix-grpc-daemon[1120]: time=2026-09-20T08:04:25.556Z level=INFO msg="Upload complete. (377ms)"5459lb # [ 81.569921] niks3-server[1047]: 2026/09/20 08:04:25 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5460worker1 # [ 81.521738] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43736 duration_s=0 paths=1 nar_bytes_in=5205461worker1 # [ 81.526613] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437365462worker1 # [ 81.532578] nix-daemon[845]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)5463worker1 # [ 81.535027] nix-daemon[845]: reaped child process 1118, status = succeeded5464worker1 # [ 81.540494] nix-daemon[845]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)5465client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5466client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5467client # farm-a> LOG-farm-a-on-standby5468worker1 # [ 82.969280] nix-daemon[845]: reaped child process 1145, status = succeeded5469worker1 # [ 83.101696] nix-daemon[845]: accepted connection from pid 1160, user nix-grpc-daemon (trusted)5470worker1 # [ 83.118402] nix-daemon[845]: reaped child process 1163, status = succeeded5471lb # [ 83.176672] niks3-server[1047]: 2026/09/20 08:04:27 INFO Received uploads request method=POST path=/api/pending_closures5472worker1 # [ 83.133460] nix-grpc-daemon[1120]: time=2026-09-20T08:04:27.169Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5473worker1 # [ 83.137294] nix-grpc-daemon[1120]: time=2026-09-20T08:04:27.171Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5474lb # [ 83.201099] niks3-server[1047]: 2026/09/20 08:04:27 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5475lb # [ 83.205262] niks3-server[1047]: 2026/09/20 08:04:27 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5476lb # [ 83.208926] niks3-server[1047]: 2026/09/20 08:04:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5477lb # [ 83.210594] niks3-server[1047]: 2026/09/20 08:04:27 INFO Signed narinfos id=26 count=15478worker1 # [ 83.163893] nix-grpc-daemon[1120]: time=2026-09-20T08:04:27.199Z level=INFO msg="Uploading 1 narinfos"5479lb # [ 83.215282] niks3-server[1047]: 2026/09/20 08:04:27 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5480lb # [ 83.220702] niks3-server[1047]: 2026/09/20 08:04:27 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5481lb # [ 83.224608] niks3-server[1047]: 2026/09/20 08:04:27 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5482lb # [ 83.227621] niks3-server[1047]: 2026/09/20 08:04:27 INFO Completed upload id=265483worker1 # [ 83.179205] nix-grpc-daemon[1120]: time=2026-09-20T08:04:27.215Z level=INFO msg="Upload complete. (230ms)"5484worker1 # [ 83.183226] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43736 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15485worker1 # [ 83.195801] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:27Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05486worker1 # [ 83.198291] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:27Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15487worker1 # [ 83.200142] nix-daemon[845]: reaped child process 1143, status = succeeded5488worker1 # [ 83.240578] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437365489worker1 # [ 83.248431] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437365490worker1 # [ 83.258603] nix-grpc-daemon[1120]: time=2026-09-20T08:04:27.294Z level=INFO msg="All 1 paths already cached"5491client # copying 1 paths to 'lb:50051'...5492client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5493worker1 # [ 83.265529] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437365494worker1 # [ 83.272805] nix-daemon[845]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)5495worker1 # [ 83.434148] nix-daemon[845]: accepted connection from pid 1169, user nix-grpc-daemon (trusted)5496worker1 # [ 83.451568] nix-daemon[845]: reaped child process 1172, status = succeeded5497worker1 # [ 83.629117] nix-daemon[845]: accepted connection from pid 1174, user nix-grpc-daemon (trusted)5498worker1 # [ 83.643856] nix-daemon[845]: reaped child process 1177, status = succeeded5499lb # [ 83.707639] niks3-server[1047]: 2026/09/20 08:04:27 INFO Received uploads request method=POST path=/api/pending_closures5500worker1 # [ 83.664955] nix-grpc-daemon[1120]: time=2026-09-20T08:04:27.701Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5501worker1 # [ 83.668712] nix-grpc-daemon[1120]: time=2026-09-20T08:04:27.704Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5502lb # [ 83.731662] niks3-server[1047]: 2026/09/20 08:04:27 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5503lb # [ 83.734293] niks3-server[1047]: 2026/09/20 08:04:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5504lb # [ 83.737151] niks3-server[1047]: 2026/09/20 08:04:27 INFO Signed narinfos id=27 count=15505worker1 # [ 83.690354] nix-grpc-daemon[1120]: time=2026-09-20T08:04:27.726Z level=INFO msg="Uploading 1 narinfos"5506lb # [ 83.744067] niks3-server[1047]: 2026/09/20 08:04:27 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5507lb # [ 83.748356] niks3-server[1047]: 2026/09/20 08:04:27 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5508lb # [ 83.751931] niks3-server[1047]: 2026/09/20 08:04:27 INFO Completed upload id=275509worker1 # [ 83.704974] nix-grpc-daemon[1120]: time=2026-09-20T08:04:27.741Z level=INFO msg="Upload complete. (424ms)"5510lb # [ 83.753965] niks3-server[1047]: 2026/09/20 08:04:27 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5511worker1 # [ 83.708182] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43736 duration_s=0 paths=1 nar_bytes_in=6405512worker1 # [ 83.710918] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437365513worker1 # [ 83.716190] nix-daemon[845]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)5514worker1 # [ 83.725746] nix-daemon[845]: reaped child process 1167, status = succeeded5515worker1 # [ 83.729273] nix-daemon[845]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)5516client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5517client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5518client # farm-b> LOG-farm-b-on-standby5519worker1 # [ 84.746662] nix-daemon[845]: reaped child process 1181, status = succeeded5520worker1 # [ 84.905631] nix-daemon[845]: accepted connection from pid 1196, user nix-grpc-daemon (trusted)5521worker1 # [ 84.918177] nix-daemon[845]: reaped child process 1199, status = succeeded5522lb # [ 84.982173] niks3-server[1047]: 2026/09/20 08:04:29 INFO Received uploads request method=POST path=/api/pending_closures5523worker1 # [ 84.948324] nix-grpc-daemon[1120]: time=2026-09-20T08:04:28.984Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5524worker1 # [ 84.950572] nix-grpc-daemon[1120]: time=2026-09-20T08:04:28.986Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5525lb # [ 85.018331] niks3-server[1047]: 2026/09/20 08:04:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5526lb # [ 85.021692] niks3-server[1047]: 2026/09/20 08:04:29 INFO Signed narinfos id=28 count=15527worker1 # [ 84.973422] nix-grpc-daemon[1120]: time=2026-09-20T08:04:29.009Z level=INFO msg="Uploading 1 narinfos"5528lb # [ 85.034805] niks3-server[1047]: 2026/09/20 08:04:29 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5529lb # [ 85.036765] niks3-server[1047]: 2026/09/20 08:04:29 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5530worker1 # [ 84.994052] nix-grpc-daemon[1120]: time=2026-09-20T08:04:29.030Z level=INFO msg="Upload complete. (254ms)"5531lb # [ 85.043247] niks3-server[1047]: 2026/09/20 08:04:29 INFO Completed upload id=285532lb # [ 85.044596] niks3-server[1047]: 2026/09/20 08:04:29 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5533worker1 # [ 84.996648] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43736 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15534lb # [ 85.048335] niks3-server[1047]: 2026/09/20 08:04:29 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5535worker1 # [ 85.004710] nix-daemon[845]: reaped child process 1179, status = succeeded5536lb # [ 85.053102] niks3-server[1047]: 2026/09/20 08:04:29 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5537worker1 # [ 85.008350] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:29Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05538worker1 # [ 85.010307] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:29Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15539worker1 # [ 85.052397] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437365540worker1 # [ 85.059369] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437365541worker1 # [ 85.083495] nix-grpc-daemon[1120]: time=2026-09-20T08:04:29.119Z level=INFO msg="All 2 paths already cached"5542client # copying 1 paths to 'lb:50051'...5543client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5544worker1 # [ 85.090440] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437365545worker1 # [ 85.096994] nix-daemon[845]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)5546worker1 # [ 85.252368] nix-daemon[845]: accepted connection from pid 1205, user nix-grpc-daemon (trusted)5547worker1 # [ 85.265283] nix-daemon[845]: reaped child process 1208, status = succeeded5548worker1 # [ 85.407962] nix-daemon[845]: accepted connection from pid 1210, user nix-grpc-daemon (trusted)5549worker1 # [ 85.420639] nix-daemon[845]: reaped child process 1213, status = succeeded5550lb # [ 85.480969] niks3-server[1047]: 2026/09/20 08:04:29 INFO Received uploads request method=POST path=/api/pending_closures5551worker1 # [ 85.438742] nix-grpc-daemon[1120]: time=2026-09-20T08:04:29.475Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5552worker1 # [ 85.440701] nix-grpc-daemon[1120]: time=2026-09-20T08:04:29.476Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5553lb # [ 85.499823] niks3-server[1047]: 2026/09/20 08:04:29 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5554lb # [ 85.502990] niks3-server[1047]: 2026/09/20 08:04:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5555lb # [ 85.506247] niks3-server[1047]: 2026/09/20 08:04:29 INFO Signed narinfos id=29 count=15556worker1 # [ 85.457946] nix-grpc-daemon[1120]: time=2026-09-20T08:04:29.494Z level=INFO msg="Uploading 1 narinfos"5557lb # [ 85.509899] niks3-server[1047]: 2026/09/20 08:04:29 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5558lb # [ 85.514558] niks3-server[1047]: 2026/09/20 08:04:29 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5559lb # [ 85.518890] niks3-server[1047]: 2026/09/20 08:04:29 INFO Completed upload id=295560worker1 # [ 85.470207] nix-grpc-daemon[1120]: time=2026-09-20T08:04:29.506Z level=INFO msg="Upload complete. (361ms)"5561lb # [ 85.521076] niks3-server[1047]: 2026/09/20 08:04:29 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5562worker1 # [ 85.472168] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43736 duration_s=0 paths=1 nar_bytes_in=7685563worker1 # [ 85.475235] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437365564worker1 # [ 85.482635] nix-daemon[845]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)5565worker1 # [ 85.485472] nix-daemon[845]: reaped child process 1203, status = succeeded5566client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5567worker1 # [ 85.492363] nix-daemon[845]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)5568client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5569lb # [ 86.018889] envoy[899]: conn peer=[2001:db8:1::4]:57530 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1711 tx=441 ms=80375570client # farm-top> LOG-farm-top-on-standby5571worker1 # [ 86.705897] nix-daemon[845]: reaped child process 1217, status = succeeded5572worker1 # [ 86.848675] nix-daemon[845]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)5573worker1 # [ 86.861854] nix-daemon[845]: reaped child process 1235, status = succeeded5574lb # [ 86.926595] niks3-server[1047]: 2026/09/20 08:04:30 INFO Received uploads request method=POST path=/api/pending_closures5575worker1 # [ 86.885287] nix-grpc-daemon[1120]: time=2026-09-20T08:04:30.921Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5576worker1 # [ 86.888069] nix-grpc-daemon[1120]: time=2026-09-20T08:04:30.923Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5577lb # [ 86.951413] niks3-server[1047]: 2026/09/20 08:04:30 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5578lb # [ 86.957203] niks3-server[1047]: 2026/09/20 08:04:31 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5579lb # [ 86.964684] niks3-server[1047]: 2026/09/20 08:04:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5580lb # [ 86.967318] niks3-server[1047]: 2026/09/20 08:04:31 INFO Signed narinfos id=30 count=15581worker1 # [ 86.920819] nix-grpc-daemon[1120]: time=2026-09-20T08:04:30.957Z level=INFO msg="Uploading 1 narinfos"5582lb # [ 86.971763] niks3-server[1047]: 2026/09/20 08:04:31 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5583lb # [ 86.979260] niks3-server[1047]: 2026/09/20 08:04:31 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5584lb # [ 86.985065] niks3-server[1047]: 2026/09/20 08:04:31 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5585lb # [ 86.988520] niks3-server[1047]: 2026/09/20 08:04:31 INFO Completed upload id=305586worker1 # [ 86.940132] nix-grpc-daemon[1120]: time=2026-09-20T08:04:30.976Z level=INFO msg="Upload complete. (240ms)"5587worker1 # [ 86.943238] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43736 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15588worker1 # [ 86.949909] nix-daemon[845]: reaped child process 1215, status = succeeded5589client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&2, in 7.36 seconds)5590client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath5591client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath, in 0.16 seconds)5592worker2 # [ 87.201572] systemd[1]: Listening on Nix worker-protocol over gRPC.5593worker2 # [ 87.206492] systemd[1]: Starting Nix worker-protocol over gRPC...5594worker2 # [ 87.347915] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:31Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5595worker2 # [ 87.351433] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:31Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15596worker2 # [ 87.358134] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:31Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5597worker2 # [ 87.364153] systemd[1]: Started Nix worker-protocol over gRPC.5598lb: must succeed: curl -sf localhost:9901/clusters5599worker2 # [ 87.378995] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:31Z level=info event=scheduler_connected addr=lb:500515600worker1 # [ 87.365378] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:31Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05601lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5602worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5603worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)5604lb: must succeed: curl -sf localhost:9901/clusters5605lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5606lb: must succeed: curl -sf localhost:9901/clusters5607lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5608worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5609worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5610(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.82 seconds)5611subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5612client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5613client # [ 87.729141] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5614client # Running as unit: rs.service; invocation ID: af414a83bd934522925000bb4b6954da5615client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds)5616worker2 # [ 87.933148] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:337605617worker2 # [ 87.946669] nix-daemon[870]: accepted connection from pid 1322, user nix-grpc-daemon (trusted)5618client # [ 87.957414] nix[1161]: don't know how to build these paths:5619client # [ 87.958314] nix[1161]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5620worker1 # [ 87.956466] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:31Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05621worker1 # [ 87.960489] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:31Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15622worker1 # [ 87.998870] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437365623worker1 # [ 88.006166] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:437365624client # [ 88.024279] nix[1161]: copying 1 paths to 'lb:50051'...5625worker1 # [ 88.012184] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:437365626client # [ 88.026385] nix[1161]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5627worker1 # [ 88.021675] nix-daemon[845]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)5628worker1 # [ 88.163835] nix-daemon[845]: accepted connection from pid 1250, user nix-grpc-daemon (trusted)5629worker1 # [ 88.176107] nix-daemon[845]: reaped child process 1253, status = succeeded5630worker1 # [ 88.310083] nix-daemon[845]: accepted connection from pid 1255, user nix-grpc-daemon (trusted)5631worker1 # [ 88.321979] nix-daemon[845]: reaped child process 1258, status = succeeded5632lb # [ 88.383933] niks3-server[1047]: 2026/09/20 08:04:32 INFO Received uploads request method=POST path=/api/pending_closures5633worker1 # [ 88.342900] nix-grpc-daemon[1120]: time=2026-09-20T08:04:32.378Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5634worker1 # [ 88.344350] nix-grpc-daemon[1120]: time=2026-09-20T08:04:32.378Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5635lb # [ 88.412883] niks3-server[1047]: 2026/09/20 08:04:32 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5636lb # [ 88.423659] niks3-server[1047]: 2026/09/20 08:04:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5637worker1 # [ 88.381539] nix-grpc-daemon[1120]: time=2026-09-20T08:04:32.417Z level=INFO msg="Uploading 1 narinfos"5638lb # [ 88.429829] niks3-server[1047]: 2026/09/20 08:04:32 INFO Signed narinfos id=31 count=15639lb # [ 88.437402] niks3-server[1047]: 2026/09/20 08:04:32 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5640lb # [ 88.453551] niks3-server[1047]: 2026/09/20 08:04:32 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5641lb # [ 88.458535] niks3-server[1047]: 2026/09/20 08:04:32 INFO Completed upload id=315642worker1 # [ 88.410131] nix-grpc-daemon[1120]: time=2026-09-20T08:04:32.446Z level=INFO msg="Upload complete. (383ms)"5643lb # [ 88.461274] niks3-server[1047]: 2026/09/20 08:04:32 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5644worker1 # [ 88.413724] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43736 duration_s=0 paths=1 nar_bytes_in=4165645worker1 # [ 88.419277] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:437365646worker1 # [ 88.426533] nix-daemon[845]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)5647worker1 # [ 88.430598] nix-daemon[845]: reaped child process 1248, status = succeeded5648client # [ 88.448075] nix[1161]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5649worker1 # [ 88.436419] nix-daemon[845]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)5650lb: must succeed: curl -sf localhost:9901/clusters5651lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5652lb: must succeed: curl -sf localhost:9901/clusters5653lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5654lb: must succeed: curl -sf localhost:9901/clusters5655lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5656lb: must succeed: curl -sf localhost:9901/clusters5657lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5658worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5659worker2 # [ 90.517477] systemd-journald[288]: Received client request to rotate journal, rotating.5660worker2 # [ 90.527154] systemd-journald[288]: Vacuuming done, freed 0B of archived journals from /var/log/journal/7ef94c9f577d44e8b0faa6e630d3b5fd.5661worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.04 seconds)5662worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5663worker1 # [ 90.411171] systemd[1]: Stopping Nix worker-protocol over gRPC...5664worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5665client: must succeed: sleep 5.05666worker1 # [ 90.704840] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:34Z level=info event=draining5667client: (finished: must succeed: sleep 5.0, in 5.03 seconds)5668worker1 # [ 95.656622] nix-daemon[845]: reaped child process 1262, status = succeeded5669worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5670worker1 # [ 95.798832] nix-daemon[845]: accepted connection from pid 1302, user nix-grpc-daemon (trusted)5671worker1 # [ 95.813699] nix-daemon[845]: reaped child process 1305, status = succeeded5672lb # [ 95.871222] niks3-server[1047]: 2026/09/20 08:04:39 INFO Received uploads request method=POST path=/api/pending_closures5673worker1 # [ 95.830452] nix-grpc-daemon[1120]: time=2026-09-20T08:04:39.865Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5674worker1 # [ 95.832268] nix-grpc-daemon[1120]: time=2026-09-20T08:04:39.865Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5675lb # [ 95.903842] niks3-server[1047]: 2026/09/20 08:04:39 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5676lb # [ 95.906434] niks3-server[1047]: 2026/09/20 08:04:39 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5677lb # [ 95.913032] niks3-server[1047]: 2026/09/20 08:04:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5678lb # [ 95.916527] niks3-server[1047]: 2026/09/20 08:04:39 INFO Signed narinfos id=32 count=15679worker1 # [ 95.868461] nix-grpc-daemon[1120]: time=2026-09-20T08:04:39.904Z level=INFO msg="Uploading 1 narinfos"5680lb # [ 95.920419] niks3-server[1047]: 2026/09/20 08:04:39 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5681lb # [ 95.928050] niks3-server[1047]: 2026/09/20 08:04:39 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5682lb # [ 95.936197] niks3-server[1047]: 2026/09/20 08:04:39 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5683lb # [ 95.938654] niks3-server[1047]: 2026/09/20 08:04:39 INFO Completed upload id=325684worker1 # [ 95.890146] nix-grpc-daemon[1120]: time=2026-09-20T08:04:39.926Z level=INFO msg="Upload complete. (240ms)"5685worker1 # [ 95.896095] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43736 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15686worker1 # [ 95.903689] nix-daemon[845]: reaped child process 1260, status = succeeded5687client # [ 95.932759] systemd[1]: rs.service: Deactivated successfully.5688client # [ 95.934327] systemd[1]: rs.service: Consumed 105ms CPU time over 8.205s wall clock time, 41.1M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic.5689lb # [ 96.018816] envoy[899]: conn peer=[2001:db8:1::1]:56750 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9451 tx=3802 ms=71525690lb # [ 96.020558] envoy[899]: conn peer=[2001:db8:1::1]:39976 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2930 tx=1331 ms=79915691worker1 # [ 96.705680] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:40Z level=info event=signal_exit5692worker1 # [ 96.927105] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:40Z level=info event=scheduler_yield5693lb # [ 96.977832] niks3-server[1047]: 2026/09/20 08:04:41 INFO lead: released remote=192.168.1.3:395265694worker1 # [ 96.932291] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:40Z level=info event=scheduler_restarting addr=lb:500515695worker2 # [ 96.950724] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:41Z level=info event=scheduler_restarting addr=lb:500515696worker1 # [ 96.937874] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:40Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:437245697worker1 # [ 96.941278] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:40Z level=info event=worker_gone addr=192.168.1.3:500515698worker1 # [ 96.944341] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:40Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:437245699worker1 # [ 96.947696] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:40Z level=info event=worker_gone addr=192.168.1.4:500515700worker2 # [ 97.150141] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:41Z level=info event=scheduler_connected addr=lb:500515701worker1 # [ 97.133403] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:41Z level=info event=scheduler_connected addr=lb:500515702worker2 # [ 97.156896] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5703worker1 # [ 97.146747] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5704worker2 # [ 97.357903] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:41Z level=info event=scheduler_connected addr=lb:500515705worker2 # [ 97.362854] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5706worker1 # [ 97.347599] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:41Z level=info event=scheduler_connected addr=lb:500515707lb # [ 97.402561] niks3-server[1047]: 2026/09/20 08:04:41 INFO lead: acquired remote=192.168.1.4:368485708worker1 # [ 97.352970] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5709worker2 # [ 97.374749] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:41Z level=info event=scheduler_take_over5710worker2 # [ 97.563175] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:41Z level=info event=scheduler_connected addr=lb:500515711worker2 # [ 97.566111] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5712worker1 # [ 97.553975] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:41Z level=info event=scheduler_connected addr=lb:500515713worker2 # [ 97.571659] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:41Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=0 running=05714worker2 # [ 97.766986] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:41Z level=info event=scheduler_connected addr=lb:500515715worker2 # [ 97.770466] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5716worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.13 seconds)5717client: waiting for success: ! systemctl is-active rs5718client: (finished: waiting for success: ! systemctl is-active rs, in 0.05 seconds)5719client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5720client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5721client: must fail: journalctl -u rs | grep -q 'reconnecting'5722worker1 # [ 97.930561] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:41Z level=info event=scheduler_restarting5723client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5724lb: must succeed: curl -sf localhost:9901/clusters5725worker2 # [ 97.970349] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:405285726worker2 # [ 97.974820] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:42Z level=info event=worker_gone addr=192.168.1.3:500515727worker2 # [ 97.979560] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:42Z level=info event=scheduler_connected addr=lb:500515728worker1 # [ 97.965373] nix-grpc-daemon[1045]: ts=2026-09-20T08:04:42Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5729worker2 # [ 97.983252] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:42Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05730worker1 # [ 97.979993] nix-daemon[845]: reaped child process 1111, status = succeeded5731lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5732worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5733worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5734worker1 # [ 98.908261] nix-grpc-daemon[1045]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5735worker1 # [ 98.911834] nix-grpc-daemon[1045]: E0000 00:00:1789891482.944254 1088 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5736worker1 # [ 98.916653] nix-grpc-daemon[1045]: E0000 00:00:1789891482.944949 1088 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5737lb: must succeed: curl -sf localhost:9901/clusters5738lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5739worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5740worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)5741worker1 # [ 99.520316] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5742worker1 # [ 99.522166] systemd[1]: Stopped Nix worker-protocol over gRPC.5743worker1 # [ 99.522939] systemd[1]: nix-grpc-daemon.service: Consumed 1.312s CPU time over 25.982s wall clock time, 33.6M memory peak, 45.2K incoming IP traffic, 90.2K outgoing IP traffic.5744worker1 # [ 99.529638] systemd[1]: Starting Nix worker-protocol over gRPC...5745worker1 # [ 99.673480] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5746worker1 # [ 99.677583] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15747worker1 # [ 99.684169] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5748worker1 # [ 99.687098] systemd[1]: Started Nix worker-protocol over gRPC.5749worker1 # [ 99.697518] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:43Z level=info event=scheduler_connected addr=lb:500515750worker2 # [ 99.716558] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:43Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05751lb: must succeed: curl -sf localhost:9901/clusters5752lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5753worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5754worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5755(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.60 seconds)5756subtest: scheduler restart mid-build: build finishes, no double build5757client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5758client # [ 100.330986] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5759client # Running as unit: mid.service; invocation ID: a11962ecd75841a691acb93bdf5332af5760client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.07 seconds)5761worker2 # [ 100.531473] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:44Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:337605762client # [ 100.534132] nix[1197]: don't know how to build these paths:5763client # [ 100.535143] nix[1197]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5764worker2 # [ 100.546074] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:44Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05765worker2 # [ 100.550635] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:44Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15766worker2 # [ 100.589698] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:337605767worker2 # [ 100.601982] nix-grpc-daemon[1322]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 1/5)5768worker2 # [ 100.662089] nix-grpc-daemon[1322]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 149 ms (attempt 2/5)5769worker2 # [ 100.814882] nix-grpc-daemon[1322]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 357 ms (attempt 3/5)5770worker2 # [ 101.172294] nix-grpc-daemon[1322]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 386 ms (attempt 4/5)5771worker2 # [ 101.564297] nix-grpc-daemon[1322]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5772worker2 # [ 101.577710] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:337605773client # [ 101.583409] nix[1197]: copying 1 paths to 'lb:50051'...5774client # [ 101.584236] nix[1197]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5775worker2 # [ 101.588369] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:337605776worker2 # [ 101.597649] nix-daemon[870]: accepted connection from pid 1322, user nix-grpc-daemon (trusted)5777worker2 # [ 101.624824] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:45Z level=info event=niks3_push_started pid=14555778worker2 # [ 101.911825] nix-daemon[870]: accepted connection from pid 1468, user nix-grpc-daemon (trusted)5779worker2 # [ 101.925189] nix-daemon[870]: reaped child process 1471, status = succeeded5780worker2 # [ 102.080088] nix-daemon[870]: accepted connection from pid 1473, user nix-grpc-daemon (trusted)5781worker2 # [ 102.093718] nix-daemon[870]: reaped child process 1476, status = succeeded5782lb # [ 102.141059] niks3-server[1047]: 2026/09/20 08:04:46 INFO Received uploads request method=POST path=/api/pending_closures5783worker2 # [ 102.123179] nix-grpc-daemon[1455]: time=2026-09-20T08:04:46.306Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5784worker2 # [ 102.124539] nix-grpc-daemon[1455]: time=2026-09-20T08:04:46.306Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5785lb # [ 102.173526] niks3-server[1047]: 2026/09/20 08:04:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5786lb # [ 102.176066] niks3-server[1047]: 2026/09/20 08:04:46 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5787lb # [ 102.184636] niks3-server[1047]: 2026/09/20 08:04:46 INFO Signed narinfos id=33 count=15788worker2 # [ 102.153268] nix-grpc-daemon[1455]: time=2026-09-20T08:04:46.337Z level=INFO msg="Uploading 1 narinfos"5789lb # [ 102.187351] niks3-server[1047]: 2026/09/20 08:04:46 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5790lb # [ 102.191667] niks3-server[1047]: 2026/09/20 08:04:46 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5791lb # [ 102.200703] niks3-server[1047]: 2026/09/20 08:04:46 INFO Completed upload id=335792worker2 # [ 102.169086] nix-grpc-daemon[1455]: time=2026-09-20T08:04:46.353Z level=INFO msg="Upload complete. (392ms)"5793worker2 # [ 102.172297] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:33760 duration_s=0 paths=1 nar_bytes_in=4245794worker2 # [ 102.174854] nix-grpc-daemon[1322]: ts=2026-09-20T08:04:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:337605795lb # [ 102.209575] niks3-server[1047]: 2026/09/20 08:04:46 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5796worker2 # [ 102.180045] nix-daemon[870]: accepted connection from pid 1322, user nix-grpc-daemon (trusted)5797worker2 # [ 102.185695] nix-daemon[870]: reaped child process 1453, status = succeeded5798client # [ 102.184876] nix[1197]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5799worker2 # [ 102.191259] nix-daemon[870]: accepted connection from pid 1322, user nix-grpc-daemon (trusted)5800lb: must succeed: curl -sf localhost:9901/clusters5801lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5802lb: must succeed: curl -sf localhost:9901/clusters5803lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5804worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5805worker2 # [ 104.062280] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1322 (nix-grpc-daemon) on client request.5806worker2 # [ 104.063989] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5807lb # [ 104.104093] niks3-server[1047]: 2026/09/20 08:04:48 INFO lead: released remote=192.168.1.4:368485808client # [ 104.066488] nix[1197]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5809worker1 # [ 104.053549] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5810client # [ 104.071241] nix[1197]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5811worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)5812client: must succeed: sleep 5.05813worker2 # [ 104.094200] nix-daemon[870]: reaped child process 1478, status = succeeded5814worker2 # [ 104.095594] nix-daemon[870]: reaped child process 1380, status = succeeded5815worker2 # [ 104.099560] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5816worker2 # [ 104.101781] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5817worker2 # [ 104.103173] systemd[1]: nix-grpc-daemon.service: Consumed 434ms CPU time over 16.892s wall clock time, 30.8M memory peak, 14.4K incoming IP traffic, 32.6K outgoing IP traffic.5818worker2 # [ 104.111266] nix-daemon[1480]: unexpected Nix daemon error: error: interrupted by the user5819worker2 # [ 104.115364] nix-daemon[870]: reaped child process 1480, status = failed with exit code 15820worker1 # [ 104.253344] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:48Z level=info event=scheduler_connected addr=lb:500515821worker2 # [ 104.273878] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5822worker2 # [ 104.283593] systemd[1]: Starting Nix worker-protocol over gRPC...5823worker2 # [ 104.449285] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:48Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5824worker2 # [ 104.452570] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:48Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15825worker2 # [ 104.458063] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:48Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5826worker2 # [ 104.462159] systemd[1]: Started Nix worker-protocol over gRPC.5827lb # [ 104.500517] niks3-server[1047]: 2026/09/20 08:04:48 INFO lead: acquired remote=192.168.1.4:450845828worker2 # [ 104.470402] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:48Z level=info event=scheduler_take_over5829worker1 # [ 104.455692] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5830worker2 # [ 104.474553] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:48Z level=info event=scheduler_connected addr=lb:500515831worker2 # [ 104.476354] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:48Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05832worker2 # [ 104.582753] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:48Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05833worker2 # [ 104.588378] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:48Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15834worker2 # [ 104.630146] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343125835worker2 # [ 104.641165] nix-daemon[870]: accepted connection from pid 1516, user nix-grpc-daemon (trusted)5836worker2 # [ 104.656242] nix-daemon[870]: accepted connection from pid 1516, user nix-grpc-daemon (trusted)5837client # [ 104.663495] nix[1197]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5838worker2 # [ 104.669781] nix-daemon[870]: accepted connection from pid 1516, user nix-grpc-daemon (trusted)5839worker1 # [ 104.656750] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:48Z level=info event=scheduler_connected addr=lb:500515840worker2 # [ 104.674637] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:48Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05841lb # [ 106.019656] envoy[899]: conn peer=[2001:db8:1::3]:59626 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3792 tx=1049 ms=242425842lb # [ 106.021304] envoy[899]: conn peer=[2001:db8:1::4]:51212 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1560 tx=496 ms=166975843client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5844client: waiting for success: ! systemctl is-active mid5845worker2 # [ 109.498351] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:53Z level=info event=niks3_push_started pid=15955846worker2 # [ 109.525730] nix-daemon[870]: reaped child process 1571, status = succeeded5847worker2 # [ 109.797449] nix-daemon[870]: accepted connection from pid 1608, user nix-grpc-daemon (trusted)5848worker2 # [ 109.809494] nix-daemon[870]: reaped child process 1611, status = succeeded5849lb # [ 109.850758] niks3-server[1047]: 2026/09/20 08:04:53 INFO Received uploads request method=POST path=/api/pending_closures5850worker2 # [ 109.823868] nix-grpc-daemon[1595]: time=2026-09-20T08:04:54.008Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5851worker2 # [ 109.827300] nix-grpc-daemon[1595]: time=2026-09-20T08:04:54.009Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5852lb # [ 109.875356] niks3-server[1047]: 2026/09/20 08:04:53 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5853lb # [ 109.883342] niks3-server[1047]: 2026/09/20 08:04:53 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5854lb # [ 109.886081] niks3-server[1047]: 2026/09/20 08:04:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5855lb # [ 109.889293] niks3-server[1047]: 2026/09/20 08:04:53 INFO Signed narinfos id=34 count=15856worker2 # [ 109.858248] nix-grpc-daemon[1595]: time=2026-09-20T08:04:54.042Z level=INFO msg="Uploading 1 narinfos"5857lb # [ 109.892021] niks3-server[1047]: 2026/09/20 08:04:53 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5858lb # [ 109.897145] niks3-server[1047]: 2026/09/20 08:04:53 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5859lb # [ 109.899682] niks3-server[1047]: 2026/09/20 08:04:53 INFO Completed upload id=345860worker2 # [ 109.867977] nix-grpc-daemon[1595]: time=2026-09-20T08:04:54.052Z level=INFO msg="Upload complete. (189ms)"5861lb # [ 109.902695] niks3-server[1047]: 2026/09/20 08:04:53 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5862worker2 # [ 109.870514] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34312 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15863worker2 # [ 109.879298] nix-daemon[870]: reaped child process 1569, status = succeeded5864client # [ 109.896219] systemd[1]: mid.service: Deactivated successfully.5865client # [ 109.899148] systemd[1]: mid.service: Consumed 123ms CPU time over 9.568s wall clock time, 39.3M memory peak, 9.6K incoming IP traffic, 10.7K outgoing IP traffic.5866client: (finished: waiting for success: ! systemctl is-active mid, in 1.10 seconds)5867client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5868client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)5869(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.21 seconds)5870subtest: interrupting the client stops the build on the worker5871client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5872client # [ 110.518465] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5873client # Running as unit: intr.service; invocation ID: 2dbf68a5d61b41389808627d8ba64e095874client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)5875worker1 # [ 110.699307] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:389605876worker1 # [ 110.709560] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5877client # [ 110.733900] nix[1233]: don't know how to build these paths:5878client # [ 110.734765] nix[1233]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5879worker2 # [ 110.749505] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:54Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05880worker2 # [ 110.753502] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:54Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15881worker1 # [ 110.776438] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389605882worker1 # [ 110.787981] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 44 ms (attempt 1/5)5883worker1 # [ 110.837768] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 13 ms (attempt 2/5)5884worker1 # [ 110.856430] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 315 ms (attempt 3/5)5885worker1 # [ 111.174648] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 196 ms (attempt 4/5)5886worker1 # [ 111.376565] nix-grpc-daemon[1312]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5887worker1 # [ 111.386593] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:389605888client # [ 111.403817] nix[1233]: copying 1 paths to 'lb:50051'...5889worker1 # [ 111.394774] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:389605890client # [ 111.407131] nix[1233]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5891worker1 # [ 111.403464] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5892worker1 # [ 111.414118] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:55Z level=info event=niks3_push_started pid=14005893worker1 # [ 111.701456] nix-daemon[845]: accepted connection from pid 1413, user nix-grpc-daemon (trusted)5894worker1 # [ 111.714469] nix-daemon[845]: reaped child process 1420, status = succeeded5895worker1 # [ 111.871509] nix-daemon[845]: accepted connection from pid 1422, user nix-grpc-daemon (trusted)5896worker1 # [ 111.883588] nix-daemon[845]: reaped child process 1425, status = succeeded5897lb # [ 111.947792] niks3-server[1047]: 2026/09/20 08:04:55 INFO Received uploads request method=POST path=/api/pending_closures5898worker1 # [ 111.904423] nix-grpc-daemon[1400]: time=2026-09-20T08:04:55.940Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5899worker1 # [ 111.906437] nix-grpc-daemon[1400]: time=2026-09-20T08:04:55.942Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5900lb # [ 111.968427] niks3-server[1047]: 2026/09/20 08:04:56 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5901lb # [ 111.972324] niks3-server[1047]: 2026/09/20 08:04:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5902lb # [ 111.974147] niks3-server[1047]: 2026/09/20 08:04:56 INFO Signed narinfos id=35 count=15903worker1 # [ 111.927233] nix-grpc-daemon[1400]: time=2026-09-20T08:04:55.963Z level=INFO msg="Uploading 1 narinfos"5904lb # [ 111.979270] niks3-server[1047]: 2026/09/20 08:04:56 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5905lb # [ 111.982877] niks3-server[1047]: 2026/09/20 08:04:56 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5906lb # [ 111.985166] niks3-server[1047]: 2026/09/20 08:04:56 INFO Completed upload id=355907worker1 # [ 111.938111] nix-grpc-daemon[1400]: time=2026-09-20T08:04:55.974Z level=INFO msg="Upload complete. (389ms)"5908lb # [ 111.987870] niks3-server[1047]: 2026/09/20 08:04:56 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5909worker1 # [ 111.940578] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 paths=1 nar_bytes_in=4245910worker1 # [ 111.944191] nix-grpc-daemon[1312]: ts=2026-09-20T08:04:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389605911worker1 # [ 111.950943] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5912worker1 # [ 111.953497] nix-daemon[845]: reaped child process 1398, status = succeeded5913worker1 # [ 111.959028] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)5914client # [ 111.971599] nix[1233]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5915client: must succeed: systemctl kill -s INT intr5916client # [ 113.978759] systemd[1]: intr.service: Sent signal SIGINT to main process 1233 (nix) on client request.5917client # [ 113.982281] nix[1233]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5918client: (finished: must succeed: systemctl kill -s INT intr, in 0.04 seconds)5919client # [ 113.985907] nix[1233]: error: interrupted by the user5920worker1 # [ 113.980851] nix-daemon[845]: reaped child process 1427, status = succeeded5921worker1 # [ 113.987276] nix-daemon[1429]: unexpected Nix daemon error: error: interrupted by the user5922worker1 # [ 113.991781] nix-daemon[845]: reaped child process 1429, status = failed with exit code 15923client # [ 114.013620] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5924client # [ 114.015091] systemd[1]: intr.service: Failed with result 'exit-code'.5925client # [ 114.017050] systemd[1]: intr.service: Consumed 105ms CPU time over 3.497s wall clock time, 39.3M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5926(finished: subtest: interrupting the client stops the build on the worker, in 3.60 seconds)5927subtest: a deploy mid-build drains: the build finishes, the new generation takes over5928client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5929client # [ 114.121156] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5930client # Running as unit: sw.service; invocation ID: 6cf80757b6374f26bd9bc68f8d0416a25931client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.04 seconds)5932worker2 # [ 114.323595] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:343125933client # [ 114.325734] nix[1254]: don't know how to build these paths:5934client # [ 114.326704] nix[1254]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5935worker2 # [ 114.336946] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:58Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05936worker2 # [ 114.342228] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:58Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15937worker2 # [ 114.379938] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343125938worker2 # [ 114.391938] nix-grpc-daemon[1516]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5)5939worker2 # [ 114.414723] nix-grpc-daemon[1516]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 2/5)5940worker2 # [ 114.474455] nix-grpc-daemon[1516]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 3/5)5941worker2 # [ 114.558855] nix-grpc-daemon[1516]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 126 ms (attempt 4/5)5942worker2 # [ 114.691871] nix-grpc-daemon[1516]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5943worker2 # [ 114.710115] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:343125944client # [ 114.716097] nix[1254]: copying 1 paths to 'lb:50051'...5945client # [ 114.717248] nix[1254]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5946worker2 # [ 114.721865] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:343125947worker2 # [ 114.730908] nix-daemon[870]: accepted connection from pid 1516, user nix-grpc-daemon (trusted)5948worker2 # [ 114.885524] nix-daemon[870]: accepted connection from pid 1646, user nix-grpc-daemon (trusted)5949worker2 # [ 114.900651] nix-daemon[870]: reaped child process 1649, status = succeeded5950worker2 # [ 115.033384] nix-daemon[870]: accepted connection from pid 1651, user nix-grpc-daemon (trusted)5951worker2 # [ 115.045327] nix-daemon[870]: reaped child process 1654, status = succeeded5952lb # [ 115.091453] niks3-server[1047]: 2026/09/20 08:04:59 INFO Received uploads request method=POST path=/api/pending_closures5953worker2 # [ 115.067428] nix-grpc-daemon[1595]: time=2026-09-20T08:04:59.251Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5954worker2 # [ 115.068875] nix-grpc-daemon[1595]: time=2026-09-20T08:04:59.253Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5955lb # [ 115.121328] niks3-server[1047]: 2026/09/20 08:04:59 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5956lb # [ 115.130205] niks3-server[1047]: 2026/09/20 08:04:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5957lb # [ 115.135223] niks3-server[1047]: 2026/09/20 08:04:59 INFO Signed narinfos id=36 count=15958worker2 # [ 115.106543] nix-grpc-daemon[1595]: time=2026-09-20T08:04:59.290Z level=INFO msg="Uploading 1 narinfos"5959lb # [ 115.145550] niks3-server[1047]: 2026/09/20 08:04:59 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5960lb # [ 115.155953] niks3-server[1047]: 2026/09/20 08:04:59 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5961lb # [ 115.161773] niks3-server[1047]: 2026/09/20 08:04:59 INFO Completed upload id=365962worker2 # [ 115.129930] nix-grpc-daemon[1595]: time=2026-09-20T08:04:59.314Z level=INFO msg="Upload complete. (385ms)"5963lb # [ 115.164697] niks3-server[1047]: 2026/09/20 08:04:59 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5964worker2 # [ 115.133503] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:34312 duration_s=0 paths=1 nar_bytes_in=4165965worker2 # [ 115.139849] nix-grpc-daemon[1516]: ts=2026-09-20T08:04:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:343125966worker2 # [ 115.150264] nix-daemon[870]: accepted connection from pid 1516, user nix-grpc-daemon (trusted)5967worker2 # [ 115.153251] nix-daemon[870]: reaped child process 1644, status = succeeded5968worker2 # [ 115.158042] nix-daemon[870]: accepted connection from pid 1516, user nix-grpc-daemon (trusted)5969client # [ 115.153805] nix[1254]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5970lb # [ 116.020116] envoy[899]: conn peer=[2001:db8:1::1]:45924 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3835 tx=1661 ms=93515971lb # [ 116.022444] envoy[899]: conn peer=[2001:db8:1::1]:44034 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2924 tx=731 ms=32905972worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25973worker2 # Checking switch inhibitors... done5974worker2 # activating the configuration...5975worker2 # [ 117.184751] nixos[1689]: switching to system configuration /nix/store/6kvdwskm1zv77gxfq4cyj03j4bm57kl6-nixos-system-worker2-test5976worker2 # [ 117.187453] systemd[1]: Stopped target Local File Systems.5977worker2 # [ 117.188616] systemd[1]: Stopped target Remote File Systems.5978worker2 # setting up /etc...5979worker2 # [ 117.805836] systemd[1]: Reload requested from client PID 1689 ('.switch-to-conf') (unit backdoor.service)...5980worker2 # [ 117.807417] systemd[1]: Reloading...5981worker2 # [ 118.452648] systemd[1]: Reloading finished in 642 ms.5982worker2 # restarting sysinit-reactivation.target5983worker2 # [ 118.509465] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5984worker2 # [ 118.635129] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5985worker2 # [ 118.639555] systemd[1]: Reached target Reactivate sysinit units.5986worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5987worker2 # [ 118.644582] systemd[1]: Reloading D-Bus System Message Bus...5988worker2 # [ 118.647885] dbus-broker-launch[534]: Caught SIGHUP, trigger reload.5989worker2 # [ 118.650240] systemd[1]: Reloading Nix worker-protocol over gRPC...5990worker2 # [ 118.680959] dbus-broker-launch[534]: Looking up NSS user entry for 'systemd-timesync'...5991worker2 # [ 118.683287] dbus-broker-launch[534]: NSS returned no entry for 'systemd-timesync'5992worker2 # [ 118.684809] dbus-broker-launch[534]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5993worker2 # [ 118.692386] systemd[1]: Reloaded Nix worker-protocol over gRPC.5994worker2 # [ 118.714862] systemd[1]: Reloaded D-Bus System Message Bus.5995worker2 # [ 118.721379] systemd[1]: Reached target Remote File Systems.5996worker2 # [ 118.724670] systemd[1]: Starting linger-users.service...5997worker2 # [ 118.732836] systemd[1]: Reached target Local File Systems.5998worker2 # [ 118.733655] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5999worker2 # [ 118.739547] systemd[1]: Starting Create SUID/SGID Wrappers...6000worker2 # [ 118.742139] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6001worker2 # [ 118.745126] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676002worker2 # [ 118.747172] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6003worker2 # [ 118.750122] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6004worker2 # [ 118.752045] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6005worker2 # [ 118.757741] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6006worker2 # [ 118.758965] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6007worker2 # [ 118.797967] systemd[1]: linger-users.service: Deactivated successfully.6008worker2 # [ 118.801185] systemd[1]: Finished linger-users.service.6009worker2 # [ 119.140545] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6010worker2 # [ 119.143084] systemd[1]: Finished Create SUID/SGID Wrappers.6011worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6012worker2 # [ 119.401070] nixos[1689]: finished switching to system configuration /nix/store/6kvdwskm1zv77gxfq4cyj03j4bm57kl6-nixos-system-worker2-test6013worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 2.82 seconds)6014worker2: must succeed: pgrep -f 'read -t [9]0 x'6015worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6016client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&26017worker2 # [ 119.471146] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:03Z level=info event=draining6018worker1 # [ 119.637668] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:03Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:389606019client # don't know how to build these paths:6020client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6021worker2 # [ 119.668137] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:03Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06022worker2 # [ 119.669937] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:03Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=16023worker1 # [ 119.699132] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606024worker1 # [ 119.711965] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:389606025client # copying 1 paths to 'lb:50051'...6026worker1 # [ 119.724563] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:389606027client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6028worker1 # [ 119.740592] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6029worker1 # [ 119.899655] nix-daemon[845]: accepted connection from pid 1475, user nix-grpc-daemon (trusted)6030worker1 # [ 119.912370] nix-daemon[845]: reaped child process 1478, status = succeeded6031worker1 # [ 120.075265] nix-daemon[845]: accepted connection from pid 1480, user nix-grpc-daemon (trusted)6032worker1 # [ 120.090209] nix-daemon[845]: reaped child process 1483, status = succeeded6033lb # [ 120.154916] niks3-server[1047]: 2026/09/20 08:05:04 INFO Received uploads request method=POST path=/api/pending_closures6034worker1 # [ 120.115418] nix-grpc-daemon[1400]: time=2026-09-20T08:05:04.151Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6035worker1 # [ 120.116937] nix-grpc-daemon[1400]: time=2026-09-20T08:05:04.153Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6036lb # [ 120.186904] niks3-server[1047]: 2026/09/20 08:05:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign6037worker1 # [ 120.144784] nix-grpc-daemon[1400]: time=2026-09-20T08:05:04.181Z level=INFO msg="Uploading 1 narinfos"6038lb # [ 120.193423] niks3-server[1047]: 2026/09/20 08:05:04 INFO Signed narinfos id=37 count=16039lb # [ 120.204395] niks3-server[1047]: 2026/09/20 08:05:04 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6040lb # [ 120.218171] niks3-server[1047]: 2026/09/20 08:05:04 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete6041worker1 # [ 120.177325] nix-grpc-daemon[1400]: time=2026-09-20T08:05:04.213Z level=INFO msg="Upload complete. (428ms)"6042lb # [ 120.225714] niks3-server[1047]: 2026/09/20 08:05:04 INFO Completed upload id=376043worker1 # [ 120.179483] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 paths=1 nar_bytes_in=5286044worker1 # [ 120.182516] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606045lb # [ 120.233770] niks3-server[1047]: 2026/09/20 08:05:04 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6046worker1 # [ 120.189470] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6047worker1 # [ 120.192054] nix-daemon[845]: reaped child process 1473, status = succeeded6048lb # [ 120.244974] niks3-server[1047]: 2026/09/20 08:05:04 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6049client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6050worker1 # [ 120.198079] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6051client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6052client # farm-a> LOG-farm-a-during-drain6053worker1 # [ 121.625507] nix-daemon[845]: reaped child process 1487, status = succeeded6054worker1 # [ 121.763194] nix-daemon[845]: accepted connection from pid 1502, user nix-grpc-daemon (trusted)6055worker1 # [ 121.775831] nix-daemon[845]: reaped child process 1505, status = succeeded6056lb # [ 121.835876] niks3-server[1047]: 2026/09/20 08:05:05 INFO Received uploads request method=POST path=/api/pending_closures6057worker1 # [ 121.797859] nix-grpc-daemon[1400]: time=2026-09-20T08:05:05.834Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6058worker1 # [ 121.799428] nix-grpc-daemon[1400]: time=2026-09-20T08:05:05.835Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6059lb # [ 121.876342] niks3-server[1047]: 2026/09/20 08:05:05 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6060lb # [ 121.885503] niks3-server[1047]: 2026/09/20 08:05:05 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6061lb # [ 121.895848] niks3-server[1047]: 2026/09/20 08:05:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign6062lb # [ 121.901898] niks3-server[1047]: 2026/09/20 08:05:05 INFO Signed narinfos id=38 count=16063worker1 # [ 121.854151] nix-grpc-daemon[1400]: time=2026-09-20T08:05:05.889Z level=INFO msg="Uploading 1 narinfos"6064lb # [ 121.905528] niks3-server[1047]: 2026/09/20 08:05:05 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6065lb # [ 121.913917] niks3-server[1047]: 2026/09/20 08:05:05 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete6066lb # [ 121.916873] niks3-server[1047]: 2026/09/20 08:05:05 INFO Completed upload id=386067lb # [ 121.918829] niks3-server[1047]: 2026/09/20 08:05:05 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6068worker1 # [ 121.869831] nix-grpc-daemon[1400]: time=2026-09-20T08:05:05.906Z level=INFO msg="Upload complete. (264ms)"6069worker2 # [ 121.895520] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:06Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06070worker1 # [ 121.876387] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16071worker2 # [ 121.897508] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:06Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=16072worker1 # [ 121.888553] nix-daemon[845]: reaped child process 1485, status = succeeded6073worker1 # [ 121.930186] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606074worker1 # [ 121.942841] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:389606075worker1 # [ 121.956464] nix-grpc-daemon[1400]: time=2026-09-20T08:05:05.992Z level=INFO msg="All 1 paths already cached"6076client # copying 1 paths to 'lb:50051'...6077worker1 # [ 121.965278] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:389606078client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6079worker1 # [ 121.985251] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6080worker1 # [ 122.156724] nix-daemon[845]: accepted connection from pid 1509, user nix-grpc-daemon (trusted)6081worker1 # [ 122.169322] nix-daemon[845]: reaped child process 1512, status = succeeded6082worker1 # [ 122.315270] nix-daemon[845]: accepted connection from pid 1514, user nix-grpc-daemon (trusted)6083worker1 # [ 122.327429] nix-daemon[845]: reaped child process 1517, status = succeeded6084lb # [ 122.385965] niks3-server[1047]: 2026/09/20 08:05:06 INFO Received uploads request method=POST path=/api/pending_closures6085worker1 # [ 122.345706] nix-grpc-daemon[1400]: time=2026-09-20T08:05:06.382Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6086worker1 # [ 122.347810] nix-grpc-daemon[1400]: time=2026-09-20T08:05:06.383Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6087lb # [ 122.414533] niks3-server[1047]: 2026/09/20 08:05:06 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6088lb # [ 122.427752] niks3-server[1047]: 2026/09/20 08:05:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6089worker1 # [ 122.385348] nix-grpc-daemon[1400]: time=2026-09-20T08:05:06.421Z level=INFO msg="Uploading 1 narinfos"6090lb # [ 122.433845] niks3-server[1047]: 2026/09/20 08:05:06 INFO Signed narinfos id=39 count=16091lb # [ 122.439616] niks3-server[1047]: 2026/09/20 08:05:06 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6092lb # [ 122.449243] niks3-server[1047]: 2026/09/20 08:05:06 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6093lb # [ 122.456269] niks3-server[1047]: 2026/09/20 08:05:06 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6094lb # [ 122.462048] niks3-server[1047]: 2026/09/20 08:05:06 INFO Completed upload id=396095worker1 # [ 122.413648] nix-grpc-daemon[1400]: time=2026-09-20T08:05:06.449Z level=INFO msg="Upload complete. (416ms)"6096worker1 # [ 122.418086] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 paths=1 nar_bytes_in=6406097worker1 # [ 122.422577] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606098worker1 # [ 122.434111] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6099worker1 # [ 122.437504] nix-daemon[845]: reaped child process 1507, status = succeeded6100worker1 # [ 122.443257] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6101client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6102client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6103client # farm-b> LOG-farm-b-during-drain6104worker1 # [ 123.657447] nix-daemon[845]: reaped child process 1521, status = succeeded6105worker1 # [ 123.781524] nix-daemon[845]: accepted connection from pid 1536, user nix-grpc-daemon (trusted)6106worker1 # [ 123.793615] nix-daemon[845]: reaped child process 1539, status = succeeded6107lb # [ 123.856103] niks3-server[1047]: 2026/09/20 08:05:07 INFO Received uploads request method=POST path=/api/pending_closures6108worker1 # [ 123.814322] nix-grpc-daemon[1400]: time=2026-09-20T08:05:07.850Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6109worker1 # [ 123.815793] nix-grpc-daemon[1400]: time=2026-09-20T08:05:07.852Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6110lb # [ 123.889478] niks3-server[1047]: 2026/09/20 08:05:07 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6111lb # [ 123.907155] niks3-server[1047]: 2026/09/20 08:05:07 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6112lb # [ 123.919608] niks3-server[1047]: 2026/09/20 08:05:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6113lb # [ 123.924607] niks3-server[1047]: 2026/09/20 08:05:07 INFO Signed narinfos id=40 count=16114worker1 # [ 123.876364] nix-grpc-daemon[1400]: time=2026-09-20T08:05:07.912Z level=INFO msg="Uploading 1 narinfos"6115lb # [ 123.930928] niks3-server[1047]: 2026/09/20 08:05:07 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6116lb # [ 123.936967] niks3-server[1047]: 2026/09/20 08:05:07 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6117lb # [ 123.940821] niks3-server[1047]: 2026/09/20 08:05:07 INFO Completed upload id=406118lb # [ 123.942273] niks3-server[1047]: 2026/09/20 08:05:07 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6119worker1 # [ 123.893753] nix-grpc-daemon[1400]: time=2026-09-20T08:05:07.930Z level=INFO msg="Upload complete. (242ms)"6120worker2 # [ 123.919880] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:08Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06121worker1 # [ 123.900354] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16122worker2 # [ 123.921889] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:08Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=16123worker1 # [ 123.914876] nix-daemon[845]: reaped child process 1519, status = succeeded6124worker1 # [ 123.948935] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606125worker1 # [ 123.956300] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:389606126worker1 # [ 123.962676] nix-grpc-daemon[1400]: time=2026-09-20T08:05:07.999Z level=INFO msg="All 2 paths already cached"6127client # copying 1 paths to 'lb:50051'...6128worker1 # [ 123.967564] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:389606129client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6130worker1 # [ 123.984260] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6131worker1 # [ 124.139898] nix-daemon[845]: accepted connection from pid 1543, user nix-grpc-daemon (trusted)6132worker1 # [ 124.152208] nix-daemon[845]: reaped child process 1546, status = succeeded6133worker1 # [ 124.304926] nix-daemon[845]: accepted connection from pid 1548, user nix-grpc-daemon (trusted)6134worker1 # [ 124.316554] nix-daemon[845]: reaped child process 1551, status = succeeded6135lb # [ 124.380411] niks3-server[1047]: 2026/09/20 08:05:08 INFO Received uploads request method=POST path=/api/pending_closures6136worker1 # [ 124.336359] nix-grpc-daemon[1400]: time=2026-09-20T08:05:08.372Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6137worker1 # [ 124.337786] nix-grpc-daemon[1400]: time=2026-09-20T08:05:08.372Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6138lb # [ 124.396378] niks3-server[1047]: 2026/09/20 08:05:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6139lb # [ 124.398927] niks3-server[1047]: 2026/09/20 08:05:08 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6140lb # [ 124.401529] niks3-server[1047]: 2026/09/20 08:05:08 INFO Signed narinfos id=41 count=16141worker1 # [ 124.353246] nix-grpc-daemon[1400]: time=2026-09-20T08:05:08.389Z level=INFO msg="Uploading 1 narinfos"6142lb # [ 124.403540] niks3-server[1047]: 2026/09/20 08:05:08 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6143lb # [ 124.409040] niks3-server[1047]: 2026/09/20 08:05:08 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6144lb # [ 124.414797] niks3-server[1047]: 2026/09/20 08:05:08 INFO Completed upload id=416145worker1 # [ 124.366410] nix-grpc-daemon[1400]: time=2026-09-20T08:05:08.402Z level=INFO msg="Upload complete. (375ms)"6146lb # [ 124.417701] niks3-server[1047]: 2026/09/20 08:05:08 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6147worker1 # [ 124.368798] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 paths=1 nar_bytes_in=7686148worker1 # [ 124.371707] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606149worker1 # [ 124.378989] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6150worker1 # [ 124.381213] nix-daemon[845]: reaped child process 1541, status = succeeded6151worker1 # [ 124.387105] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6152client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6153client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6154worker1 # [ 124.999136] nix-daemon[845]: reaped child process 1555, status = succeeded6155client # farm-top> LOG-farm-top-during-drain6156worker1 # [ 125.133976] nix-daemon[845]: accepted connection from pid 1570, user nix-grpc-daemon (trusted)6157worker1 # [ 125.144987] nix-daemon[845]: reaped child process 1573, status = succeeded6158lb # [ 125.207099] niks3-server[1047]: 2026/09/20 08:05:09 INFO Received uploads request method=POST path=/api/pending_closures6159worker1 # [ 125.164466] nix-grpc-daemon[1400]: time=2026-09-20T08:05:09.200Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6160worker1 # [ 125.165953] nix-grpc-daemon[1400]: time=2026-09-20T08:05:09.202Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6161lb # [ 125.230564] niks3-server[1047]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6162lb # [ 125.235073] niks3-server[1047]: 2026/09/20 08:05:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6163worker1 # [ 125.190253] nix-grpc-daemon[1400]: time=2026-09-20T08:05:09.226Z level=INFO msg="Uploading 1 narinfos"6164lb # [ 125.238412] niks3-server[1047]: 2026/09/20 08:05:09 INFO Signed narinfos id=42 count=16165lb # [ 125.243685] niks3-server[1047]: 2026/09/20 08:05:09 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6166lb # [ 125.246715] niks3-server[1047]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6167lb # [ 125.250091] niks3-server[1047]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6168lb # [ 125.251863] niks3-server[1047]: 2026/09/20 08:05:09 INFO Completed upload id=426169worker1 # [ 125.203395] nix-grpc-daemon[1400]: time=2026-09-20T08:05:09.239Z level=INFO msg="Upload complete. (210ms)"6170lb # [ 125.256036] niks3-server[1047]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6171worker1 # [ 125.205747] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16172worker1 # [ 125.212369] nix-daemon[845]: reaped child process 1553, status = succeeded6173client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&2, in 5.80 seconds)6174client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath6175client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath, in 0.19 seconds)6176worker2: must succeed: pkill -f 'read -t [9]0 x'6177worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6178client: waiting for success: ! systemctl is-active sw6179worker2 # [ 125.581843] nix-daemon[870]: reaped child process 1658, status = succeeded6180worker2 # [ 125.715857] nix-daemon[870]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)6181worker2 # [ 125.728203] nix-daemon[870]: reaped child process 1838, status = succeeded6182lb # [ 125.772901] niks3-server[1047]: 2026/09/20 08:05:09 INFO Received uploads request method=POST path=/api/pending_closures6183worker2 # [ 125.749219] nix-grpc-daemon[1595]: time=2026-09-20T08:05:09.933Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6184worker2 # [ 125.751442] nix-grpc-daemon[1595]: time=2026-09-20T08:05:09.935Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6185lb # [ 125.808144] niks3-server[1047]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6186lb # [ 125.818163] niks3-server[1047]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6187lb # [ 125.825684] niks3-server[1047]: 2026/09/20 08:05:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6188worker2 # [ 125.800284] nix-grpc-daemon[1595]: time=2026-09-20T08:05:09.984Z level=INFO msg="Uploading 1 narinfos"6189lb # [ 125.832374] niks3-server[1047]: 2026/09/20 08:05:09 INFO Signed narinfos id=43 count=16190lb # [ 125.839228] niks3-server[1047]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6191lb # [ 125.849425] niks3-server[1047]: 2026/09/20 08:05:09 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6192lb # [ 125.855572] niks3-server[1047]: 2026/09/20 08:05:09 INFO Completed upload id=436193worker2 # [ 125.823777] nix-grpc-daemon[1595]: time=2026-09-20T08:05:10.008Z level=INFO msg="Upload complete. (249ms)"6194lb # [ 125.857209] niks3-server[1047]: 2026/09/20 08:05:09 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6195worker2 # [ 125.826145] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:34312 duration_s=10 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16196worker2 # [ 125.833931] nix-daemon[870]: reaped child process 1656, status = succeeded6197client # [ 125.862175] systemd[1]: sw.service: Deactivated successfully.6198client # [ 125.864971] systemd[1]: sw.service: Consumed 115ms CPU time over 11.740s wall clock time, 39.1M memory peak, 8.7K incoming IP traffic, 9K outgoing IP traffic.6199lb # [ 126.021986] envoy[899]: conn peer=[2001:db8:1::1]:45580 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9403 tx=3809 ms=55856200lb # [ 126.027426] envoy[899]: conn peer=[2001:db8:1::1]:45566 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2949 tx=1351 ms=115196201worker2 # [ 126.473079] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:10Z level=info event=signal_exit6202worker2 # [ 126.490652] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:10Z level=info event=scheduler_yield6203lb # [ 126.524492] niks3-server[1047]: 2026/09/20 08:05:10 INFO lead: released remote=192.168.1.4:450846204worker1 # [ 126.478695] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:10Z level=info event=scheduler_restarting addr=lb:500516205worker2 # [ 126.495580] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:342786206worker2 # [ 126.496975] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:10Z level=info event=worker_gone addr=192.168.1.3:500516207worker2 # [ 126.498640] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:10Z level=info event=scheduler_restarting addr=lb:500516208worker2 # [ 126.500344] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:342786209worker2 # [ 126.501681] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:10Z level=info event=worker_gone addr=192.168.1.4:500516210client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds)6211client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6212client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6213worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6214worker1 # [ 126.679026] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:10Z level=info event=scheduler_connected addr=lb:500516215worker2 # [ 126.699310] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:10Z level=info event=scheduler_connected addr=lb:500516216worker1 # [ 126.685151] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6217worker2 # [ 126.703134] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6218worker1 # [ 126.885519] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:10Z level=info event=scheduler_connected addr=lb:500516219worker2 # [ 126.904421] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:11Z level=info event=scheduler_connected addr=lb:500516220worker1 # [ 126.888508] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6221worker2 # [ 126.907454] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6222worker1 # [ 127.089141] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:11Z level=info event=scheduler_connected addr=lb:500516223worker2 # [ 127.108189] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:11Z level=info event=scheduler_connected addr=lb:500516224worker1 # [ 127.091479] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6225worker2 # [ 127.110442] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6226worker1 # [ 127.292060] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:11Z level=info event=scheduler_connected addr=lb:500516227worker2 # [ 127.311073] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:11Z level=info event=scheduler_connected addr=lb:500516228worker1 # [ 127.294486] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6229worker2 # [ 127.313559] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6230worker2 # [ 127.492080] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:11Z level=info event=scheduler_restarting6231worker1 # [ 127.497146] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:11Z level=info event=scheduler_connected addr=lb:500516232worker1 # [ 127.501106] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6233worker2 # [ 127.523528] nix-grpc-daemon[1516]: ts=2026-09-20T08:05:11Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6234worker2 # [ 127.569288] nix-grpc-daemon[1516]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6235worker2 # [ 127.573256] nix-grpc-daemon[1516]: E0000 00:00:1789891511.753348 1559 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true6236worker2 # [ 127.578143] nix-grpc-daemon[1516]: E0000 00:00:1789891511.753518 1559 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6237worker1 # [ 127.701854] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:11Z level=info event=scheduler_connected addr=lb:500516238worker2 # [ 127.720698] nix-grpc-daemon[1516]: E0000 00:00:1789891511.905059 1559 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true6239worker2 # [ 127.894909] nix-daemon[870]: reaped child process 1567, status = succeeded6240worker1 # [ 128.470997] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:12Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"6241worker2 # [ 128.505624] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6242worker2 # [ 128.509147] systemd[1]: nix-grpc-daemon.service: Consumed 654ms CPU time over 24.406s wall clock time, 31M memory peak, 24K incoming IP traffic, 32.9K outgoing IP traffic.6243worker2 # [ 128.525812] systemd[1]: Starting Nix worker-protocol over gRPC...6244worker2 # [ 128.682508] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:12Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6245worker2 # [ 128.685525] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:12Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16246worker1 # [ 128.671985] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:12Z level=info event=scheduler_connected addr=lb:500516247worker2 # [ 128.691483] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:12Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6248worker1 # [ 128.674513] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6249worker2 # [ 128.695135] systemd[1]: Started Nix worker-protocol over gRPC.6250lb # [ 128.732268] niks3-server[1047]: 2026/09/20 08:05:12 INFO lead: acquired remote=192.168.1.4:361326251worker2 # [ 128.701088] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:12Z level=info event=scheduler_take_over6252worker2 # [ 128.706053] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:12Z level=info event=scheduler_connected addr=lb:500516253worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 2.09 seconds)6254lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6255worker2 # [ 128.710974] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:12Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06256lb: must succeed: curl -sf localhost:9901/clusters6257lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6258worker1 # [ 128.875703] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:12Z level=info event=scheduler_connected addr=lb:500516259worker1 # [ 128.881130] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:12Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6260worker1 # [ 129.081905] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:13Z level=info event=scheduler_connected addr=lb:500516261worker2 # [ 129.101659] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06262lb: must succeed: curl -sf localhost:9901/clusters6263lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6264lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.10 seconds)6265lb: must succeed: curl -sf localhost:9901/clusters6266lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6267worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6268worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)6269(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.82 seconds)6270subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6271client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16272worker2 # [ 130.097979] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:561006273worker2 # [ 130.103234] nix-daemon[870]: accepted connection from pid 1852, user nix-grpc-daemon (trusted)6274worker2 # [ 130.115422] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:14Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06275worker2 # [ 130.117411] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:14Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16276worker2 # [ 130.119158] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:14Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06277worker2 # [ 130.120686] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:14Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06278worker1 # [ 130.147377] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606279worker1 # [ 130.158774] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:389606280worker1 # [ 130.168521] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:389606281worker1 # [ 130.179294] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6282worker1 # [ 130.315966] nix-daemon[845]: accepted connection from pid 1577, user nix-grpc-daemon (trusted)6283worker1 # [ 130.327932] nix-daemon[845]: reaped child process 1580, status = succeeded6284worker1 # [ 130.456397] nix-daemon[845]: accepted connection from pid 1582, user nix-grpc-daemon (trusted)6285worker1 # [ 130.468305] nix-daemon[845]: reaped child process 1585, status = succeeded6286lb # [ 130.526503] niks3-server[1047]: 2026/09/20 08:05:14 INFO Received uploads request method=POST path=/api/pending_closures6287worker1 # [ 130.490321] nix-grpc-daemon[1400]: time=2026-09-20T08:05:14.526Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6288worker1 # [ 130.491758] nix-grpc-daemon[1400]: time=2026-09-20T08:05:14.528Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6289lb # [ 130.556560] niks3-server[1047]: 2026/09/20 08:05:14 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6290lb # [ 130.563898] niks3-server[1047]: 2026/09/20 08:05:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6291lb # [ 130.567064] niks3-server[1047]: 2026/09/20 08:05:14 INFO Signed narinfos id=44 count=16292worker1 # [ 130.518515] nix-grpc-daemon[1400]: time=2026-09-20T08:05:14.555Z level=INFO msg="Uploading 1 narinfos"6293lb # [ 130.575879] niks3-server[1047]: 2026/09/20 08:05:14 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6294lb # [ 130.584159] niks3-server[1047]: 2026/09/20 08:05:14 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6295lb # [ 130.594989] niks3-server[1047]: 2026/09/20 08:05:14 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6296lb # [ 130.610489] niks3-server[1047]: 2026/09/20 08:05:14 INFO Completed upload id=446297worker1 # [ 130.562087] nix-grpc-daemon[1400]: time=2026-09-20T08:05:14.598Z level=INFO msg="Upload complete. (372ms)"6298worker1 # [ 130.565445] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 paths=1 nar_bytes_in=5046299worker1 # [ 130.571340] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606300worker1 # [ 130.583107] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6301worker1 # [ 130.590547] nix-daemon[845]: reaped child process 1575, status = succeeded6302worker1 # [ 130.601779] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6303worker1 # [ 132.216657] nix-daemon[845]: reaped child process 1589, status = succeeded6304worker1 # [ 132.334633] nix-daemon[845]: accepted connection from pid 1604, user nix-grpc-daemon (trusted)6305worker1 # [ 132.346769] nix-daemon[845]: reaped child process 1607, status = succeeded6306lb # [ 132.408633] niks3-server[1047]: 2026/09/20 08:05:16 INFO Received uploads request method=POST path=/api/pending_closures6307worker1 # [ 132.365938] nix-grpc-daemon[1400]: time=2026-09-20T08:05:16.402Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6308worker1 # [ 132.367480] nix-grpc-daemon[1400]: time=2026-09-20T08:05:16.403Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6309lb # [ 132.432248] niks3-server[1047]: 2026/09/20 08:05:16 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6310lb # [ 132.436856] niks3-server[1047]: 2026/09/20 08:05:16 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6311lb # [ 132.439071] niks3-server[1047]: 2026/09/20 08:05:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6312lb # [ 132.441054] niks3-server[1047]: 2026/09/20 08:05:16 INFO Signed narinfos id=45 count=16313worker1 # [ 132.392776] nix-grpc-daemon[1400]: time=2026-09-20T08:05:16.429Z level=INFO msg="Uploading 1 narinfos"6314lb # [ 132.446396] niks3-server[1047]: 2026/09/20 08:05:16 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6315lb # [ 132.449040] niks3-server[1047]: 2026/09/20 08:05:16 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6316lb # [ 132.452910] niks3-server[1047]: 2026/09/20 08:05:16 INFO Completed upload id=456317worker1 # [ 132.404438] nix-grpc-daemon[1400]: time=2026-09-20T08:05:16.440Z level=INFO msg="Upload complete. (195ms)"6318lb # [ 132.454740] niks3-server[1047]: 2026/09/20 08:05:16 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6319worker1 # [ 132.406858] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=16320worker1 # [ 132.413144] nix-daemon[845]: reaped child process 1587, status = succeeded6321worker2 # [ 132.429987] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:16Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16322worker2 # [ 132.437835] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:16Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06323worker1 # [ 132.458084] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606324worker1 # [ 132.468828] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:389606325worker1 # [ 132.476700] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:389606326worker1 # [ 132.484328] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6327worker1 # [ 132.641315] nix-daemon[845]: accepted connection from pid 1611, user nix-grpc-daemon (trusted)6328worker1 # [ 132.653507] nix-daemon[845]: reaped child process 1614, status = succeeded6329worker1 # [ 132.804511] nix-daemon[845]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)6330worker1 # [ 132.816794] nix-daemon[845]: reaped child process 1619, status = succeeded6331lb # [ 132.877548] niks3-server[1047]: 2026/09/20 08:05:16 INFO Received uploads request method=POST path=/api/pending_closures6332worker1 # [ 132.833839] nix-grpc-daemon[1400]: time=2026-09-20T08:05:16.870Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6333worker1 # [ 132.835280] nix-grpc-daemon[1400]: time=2026-09-20T08:05:16.870Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6334lb # [ 132.891656] niks3-server[1047]: 2026/09/20 08:05:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6335lb # [ 132.895851] niks3-server[1047]: 2026/09/20 08:05:16 INFO Signed narinfos id=46 count=16336worker1 # [ 132.847382] nix-grpc-daemon[1400]: time=2026-09-20T08:05:16.883Z level=INFO msg="Uploading 1 narinfos"6337lb # [ 132.898316] niks3-server[1047]: 2026/09/20 08:05:16 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6338lb # [ 132.901275] niks3-server[1047]: 2026/09/20 08:05:16 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6339lb # [ 132.905954] niks3-server[1047]: 2026/09/20 08:05:16 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6340lb # [ 132.908347] niks3-server[1047]: 2026/09/20 08:05:16 INFO Completed upload id=466341worker1 # [ 132.861139] nix-grpc-daemon[1400]: time=2026-09-20T08:05:16.897Z level=INFO msg="Upload complete. (366ms)"6342lb # [ 132.910772] niks3-server[1047]: 2026/09/20 08:05:16 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6343worker1 # [ 132.863169] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 paths=1 nar_bytes_in=5046344worker1 # [ 132.866135] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606345worker1 # [ 132.870704] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6346worker1 # [ 132.876249] nix-daemon[845]: reaped child process 1609, status = succeeded6347worker1 # [ 132.880234] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6348worker1 # [ 134.094543] nix-daemon[845]: reaped child process 1623, status = succeeded6349worker1 # [ 134.219607] nix-daemon[845]: accepted connection from pid 1638, user nix-grpc-daemon (trusted)6350worker1 # [ 134.232583] nix-daemon[845]: reaped child process 1641, status = succeeded6351lb # [ 134.290956] niks3-server[1047]: 2026/09/20 08:05:18 INFO Received uploads request method=POST path=/api/pending_closures6352worker1 # [ 134.251372] nix-grpc-daemon[1400]: time=2026-09-20T08:05:18.287Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6353worker1 # [ 134.252857] nix-grpc-daemon[1400]: time=2026-09-20T08:05:18.289Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6354lb # [ 134.332147] niks3-server[1047]: 2026/09/20 08:05:18 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6355lb # [ 134.340216] niks3-server[1047]: 2026/09/20 08:05:18 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6356lb # [ 134.349689] niks3-server[1047]: 2026/09/20 08:05:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6357lb # [ 134.354245] niks3-server[1047]: 2026/09/20 08:05:18 INFO Signed narinfos id=47 count=16358worker1 # [ 134.308964] nix-grpc-daemon[1400]: time=2026-09-20T08:05:18.345Z level=INFO msg="Uploading 1 narinfos"6359lb # [ 134.364267] niks3-server[1047]: 2026/09/20 08:05:18 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6360lb # [ 134.373255] niks3-server[1047]: 2026/09/20 08:05:18 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6361lb # [ 134.377878] niks3-server[1047]: 2026/09/20 08:05:18 INFO Completed upload id=476362worker1 # [ 134.330656] nix-grpc-daemon[1400]: time=2026-09-20T08:05:18.367Z level=INFO msg="Upload complete. (244ms)"6363lb # [ 134.380528] niks3-server[1047]: 2026/09/20 08:05:18 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6364worker1 # [ 134.333239] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=16365worker2 # [ 134.351582] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:18Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16366worker2 # [ 134.357036] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:18Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06367worker1 # [ 134.338779] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606368worker1 # [ 134.348664] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:389606369worker1 # [ 134.352894] nix-daemon[845]: reaped child process 1621, status = succeeded6370worker1 # [ 134.356061] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:389606371worker1 # [ 134.359971] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6372worker1 # [ 134.514290] nix-daemon[845]: accepted connection from pid 1645, user nix-grpc-daemon (trusted)6373worker1 # [ 134.528345] nix-daemon[845]: reaped child process 1648, status = succeeded6374worker1 # [ 134.662225] nix-daemon[845]: accepted connection from pid 1650, user nix-grpc-daemon (trusted)6375worker1 # [ 134.674181] nix-daemon[845]: reaped child process 1653, status = succeeded6376lb # [ 134.734361] niks3-server[1047]: 2026/09/20 08:05:18 INFO Received uploads request method=POST path=/api/pending_closures6377worker1 # [ 134.695403] nix-grpc-daemon[1400]: time=2026-09-20T08:05:18.731Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6378worker1 # [ 134.696802] nix-grpc-daemon[1400]: time=2026-09-20T08:05:18.731Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6379lb # [ 134.759900] niks3-server[1047]: 2026/09/20 08:05:18 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6380lb # [ 134.773668] niks3-server[1047]: 2026/09/20 08:05:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6381worker1 # [ 134.733075] nix-grpc-daemon[1400]: time=2026-09-20T08:05:18.769Z level=INFO msg="Uploading 1 narinfos"6382lb # [ 134.781422] niks3-server[1047]: 2026/09/20 08:05:18 INFO Signed narinfos id=48 count=16383lb # [ 134.786126] niks3-server[1047]: 2026/09/20 08:05:18 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6384lb # [ 134.797459] niks3-server[1047]: 2026/09/20 08:05:18 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6385lb # [ 134.803384] niks3-server[1047]: 2026/09/20 08:05:18 INFO Completed upload id=486386worker1 # [ 134.757179] nix-grpc-daemon[1400]: time=2026-09-20T08:05:18.793Z level=INFO msg="Upload complete. (391ms)"6387lb # [ 134.805955] niks3-server[1047]: 2026/09/20 08:05:18 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6388worker1 # [ 134.759149] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 paths=1 nar_bytes_in=5046389worker1 # [ 134.762221] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606390worker1 # [ 134.772545] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6391worker1 # [ 134.777961] nix-daemon[845]: reaped child process 1643, status = succeeded6392worker1 # [ 134.780714] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6393worker1 # [ 135.595457] nix-daemon[845]: reaped child process 1657, status = succeeded6394worker1 # [ 135.714466] nix-daemon[845]: accepted connection from pid 1672, user nix-grpc-daemon (trusted)6395worker1 # [ 135.725147] nix-daemon[845]: reaped child process 1675, status = succeeded6396lb # [ 135.784210] niks3-server[1047]: 2026/09/20 08:05:19 INFO Received uploads request method=POST path=/api/pending_closures6397worker1 # [ 135.746650] nix-grpc-daemon[1400]: time=2026-09-20T08:05:19.782Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6398worker1 # [ 135.748270] nix-grpc-daemon[1400]: time=2026-09-20T08:05:19.784Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6399lb # [ 135.810359] niks3-server[1047]: 2026/09/20 08:05:19 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6400lb # [ 135.815318] niks3-server[1047]: 2026/09/20 08:05:19 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6401lb # [ 135.819606] niks3-server[1047]: 2026/09/20 08:05:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6402lb # [ 135.821660] niks3-server[1047]: 2026/09/20 08:05:19 INFO Signed narinfos id=49 count=16403worker1 # [ 135.773170] nix-grpc-daemon[1400]: time=2026-09-20T08:05:19.809Z level=INFO msg="Uploading 1 narinfos"6404lb # [ 135.824529] niks3-server[1047]: 2026/09/20 08:05:19 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6405lb # [ 135.829154] niks3-server[1047]: 2026/09/20 08:05:19 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6406lb # [ 135.832752] niks3-server[1047]: 2026/09/20 08:05:19 INFO Completed upload id=496407worker1 # [ 135.784134] nix-grpc-daemon[1400]: time=2026-09-20T08:05:19.820Z level=INFO msg="Upload complete. (196ms)"6408lb # [ 135.835087] niks3-server[1047]: 2026/09/20 08:05:19 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6409worker1 # [ 135.786621] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=16410worker2 # [ 135.804407] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:19Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16411worker1 # [ 135.790956] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606412worker2 # [ 135.809252] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:19Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06413worker1 # [ 135.796358] nix-daemon[845]: reaped child process 1655, status = succeeded6414worker1 # [ 135.799278] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:389606415worker1 # [ 135.805065] nix-grpc-daemon[1400]: time=2026-09-20T08:05:19.841Z level=INFO msg="All 1 paths already cached"6416worker1 # [ 135.808379] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:389606417worker1 # [ 135.813069] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6418worker1 # [ 135.929544] nix-daemon[845]: accepted connection from pid 1679, user nix-grpc-daemon (trusted)6419worker1 # [ 135.942776] nix-daemon[845]: reaped child process 1682, status = succeeded6420lb # [ 136.022582] envoy[899]: conn peer=[2001:db8:1::4]:41464 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1764 tx=634 ms=230446421worker1 # [ 136.061470] nix-daemon[845]: accepted connection from pid 1684, user nix-grpc-daemon (trusted)6422worker1 # [ 136.074316] nix-daemon[845]: reaped child process 1687, status = succeeded6423lb # [ 136.132930] niks3-server[1047]: 2026/09/20 08:05:20 INFO Received uploads request method=POST path=/api/pending_closures6424worker1 # [ 136.092974] nix-grpc-daemon[1400]: time=2026-09-20T08:05:20.129Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6425worker1 # [ 136.094365] nix-grpc-daemon[1400]: time=2026-09-20T08:05:20.129Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6426lb # [ 136.156829] niks3-server[1047]: 2026/09/20 08:05:20 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6427lb # [ 136.169640] niks3-server[1047]: 2026/09/20 08:05:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6428lb # [ 136.175245] niks3-server[1047]: 2026/09/20 08:05:20 INFO Signed narinfos id=50 count=16429worker1 # [ 136.130200] nix-grpc-daemon[1400]: time=2026-09-20T08:05:20.166Z level=INFO msg="Uploading 1 narinfos"6430lb # [ 136.181855] niks3-server[1047]: 2026/09/20 08:05:20 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6431lb # [ 136.192576] niks3-server[1047]: 2026/09/20 08:05:20 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6432worker1 # [ 136.150912] nix-grpc-daemon[1400]: time=2026-09-20T08:05:20.187Z level=INFO msg="Upload complete. (333ms)"6433lb # [ 136.199297] niks3-server[1047]: 2026/09/20 08:05:20 INFO Completed upload id=506434worker1 # [ 136.153974] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 paths=1 nar_bytes_in=6246435lb # [ 136.202558] niks3-server[1047]: 2026/09/20 08:05:20 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6436worker1 # [ 136.157657] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606437worker1 # [ 136.164349] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6438worker1 # [ 136.166926] nix-daemon[845]: reaped child process 1677, status = succeeded6439worker1 # [ 136.172360] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6440worker1 # [ 137.589214] nix-daemon[845]: reaped child process 1691, status = succeeded6441worker1 # [ 137.715269] nix-daemon[845]: accepted connection from pid 1706, user nix-grpc-daemon (trusted)6442worker1 # [ 137.728564] nix-daemon[845]: reaped child process 1709, status = succeeded6443lb # [ 137.785994] niks3-server[1047]: 2026/09/20 08:05:21 INFO Received uploads request method=POST path=/api/pending_closures6444worker1 # [ 137.744306] nix-grpc-daemon[1400]: time=2026-09-20T08:05:21.779Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6445worker1 # [ 137.745644] nix-grpc-daemon[1400]: time=2026-09-20T08:05:21.779Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6446lb # [ 137.819863] niks3-server[1047]: 2026/09/20 08:05:21 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6447lb # [ 137.823806] niks3-server[1047]: 2026/09/20 08:05:21 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6448lb # [ 137.831308] niks3-server[1047]: 2026/09/20 08:05:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6449lb # [ 137.834479] niks3-server[1047]: 2026/09/20 08:05:21 INFO Signed narinfos id=51 count=16450worker1 # [ 137.787998] nix-grpc-daemon[1400]: time=2026-09-20T08:05:21.824Z level=INFO msg="Uploading 1 narinfos"6451lb # [ 137.845237] niks3-server[1047]: 2026/09/20 08:05:21 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6452lb # [ 137.849067] niks3-server[1047]: 2026/09/20 08:05:21 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6453lb # [ 137.856374] niks3-server[1047]: 2026/09/20 08:05:21 INFO Completed upload id=516454worker1 # [ 137.808228] nix-grpc-daemon[1400]: time=2026-09-20T08:05:21.844Z level=INFO msg="Upload complete. (228ms)"6455worker2 # [ 137.829754] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:22Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16456lb # [ 137.864390] niks3-server[1047]: 2026/09/20 08:05:21 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6457worker1 # [ 137.812519] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=16458worker2 # [ 137.836152] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:22Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06459worker1 # [ 137.819823] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606460worker1 # [ 137.826800] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:389606461worker1 # [ 137.828988] nix-daemon[845]: reaped child process 1689, status = succeeded6462worker1 # [ 137.845843] nix-grpc-daemon[1400]: time=2026-09-20T08:05:21.882Z level=INFO msg="All 1 paths already cached"6463worker1 # [ 137.849981] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:389606464worker1 # [ 137.855285] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6465worker1 # [ 138.006178] nix-daemon[845]: accepted connection from pid 1713, user nix-grpc-daemon (trusted)6466worker1 # [ 138.022432] nix-daemon[845]: reaped child process 1716, status = succeeded6467worker1 # [ 138.162060] nix-daemon[845]: accepted connection from pid 1718, user nix-grpc-daemon (trusted)6468worker1 # [ 138.174354] nix-daemon[845]: reaped child process 1721, status = succeeded6469lb # [ 138.233137] niks3-server[1047]: 2026/09/20 08:05:22 INFO Received uploads request method=POST path=/api/pending_closures6470worker1 # [ 138.193412] nix-grpc-daemon[1400]: time=2026-09-20T08:05:22.229Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6471worker1 # [ 138.194833] nix-grpc-daemon[1400]: time=2026-09-20T08:05:22.229Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6472lb # [ 138.259246] niks3-server[1047]: 2026/09/20 08:05:22 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6473lb # [ 138.272754] niks3-server[1047]: 2026/09/20 08:05:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6474worker1 # [ 138.229390] nix-grpc-daemon[1400]: time=2026-09-20T08:05:22.265Z level=INFO msg="Uploading 1 narinfos"6475lb # [ 138.277944] niks3-server[1047]: 2026/09/20 08:05:22 INFO Signed narinfos id=52 count=16476lb # [ 138.287126] niks3-server[1047]: 2026/09/20 08:05:22 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6477lb # [ 138.293927] niks3-server[1047]: 2026/09/20 08:05:22 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6478lb # [ 138.299739] niks3-server[1047]: 2026/09/20 08:05:22 INFO Completed upload id=526479worker1 # [ 138.251313] nix-grpc-daemon[1400]: time=2026-09-20T08:05:22.287Z level=INFO msg="Upload complete. (391ms)"6480lb # [ 138.301251] niks3-server[1047]: 2026/09/20 08:05:22 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6481worker1 # [ 138.254840] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 paths=1 nar_bytes_in=6246482worker1 # [ 138.260277] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606483worker1 # [ 138.270296] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6484worker1 # [ 138.272949] nix-daemon[845]: reaped child process 1711, status = succeeded6485worker1 # [ 138.278971] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6486worker1 # [ 138.891332] nix-daemon[845]: reaped child process 1725, status = succeeded6487worker1 # [ 139.035144] nix-daemon[845]: accepted connection from pid 1740, user nix-grpc-daemon (trusted)6488worker1 # [ 139.047872] nix-daemon[845]: reaped child process 1743, status = succeeded6489lb # [ 139.105747] niks3-server[1047]: 2026/09/20 08:05:23 INFO Received uploads request method=POST path=/api/pending_closures6490worker1 # [ 139.064199] nix-grpc-daemon[1400]: time=2026-09-20T08:05:23.099Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6491worker1 # [ 139.065585] nix-grpc-daemon[1400]: time=2026-09-20T08:05:23.099Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6492lb # [ 139.139216] niks3-server[1047]: 2026/09/20 08:05:23 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6493lb # [ 139.146054] niks3-server[1047]: 2026/09/20 08:05:23 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6494lb # [ 139.156318] niks3-server[1047]: 2026/09/20 08:05:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6495lb # [ 139.159869] niks3-server[1047]: 2026/09/20 08:05:23 INFO Signed narinfos id=53 count=16496worker1 # [ 139.114425] nix-grpc-daemon[1400]: time=2026-09-20T08:05:23.150Z level=INFO msg="Uploading 1 narinfos"6497lb # [ 139.166400] niks3-server[1047]: 2026/09/20 08:05:23 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6498lb # [ 139.173038] niks3-server[1047]: 2026/09/20 08:05:23 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6499lb # [ 139.175873] niks3-server[1047]: 2026/09/20 08:05:23 INFO Completed upload id=536500worker1 # [ 139.127535] nix-grpc-daemon[1400]: time=2026-09-20T08:05:23.164Z level=INFO msg="Upload complete. (243ms)"6501lb # [ 139.178822] niks3-server[1047]: 2026/09/20 08:05:23 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6502worker1 # [ 139.133150] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=16503worker2 # [ 139.151779] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:23Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16504worker1 # [ 139.138940] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606505worker2 # [ 139.161198] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:23Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06506worker1 # [ 139.149342] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:389606507worker1 # [ 139.151263] nix-daemon[845]: reaped child process 1723, status = succeeded6508worker1 # [ 139.156694] nix-grpc-daemon[1400]: time=2026-09-20T08:05:23.193Z level=INFO msg="All 1 paths already cached"6509worker1 # [ 139.160890] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:389606510worker1 # [ 139.165713] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6511worker1 # [ 139.310924] nix-daemon[845]: accepted connection from pid 1747, user nix-grpc-daemon (trusted)6512worker1 # [ 139.323111] nix-daemon[845]: reaped child process 1750, status = succeeded6513worker1 # [ 139.469632] nix-daemon[845]: accepted connection from pid 1752, user nix-grpc-daemon (trusted)6514worker1 # [ 139.482245] nix-daemon[845]: reaped child process 1755, status = succeeded6515lb # [ 139.541511] niks3-server[1047]: 2026/09/20 08:05:23 INFO Received uploads request method=POST path=/api/pending_closures6516worker1 # [ 139.503593] nix-grpc-daemon[1400]: time=2026-09-20T08:05:23.540Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6517worker1 # [ 139.505279] nix-grpc-daemon[1400]: time=2026-09-20T08:05:23.541Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6518lb # [ 139.574224] niks3-server[1047]: 2026/09/20 08:05:23 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6519lb # [ 139.588788] niks3-server[1047]: 2026/09/20 08:05:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6520worker1 # [ 139.545881] nix-grpc-daemon[1400]: time=2026-09-20T08:05:23.582Z level=INFO msg="Uploading 1 narinfos"6521lb # [ 139.594208] niks3-server[1047]: 2026/09/20 08:05:23 INFO Signed narinfos id=54 count=16522lb # [ 139.601518] niks3-server[1047]: 2026/09/20 08:05:23 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6523lb # [ 139.613115] niks3-server[1047]: 2026/09/20 08:05:23 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6524lb # [ 139.620193] niks3-server[1047]: 2026/09/20 08:05:23 INFO Completed upload id=546525worker1 # [ 139.571852] nix-grpc-daemon[1400]: time=2026-09-20T08:05:23.608Z level=INFO msg="Upload complete. (401ms)"6526lb # [ 139.622136] niks3-server[1047]: 2026/09/20 08:05:23 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6527worker1 # [ 139.574038] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 paths=1 nar_bytes_in=6246528worker1 # [ 139.578431] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606529worker1 # [ 139.586974] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6530worker1 # [ 139.590719] nix-daemon[845]: reaped child process 1745, status = succeeded6531worker1 # [ 139.596781] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6532worker1 # [ 140.609107] nix-daemon[845]: reaped child process 1759, status = succeeded6533worker1 # [ 140.739898] nix-daemon[845]: accepted connection from pid 1774, user nix-grpc-daemon (trusted)6534worker1 # [ 140.752367] nix-daemon[845]: reaped child process 1777, status = succeeded6535lb # [ 140.815365] niks3-server[1047]: 2026/09/20 08:05:24 INFO Received uploads request method=POST path=/api/pending_closures6536worker1 # [ 140.777296] nix-grpc-daemon[1400]: time=2026-09-20T08:05:24.812Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6537worker1 # [ 140.778633] nix-grpc-daemon[1400]: time=2026-09-20T08:05:24.812Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6538lb # [ 140.858078] niks3-server[1047]: 2026/09/20 08:05:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6539worker1 # [ 140.817725] nix-grpc-daemon[1400]: time=2026-09-20T08:05:24.854Z level=INFO msg="Uploading 1 narinfos"6540lb # [ 140.866587] niks3-server[1047]: 2026/09/20 08:05:24 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6541lb # [ 140.869778] niks3-server[1047]: 2026/09/20 08:05:24 INFO Signed narinfos id=55 count=16542lb # [ 140.875229] niks3-server[1047]: 2026/09/20 08:05:24 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6543lb # [ 140.880478] niks3-server[1047]: 2026/09/20 08:05:24 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6544lb # [ 140.890772] niks3-server[1047]: 2026/09/20 08:05:24 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6545lb # [ 140.894343] niks3-server[1047]: 2026/09/20 08:05:24 INFO Completed upload id=556546worker1 # [ 140.846068] nix-grpc-daemon[1400]: time=2026-09-20T08:05:24.882Z level=INFO msg="Upload complete. (243ms)"6547lb # [ 140.897142] niks3-server[1047]: 2026/09/20 08:05:24 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6548worker1 # [ 140.850945] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:24Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=16549worker2 # [ 140.869612] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:25Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16550worker1 # [ 140.864522] nix-daemon[845]: reaped child process 1757, status = succeeded6551worker2 # [ 140.879348] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:25Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06552worker1 # [ 140.903426] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606553worker1 # [ 140.912752] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:389606554worker1 # [ 140.921735] nix-grpc-daemon[1400]: time=2026-09-20T08:05:24.958Z level=INFO msg="All 2 paths already cached"6555worker1 # [ 140.929059] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:389606556worker1 # [ 140.937333] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6557worker1 # [ 141.104483] nix-daemon[845]: accepted connection from pid 1781, user nix-grpc-daemon (trusted)6558worker1 # [ 141.117306] nix-daemon[845]: reaped child process 1784, status = succeeded6559worker1 # [ 141.267583] nix-daemon[845]: accepted connection from pid 1786, user nix-grpc-daemon (trusted)6560worker1 # [ 141.280430] nix-daemon[845]: reaped child process 1789, status = succeeded6561lb # [ 141.338494] niks3-server[1047]: 2026/09/20 08:05:25 INFO Received uploads request method=POST path=/api/pending_closures6562worker1 # [ 141.299280] nix-grpc-daemon[1400]: time=2026-09-20T08:05:25.335Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6563worker1 # [ 141.300748] nix-grpc-daemon[1400]: time=2026-09-20T08:05:25.335Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6564lb # [ 141.367314] niks3-server[1047]: 2026/09/20 08:05:25 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6565lb # [ 141.376368] niks3-server[1047]: 2026/09/20 08:05:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6566lb # [ 141.381227] niks3-server[1047]: 2026/09/20 08:05:25 INFO Signed narinfos id=56 count=16567worker1 # [ 141.336302] nix-grpc-daemon[1400]: time=2026-09-20T08:05:25.372Z level=INFO msg="Uploading 1 narinfos"6568lb # [ 141.391237] niks3-server[1047]: 2026/09/20 08:05:25 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6569lb # [ 141.401971] niks3-server[1047]: 2026/09/20 08:05:25 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6570lb # [ 141.409267] niks3-server[1047]: 2026/09/20 08:05:25 INFO Completed upload id=566571worker1 # [ 141.363478] nix-grpc-daemon[1400]: time=2026-09-20T08:05:25.399Z level=INFO msg="Upload complete. (413ms)"6572lb # [ 141.412980] niks3-server[1047]: 2026/09/20 08:05:25 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6573worker1 # [ 141.367541] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 paths=1 nar_bytes_in=7526574worker1 # [ 141.372412] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606575worker1 # [ 141.381462] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6576worker1 # [ 141.386379] nix-daemon[845]: reaped child process 1779, status = succeeded6577worker1 # [ 141.390703] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6578worker1 # [ 142.403771] nix-daemon[845]: reaped child process 1793, status = succeeded6579worker1 # [ 142.557385] nix-daemon[845]: accepted connection from pid 1808, user nix-grpc-daemon (trusted)6580worker1 # [ 142.569982] nix-daemon[845]: reaped child process 1811, status = succeeded6581lb # [ 142.633303] niks3-server[1047]: 2026/09/20 08:05:26 INFO Received uploads request method=POST path=/api/pending_closures6582worker1 # [ 142.589838] nix-grpc-daemon[1400]: time=2026-09-20T08:05:26.626Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6583worker1 # [ 142.591990] nix-grpc-daemon[1400]: time=2026-09-20T08:05:26.627Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6584lb # [ 142.653991] niks3-server[1047]: 2026/09/20 08:05:26 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6585lb # [ 142.660083] niks3-server[1047]: 2026/09/20 08:05:26 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6586lb # [ 142.667289] niks3-server[1047]: 2026/09/20 08:05:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6587lb # [ 142.670164] niks3-server[1047]: 2026/09/20 08:05:26 INFO Signed narinfos id=57 count=16588worker1 # [ 142.621976] nix-grpc-daemon[1400]: time=2026-09-20T08:05:26.658Z level=INFO msg="Uploading 1 narinfos"6589lb # [ 142.674700] niks3-server[1047]: 2026/09/20 08:05:26 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6590lb # [ 142.680177] niks3-server[1047]: 2026/09/20 08:05:26 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6591lb # [ 142.684034] niks3-server[1047]: 2026/09/20 08:05:26 INFO Completed upload id=576592worker1 # [ 142.635582] nix-grpc-daemon[1400]: time=2026-09-20T08:05:26.672Z level=INFO msg="Upload complete. (238ms)"6593lb # [ 142.686936] niks3-server[1047]: 2026/09/20 08:05:26 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6594worker1 # [ 142.638488] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=16595worker2 # [ 142.656487] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:26Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16596worker1 # [ 142.645433] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606597worker1 # [ 142.649875] nix-daemon[845]: reaped child process 1791, status = succeeded6598worker1 # [ 142.654516] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:389606599worker1 # [ 142.661528] nix-grpc-daemon[1400]: time=2026-09-20T08:05:26.698Z level=INFO msg="All 2 paths already cached"6600worker1 # [ 142.666152] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:389606601worker1 # [ 142.671461] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6602worker1 # [ 142.833088] nix-daemon[845]: accepted connection from pid 1815, user nix-grpc-daemon (trusted)6603worker1 # [ 142.846744] nix-daemon[845]: reaped child process 1818, status = succeeded6604worker1 # [ 142.966167] nix-daemon[845]: accepted connection from pid 1820, user nix-grpc-daemon (trusted)6605worker1 # [ 142.979216] nix-daemon[845]: reaped child process 1823, status = succeeded6606lb # [ 143.036939] niks3-server[1047]: 2026/09/20 08:05:27 INFO Received uploads request method=POST path=/api/pending_closures6607worker1 # [ 142.993560] nix-grpc-daemon[1400]: time=2026-09-20T08:05:27.030Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6608worker1 # [ 142.995074] nix-grpc-daemon[1400]: time=2026-09-20T08:05:27.031Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6609lb # [ 143.057501] niks3-server[1047]: 2026/09/20 08:05:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6610lb # [ 143.060789] niks3-server[1047]: 2026/09/20 08:05:27 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6611lb # [ 143.063368] niks3-server[1047]: 2026/09/20 08:05:27 INFO Signed narinfos id=58 count=16612worker1 # [ 143.014965] nix-grpc-daemon[1400]: time=2026-09-20T08:05:27.051Z level=INFO msg="Uploading 1 narinfos"6613lb # [ 143.066677] niks3-server[1047]: 2026/09/20 08:05:27 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6614lb # [ 143.074388] niks3-server[1047]: 2026/09/20 08:05:27 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6615lb # [ 143.077350] niks3-server[1047]: 2026/09/20 08:05:27 INFO Completed upload id=586616worker1 # [ 143.028848] nix-grpc-daemon[1400]: time=2026-09-20T08:05:27.065Z level=INFO msg="Upload complete. (351ms)"6617worker1 # [ 143.030305] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 paths=1 nar_bytes_in=7526618lb # [ 143.079737] niks3-server[1047]: 2026/09/20 08:05:27 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6619worker1 # [ 143.036447] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606620worker1 # [ 143.041454] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6621worker1 # [ 143.043767] nix-daemon[845]: reaped child process 1813, status = succeeded6622worker1 # [ 143.049470] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6623worker1 # [ 144.477623] nix-daemon[845]: reaped child process 1827, status = succeeded6624worker1 # [ 144.638969] nix-daemon[845]: accepted connection from pid 1842, user nix-grpc-daemon (trusted)6625worker1 # [ 144.651889] nix-daemon[845]: reaped child process 1845, status = succeeded6626lb # [ 144.710252] niks3-server[1047]: 2026/09/20 08:05:28 INFO Received uploads request method=POST path=/api/pending_closures6627worker1 # [ 144.670992] nix-grpc-daemon[1400]: time=2026-09-20T08:05:28.707Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6628worker1 # [ 144.674054] nix-grpc-daemon[1400]: time=2026-09-20T08:05:28.709Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6629lb # [ 144.736177] niks3-server[1047]: 2026/09/20 08:05:28 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6630lb # [ 144.740582] niks3-server[1047]: 2026/09/20 08:05:28 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6631lb # [ 144.743954] niks3-server[1047]: 2026/09/20 08:05:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6632lb # [ 144.745887] niks3-server[1047]: 2026/09/20 08:05:28 INFO Signed narinfos id=59 count=16633worker1 # [ 144.697789] nix-grpc-daemon[1400]: time=2026-09-20T08:05:28.734Z level=INFO msg="Uploading 1 narinfos"6634lb # [ 144.751136] niks3-server[1047]: 2026/09/20 08:05:28 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6635lb # [ 144.756829] niks3-server[1047]: 2026/09/20 08:05:28 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6636lb # [ 144.759581] niks3-server[1047]: 2026/09/20 08:05:28 INFO Completed upload id=596637worker1 # [ 144.712805] nix-grpc-daemon[1400]: time=2026-09-20T08:05:28.749Z level=INFO msg="Upload complete. (254ms)"6638worker1 # [ 144.716363] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=16639worker2 # [ 144.734059] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:28Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16640lb # [ 144.771490] niks3-server[1047]: 2026/09/20 08:05:28 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6641worker1 # [ 144.724049] nix-daemon[845]: reaped child process 1825, status = succeeded6642worker1 # [ 144.760670] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606643worker1 # [ 144.769668] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:389606644worker1 # [ 144.779550] nix-grpc-daemon[1400]: time=2026-09-20T08:05:28.815Z level=INFO msg="All 2 paths already cached"6645worker1 # [ 144.785448] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:389606646worker1 # [ 144.793325] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6647worker1 # [ 144.938688] nix-daemon[845]: accepted connection from pid 1849, user nix-grpc-daemon (trusted)6648worker1 # [ 144.952967] nix-daemon[845]: reaped child process 1852, status = succeeded6649worker1 # [ 145.107653] nix-daemon[845]: accepted connection from pid 1854, user nix-grpc-daemon (trusted)6650worker1 # [ 145.120639] nix-daemon[845]: reaped child process 1857, status = succeeded6651lb # [ 145.184230] niks3-server[1047]: 2026/09/20 08:05:29 INFO Received uploads request method=POST path=/api/pending_closures6652worker1 # [ 145.143213] nix-grpc-daemon[1400]: time=2026-09-20T08:05:29.179Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6653worker1 # [ 145.144768] nix-grpc-daemon[1400]: time=2026-09-20T08:05:29.181Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6654lb # [ 145.220904] niks3-server[1047]: 2026/09/20 08:05:29 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6655lb # [ 145.224527] niks3-server[1047]: 2026/09/20 08:05:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6656lb # [ 145.226886] niks3-server[1047]: 2026/09/20 08:05:29 INFO Signed narinfos id=60 count=16657worker1 # [ 145.179728] nix-grpc-daemon[1400]: time=2026-09-20T08:05:29.216Z level=INFO msg="Uploading 1 narinfos"6658lb # [ 145.231272] niks3-server[1047]: 2026/09/20 08:05:29 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6659lb # [ 145.238137] niks3-server[1047]: 2026/09/20 08:05:29 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6660lb # [ 145.242171] niks3-server[1047]: 2026/09/20 08:05:29 INFO Completed upload id=606661worker1 # [ 145.193887] nix-grpc-daemon[1400]: time=2026-09-20T08:05:29.230Z level=INFO msg="Upload complete. (394ms)"6662lb # [ 145.245287] niks3-server[1047]: 2026/09/20 08:05:29 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6663worker1 # [ 145.196867] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=0 paths=1 nar_bytes_in=7526664worker1 # [ 145.199675] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:389606665worker1 # [ 145.206516] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6666worker1 # [ 145.209812] nix-daemon[845]: reaped child process 1847, status = succeeded6667worker1 # [ 145.215388] nix-daemon[845]: accepted connection from pid 1312, user nix-grpc-daemon (trusted)6668worker1 # [ 146.238453] nix-daemon[845]: reaped child process 1861, status = succeeded6669worker1 # [ 146.369097] nix-daemon[845]: accepted connection from pid 1876, user nix-grpc-daemon (trusted)6670worker1 # [ 146.383264] nix-daemon[845]: reaped child process 1879, status = succeeded6671lb # [ 146.443345] niks3-server[1047]: 2026/09/20 08:05:30 INFO Received uploads request method=POST path=/api/pending_closures6672worker1 # [ 146.403924] nix-grpc-daemon[1400]: time=2026-09-20T08:05:30.440Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6673worker1 # [ 146.407174] nix-grpc-daemon[1400]: time=2026-09-20T08:05:30.442Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6674lb # [ 146.481341] niks3-server[1047]: 2026/09/20 08:05:30 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6675lb # [ 146.493174] niks3-server[1047]: 2026/09/20 08:05:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6676lb # [ 146.502986] niks3-server[1047]: 2026/09/20 08:05:30 INFO Signed narinfos id=61 count=16677worker1 # [ 146.457596] nix-grpc-daemon[1400]: time=2026-09-20T08:05:30.493Z level=INFO msg="Uploading 1 narinfos"6678lb # [ 146.508801] niks3-server[1047]: 2026/09/20 08:05:30 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6679lb # [ 146.513311] niks3-server[1047]: 2026/09/20 08:05:30 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6680lb # [ 146.522260] niks3-server[1047]: 2026/09/20 08:05:30 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6681lb # [ 146.526281] niks3-server[1047]: 2026/09/20 08:05:30 INFO Completed upload id=616682worker1 # [ 146.477835] nix-grpc-daemon[1400]: time=2026-09-20T08:05:30.514Z level=INFO msg="Upload complete. (255ms)"6683lb # [ 146.528810] niks3-server[1047]: 2026/09/20 08:05:30 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6684worker1 # [ 146.480398] nix-grpc-daemon[1312]: ts=2026-09-20T08:05:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:38960 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=16685worker1 # [ 146.487567] nix-daemon[845]: reaped child process 1859, status = succeeded6686client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.66 seconds)6687worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6688worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.04 seconds)6689client: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]'6690client # [ 146.652171] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build -L --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features "[\"gpu\"]".6691client # Running as unit: gpu.service; invocation ID: 91b4a15c952542b29d45fce8d2230d536692client: (finished: must succeed: systemd-run --unit gpu nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]', in 0.07 seconds)6693lb: must succeed: curl -sf localhost:9901/clusters6694lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6695lb: must succeed: curl -sf localhost:9901/clusters6696lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6697worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true6698worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true, in 0.05 seconds)6699worker2 # [ 146.839634] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:561006700client # [ 146.836178] nix[1334]: don't know how to build these paths:6701client # [ 146.837072] nix[1334]: /nix/store/ynb3m2rijlmsagnc1dpj672gknpqrkcv-farm-top.drv6702worker2 # [ 146.846967] nix-grpc-daemon[1852]: ts=2026-09-20T08:05:31Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06703client # [ 146.843217] nix[1334]: warning: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}, waiting up to 120s for a worker6704lb: must succeed: curl -sf localhost:9901/clusters6705lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6706lb: must succeed: curl -sf localhost:9901/clusters6707lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6708worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true6709worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true, in 0.05 seconds)6710client: waiting for success: systemctl show -p Result gpu | grep -q exit-code6711lb # [ 156.023341] envoy[899]: conn peer=[2001:db8:1::1]:56032 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26821 tx=10620 ms=164556712client # [ 266.844581] nix[1334]: z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv: no connected, non-draining worker for system 'x86_64-linux' offers features {gpu}6713client # [ 266.853084] nix[1334]: error: dependency 'z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv' failed6714client # [ 266.886806] systemd[1]: gpu.service: Main process exited, code=exited, status=1/FAILURE6715client # [ 266.890249] systemd[1]: gpu.service: Failed with result 'exit-code'.6716client # [ 266.895148] systemd[1]: gpu.service: Consumed 190ms CPU time over 2min 241ms wall clock time, 33.5M memory peak, 4K written to disk, 6.6K incoming IP traffic, 5.5K outgoing IP traffic.6717client: (finished: waiting for success: systemctl show -p Result gpu | grep -q exit-code, in 119.73 seconds)6718client: must succeed: journalctl -u gpu -o cat6719client: (finished: must succeed: journalctl -u gpu -o cat, in 0.03 seconds)6720lb: must succeed: curl -sf localhost:9901/clusters6721lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)6722lb: must succeed: curl -sf localhost:9901/clusters6723lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6724worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true6725worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched_system{features="gpu",kind="unplaceable",system="x86_64-linux"} ' || true, in 0.07 seconds)6726(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 137.96 seconds)6727subtest: low disk drains a worker and builds go to the other6728worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6729worker1 # [ 268.740068] nix-grpc-daemon[1312]: ts=2026-09-20T08:07:32Z level=info event=unhealthy reason=min_free6730worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.01 seconds)6731worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6732worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 0.04 seconds)6733client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&26734worker1 # [ 269.115113] nix-grpc-daemon[1312]: ts=2026-09-20T08:07:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:389606735client # don't know how to build these paths:6736client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6737worker2 # [ 269.151203] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:33Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06738worker2 # [ 269.155506] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:33Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16739worker2 # [ 269.193131] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561006740worker2 # [ 269.204819] nix-grpc-daemon[1852]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5)6741worker2 # [ 269.246586] nix-grpc-daemon[1852]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 14 ms (attempt 2/5)6742worker2 # [ 269.266382] nix-grpc-daemon[1852]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 204 ms (attempt 3/5)6743worker2 # [ 269.476294] nix-grpc-daemon[1852]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 344 ms (attempt 4/5)6744worker2 # [ 269.826547] nix-grpc-daemon[1852]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6745worker2 # [ 269.844724] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:561006746client # copying 1 paths to 'lb:50051'...6747client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6748worker2 # [ 269.856353] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:561006749worker2 # [ 269.868521] nix-daemon[870]: accepted connection from pid 1852, user nix-grpc-daemon (trusted)6750worker2 # [ 269.886610] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:34Z level=info event=niks3_push_started pid=19466751worker2 # [ 270.202450] nix-daemon[870]: accepted connection from pid 1959, user nix-grpc-daemon (trusted)6752worker2 # [ 270.214651] nix-daemon[870]: reaped child process 1962, status = succeeded6753worker2 # [ 270.364231] nix-daemon[870]: accepted connection from pid 1964, user nix-grpc-daemon (trusted)6754worker2 # [ 270.376117] nix-daemon[870]: reaped child process 1967, status = succeeded6755lb # [ 270.421782] niks3-server[1047]: 2026/09/20 08:07:34 INFO Received uploads request method=POST path=/api/pending_closures6756worker2 # [ 270.434329] nix-grpc-daemon[1946]: time=2026-09-20T08:07:34.618Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6757worker2 # [ 270.437795] nix-grpc-daemon[1946]: time=2026-09-20T08:07:34.620Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6758lb # [ 270.491657] niks3-server[1047]: 2026/09/20 08:07:34 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6759lb # [ 270.504768] niks3-server[1047]: 2026/09/20 08:07:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6760lb # [ 270.510120] niks3-server[1047]: 2026/09/20 08:07:34 INFO Signed narinfos id=62 count=16761worker2 # [ 270.482293] nix-grpc-daemon[1946]: time=2026-09-20T08:07:34.665Z level=INFO msg="Uploading 1 narinfos"6762lb # [ 270.522518] niks3-server[1047]: 2026/09/20 08:07:34 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6763lb # [ 270.531452] niks3-server[1047]: 2026/09/20 08:07:34 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6764lb # [ 270.539889] niks3-server[1047]: 2026/09/20 08:07:34 INFO Completed upload id=626765worker2 # [ 270.507985] nix-grpc-daemon[1946]: time=2026-09-20T08:07:34.692Z level=INFO msg="Upload complete. (452ms)"6766lb # [ 270.541873] niks3-server[1047]: 2026/09/20 08:07:34 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6767worker2 # [ 270.514575] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56100 duration_s=0 paths=1 nar_bytes_in=5126768worker2 # [ 270.520357] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561006769worker2 # [ 270.532149] nix-daemon[870]: accepted connection from pid 1852, user nix-grpc-daemon (trusted)6770worker2 # [ 270.543725] nix-daemon[870]: reaped child process 1944, status = succeeded6771client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6772worker2 # [ 270.549950] nix-daemon[870]: accepted connection from pid 1852, user nix-grpc-daemon (trusted)6773client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6774client # farm-a> LOG-farm-a-drain6775worker2 # [ 271.368436] nix-daemon[870]: reaped child process 1971, status = succeeded6776worker2 # [ 271.501454] nix-daemon[870]: accepted connection from pid 1986, user nix-grpc-daemon (trusted)6777worker2 # [ 271.513863] nix-daemon[870]: reaped child process 1989, status = succeeded6778lb # [ 271.561361] niks3-server[1047]: 2026/09/20 08:07:35 INFO Received uploads request method=POST path=/api/pending_closures6779worker2 # [ 271.539997] nix-grpc-daemon[1946]: time=2026-09-20T08:07:35.724Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6780worker2 # [ 271.541632] nix-grpc-daemon[1946]: time=2026-09-20T08:07:35.726Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6781lb # [ 271.605290] niks3-server[1047]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6782lb # [ 271.615456] niks3-server[1047]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6783lb # [ 271.620668] niks3-server[1047]: 2026/09/20 08:07:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6784lb # [ 271.624877] niks3-server[1047]: 2026/09/20 08:07:35 INFO Signed narinfos id=63 count=16785worker2 # [ 271.596216] nix-grpc-daemon[1946]: time=2026-09-20T08:07:35.780Z level=INFO msg="Uploading 1 narinfos"6786lb # [ 271.629306] niks3-server[1047]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6787lb # [ 271.634664] niks3-server[1047]: 2026/09/20 08:07:35 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6788lb # [ 271.639242] niks3-server[1047]: 2026/09/20 08:07:35 INFO Completed upload id=636789worker2 # [ 271.607552] nix-grpc-daemon[1946]: time=2026-09-20T08:07:35.791Z level=INFO msg="Upload complete. (247ms)"6790lb # [ 271.640930] niks3-server[1047]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6791worker2 # [ 271.616677] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56100 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=16792worker2 # [ 271.623551] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:35Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06793worker2 # [ 271.627220] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:35Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16794worker2 # [ 271.633829] nix-daemon[870]: reaped child process 1969, status = succeeded6795worker2 # [ 271.665614] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561006796worker2 # [ 271.677445] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:561006797worker2 # [ 271.693479] nix-grpc-daemon[1946]: time=2026-09-20T08:07:35.877Z level=INFO msg="All 1 paths already cached"6798client # copying 1 paths to 'lb:50051'...6799client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6800worker2 # [ 271.700666] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:561006801worker2 # [ 271.712196] nix-daemon[870]: accepted connection from pid 1852, user nix-grpc-daemon (trusted)6802worker2 # [ 271.870974] nix-daemon[870]: accepted connection from pid 1995, user nix-grpc-daemon (trusted)6803worker2 # [ 271.883715] nix-daemon[870]: reaped child process 1998, status = succeeded6804worker2 # [ 272.035128] nix-daemon[870]: accepted connection from pid 2000, user nix-grpc-daemon (trusted)6805worker2 # [ 272.047373] nix-daemon[870]: reaped child process 2003, status = succeeded6806lb # [ 272.091716] niks3-server[1047]: 2026/09/20 08:07:36 INFO Received uploads request method=POST path=/api/pending_closures6807worker2 # [ 272.069029] nix-grpc-daemon[1946]: time=2026-09-20T08:07:36.253Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6808worker2 # [ 272.070566] nix-grpc-daemon[1946]: time=2026-09-20T08:07:36.253Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6809lb # [ 272.117853] niks3-server[1047]: 2026/09/20 08:07:36 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6810lb # [ 272.129384] niks3-server[1047]: 2026/09/20 08:07:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6811lb # [ 272.134827] niks3-server[1047]: 2026/09/20 08:07:36 INFO Signed narinfos id=64 count=16812worker2 # [ 272.105953] nix-grpc-daemon[1946]: time=2026-09-20T08:07:36.290Z level=INFO msg="Uploading 1 narinfos"6813lb # [ 272.140966] niks3-server[1047]: 2026/09/20 08:07:36 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6814lb # [ 272.152809] niks3-server[1047]: 2026/09/20 08:07:36 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6815worker2 # [ 272.127026] nix-grpc-daemon[1946]: time=2026-09-20T08:07:36.311Z level=INFO msg="Upload complete. (403ms)"6816lb # [ 272.158839] niks3-server[1047]: 2026/09/20 08:07:36 INFO Completed upload id=646817worker2 # [ 272.128958] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56100 duration_s=0 paths=1 nar_bytes_in=6246818lb # [ 272.162243] niks3-server[1047]: 2026/09/20 08:07:36 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6819worker2 # [ 272.135443] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561006820worker2 # [ 272.139512] nix-daemon[870]: accepted connection from pid 1852, user nix-grpc-daemon (trusted)6821worker2 # [ 272.141815] nix-daemon[870]: reaped child process 1993, status = succeeded6822client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6823client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6824worker2 # [ 272.146851] nix-daemon[870]: accepted connection from pid 1852, user nix-grpc-daemon (trusted)6825worker2 # [ 273.159866] nix-daemon[870]: reaped child process 2007, status = succeeded6826client # farm-b> LOG-farm-b-drain6827worker2 # [ 273.277574] nix-daemon[870]: accepted connection from pid 2022, user nix-grpc-daemon (trusted)6828worker2 # [ 273.290621] nix-daemon[870]: reaped child process 2025, status = succeeded6829lb # [ 273.339073] niks3-server[1047]: 2026/09/20 08:07:37 INFO Received uploads request method=POST path=/api/pending_closures6830worker2 # [ 273.318515] nix-grpc-daemon[1946]: time=2026-09-20T08:07:37.502Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6831worker2 # [ 273.320080] nix-grpc-daemon[1946]: time=2026-09-20T08:07:37.504Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6832lb # [ 273.376769] niks3-server[1047]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6833lb # [ 273.389082] niks3-server[1047]: 2026/09/20 08:07:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6834worker2 # [ 273.364439] nix-grpc-daemon[1946]: time=2026-09-20T08:07:37.548Z level=INFO msg="Uploading 1 narinfos"6835lb # [ 273.396061] niks3-server[1047]: 2026/09/20 08:07:37 INFO Signed narinfos id=65 count=16836lb # [ 273.405995] niks3-server[1047]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6837lb # [ 273.418061] niks3-server[1047]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6838lb # [ 273.422430] niks3-server[1047]: 2026/09/20 08:07:37 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6839lb # [ 273.426525] niks3-server[1047]: 2026/09/20 08:07:37 INFO Completed upload id=656840worker2 # [ 273.394884] nix-grpc-daemon[1946]: time=2026-09-20T08:07:37.579Z level=INFO msg="Upload complete. (241ms)"6841lb # [ 273.428049] niks3-server[1047]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6842worker2 # [ 273.407219] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56100 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=16843worker2 # [ 273.412326] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:37Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06844worker2 # [ 273.416169] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:37Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16845worker2 # [ 273.424904] nix-daemon[870]: reaped child process 2005, status = succeeded6846worker2 # [ 273.449184] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561006847worker2 # [ 273.462127] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:561006848worker2 # [ 273.475075] nix-grpc-daemon[1946]: time=2026-09-20T08:07:37.659Z level=INFO msg="All 2 paths already cached"6849client # copying 1 paths to 'lb:50051'...6850client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6851worker2 # [ 273.483231] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:561006852worker2 # [ 273.493175] nix-daemon[870]: accepted connection from pid 1852, user nix-grpc-daemon (trusted)6853worker2 # [ 273.661564] nix-daemon[870]: accepted connection from pid 2031, user nix-grpc-daemon (trusted)6854worker2 # [ 273.674711] nix-daemon[870]: reaped child process 2034, status = succeeded6855worker2 # [ 273.833026] nix-daemon[870]: accepted connection from pid 2036, user nix-grpc-daemon (trusted)6856worker2 # [ 273.845613] nix-daemon[870]: reaped child process 2039, status = succeeded6857lb # [ 273.891576] niks3-server[1047]: 2026/09/20 08:07:37 INFO Received uploads request method=POST path=/api/pending_closures6858worker2 # [ 273.868035] nix-grpc-daemon[1946]: time=2026-09-20T08:07:38.052Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6859worker2 # [ 273.869499] nix-grpc-daemon[1946]: time=2026-09-20T08:07:38.053Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6860lb # [ 273.922964] niks3-server[1047]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6861lb # [ 273.933269] niks3-server[1047]: 2026/09/20 08:07:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6862lb # [ 273.940371] niks3-server[1047]: 2026/09/20 08:07:37 INFO Signed narinfos id=66 count=16863worker2 # [ 273.911668] nix-grpc-daemon[1946]: time=2026-09-20T08:07:38.096Z level=INFO msg="Uploading 1 narinfos"6864lb # [ 273.944372] niks3-server[1047]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6865lb # [ 273.955659] niks3-server[1047]: 2026/09/20 08:07:38 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6866lb # [ 273.961695] niks3-server[1047]: 2026/09/20 08:07:38 INFO Completed upload id=666867worker2 # [ 273.929909] nix-grpc-daemon[1946]: time=2026-09-20T08:07:38.114Z level=INFO msg="Upload complete. (426ms)"6868lb # [ 273.966218] niks3-server[1047]: 2026/09/20 08:07:38 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6869worker2 # [ 273.934151] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56100 duration_s=0 paths=1 nar_bytes_in=7526870worker2 # [ 273.939215] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:561006871worker2 # [ 273.947132] nix-daemon[870]: accepted connection from pid 1852, user nix-grpc-daemon (trusted)6872worker2 # [ 273.952422] nix-daemon[870]: reaped child process 2029, status = succeeded6873client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6874worker2 # [ 273.958922] nix-daemon[870]: accepted connection from pid 1852, user nix-grpc-daemon (trusted)6875client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6876client # farm-top> LOG-farm-top-drain6877worker2 # [ 274.972332] nix-daemon[870]: reaped child process 2043, status = succeeded6878worker2 # [ 275.114477] nix-daemon[870]: accepted connection from pid 2058, user nix-grpc-daemon (trusted)6879worker2 # [ 275.126915] nix-daemon[870]: reaped child process 2061, status = succeeded6880lb # [ 275.173821] niks3-server[1047]: 2026/09/20 08:07:39 INFO Received uploads request method=POST path=/api/pending_closures6881worker2 # [ 275.151052] nix-grpc-daemon[1946]: time=2026-09-20T08:07:39.335Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6882worker2 # [ 275.152533] nix-grpc-daemon[1946]: time=2026-09-20T08:07:39.337Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6883lb # [ 275.216758] niks3-server[1047]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6884lb # [ 275.221367] niks3-server[1047]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6885lb # [ 275.233054] niks3-server[1047]: 2026/09/20 08:07:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6886lb # [ 275.239653] niks3-server[1047]: 2026/09/20 08:07:39 INFO Signed narinfos id=67 count=16887worker2 # [ 275.210613] nix-grpc-daemon[1946]: time=2026-09-20T08:07:39.394Z level=INFO msg="Uploading 1 narinfos"6888lb # [ 275.243696] niks3-server[1047]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6889lb # [ 275.255069] niks3-server[1047]: 2026/09/20 08:07:39 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6890lb # [ 275.261395] niks3-server[1047]: 2026/09/20 08:07:39 INFO Completed upload id=676891worker2 # [ 275.229572] nix-grpc-daemon[1946]: time=2026-09-20T08:07:39.414Z level=INFO msg="Upload complete. (264ms)"6892lb # [ 275.262988] niks3-server[1047]: 2026/09/20 08:07:39 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6893worker2 # [ 275.231950] nix-grpc-daemon[1852]: ts=2026-09-20T08:07:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56100 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=16894worker2 # [ 275.239450] nix-daemon[870]: reaped child process 2041, status = succeeded6895client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&2, in 6.36 seconds)6896client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath6897client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath, in 0.19 seconds)6898worker1: must succeed: rm /nix/.rw-store/fill6899worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds)6900worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6901worker1 # [ 275.742670] nix-grpc-daemon[1312]: ts=2026-09-20T08:07:39Z level=info event=healthy reason=min_free6902lb # [ 276.029423] envoy[899]: conn peer=[2001:db8:1::1]:42420 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=725 tx=455 ms=1200306903lb # [ 276.033582] envoy[899]: conn peer=[2001:db8:1::1]:52894 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9390 tx=3819 ms=61176904worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds)6905(finished: subtest: low disk drains a worker and builds go to the other, in 8.89 seconds)6906(finished: run the VM test script, in 277.77 seconds)6907test script finished in 278.00s6908cleanup6909kill QemuMachine (pid 49)6910client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6911kill QemuMachine (pid 52)6912lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6913kill QemuMachine (pid 50)6914worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6915kill QemuMachine (pid 51)6916worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6917(finished: cleanup, in 0.98 seconds)6918additionally exposed symbols:6919 client, lb, worker1, worker2,6920 vlan1,6921 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh