vm-test-run-nix-grpc-farm log

succeeded `vm-test-run-nix-grpc-farm` `checks.x86_64-linux.farm` · build #251 · raw

1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2 # Formatting '/build/vm-state-worker2/tmp.NtfVkiIgny', fmt=raw size=107374182414worker2 # mke2fs 1.47.4 (6-Mar-2025)15worker2: QEMU running (pid 52)16worker2 # Discarding device blocks: 0/262144 done17worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes18worker2 # Filesystem UUID: a4bc3e9c-12ad-4290-9fb1-dc350de2198a19worker2 # Superblock backups stored on blocks:20worker2 # 32768, 98304, 163840, 22937621worker2 # 22worker1: QEMU running (pid 51)23worker2 # Allocating group tables: 0/8 done24worker1 # Disk image does not exist, creating the virtualisation disk image...25worker2 # Writing inode tables: 0/8 done26worker1 # Formatting '/build/vm-state-worker1/tmp.eBpGgr4Fcs', fmt=raw size=107374182427worker2 # Creating journal (8192 blocks): done28worker1 # mke2fs 1.47.4 (6-Mar-2025)29lb # Disk image does not exist, creating the virtualisation disk image...30lb: QEMU running (pid 50)31worker2 # Writing superblocks and filesystem accounting information: 0/8 done32worker1 # Discarding device blocks: 0/262144 done33worker2 # 34worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes35worker2 # Virtualisation disk image created.36worker1 # Filesystem UUID: 5d89d707-4729-400a-9e43-87743a27371737lb # Formatting '/build/vm-state-lb/tmp.Zy7WrUOtNn', fmt=raw size=107374182438worker1 # Superblock backups stored on blocks:39lb # mke2fs 1.47.4 (6-Mar-2025)40worker1 # 32768, 98304, 163840, 22937641lb # Discarding device blocks: 0/262144 done42worker1 # 43lb # Creating filesystem with 262144 4k blocks and 65536 inodes44worker1 # Allocating group tables: 0/8 done45lb # Filesystem UUID: ce20611d-cea6-4045-98fe-178a6a13088346worker1 # Writing inode tables: 0/8 done47lb # Superblock backups stored on blocks:48worker1 # Creating journal (8192 blocks): done49lb # 32768, 98304, 163840, 22937650worker1 # Writing superblocks and filesystem accounting information: 0/8 done51lb # 52worker1 # 53lb # Allocating group tables: 0/8 done54worker1 # Virtualisation disk image created.55lb # Writing inode tables: 0/8 done56client # Disk image does not exist, creating the virtualisation disk image...57client: QEMU running (pid 49)58client # Formatting '/build/vm-state-client/tmp.nn60wbLw1q', fmt=raw size=107374182459lb # Creating journal (8192 blocks): done60client # mke2fs 1.47.4 (6-Mar-2025)61lb # Writing superblocks and filesystem accounting information: 0/8 done62client # Discarding device blocks: 0/262144 done63lb # 64client # Creating filesystem with 262144 4k blocks and 65536 inodes65lb # Virtualisation disk image created.66client # Filesystem UUID: 1d11266c-2da4-4fda-a9c0-c2d99972854f67(finished: start all VMs, in 0.22 seconds)68client # Superblock backups stored on blocks:69client: waiting for unit network-addresses-eth1.service70client # 32768, 98304, 163840, 22937671client: waiting for the VM to finish booting72client # 73client # Allocating group tables: 0/8 done74client # Writing inode tables: 0/8 done75client # Creating journal (8192 blocks): done76client # Writing superblocks and filesystem accounting information: 0/8 done77client # 78client # Virtualisation disk image created.79worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker1 # 84worker1 # 85worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086worker2 # 87worker2 # 88worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...89worker1 # 90worker1 # 91worker1 # 92worker1 # 93worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0094worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0095worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...96worker2 # 97worker2 # 98worker2 # 99worker2 # 100lb # 101lb # 102worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00103lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00104worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...105worker1 # 106worker1 # 107lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...108lb # 109lb # 110lb # 111lb # 112worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...113worker2 # 114worker2 # 115lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00116lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...117lb # 118lb # 119client # 120client # 121client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00122worker1 # Booting from ROM...123client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...124client # 125client # 126client # 127client # 128client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00129worker2 # Booting from ROM...130client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...131client # 132client # 133lb # Booting from ROM...134client # Booting from ROM...135worker1 # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/98yf21c3jz4dira9wimzcqdwlb0l32kr-nixos-system-worker1-test/init regInfo=/nix/store/rgb3swjz9fl8q4w8lswl5z8wlc1zgzv4-closure-info/registration console=ttyS0,115200n8 console=tty0137worker1 # [ 0.000000] BIOS-provided physical RAM map:138worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved140worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved141worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable142worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved143worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved144worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved145worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved146worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved147worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved148worker1 # [ 0.000000] NX (Execute Disable) protection: active149worker1 # [ 0.000000] APIC: Static calls initialized150worker1 # [ 0.000000] SMBIOS 2.8 present.151worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026152worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014153worker1 # [ 0.000000] DMI: Memory slots populated: 1/1154worker1 # [ 0.000000] Hypervisor detected: KVM155worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000156worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00157worker1 # [ 0.000001] kvm-clock: using sched offset of 470146551 cycles158worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2y6kwi1mdv3l7s63cygabx3gwjz592yw-nixos-system-worker2-test/init regInfo=/nix/store/rxnsaix8qkg1nyh96vsafrk0l5rbj4zn-closure-info/registration console=ttyS0,115200n8 console=tty0159worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns160worker2 # [ 0.000000] BIOS-provided physical RAM map:161worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor162worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable163worker1 # [ 0.000825] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000164worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved165worker1 # [ 0.000851] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs166worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved167worker1 # [ 0.000854] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT168worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable169worker1 # [ 0.002761] found SMP MP-table at [mem 0x000f5450-0x000f545f]170worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved171worker1 # [ 0.002772] Using GB pages for direct mapping172worker1 # [ 0.002930] RAMDISK: [mem 0x5e367000-0x5ffcffff]173worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved174worker1 # [ 0.002939] ACPI: Early table checksum verification disabled175lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026176worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved177worker1 # [ 0.002942] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )178worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved179worker1 # [ 0.002946] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)180worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved181worker1 # [ 0.002950] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)182worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved183worker2 # [ 0.000000] NX (Execute Disable) protection: active184lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0185worker1 # [ 0.002957] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)186worker2 # [ 0.000000] APIC: Static calls initialized187lb # [ 0.000000] BIOS-provided physical RAM map:188worker1 # [ 0.002959] ACPI: FACS 0x000000005FFE0000 000040189worker2 # [ 0.000000] SMBIOS 2.8 present.190lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable191worker1 # [ 0.002960] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)192worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014193lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved194worker2 # [ 0.000000] DMI: Memory slots populated: 1/1195worker1 # [ 0.002962] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)196worker2 # [ 0.000000] Hypervisor detected: KVM197lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved198worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000199lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable200worker1 # [ 0.002963] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)201worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00202lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved203worker1 # [ 0.002965] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)204worker2 # [ 0.000000] kvm-clock: using sched offset of 465539972 cycles205lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved206worker1 # [ 0.002966] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]207worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns208lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved209worker1 # [ 0.002967] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]210worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor211lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved212worker1 # [ 0.002968] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]213worker2 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000214lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved215worker1 # [ 0.002968] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]216worker2 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs217lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved218worker1 # [ 0.002969] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]219lb # [ 0.000000] NX (Execute Disable) protection: active220worker2 # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT221lb # [ 0.000000] APIC: Static calls initialized222worker2 # [ 0.002733] found SMP MP-table at [mem 0x000f5450-0x000f545f]223worker1 # [ 0.002969] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]224lb # [ 0.000000] SMBIOS 2.8 present.225worker2 # [ 0.002745] Using GB pages for direct mapping226client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026227worker1 # [ 0.002970] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]228worker2 # [ 0.002865] RAMDISK: [mem 0x5e367000-0x5ffcffff]229worker1 # [ 0.003205] No NUMA configuration found230lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014231worker2 # [ 0.002873] ACPI: Early table checksum verification disabled232lb # [ 0.000000] DMI: Memory slots populated: 1/1233worker1 # [ 0.003206] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]234worker2 # [ 0.002876] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )235lb # [ 0.000000] Hypervisor detected: KVM236worker1 # [ 0.003208] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]237worker1 # [ 0.005312] Zone ranges:238lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000239worker2 # [ 0.002880] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)240lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00241worker1 # [ 0.005313] DMA [mem 0x0000000000001000-0x0000000000ffffff]242client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3yn33ipjwn92p38w4qwdnvyyq096zfzd-nixos-system-client-test/init regInfo=/nix/store/z9v5mszvmn20hi4xvr0fypzq6a1x1rya-closure-info/registration console=ttyS0,115200n8 console=tty0243lb # [ 0.000001] kvm-clock: using sched offset of 478696467 cycles244worker2 # [ 0.002884] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)245worker1 # [ 0.005315] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]246client # [ 0.000000] BIOS-provided physical RAM map:247worker1 # [ 0.005316] Normal empty248worker1 # [ 0.005317] Device empty249worker2 # [ 0.002891] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)250client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable251lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns252worker1 # [ 0.005317] Movable zone start for each node253worker2 # [ 0.002893] ACPI: FACS 0x000000005FFE0000 000040254worker1 # [ 0.005318] Early memory node ranges255lb # [ 0.000005] tsc: Detected 2400.012 MHz processor256client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved257worker1 # [ 0.005318] node 0: [mem 0x0000000000001000-0x000000000009efff]258lb # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000259client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved260worker2 # [ 0.002895] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)261worker1 # [ 0.005319] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]262lb # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs263client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable264worker2 # [ 0.002896] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)265worker1 # [ 0.005320] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]266lb # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT267client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved268worker2 # [ 0.002898] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)269worker1 # [ 0.005339] On node 0, zone DMA: 1 pages in unavailable ranges270lb # [ 0.002735] found SMP MP-table at [mem 0x000f5450-0x000f545f]271client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved272lb # [ 0.002747] Using GB pages for direct mapping273worker1 # [ 0.005582] On node 0, zone DMA: 97 pages in unavailable ranges274worker2 # [ 0.002899] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)275client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved276lb # [ 0.002855] RAMDISK: [mem 0x5e367000-0x5ffcffff]277worker1 # [ 0.030485] On node 0, zone DMA32: 40 pages in unavailable ranges278worker2 # [ 0.002901] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]279lb # [ 0.002864] ACPI: Early table checksum verification disabled280worker1 # [ 0.030973] ACPI: PM-Timer IO Port: 0x608281client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved282lb # [ 0.002867] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )283worker1 # [ 0.030987] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])284worker2 # [ 0.002902] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]285client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved286worker1 # [ 0.031018] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23287worker2 # [ 0.002902] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]288client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved289lb # [ 0.002872] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)290client # [ 0.000000] NX (Execute Disable) protection: active291worker2 # [ 0.002903] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]292worker1 # [ 0.031021] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)293lb # [ 0.002876] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)294client # [ 0.000000] APIC: Static calls initialized295worker1 # [ 0.031022] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)296client # [ 0.000000] SMBIOS 2.8 present.297worker2 # [ 0.002903] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]298lb # [ 0.002883] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)299worker1 # [ 0.031024] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)300worker2 # [ 0.002904] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]301lb # [ 0.002885] ACPI: FACS 0x000000005FFE0000 000040302client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014303worker1 # [ 0.031025] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)304worker2 # [ 0.002904] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]305client # [ 0.000000] DMI: Memory slots populated: 1/1306lb # [ 0.002886] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)307worker2 # [ 0.003132] No NUMA configuration found308client # [ 0.000000] Hypervisor detected: KVM309worker1 # [ 0.031026] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)310client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000311worker2 # [ 0.003133] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]312worker1 # [ 0.031030] ACPI: Using ACPI (MADT) for SMP configuration information313lb # [ 0.002888] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)314client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00315worker2 # [ 0.003135] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]316worker1 # [ 0.031031] ACPI: HPET id: 0x8086a201 base: 0xfed00000317worker2 # [ 0.005409] Zone ranges:318client # [ 0.000000] kvm-clock: using sched offset of 489254583 cycles319worker1 # [ 0.031037] TSC deadline timer available320lb # [ 0.002890] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)321worker2 # [ 0.005409] DMA [mem 0x0000000000001000-0x0000000000ffffff]322worker1 # [ 0.031042] CPU topo: Max. logical packages: 1323lb # [ 0.002891] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)324client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns325worker2 # [ 0.005411] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]326worker1 # [ 0.031043] CPU topo: Max. logical dies: 1327worker2 # [ 0.005412] Normal empty328lb # [ 0.002893] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]329worker1 # [ 0.031043] CPU topo: Max. dies per package: 1330client # [ 0.000005] tsc: Detected 2400.012 MHz processor331worker2 # [ 0.005413] Device empty332worker1 # [ 0.031047] CPU topo: Max. threads per core: 1333worker2 # [ 0.005413] Movable zone start for each node334client # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000335lb # [ 0.002894] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]336worker1 # [ 0.031047] CPU topo: Num. cores per package: 1337worker2 # [ 0.005414] Early memory node ranges338client # [ 0.000839] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs339worker1 # [ 0.031048] CPU topo: Num. threads per package: 1340lb # [ 0.002894] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]341worker2 # [ 0.005414] node 0: [mem 0x0000000000001000-0x000000000009efff]342worker1 # [ 0.031048] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs343client # [ 0.000842] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT344worker2 # [ 0.005415] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]345lb # [ 0.002895] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]346client # [ 0.002739] found SMP MP-table at [mem 0x000f5450-0x000f545f]347worker1 # [ 0.031071] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()348lb # [ 0.002895] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]349worker2 # [ 0.005416] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]350client # [ 0.002751] Using GB pages for direct mapping351worker2 # [ 0.005437] On node 0, zone DMA: 1 pages in unavailable ranges352client # [ 0.002902] RAMDISK: [mem 0x5e366000-0x5ffcffff]353worker1 # [ 0.031107] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]354lb # [ 0.002896] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]355worker2 # [ 0.005703] On node 0, zone DMA: 97 pages in unavailable ranges356client # [ 0.002910] ACPI: Early table checksum verification disabled357lb # [ 0.002896] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]358worker1 # [ 0.031109] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]359client # [ 0.002912] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )360worker2 # [ 0.032227] On node 0, zone DMA32: 40 pages in unavailable ranges361lb # [ 0.003119] No NUMA configuration found362worker1 # [ 0.031111] [mem 0x60000000-0xafffffff] available for PCI devices363worker2 # [ 0.032685] ACPI: PM-Timer IO Port: 0x608364lb # [ 0.003120] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]365worker1 # [ 0.031112] Booting paravirtualized kernel on KVM366client # [ 0.002916] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)367worker2 # [ 0.032697] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])368lb # [ 0.003123] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]369lb # [ 0.005400] Zone ranges:370worker2 # [ 0.032725] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23371worker1 # [ 0.031116] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns372client # [ 0.002921] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)373lb # [ 0.005401] DMA [mem 0x0000000000001000-0x0000000000ffffff]374worker2 # [ 0.032728] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)375worker1 # [ 0.035593] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1376client # [ 0.002927] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)377lb # [ 0.005402] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]378worker2 # [ 0.032729] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)379client # [ 0.002929] ACPI: FACS 0x000000005FFE0000 000040380lb # [ 0.005404] Normal empty381worker1 # [ 0.037641] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152382lb # [ 0.005405] Device empty383worker2 # [ 0.032730] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)384worker1 # [ 0.037683] kvm-guest: PV spinlocks disabled, single CPU385lb # [ 0.005405] Movable zone start for each node386client # [ 0.002931] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)387lb # [ 0.005406] Early memory node ranges388worker2 # [ 0.032731] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)389lb # [ 0.005407] node 0: [mem 0x0000000000001000-0x000000000009efff]390client # [ 0.002933] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)391worker2 # [ 0.032732] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)392lb # [ 0.005408] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]393client # [ 0.002934] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)394worker2 # [ 0.032735] ACPI: Using ACPI (MADT) for SMP configuration information395lb # [ 0.005409] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]396worker2 # [ 0.032736] ACPI: HPET id: 0x8086a201 base: 0xfed00000397client # [ 0.002936] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)398worker2 # [ 0.032739] TSC deadline timer available399lb # [ 0.005437] On node 0, zone DMA: 1 pages in unavailable ranges400worker1 # [ 0.037685] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/98yf21c3jz4dira9wimzcqdwlb0l32kr-nixos-system-worker1-test/init regInfo=/nix/store/rgb3swjz9fl8q4w8lswl5z8wlc1zgzv4-closure-info/registration console=ttyS0,115200n8 console=tty0401worker2 # [ 0.032743] CPU topo: Max. logical packages: 1402client # [ 0.002937] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]403lb # [ 0.005700] On node 0, zone DMA: 97 pages in unavailable ranges404worker2 # [ 0.032744] CPU topo: Max. logical dies: 1405client # [ 0.002938] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]406lb # [ 0.032098] On node 0, zone DMA32: 40 pages in unavailable ranges407worker2 # [ 0.032744] CPU topo: Max. dies per package: 1408lb # [ 0.032555] ACPI: PM-Timer IO Port: 0x608409worker1 # [ 0.037778] Unknown kernel command line parameters "regInfo=/nix/store/rgb3swjz9fl8q4w8lswl5z8wlc1zgzv4-closure-info/registration", will be passed to user space.410worker2 # [ 0.032748] CPU topo: Max. threads per core: 1411client # [ 0.002938] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]412worker1 # [ 0.037791] random: crng init done413lb # [ 0.032565] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])414worker2 # [ 0.032748] CPU topo: Num. cores per package: 1415client # [ 0.002939] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]416worker1 # [ 0.037792] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes417worker2 # [ 0.032749] CPU topo: Num. threads per package: 1418lb # [ 0.032590] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23419client # [ 0.002939] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]420worker2 # [ 0.032749] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs421worker1 # [ 0.039810] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)422lb # [ 0.032592] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)423client # [ 0.002940] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]424worker2 # [ 0.032768] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()425lb # [ 0.032594] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)426worker1 # [ 0.040938] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)427worker1 # [ 0.040971] Fallback order for Node 0: 0428client # [ 0.002940] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]429lb # [ 0.032595] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)430worker2 # [ 0.032809] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]431client # [ 0.003161] No NUMA configuration found432worker1 # [ 0.040974] Built 1 zonelists, mobility grouping on. Total pages: 393078433lb # [ 0.032597] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)434worker2 # [ 0.032810] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]435worker1 # [ 0.040974] Policy zone: DMA32436client # [ 0.003162] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]437lb # [ 0.032597] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)438worker2 # [ 0.032812] [mem 0x60000000-0xafffffff] available for PCI devices439worker1 # [ 0.043344] mem auto-init: stack:all(zero), heap alloc:on, heap free:off440client # [ 0.003165] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]441client # [ 0.005211] Zone ranges:442worker2 # [ 0.032813] Booting paravirtualized kernel on KVM443lb # [ 0.032600] ACPI: Using ACPI (MADT) for SMP configuration information444worker1 # [ 0.046395] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1445client # [ 0.005212] DMA [mem 0x0000000000001000-0x0000000000ffffff]446lb # [ 0.032601] ACPI: HPET id: 0x8086a201 base: 0xfed00000447worker1 # [ 0.049504] allocated 3145728 bytes of page_ext448worker2 # [ 0.032816] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns449lb # [ 0.032604] TSC deadline timer available450client # [ 0.005214] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]451worker1 # [ 0.059080] ftrace: allocating 48731 entries in 192 pages452client # [ 0.005215] Normal empty453lb # [ 0.032609] CPU topo: Max. logical packages: 1454client # [ 0.005216] Device empty455worker2 # [ 0.037288] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1456worker1 # [ 0.059082] ftrace: allocated 192 pages with 2 groups457lb # [ 0.032609] CPU topo: Max. logical dies: 1458worker1 # [ 0.059896] Dynamic Preempt: lazy459client # [ 0.005217] Movable zone start for each node460lb # [ 0.032610] CPU topo: Max. dies per package: 1461client # [ 0.005218] Early memory node ranges462worker2 # [ 0.039645] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152463worker1 # [ 0.060069] rcu: Preemptible hierarchical RCU implementation.464lb # [ 0.032613] CPU topo: Max. threads per core: 1465worker2 # [ 0.039690] kvm-guest: PV spinlocks disabled, single CPU466worker1 # [ 0.060070] rcu: RCU event tracing is enabled.467client # [ 0.005218] node 0: [mem 0x0000000000001000-0x000000000009efff]468lb # [ 0.032614] CPU topo: Num. cores per package: 1469client # [ 0.005219] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]470worker1 # [ 0.060070] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.471lb # [ 0.032614] CPU topo: Num. threads per package: 1472worker1 # [ 0.060072] Trampoline variant of Tasks RCU enabled.473client # [ 0.005220] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]474lb # [ 0.032614] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs475worker1 # [ 0.060073] Rude variant of Tasks RCU enabled.476client # [ 0.005240] On node 0, zone DMA: 1 pages in unavailable ranges477lb # [ 0.032634] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()478worker1 # [ 0.060073] Tracing variant of Tasks RCU enabled.479client # [ 0.005492] On node 0, zone DMA: 97 pages in unavailable ranges480lb # [ 0.032666] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]481worker2 # [ 0.039692] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/2y6kwi1mdv3l7s63cygabx3gwjz592yw-nixos-system-worker2-test/init regInfo=/nix/store/rxnsaix8qkg1nyh96vsafrk0l5rbj4zn-closure-info/registration console=ttyS0,115200n8 console=tty0482worker1 # [ 0.060074] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.483client # [ 0.030320] On node 0, zone DMA32: 40 pages in unavailable ranges484client # [ 0.030793] ACPI: PM-Timer IO Port: 0x608485lb # [ 0.032668] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]486worker1 # [ 0.060074] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1487client # [ 0.030805] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])488lb # [ 0.032669] [mem 0x60000000-0xafffffff] available for PCI devices489worker2 # [ 0.039798] Unknown kernel command line parameters "regInfo=/nix/store/rxnsaix8qkg1nyh96vsafrk0l5rbj4zn-closure-info/registration", will be passed to user space.490worker1 # [ 0.060097] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.491lb # [ 0.032671] Booting paravirtualized kernel on KVM492client # [ 0.030831] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23493worker2 # [ 0.039812] random: crng init done494worker1 # [ 0.060098] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.495client # [ 0.030833] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)496worker2 # [ 0.039813] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes497lb # [ 0.032674] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns498client # [ 0.030835] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)499worker1 # [ 0.060099] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.500worker2 # [ 0.041945] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)501lb # [ 0.037125] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1502client # [ 0.030836] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)503worker1 # [ 0.064592] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16504worker2 # [ 0.043014] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)505lb # [ 0.039296] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152506client # [ 0.030837] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)507worker2 # [ 0.043061] Fallback order for Node 0: 0508worker1 # [ 0.064875] rcu: srcu_init: Setting srcu_struct sizes based on contention.509lb # [ 0.039337] kvm-guest: PV spinlocks disabled, single CPU510client # [ 0.030838] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)511worker2 # [ 0.043067] Built 1 zonelists, mobility grouping on. Total pages: 393078512worker2 # [ 0.043068] Policy zone: DMA32513worker1 # [ 0.064882] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns514client # [ 0.030840] ACPI: Using ACPI (MADT) for SMP configuration information515worker2 # [ 0.045565] mem auto-init: stack:all(zero), heap alloc:on, heap free:off516client # [ 0.030842] ACPI: HPET id: 0x8086a201 base: 0xfed00000517worker1 # [ 0.064985] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)518client # [ 0.030845] TSC deadline timer available519worker2 # [ 0.048893] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1520worker1 # [ 0.068564] Console: colour VGA+ 80x25521client # [ 0.030849] CPU topo: Max. logical packages: 1522worker2 # [ 0.052533] allocated 3145728 bytes of page_ext523worker1 # [ 0.068567] printk: legacy console [tty0] enabled524client # [ 0.030850] CPU topo: Max. logical dies: 1525worker2 # [ 0.062616] ftrace: allocating 48731 entries in 192 pages526lb # [ 0.039338] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0527worker1 # [ 0.098460] printk: legacy console [ttyS0] enabled528client # [ 0.030851] CPU topo: Max. dies per package: 1529worker2 # [ 0.062619] ftrace: allocated 192 pages with 2 groups530worker1 # [ 0.196114] ACPI: Core revision 20250807531worker2 # [ 0.063473] Dynamic Preempt: lazy532client # [ 0.030854] CPU topo: Max. threads per core: 1533client # [ 0.030855] CPU topo: Num. cores per package: 1534worker2 # [ 0.063626] rcu: Preemptible hierarchical RCU implementation.535lb # [ 0.039442] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.536client # [ 0.030855] CPU topo: Num. threads per package: 1537lb # [ 0.039455] random: crng init done538worker2 # [ 0.063627] rcu: RCU event tracing is enabled.539worker1 # [ 0.197036] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns540client # [ 0.030855] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs541worker2 # [ 0.063627] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.542lb # [ 0.039455] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes543worker1 # [ 0.198535] APIC: Switch to symmetric I/O mode setup544client # [ 0.030875] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()545worker2 # [ 0.063629] Trampoline variant of Tasks RCU enabled.546lb # [ 0.041759] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)547worker1 # [ 0.199473] x2apic enabled548worker2 # [ 0.063630] Rude variant of Tasks RCU enabled.549client # [ 0.030908] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]550worker2 # [ 0.063630] Tracing variant of Tasks RCU enabled.551lb # [ 0.042819] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)552worker1 # [ 0.200242] APIC: Switched APIC routing to: physical x2apic553client # [ 0.030909] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]554lb # [ 0.042850] Fallback order for Node 0: 0555worker2 # [ 0.063631] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.556client # [ 0.030911] [mem 0x60000000-0xafffffff] available for PCI devices557lb # [ 0.042853] Built 1 zonelists, mobility grouping on. Total pages: 393078558worker2 # [ 0.063631] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1559lb # [ 0.042854] Policy zone: DMA32560client # [ 0.030912] Booting paravirtualized kernel on KVM561worker1 # [ 0.202054] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1562lb # [ 0.045335] mem auto-init: stack:all(zero), heap alloc:on, heap free:off563worker2 # [ 0.063646] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.564client # [ 0.030915] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns565lb # [ 0.048579] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1566worker2 # [ 0.063648] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.567worker1 # [ 0.203010] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns568lb # [ 0.051926] allocated 3145728 bytes of page_ext569client # [ 0.035365] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1570lb # [ 0.062248] ftrace: allocating 48731 entries in 192 pages571client # [ 0.037412] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152572worker2 # [ 0.063648] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.573lb # [ 0.062250] ftrace: allocated 192 pages with 2 groups574client # [ 0.037452] kvm-guest: PV spinlocks disabled, single CPU575worker1 # [ 0.204619] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)576worker2 # [ 0.068077] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16577lb # [ 0.063100] Dynamic Preempt: lazy578worker2 # [ 0.068343] rcu: srcu_init: Setting srcu_struct sizes based on contention.579lb # [ 0.063266] rcu: Preemptible hierarchical RCU implementation.580worker1 # [ 0.205703] x86/cpu: User Mode Instruction Prevention (UMIP) activated581lb # [ 0.063267] rcu: RCU event tracing is enabled.582worker2 # [ 0.068351] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns583worker1 # [ 0.206757] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127584lb # [ 0.063267] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.585lb # [ 0.063269] Trampoline variant of Tasks RCU enabled.586worker1 # [ 0.207617] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0587worker2 # [ 0.068458] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)588lb # [ 0.063269] Rude variant of Tasks RCU enabled.589client # [ 0.037453] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3yn33ipjwn92p38w4qwdnvyyq096zfzd-nixos-system-client-test/init regInfo=/nix/store/z9v5mszvmn20hi4xvr0fypzq6a1x1rya-closure-info/registration console=ttyS0,115200n8 console=tty0590worker2 # [ 0.071998] Console: colour VGA+ 80x25591lb # [ 0.063269] Tracing variant of Tasks RCU enabled.592worker2 # [ 0.072001] printk: legacy console [tty0] enabled593worker2 # [ 0.101446] printk: legacy console [ttyS0] enabled594worker1 # [ 0.208621] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto595lb # [ 0.063270] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.596client # [ 0.037546] Unknown kernel command line parameters "regInfo=/nix/store/z9v5mszvmn20hi4xvr0fypzq6a1x1rya-closure-info/registration", will be passed to user space.597worker2 # [ 0.197993] ACPI: Core revision 20250807598lb # [ 0.063271] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1599client # [ 0.037559] random: crng init done600worker1 # [ 0.209617] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl601client # [ 0.037560] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes602lb # [ 0.063292] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.603worker2 # [ 0.198872] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns604worker1 # [ 0.210617] Transient Scheduler Attacks: Vulnerable: No microcode605client # [ 0.039541] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)606lb # [ 0.063294] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.607worker1 # [ 0.211616] Spectre V2 : Mitigation: Enhanced / Automatic IBRS608worker2 # [ 0.200366] APIC: Switch to symmetric I/O mode setup609client # [ 0.040842] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)610worker2 # [ 0.201311] x2apic enabled611lb # [ 0.063295] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.612worker1 # [ 0.212616] Speculative Return Stack Overflow: Mitigation: Safe RET613client # [ 0.040872] Fallback order for Node 0: 0614lb # [ 0.067666] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16615client # [ 0.040875] Built 1 zonelists, mobility grouping on. Total pages: 393078616worker2 # [ 0.202049] APIC: Switched APIC routing to: physical x2apic617client # [ 0.040876] Policy zone: DMA32618lb # [ 0.067944] rcu: srcu_init: Setting srcu_struct sizes based on contention.619client # [ 0.043434] mem auto-init: stack:all(zero), heap alloc:on, heap free:off620lb # [ 0.067950] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns621worker2 # [ 0.203825] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1622client # [ 0.046408] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1623client # [ 0.049576] allocated 3145728 bytes of page_ext624lb # [ 0.068055] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)625client # [ 0.059091] ftrace: allocating 48731 entries in 192 pages626worker1 # [ 0.213616] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization627worker2 # [ 0.204795] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns628lb # [ 0.071599] Console: colour VGA+ 80x25629client # [ 0.059094] ftrace: allocated 192 pages with 2 groups630worker1 # [ 0.215624] Spectre V2 : Enabling IBPB for BPF631lb # [ 0.071602] printk: legacy console [tty0] enabled632client # [ 0.059910] Dynamic Preempt: lazy633lb # [ 0.101040] printk: legacy console [ttyS0] enabled634client # [ 0.060034] rcu: Preemptible hierarchical RCU implementation.635worker2 # [ 0.206424] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)636worker1 # [ 0.216327] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier637client # [ 0.060035] rcu: RCU event tracing is enabled.638lb # [ 0.197201] ACPI: Core revision 20250807639worker1 # [ 0.217617] active return thunk: srso_alias_return_thunk640worker2 # [ 0.207516] x86/cpu: User Mode Instruction Prevention (UMIP) activated641client # [ 0.060035] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.642client # [ 0.060037] Trampoline variant of Tasks RCU enabled.643worker2 # [ 0.208555] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127644lb # [ 0.198124] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns645worker1 # [ 0.218637] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'646client # [ 0.060037] Rude variant of Tasks RCU enabled.647client # [ 0.060037] Tracing variant of Tasks RCU enabled.648lb # [ 0.199682] APIC: Switch to symmetric I/O mode setup649worker2 # [ 0.209422] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0650worker1 # [ 0.219617] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'651lb # [ 0.200627] x2apic enabled652client # [ 0.060038] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.653worker1 # [ 0.220617] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'654client # [ 0.060039] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1655worker2 # [ 0.210425] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto656lb # [ 0.201377] APIC: Switched APIC routing to: physical x2apic657worker1 # [ 0.221616] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'658client # [ 0.060090] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.659worker1 # [ 0.222616] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'660worker2 # [ 0.211422] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl661client # [ 0.060092] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.662lb # [ 0.203197] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1663worker2 # [ 0.212422] Transient Scheduler Attacks: Vulnerable: No microcode664worker1 # [ 0.223617] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'665client # [ 0.060092] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.666worker2 # [ 0.213421] Spectre V2 : Mitigation: Enhanced / Automatic IBRS667lb # [ 0.204158] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns668client # [ 0.064407] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16669worker1 # [ 0.224617] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'670worker2 # [ 0.214421] Speculative Return Stack Overflow: Mitigation: Safe RET671client # [ 0.064676] rcu: srcu_init: Setting srcu_struct sizes based on contention.672worker1 # [ 0.225617] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256673lb # [ 0.205784] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)674worker1 # [ 0.226616] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64675client # [ 0.064681] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns676lb # [ 0.206870] x86/cpu: User Mode Instruction Prevention (UMIP) activated677worker1 # [ 0.227616] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512678client # [ 0.064784] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)679lb # [ 0.207920] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127680client # [ 0.068452] Console: colour VGA+ 80x25681worker1 # [ 0.228616] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024682client # [ 0.068454] printk: legacy console [tty0] enabled683lb # [ 0.208782] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0684worker2 # [ 0.215421] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization685worker1 # [ 0.229617] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8686client # [ 0.099745] printk: legacy console [ttyS0] enabled687worker2 # [ 0.217429] Spectre V2 : Enabling IBPB for BPF688client # [ 0.195592] ACPI: Core revision 20250807689lb # [ 0.209785] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto690worker1 # [ 0.230616] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.691worker2 # [ 0.218422] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier692client # [ 0.196430] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns693lb # [ 0.210782] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl694worker2 # [ 0.219422] active return thunk: srso_alias_return_thunk695client # [ 0.197937] APIC: Switch to symmetric I/O mode setup696lb # [ 0.211781] Transient Scheduler Attacks: Vulnerable: No microcode697client # [ 0.198937] x2apic enabled698worker2 # [ 0.220443] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'699lb # [ 0.212781] Spectre V2 : Mitigation: Enhanced / Automatic IBRS700client # [ 0.199701] APIC: Switched APIC routing to: physical x2apic701worker2 # [ 0.221421] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'702lb # [ 0.213781] Speculative Return Stack Overflow: Mitigation: Safe RET703worker2 # [ 0.222423] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'704client # [ 0.201495] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1705worker2 # [ 0.223421] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'706worker2 # [ 0.224421] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'707client # [ 0.202521] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns708worker2 # [ 0.225421] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'709lb # [ 0.214781] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization710client # [ 0.204215] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)711lb # [ 0.216790] Spectre V2 : Enabling IBPB for BPF712worker2 # [ 0.227215] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'713client # [ 0.205298] x86/cpu: User Mode Instruction Prevention (UMIP) activated714worker2 # [ 0.228422] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256715lb # [ 0.217782] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier716client # [ 0.206343] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127717lb # [ 0.218782] active return thunk: srso_alias_return_thunk718worker2 # [ 0.229344] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64719client # [ 0.207899] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0720worker2 # [ 0.230132] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512721lb # [ 0.219803] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'722worker2 # [ 0.231134] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024723lb # [ 0.220781] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'724client # [ 0.208972] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto725worker2 # [ 0.232146] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8726lb # [ 0.221781] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'727client # [ 0.210213] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl728lb # [ 0.222781] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'729worker2 # [ 0.233166] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.730client # [ 0.211213] Transient Scheduler Attacks: Vulnerable: No microcode731lb # [ 0.223781] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'732client # [ 0.212951] Spectre V2 : Mitigation: Enhanced / Automatic IBRS733lb # [ 0.224781] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'734client # [ 0.213919] Speculative Return Stack Overflow: Mitigation: Safe RET735lb # [ 0.225781] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'736lb # [ 0.226781] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256737lb # [ 0.227781] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64738lb # [ 0.228781] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512739client # [ 0.214213] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization740lb # [ 0.229781] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024741client # [ 0.216220] Spectre V2 : Enabling IBPB for BPF742lb # [ 0.230781] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8743client # [ 0.217213] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier744lb # [ 0.231781] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.745client # [ 0.218215] active return thunk: srso_alias_return_thunk746client # [ 0.219901] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'747client # [ 0.221212] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'748client # [ 0.222212] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'749client # [ 0.223212] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'750client # [ 0.224212] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'751client # [ 0.225212] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'752client # [ 0.226212] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'753worker1 # [ 0.265262] Freeing SMP alternatives memory: 44K754client # [ 0.227213] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256755worker1 # [ 0.265619] pid_max: default: 32768 minimum: 301756client # [ 0.228996] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64757worker1 # [ 0.266697] LSM: initializing lsm=capability,landlock,yama,bpf,ima758client # [ 0.229988] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512759worker1 # [ 0.267717] landlock: Up and running.760worker1 # [ 0.268326] Yama: becoming mindful.761client # [ 0.231212] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024762worker1 # [ 0.269238] LSM support for eBPF active763client # [ 0.232211] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8764worker1 # [ 0.269736] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)765client # [ 0.233212] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.766worker1 # [ 0.270652] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)767worker1 # [ 0.273513] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)768worker1 # [ 0.274133] Performance Events: Fam17h+ core perfctr, AMD PMU driver.769worker1 # [ 0.274622] ... version: 2770worker1 # [ 0.275346] ... bit width: 48771worker1 # [ 0.275619] ... generic counters: 6772worker1 # [ 0.276318] ... generic bitmap: 000000000000003f773worker1 # [ 0.276667] ... fixed-purpose counters: 0774worker2 # [ 0.267435] Freeing SMP alternatives memory: 44K775worker1 # [ 0.277357] ... fixed-purpose bitmap: 0000000000000000776worker2 # [ 0.268203] pid_max: default: 32768 minimum: 301777worker1 # [ 0.277620] ... value mask: 0000ffffffffffff778worker1 # [ 0.278489] ... max period: 00007fffffffffff779worker2 # [ 0.268526] LSM: initializing lsm=capability,landlock,yama,bpf,ima780worker2 # [ 0.269517] landlock: Up and running.781worker1 # [ 0.279309] ... global_ctrl mask: 000000000000003f782worker2 # [ 0.270422] Yama: becoming mindful.783worker1 # [ 0.279731] signal: max sigframe size: 3376784worker2 # [ 0.271616] LSM support for eBPF active785worker1 # [ 0.280527] rcu: Hierarchical SRCU implementation.786worker1 # [ 0.281186] rcu: Max phase no-delay instances is 400.787worker2 # [ 0.272376] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)788worker2 # [ 0.273464] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)789worker2 # [ 0.275988] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)790lb # [ 0.267095] Freeing SMP alternatives memory: 44K791worker1 # [ 0.286099] smp: Bringing up secondary CPUs ...792lb # [ 0.267784] pid_max: default: 32768 minimum: 301793worker2 # [ 0.276983] Performance Events: Fam17h+ core perfctr, AMD PMU driver.794worker1 # [ 0.286633] smp: Brought up 1 node, 1 CPU795worker2 # [ 0.277427] ... version: 2796lb # [ 0.268606] LSM: initializing lsm=capability,landlock,yama,bpf,ima797worker1 # [ 0.287288] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)798worker2 # [ 0.278125] ... bit width: 48799lb # [ 0.269841] landlock: Up and running.800worker2 # [ 0.278424] ... generic counters: 6801lb # [ 0.270454] Yama: becoming mindful.802worker2 # [ 0.279148] ... generic bitmap: 000000000000003f803lb # [ 0.270996] LSM support for eBPF active804worker1 # [ 0.287806] Memory: 1454540K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)805worker2 # [ 0.279430] ... fixed-purpose counters: 0806worker1 # [ 0.288843] devtmpfs: initialized807lb # [ 0.271915] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)808worker2 # [ 0.280157] ... fixed-purpose bitmap: 0000000000000000809worker1 # [ 0.289632] x86/mm: Memory block size: 128MB810worker2 # [ 0.280424] ... value mask: 0000ffffffffffff811lb # [ 0.272821] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)812worker2 # [ 0.281407] ... max period: 00007fffffffffff813worker2 # [ 0.282131] ... global_ctrl mask: 000000000000003f814worker1 # [ 0.291384] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)815lb # [ 0.275496] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)816worker2 # [ 0.282532] signal: max sigframe size: 3376817worker1 # [ 0.292515] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).818worker2 # [ 0.283282] rcu: Hierarchical SRCU implementation.819lb # [ 0.276313] Performance Events: Fam17h+ core perfctr, AMD PMU driver.820worker1 # [ 0.293698] pinctrl core: initialized pinctrl subsystem821worker2 # [ 0.284012] rcu: Max phase no-delay instances is 400.822lb # [ 0.276786] ... version: 2823worker1 # [ 0.294821] PM: RTC time: 08:59:26, date: 2026-09-20824lb # [ 0.277499] ... bit width: 48825lb # [ 0.277783] ... generic counters: 6826lb # [ 0.278492] ... generic bitmap: 000000000000003f827lb # [ 0.278842] ... fixed-purpose counters: 0828client # [ 0.267962] Freeing SMP alternatives memory: 44K829lb # [ 0.279552] ... fixed-purpose bitmap: 0000000000000000830worker1 # [ 0.298206] NET: Registered PF_NETLINK/PF_ROUTE protocol family831client # [ 0.268215] pid_max: default: 32768 minimum: 301832worker2 # [ 0.288920] smp: Bringing up secondary CPUs ...833lb # [ 0.279784] ... value mask: 0000ffffffffffff834worker2 # [ 0.289438] smp: Brought up 1 node, 1 CPU835client # [ 0.269302] LSM: initializing lsm=capability,landlock,yama,bpf,ima836worker1 # [ 0.299098] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations837lb # [ 0.280661] ... max period: 00007fffffffffff838client # [ 0.270318] landlock: Up and running.839worker2 # [ 0.290098] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)840lb # [ 0.281443] ... global_ctrl mask: 000000000000003f841client # [ 0.271213] Yama: becoming mindful.842worker1 # [ 0.299638] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations843lb # [ 0.281897] signal: max sigframe size: 3376844client # [ 0.272004] LSM support for eBPF active845lb # [ 0.282670] rcu: Hierarchical SRCU implementation.846worker1 # [ 0.300878] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations847worker2 # [ 0.290628] Memory: 1454556K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)848client # [ 0.272758] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)849lb # [ 0.283344] rcu: Max phase no-delay instances is 400.850worker1 # [ 0.301629] audit: initializing netlink subsys (disabled)851worker2 # [ 0.291680] devtmpfs: initialized852client # [ 0.274079] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)853worker2 # [ 0.292467] x86/mm: Memory block size: 128MB854worker1 # [ 0.302621] audit: type=2000 audit(1789894767.304:1): state=initialized audit_enabled=0 res=1855worker1 # [ 0.303726] thermal_sys: Registered thermal governor 'fair_share'856client # [ 0.276352] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)857worker1 # [ 0.303728] thermal_sys: Registered thermal governor 'bang_bang'858worker2 # [ 0.294226] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)859worker1 # [ 0.304620] thermal_sys: Registered thermal governor 'step_wise'860worker2 # [ 0.295324] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).861client # [ 0.277744] Performance Events: Fam17h+ core perfctr, AMD PMU driver.862lb # [ 0.288383] smp: Bringing up secondary CPUs ...863worker1 # [ 0.305541] thermal_sys: Registered thermal governor 'user_space'864client # [ 0.278222] ... version: 2865worker2 # [ 0.296496] pinctrl core: initialized pinctrl subsystem866lb # [ 0.288798] smp: Brought up 1 node, 1 CPU867client # [ 0.278894] ... bit width: 48868worker1 # [ 0.306331] thermal_sys: Registered thermal governor 'power_allocator'869worker2 # [ 0.297616] PM: RTC time: 08:59:26, date: 2026-09-20870lb # [ 0.289440] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)871client # [ 0.279214] ... generic counters: 6872worker1 # [ 0.306632] cpuidle: using governor menu873client # [ 0.279904] ... generic bitmap: 000000000000003f874worker1 # [ 0.308812] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5875client # [ 0.280216] ... fixed-purpose counters: 0876lb # [ 0.289935] Memory: 1454548K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)877client # [ 0.280910] ... fixed-purpose bitmap: 0000000000000000878lb # [ 0.291055] devtmpfs: initialized879worker1 # [ 0.309878] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]880client # [ 0.281215] ... value mask: 0000ffffffffffff881worker2 # [ 0.301249] NET: Registered PF_NETLINK/PF_ROUTE protocol family882lb # [ 0.291917] x86/mm: Memory block size: 128MB883worker1 # [ 0.310622] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry884client # [ 0.282115] ... max period: 00007fffffffffff885worker1 # [ 0.311631] PCI: Using configuration type 1 for base access886client # [ 0.282904] ... global_ctrl mask: 000000000000003f887worker2 # [ 0.302754] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations888client # [ 0.283310] signal: max sigframe size: 3376889lb # [ 0.293694] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)890worker1 # [ 0.312691] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.891worker2 # [ 0.303447] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations892client # [ 0.284136] rcu: Hierarchical SRCU implementation.893lb # [ 0.294663] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).894client # [ 0.284834] rcu: Max phase no-delay instances is 400.895worker2 # [ 0.304695] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations896lb # [ 0.295868] pinctrl core: initialized pinctrl subsystem897worker2 # [ 0.305435] audit: initializing netlink subsys (disabled)898lb # [ 0.296993] PM: RTC time: 08:59:26, date: 2026-09-20899worker2 # [ 0.306636] thermal_sys: Registered thermal governor 'fair_share'900worker2 # [ 0.306638] thermal_sys: Registered thermal governor 'bang_bang'901worker2 # [ 0.307425] thermal_sys: Registered thermal governor 'step_wise'902client # [ 0.289694] smp: Bringing up secondary CPUs ...903lb # [ 0.300590] NET: Registered PF_NETLINK/PF_ROUTE protocol family904worker1 # [ 0.319636] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages905client # [ 0.290249] smp: Brought up 1 node, 1 CPU906worker2 # [ 0.308427] audit: type=2000 audit(1789894767.324:1): state=initialized audit_enabled=0 res=1907worker1 # [ 0.320619] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page908worker2 # [ 0.310427] thermal_sys: Registered thermal governor 'user_space'909client # [ 0.290932] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)910lb # [ 0.301979] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations911worker2 # [ 0.310428] thermal_sys: Registered thermal governor 'power_allocator'912lb # [ 0.302809] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations913worker2 # [ 0.311397] cpuidle: using governor menu914client # [ 0.291375] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)915lb # [ 0.304059] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations916client # [ 0.292446] devtmpfs: initialized917worker2 # [ 0.313002] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5918lb # [ 0.304793] audit: initializing netlink subsys (disabled)919client # [ 0.293323] x86/mm: Memory block size: 128MB920worker1 # [ 0.325620] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages921worker2 # [ 0.313646] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]922lb # [ 0.305786] audit: type=2000 audit(1789894767.333:1): state=initialized audit_enabled=0 res=1923worker1 # [ 0.326620] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page924worker2 # [ 0.314427] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry925client # [ 0.295084] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)926lb # [ 0.306963] thermal_sys: Registered thermal governor 'fair_share'927worker2 # [ 0.315437] PCI: Using configuration type 1 for base access928lb # [ 0.306965] thermal_sys: Registered thermal governor 'bang_bang'929client # [ 0.296091] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).930lb # [ 0.307785] thermal_sys: Registered thermal governor 'step_wise'931worker2 # [ 0.316536] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.932client # [ 0.297318] pinctrl core: initialized pinctrl subsystem933lb # [ 0.308712] thermal_sys: Registered thermal governor 'user_space'934client # [ 0.298393] PM: RTC time: 08:59:26, date: 2026-09-20935lb # [ 0.309486] thermal_sys: Registered thermal governor 'power_allocator'936lb # [ 0.309796] cpuidle: using governor menu937lb # [ 0.311998] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5938client # [ 0.301717] NET: Registered PF_NETLINK/PF_ROUTE protocol family939lb # [ 0.313009] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]940client # [ 0.302701] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations941lb # [ 0.313786] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry942worker2 # [ 0.323573] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages943lb # [ 0.314795] PCI: Using configuration type 1 for base access944client # [ 0.303233] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations945worker2 # [ 0.324425] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page946worker1 # [ 0.337878] ACPI: Added _OSI(Module Device)947client # [ 0.304479] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations948worker1 # [ 0.338573] ACPI: Added _OSI(Processor Device)949lb # [ 0.315883] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.950worker1 # [ 0.339150] ACPI: Added _OSI(Processor Aggregator Device)951client # [ 0.305225] audit: initializing netlink subsys (disabled)952client # [ 0.306370] thermal_sys: Registered thermal governor 'fair_share'953client # [ 0.306372] thermal_sys: Registered thermal governor 'bang_bang'954client # [ 0.307216] thermal_sys: Registered thermal governor 'step_wise'955worker2 # [ 0.329425] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages956client # [ 0.308208] thermal_sys: Registered thermal governor 'user_space'957worker2 # [ 0.330424] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page958client # [ 0.309145] audit: type=2000 audit(1789894767.346:1): state=initialized audit_enabled=0 res=1959lb # [ 0.322812] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages960worker1 # [ 0.345208] ACPI: 1 ACPI AML tables successfully acquired and loaded961client # [ 0.311218] thermal_sys: Registered thermal governor 'power_allocator'962client # [ 0.311232] cpuidle: using governor menu963lb # [ 0.323784] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page964client # [ 0.313466] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5965worker1 # [ 0.349046] ACPI: Interpreter enabled966client # [ 0.314451] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]967worker1 # [ 0.349635] ACPI: PM: (supports S0 S3 S4 S5)968client # [ 0.315219] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry969worker1 # [ 0.350345] ACPI: Using IOAPIC for interrupt routing970lb # [ 0.328785] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages971client # [ 0.316227] PCI: Using configuration type 1 for base access972lb # [ 0.329784] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page973client # [ 0.317349] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.974worker2 # [ 0.340851] ACPI: Added _OSI(Module Device)975worker2 # [ 0.341426] ACPI: Added _OSI(Processor Device)976worker1 # [ 0.352677] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug977worker2 # [ 0.342157] ACPI: Added _OSI(Processor Aggregator Device)978worker1 # [ 0.353624] PCI: Using E820 reservations for host bridge windows979worker1 # [ 0.356715] ACPI: Enabled 2 GPEs in block 00 to 3F980client # [ 0.322474] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages981client # [ 0.323216] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page982worker2 # [ 0.349029] ACPI: 1 ACPI AML tables successfully acquired and loaded983lb # [ 0.341031] ACPI: Added _OSI(Module Device)984lb # [ 0.341754] ACPI: Added _OSI(Processor Device)985lb # [ 0.342341] ACPI: Added _OSI(Processor Aggregator Device)986client # [ 0.328217] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages987client # [ 0.329216] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page988worker1 # [ 0.364370] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])989worker2 # [ 0.352838] ACPI: Interpreter enabled990worker2 # [ 0.353441] ACPI: PM: (supports S0 S3 S4 S5)991worker1 # [ 0.364625] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]992worker2 # [ 0.354150] ACPI: Using IOAPIC for interrupt routing993worker1 # [ 0.365701] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]994worker1 # [ 0.366756] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]995worker1 # [ 0.367965] PCI host bridge to bus 0000:00996worker2 # [ 0.356473] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug997lb # [ 0.348832] ACPI: 1 ACPI AML tables successfully acquired and loaded998worker1 # [ 0.368624] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]999worker2 # [ 0.357425] PCI: Using E820 reservations for host bridge windows1000worker1 # [ 0.369619] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1001worker1 # [ 0.370619] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1002lb # [ 0.352699] ACPI: Interpreter enabled1003worker1 # [ 0.371619] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1004worker2 # [ 0.360553] ACPI: Enabled 2 GPEs in block 00 to 3F1005client # [ 0.339574] ACPI: Added _OSI(Module Device)1006lb # [ 0.353234] ACPI: PM: (supports S0 S3 S4 S5)1007client # [ 0.340216] ACPI: Added _OSI(Processor Device)1008worker1 # [ 0.372619] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1009client # [ 0.340988] ACPI: Added _OSI(Processor Aggregator Device)1010worker1 # [ 0.373619] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1011worker1 # [ 0.374620] pci_bus 0000:00: root bus resource [bus 00-ff]1012lb # [ 0.355784] ACPI: Using IOAPIC for interrupt routing1013worker1 # [ 0.375562] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1014lb # [ 0.356654] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1015worker1 # [ 0.377051] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1016worker2 # [ 0.367686] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1017lb # [ 0.359784] PCI: Using E820 reservations for host bridge windows1018lb # [ 0.360883] ACPI: Enabled 2 GPEs in block 00 to 3F1019worker2 # [ 0.368431] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1020worker2 # [ 0.369502] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1021worker2 # [ 0.370546] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1022client # [ 0.349741] ACPI: 1 ACPI AML tables successfully acquired and loaded1023worker2 # [ 0.371767] PCI host bridge to bus 0000:001024worker1 # [ 0.379670] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1025worker2 # [ 0.372428] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1026worker1 # [ 0.380634] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1027worker2 # [ 0.373425] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1028worker1 # [ 0.381588] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1029client # [ 0.353642] ACPI: Interpreter enabled1030worker2 # [ 0.374424] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1031client # [ 0.354231] ACPI: PM: (supports S0 S3 S4 S5)1032worker1 # [ 0.382627] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1033lb # [ 0.369047] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1034client # [ 0.354926] ACPI: Using IOAPIC for interrupt routing1035worker2 # [ 0.375424] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1036worker2 # [ 0.376424] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1037lb # [ 0.369792] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1038client # [ 0.355257] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1039worker1 # [ 0.384483] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1040client # [ 0.356216] PCI: Using E820 reservations for host bridge windows1041worker2 # [ 0.377424] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1042lb # [ 0.370862] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1043worker2 # [ 0.378431] pci_bus 0000:00: root bus resource [bus 00-ff]1044lb # [ 0.371911] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1045lb # [ 0.373172] PCI host bridge to bus 0000:001046worker2 # [ 0.379520] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1047client # [ 0.359282] ACPI: Enabled 2 GPEs in block 00 to 3F1048worker1 # [ 0.387645] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1049lb # [ 0.373788] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1050worker1 # [ 0.388466] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1051worker2 # [ 0.380858] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1052lb # [ 0.374784] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1053worker1 # [ 0.389326] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1054lb # [ 0.375784] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1055worker1 # [ 0.389625] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1056lb # [ 0.376784] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1057worker1 # [ 0.391316] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1058lb # [ 0.377783] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1059lb # [ 0.378783] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1060lb # [ 0.379784] pci_bus 0000:00: root bus resource [bus 00-ff]1061lb # [ 0.380744] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1062client # [ 0.367862] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1063worker1 # [ 0.394741] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1064worker2 # [ 0.383510] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1065client # [ 0.368221] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1066worker1 # [ 0.396245] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1067worker2 # [ 0.384437] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1068lb # [ 0.382186] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1069worker2 # [ 0.385375] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1070worker1 # [ 0.396641] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1071client # [ 0.369806] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1072worker1 # [ 0.398185] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1073worker2 # [ 0.386432] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1074client # [ 0.370339] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1075client # [ 0.371593] PCI host bridge to bus 0000:001076worker2 # [ 0.388182] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1077client # [ 0.372220] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1078worker1 # [ 0.400638] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1079client # [ 0.373215] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1080worker1 # [ 0.401463] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1081client # [ 0.374215] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1082worker1 # [ 0.402330] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1083worker2 # [ 0.391456] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1084lb # [ 0.384849] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1085client # [ 0.375215] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1086worker2 # [ 0.392320] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1087lb # [ 0.385868] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1088client # [ 0.376215] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1089worker2 # [ 0.393201] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1090lb # [ 0.386806] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1091worker1 # [ 0.403848] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1092worker2 # [ 0.394249] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1093client # [ 0.377215] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1094client # [ 0.378216] pci_bus 0000:00: root bus resource [bus 00-ff]1095lb # [ 0.388132] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1096worker1 # [ 0.406511] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1097client # [ 0.379191] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1098worker2 # [ 0.395722] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1099worker1 # [ 0.407259] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1100lb # [ 0.389531] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1101worker1 # [ 0.407642] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1102client # [ 0.380675] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1103worker2 # [ 0.398425] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1104worker1 # [ 0.409168] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1105worker2 # [ 0.399284] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1106lb # [ 0.391792] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1107lb # [ 0.392628] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1108worker2 # [ 0.400138] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1109lb # [ 0.393539] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1110worker2 # [ 0.401017] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1111lb # [ 0.393790] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1112worker1 # [ 0.411498] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1113worker1 # [ 0.412251] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1114client # [ 0.383245] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1115lb # [ 0.395353] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1116worker1 # [ 0.412642] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1117client # [ 0.384292] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1118client # [ 0.385278] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1119worker1 # [ 0.414238] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1120worker2 # [ 0.403764] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1121lb # [ 0.397792] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1122client # [ 0.386520] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1123worker2 # [ 0.405058] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1124lb # [ 0.398634] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1125lb # [ 0.399526] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1126worker2 # [ 0.405446] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1127worker1 # [ 0.416600] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1128client # [ 0.387905] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1129worker1 # [ 0.417230] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1130lb # [ 0.400339] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1131worker2 # [ 0.406993] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1132worker1 # [ 0.417641] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1133client # [ 0.390253] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1134client # [ 0.391163] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1135worker2 # [ 0.409289] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1136worker1 # [ 0.419721] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1137worker2 # [ 0.410095] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1138client # [ 0.391968] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1139lb # [ 0.402792] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1140worker2 # [ 0.410446] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1141client # [ 0.392221] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1142lb # [ 0.404475] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1143worker1 # [ 0.422417] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1144lb # [ 0.404806] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1145client # [ 0.393765] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1146worker1 # [ 0.423249] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1147worker2 # [ 0.412539] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1148worker1 # [ 0.423642] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1149lb # [ 0.406371] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1150worker1 # [ 0.424625] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1151client # [ 0.396222] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1152worker2 # [ 0.415187] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1153lb # [ 0.407791] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1154worker1 # [ 0.426156] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1155client # [ 0.397121] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1156worker2 # [ 0.415448] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1157lb # [ 0.408610] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1158client # [ 0.397963] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1159worker2 # [ 0.416424] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1160lb # [ 0.409502] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1161client # [ 0.398789] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1162worker1 # [ 0.427921] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1163worker2 # [ 0.418051] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1164worker1 # [ 0.429350] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1165lb # [ 0.410341] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1166client # [ 0.400250] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1167worker1 # [ 0.430167] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1168lb # [ 0.412793] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1169client # [ 0.401123] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1170lb # [ 0.413676] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1171worker2 # [ 0.420796] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1172client # [ 0.401962] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1173lb # [ 0.414521] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1174worker1 # [ 0.432496] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1175worker2 # [ 0.422101] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1176worker1 # [ 0.433232] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1177worker2 # [ 0.422446] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1178client # [ 0.402790] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1179lb # [ 0.415395] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1180worker1 # [ 0.433642] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1181worker2 # [ 0.424014] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1182client # [ 0.404222] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1183client # [ 0.405054] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1184worker1 # [ 0.435196] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1185client # [ 0.406022] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1186lb # [ 0.417793] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1187worker2 # [ 0.426162] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1188lb # [ 0.418791] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1189worker2 # [ 0.426448] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1190worker1 # [ 0.437442] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1191client # [ 0.407648] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1192lb # [ 0.419749] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1193worker2 # [ 0.427446] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1194worker1 # [ 0.438252] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1195worker1 # [ 0.438641] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1196lb # [ 0.421211] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1197worker2 # [ 0.428430] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1198client # [ 0.409247] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1199worker1 # [ 0.440191] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1200worker2 # [ 0.429968] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1201lb # [ 0.422791] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1202client # [ 0.410224] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1203lb # [ 0.423623] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1204worker1 # [ 0.441357] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1205client # [ 0.411173] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1206lb # [ 0.424509] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1207worker2 # [ 0.431459] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1208worker1 # [ 0.441819] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1209lb # [ 0.424790] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1210client # [ 0.412713] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1211worker2 # [ 0.432434] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1212worker1 # [ 0.443960] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1213worker2 # [ 0.433979] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1214lb # [ 0.426305] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1215client # [ 0.414223] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1216client # [ 0.415121] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1217lb # [ 0.428748] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1218client # [ 0.416081] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1219lb # [ 0.429522] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1220worker2 # [ 0.436218] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1221worker2 # [ 0.437432] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1222client # [ 0.417644] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1223lb # [ 0.430335] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1224worker2 # [ 0.438381] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1225client # [ 0.419252] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1226lb # [ 0.431793] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1227worker2 # [ 0.439911] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1228client # [ 0.420128] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1229lb # [ 0.432635] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1230client # [ 0.420966] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1231lb # [ 0.433514] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1232client # [ 0.421225] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1233worker2 # [ 0.442160] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1234worker2 # [ 0.442431] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1235lb # [ 0.434354] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1236client # [ 0.422776] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1237worker2 # [ 0.443440] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1238worker1 # [ 0.444841] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1239lb # [ 0.435792] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1240worker1 # [ 0.447422] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1241client # [ 0.424228] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1242lb # [ 0.436631] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1243worker2 # [ 0.444979] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1244client # [ 0.425237] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1245worker1 # [ 0.448558] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1246lb # [ 0.437514] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1247worker2 # [ 0.446240] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1248worker1 # [ 0.450300] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1249client # [ 0.426756] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1250lb # [ 0.438365] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1251worker2 # [ 0.447320] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1252lb # [ 0.439410] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1253worker1 # [ 0.450847] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1254client # [ 0.428267] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1255worker2 # [ 0.449178] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1256client # [ 0.429083] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1257worker1 # [ 0.451911] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1258lb # [ 0.439984] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1259client # [ 0.430019] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1260worker1 # [ 0.452887] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1261lb # [ 0.441459] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1262client # [ 0.431629] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1263worker1 # [ 0.454669] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1264worker1 # [ 0.455528] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1265client # [ 0.433958] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1266worker1 # [ 0.456725] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1267client # [ 0.434222] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1268client # [ 0.435237] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1269worker1 # [ 0.458314] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1270client # [ 0.436805] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1271client # [ 0.437767] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1272worker2 # [ 0.449626] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1273worker1 # [ 0.461592] ACPI: PCI: Interrupt link LNKA configured for IRQ 101274client # [ 0.438424] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1275worker2 # [ 0.452242] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1276worker1 # [ 0.462521] ACPI: PCI: Interrupt link LNKB configured for IRQ 101277lb # [ 0.441980] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1278client # [ 0.439750] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1279worker1 # [ 0.463464] ACPI: PCI: Interrupt link LNKC configured for IRQ 111280worker2 # [ 0.453333] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1281lb # [ 0.444426] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1282worker1 # [ 0.464452] ACPI: PCI: Interrupt link LNKD configured for IRQ 111283worker2 # [ 0.455141] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1284worker1 # [ 0.465477] ACPI: PCI: Interrupt link LNKE configured for IRQ 101285lb # [ 0.445063] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1286worker1 # [ 0.466464] ACPI: PCI: Interrupt link LNKF configured for IRQ 101287worker2 # [ 0.455697] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1288lb # [ 0.446394] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1289worker1 # [ 0.467475] ACPI: PCI: Interrupt link LNKG configured for IRQ 111290worker2 # [ 0.456944] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1291worker1 # [ 0.468726] ACPI: PCI: Interrupt link LNKH configured for IRQ 111292lb # [ 0.447056] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1293worker1 # [ 0.469684] ACPI: PCI: Interrupt link GSIA configured for IRQ 161294worker2 # [ 0.457674] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1295lb # [ 0.448075] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1296worker1 # [ 0.470638] ACPI: PCI: Interrupt link GSIB configured for IRQ 171297worker1 # [ 0.471633] ACPI: PCI: Interrupt link GSIC configured for IRQ 181298worker2 # [ 0.459452] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1299lb # [ 0.449049] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1300worker1 # [ 0.472630] ACPI: PCI: Interrupt link GSID configured for IRQ 191301worker2 # [ 0.460292] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1302worker1 # [ 0.473622] ACPI: PCI: Interrupt link GSIE configured for IRQ 201303lb # [ 0.450801] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1304worker1 # [ 0.474560] ACPI: PCI: Interrupt link GSIF configured for IRQ 211305lb # [ 0.451653] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1306worker2 # [ 0.461501] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1307worker1 # [ 0.475337] ACPI: PCI: Interrupt link GSIG configured for IRQ 221308client # [ 0.440406] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1309worker1 # [ 0.475632] ACPI: PCI: Interrupt link GSIH configured for IRQ 231310lb # [ 0.452811] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1311worker2 # [ 0.463211] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1312lb # [ 0.454419] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1313worker1 # [ 0.477637] iommu: Default domain type: Translated1314worker1 # [ 0.478429] iommu: DMA domain TLB invalidation policy: lazy mode1315client # [ 0.443862] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1316worker1 # [ 0.479685] ACPI: bus type USB registered1317worker2 # [ 0.467052] ACPI: PCI: Interrupt link LNKA configured for IRQ 101318worker1 # [ 0.480470] usbcore: registered new interface driver usbfs1319client # [ 0.444517] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1320worker2 # [ 0.467532] ACPI: PCI: Interrupt link LNKB configured for IRQ 101321worker1 # [ 0.481309] usbcore: registered new interface driver hub1322lb # [ 0.458059] ACPI: PCI: Interrupt link LNKA configured for IRQ 101323worker1 # [ 0.481631] usbcore: registered new device driver usb1324worker2 # [ 0.468522] ACPI: PCI: Interrupt link LNKC configured for IRQ 111325lb # [ 0.458900] ACPI: PCI: Interrupt link LNKB configured for IRQ 101326client # [ 0.446100] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1327worker2 # [ 0.469525] ACPI: PCI: Interrupt link LNKD configured for IRQ 111328worker1 # [ 0.483346] NetLabel: Initializing1329lb # [ 0.459895] ACPI: PCI: Interrupt link LNKC configured for IRQ 111330client # [ 0.447172] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1331worker1 # [ 0.483625] NetLabel: domain hash size = 1281332worker2 # [ 0.470520] ACPI: PCI: Interrupt link LNKE configured for IRQ 101333lb # [ 0.460893] ACPI: PCI: Interrupt link LNKD configured for IRQ 111334worker1 # [ 0.484323] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1335worker2 # [ 0.471522] ACPI: PCI: Interrupt link LNKF configured for IRQ 101336client # [ 0.448526] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1337lb # [ 0.461895] ACPI: PCI: Interrupt link LNKE configured for IRQ 101338worker1 # [ 0.484680] NetLabel: unlabeled traffic allowed by default1339worker2 # [ 0.472526] ACPI: PCI: Interrupt link LNKG configured for IRQ 111340worker1 # [ 0.485557] PCI: Using ACPI for IRQ routing1341lb # [ 0.462883] ACPI: PCI: Interrupt link LNKF configured for IRQ 101342client # [ 0.449464] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1343worker2 # [ 0.473525] ACPI: PCI: Interrupt link LNKH configured for IRQ 111344lb # [ 0.463886] ACPI: PCI: Interrupt link LNKG configured for IRQ 111345worker2 # [ 0.474460] ACPI: PCI: Interrupt link GSIA configured for IRQ 161346lb # [ 0.464897] ACPI: PCI: Interrupt link LNKH configured for IRQ 111347worker2 # [ 0.475445] ACPI: PCI: Interrupt link GSIB configured for IRQ 171348client # [ 0.451770] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1349lb # [ 0.465826] ACPI: PCI: Interrupt link GSIA configured for IRQ 161350worker2 # [ 0.476416] ACPI: PCI: Interrupt link GSIC configured for IRQ 181351client # [ 0.452222] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1352lb # [ 0.466802] ACPI: PCI: Interrupt link GSIB configured for IRQ 171353worker2 # [ 0.477160] ACPI: PCI: Interrupt link GSID configured for IRQ 191354lb # [ 0.467772] ACPI: PCI: Interrupt link GSIC configured for IRQ 181355client # [ 0.453457] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1356worker2 # [ 0.477437] ACPI: PCI: Interrupt link GSIE configured for IRQ 201357lb # [ 0.468527] ACPI: PCI: Interrupt link GSID configured for IRQ 191358worker2 # [ 0.478436] ACPI: PCI: Interrupt link GSIF configured for IRQ 211359client # [ 0.454962] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1360lb # [ 0.468798] ACPI: PCI: Interrupt link GSIE configured for IRQ 201361worker2 # [ 0.479396] ACPI: PCI: Interrupt link GSIG configured for IRQ 221362lb # [ 0.469749] ACPI: PCI: Interrupt link GSIF configured for IRQ 211363worker2 # [ 0.480221] ACPI: PCI: Interrupt link GSIH configured for IRQ 231364lb # [ 0.470559] ACPI: PCI: Interrupt link GSIG configured for IRQ 221365lb # [ 0.470801] ACPI: PCI: Interrupt link GSIH configured for IRQ 231366client # [ 0.458117] ACPI: PCI: Interrupt link LNKA configured for IRQ 101367worker2 # [ 0.482368] iommu: Default domain type: Translated1368worker2 # [ 0.483088] iommu: DMA domain TLB invalidation policy: lazy mode1369lb # [ 0.472894] iommu: Default domain type: Translated1370client # [ 0.459077] ACPI: PCI: Interrupt link LNKB configured for IRQ 101371worker2 # [ 0.483772] ACPI: bus type USB registered1372lb # [ 0.473703] iommu: DMA domain TLB invalidation policy: lazy mode1373client # [ 0.460316] ACPI: PCI: Interrupt link LNKC configured for IRQ 111374worker2 # [ 0.484486] usbcore: registered new interface driver usbfs1375lb # [ 0.474784] ACPI: bus type USB registered1376client # [ 0.461315] ACPI: PCI: Interrupt link LNKD configured for IRQ 111377worker2 # [ 0.485387] usbcore: registered new interface driver hub1378lb # [ 0.475501] usbcore: registered new interface driver usbfs1379client # [ 0.462310] ACPI: PCI: Interrupt link LNKE configured for IRQ 101380worker2 # [ 0.486101] usbcore: registered new device driver usb1381lb # [ 0.475801] usbcore: registered new interface driver hub1382client # [ 0.463315] ACPI: PCI: Interrupt link LNKF configured for IRQ 101383lb # [ 0.476636] usbcore: registered new device driver usb1384worker2 # [ 0.487367] NetLabel: Initializing1385client # [ 0.464328] ACPI: PCI: Interrupt link LNKG configured for IRQ 111386worker2 # [ 0.487858] NetLabel: domain hash size = 1281387lb # [ 0.478344] NetLabel: Initializing1388client # [ 0.465336] ACPI: PCI: Interrupt link LNKH configured for IRQ 111389lb # [ 0.478785] NetLabel: domain hash size = 1281390worker2 # [ 0.488424] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1391client # [ 0.466259] ACPI: PCI: Interrupt link GSIA configured for IRQ 161392lb # [ 0.479504] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1393worker2 # [ 0.489455] NetLabel: unlabeled traffic allowed by default1394client # [ 0.467232] ACPI: PCI: Interrupt link GSIB configured for IRQ 171395worker2 # [ 0.490375] PCI: Using ACPI for IRQ routing1396lb # [ 0.479842] NetLabel: unlabeled traffic allowed by default1397client # [ 0.468182] ACPI: PCI: Interrupt link GSIC configured for IRQ 181398lb # [ 0.480745] PCI: Using ACPI for IRQ routing1399client # [ 0.468962] ACPI: PCI: Interrupt link GSID configured for IRQ 191400client # [ 0.469228] ACPI: PCI: Interrupt link GSIE configured for IRQ 201401client # [ 0.470228] ACPI: PCI: Interrupt link GSIF configured for IRQ 211402client # [ 0.471230] ACPI: PCI: Interrupt link GSIG configured for IRQ 221403client # [ 0.472227] ACPI: PCI: Interrupt link GSIH configured for IRQ 231404client # [ 0.474277] iommu: Default domain type: Translated1405client # [ 0.475145] iommu: DMA domain TLB invalidation policy: lazy mode1406client # [ 0.476246] ACPI: bus type USB registered1407client # [ 0.477035] usbcore: registered new interface driver usbfs1408client # [ 0.477963] usbcore: registered new interface driver hub1409client # [ 0.478225] usbcore: registered new device driver usb1410client # [ 0.479910] NetLabel: Initializing1411client # [ 0.480222] NetLabel: domain hash size = 1281412client # [ 0.481026] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413client # [ 0.482007] NetLabel: unlabeled traffic allowed by default1414client # [ 0.482986] PCI: Using ACPI for IRQ routing1415worker1 # [ 0.530076] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416worker1 # [ 0.530615] pci 0000:00:01.0: vgaarb: bridge control possible1417worker1 # [ 0.530615] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418worker1 # [ 0.530624] vgaarb: loaded1419worker1 # [ 0.531401] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420worker1 # [ 0.531620] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421worker1 # [ 0.536704] clocksource: Switched to clocksource kvm-clock1422worker1 # [ 0.540182] VFS: Disk quotas dquot_6.6.01423worker1 # [ 0.540906] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1424worker1 # [ 0.542273] pnp: PnP ACPI init1425worker1 # [ 0.543094] ACPI: IRQ 4 override to edge(!), high(!)1426worker1 # [ 0.544130] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1427worker1 # [ 0.545711] pnp: PnP ACPI: found 6 devices1428worker2 # [ 0.534765] pci 0000:00:01.0: vgaarb: setting as boot VGA device1429worker2 # [ 0.535420] pci 0000:00:01.0: vgaarb: bridge control possible1430lb # [ 0.525431] pci 0000:00:01.0: vgaarb: setting as boot VGA device1431worker2 # [ 0.535420] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1432lb # [ 0.525780] pci 0000:00:01.0: vgaarb: bridge control possible1433worker2 # [ 0.535428] vgaarb: loaded1434lb # [ 0.525780] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1435worker2 # [ 0.536167] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01436lb # [ 0.525789] vgaarb: loaded1437worker2 # [ 0.536426] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1438lb # [ 0.526558] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01439lb # [ 0.526784] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1440worker1 # [ 0.553689] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1441worker1 # [ 0.555190] clocksource: Switched to clocksource acpi_pm1442worker2 # [ 0.539527] clocksource: Switched to clocksource kvm-clock1443worker1 # [ 0.556190] NET: Registered PF_INET protocol family1444lb # [ 0.529880] clocksource: Switched to clocksource kvm-clock1445worker1 # [ 0.557398] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1446lb # [ 0.531618] VFS: Disk quotas dquot_6.6.01447worker2 # [ 0.543104] VFS: Disk quotas dquot_6.6.01448worker2 # [ 0.543840] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1449worker2 # [ 0.545191] pnp: PnP ACPI init1450lb # [ 0.534201] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1451worker2 # [ 0.545960] ACPI: IRQ 4 override to edge(!), high(!)1452lb # [ 0.535599] pnp: PnP ACPI init1453worker2 # [ 0.546936] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1454lb # [ 0.536477] ACPI: IRQ 4 override to edge(!), high(!)1455worker2 # [ 0.548511] pnp: PnP ACPI: found 6 devices1456client # [ 0.527368] pci 0000:00:01.0: vgaarb: setting as boot VGA device1457lb # [ 0.537489] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1458client # [ 0.528211] pci 0000:00:01.0: vgaarb: bridge control possible1459lb # [ 0.539094] pnp: PnP ACPI: found 6 devices1460client # [ 0.528211] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1461client # [ 0.528219] vgaarb: loaded1462client # [ 0.528976] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01463client # [ 0.529217] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1464worker2 # [ 0.556089] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1465worker2 # [ 0.557525] clocksource: Switched to clocksource acpi_pm1466client # [ 0.533300] clocksource: Switched to clocksource kvm-clock1467worker1 # [ 0.573634] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1468worker2 # [ 0.558474] NET: Registered PF_INET protocol family1469lb # [ 0.546717] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1470worker1 # [ 0.575149] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1471lb # [ 0.548139] clocksource: Switched to clocksource acpi_pm1472worker2 # [ 0.559621] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1473lb # [ 0.549117] NET: Registered PF_INET protocol family1474worker1 # [ 0.576459] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1475client # [ 0.536583] VFS: Disk quotas dquot_6.6.01476worker1 # [ 0.577833] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1477lb # [ 0.550295] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1478client # [ 0.537302] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1479client # [ 0.538638] pnp: PnP ACPI init1480worker1 # [ 0.579108] TCP: Hash tables configured (established 16384 bind 16384)1481client # [ 0.539425] ACPI: IRQ 4 override to edge(!), high(!)1482worker1 # [ 0.580269] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1483client # [ 0.540473] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1484worker1 # [ 0.581586] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1485client # [ 0.542058] pnp: PnP ACPI: found 6 devices1486worker1 # [ 0.582710] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1487worker1 # [ 0.583995] NET: Registered PF_UNIX/PF_LOCAL protocol family1488worker1 # [ 0.584988] NET: Registered PF_XDP protocol family1489worker1 # [ 0.585834] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1490worker1 # [ 0.586888] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1491worker1 # [ 0.587920] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1492worker1 # [ 0.589077] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1493worker1 # [ 0.590260] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1494client # [ 0.549649] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1495worker1 # [ 0.591409] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1496client # [ 0.551222] clocksource: Switched to clocksource acpi_pm1497worker1 # [ 0.593160] ACPI: \_SB_.GSIA: Enabled at IRQ 161498client # [ 0.552223] NET: Registered PF_INET protocol family1499worker2 # [ 0.576413] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1500worker2 # [ 0.577904] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1501client # [ 0.553387] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1502lb # [ 0.567546] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1503worker1 # [ 0.595717] ACPI: \_SB_.GSIB: Enabled at IRQ 171504worker2 # [ 0.579215] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1505lb # [ 0.569083] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1506worker2 # [ 0.580506] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1507worker1 # [ 0.597598] ACPI: \_SB_.GSIC: Enabled at IRQ 181508worker2 # [ 0.581733] TCP: Hash tables configured (established 16384 bind 16384)1509lb # [ 0.570403] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1510worker1 # [ 0.599550] ACPI: \_SB_.GSID: Enabled at IRQ 191511worker2 # [ 0.582837] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1512lb # [ 0.571766] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1513worker2 # [ 0.584094] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1514lb # [ 0.572995] TCP: Hash tables configured (established 16384 bind 16384)1515worker1 # [ 0.601248] PCI: CLS 0 bytes, default 641516worker2 # [ 0.585166] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1517lb # [ 0.574117] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1518worker2 # [ 0.586356] NET: Registered PF_UNIX/PF_LOCAL protocol family1519worker1 # [ 0.602144] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1520lb # [ 0.575425] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1521worker2 # [ 0.587266] NET: Registered PF_XDP protocol family1522worker1 # [ 0.603830] Trying to unpack rootfs image as initramfs...1523lb # [ 0.576484] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1524worker2 # [ 0.588152] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1525lb # [ 0.577694] NET: Registered PF_UNIX/PF_LOCAL protocol family1526worker2 # [ 0.589139] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1527lb # [ 0.578677] NET: Registered PF_XDP protocol family1528worker2 # [ 0.590123] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1529lb # [ 0.579512] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1530worker2 # [ 0.591175] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1531lb # [ 0.580530] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1532worker2 # [ 0.592237] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1533lb # [ 0.581537] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1534worker2 # [ 0.593286] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1535lb # [ 0.582664] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1536client # [ 0.569764] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1537worker2 # [ 0.594974] ACPI: \_SB_.GSIA: Enabled at IRQ 161538lb # [ 0.583758] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1539lb # [ 0.584856] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1540client # [ 0.571298] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1541worker2 # [ 0.597404] ACPI: \_SB_.GSIB: Enabled at IRQ 171542lb # [ 0.586488] ACPI: \_SB_.GSIA: Enabled at IRQ 161543client # [ 0.572599] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1544client # [ 0.573944] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1545worker2 # [ 0.599265] ACPI: \_SB_.GSIC: Enabled at IRQ 181546lb # [ 0.588803] ACPI: \_SB_.GSIB: Enabled at IRQ 171547client # [ 0.575249] TCP: Hash tables configured (established 16384 bind 16384)1548worker2 # [ 0.601218] ACPI: \_SB_.GSID: Enabled at IRQ 191549client # [ 0.576388] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1550lb # [ 0.590920] ACPI: \_SB_.GSIC: Enabled at IRQ 181551client # [ 0.577680] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1552worker2 # [ 0.602830] PCI: CLS 0 bytes, default 641553client # [ 0.578804] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1554lb # [ 0.592945] ACPI: \_SB_.GSID: Enabled at IRQ 191555worker2 # [ 0.603701] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1556client # [ 0.580074] NET: Registered PF_UNIX/PF_LOCAL protocol family1557worker2 # [ 0.605382] Trying to unpack rootfs image as initramfs...1558client # [ 0.581068] NET: Registered PF_XDP protocol family1559lb # [ 0.594710] PCI: CLS 0 bytes, default 641560client # [ 0.581918] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1561lb # [ 0.595613] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1562client # [ 0.582962] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1563lb # [ 0.597359] Trying to unpack rootfs image as initramfs...1564client # [ 0.583994] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1565client # [ 0.585209] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1566client # [ 0.586361] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1567client # [ 0.587519] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1568client # [ 0.589267] ACPI: \_SB_.GSIA: Enabled at IRQ 161569client # [ 0.591736] ACPI: \_SB_.GSIB: Enabled at IRQ 171570client # [ 0.593684] ACPI: \_SB_.GSIC: Enabled at IRQ 181571client # [ 0.595572] ACPI: \_SB_.GSID: Enabled at IRQ 191572client # [ 0.597193] PCI: CLS 0 bytes, default 641573client # [ 0.598081] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1574client # [ 0.599875] Trying to unpack rootfs image as initramfs...1575worker1 # [ 0.650180] Initialise system trusted keyrings1576worker1 # [ 0.651187] workingset: timestamp_bits=40 max_order=19 bucket_order=01577worker2 # [ 0.650329] Initialise system trusted keyrings1578worker2 # [ 0.653140] workingset: timestamp_bits=40 max_order=19 bucket_order=01579lb # [ 0.642151] Initialise system trusted keyrings1580worker1 # [ 0.673917] Key type asymmetric registered1581worker1 # [ 0.674648] Asymmetric key parser 'x509' registered1582lb # [ 0.646934] workingset: timestamp_bits=40 max_order=19 bucket_order=01583worker1 # [ 0.675542] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1584worker1 # [ 0.680867] io scheduler mq-deadline registered1585worker1 # [ 0.681661] io scheduler kyber registered1586client # [ 0.644584] Initialise system trusted keyrings1587worker1 # [ 0.685282] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1588worker1 # [ 0.686612] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1589client # [ 0.647595] workingset: timestamp_bits=40 max_order=19 bucket_order=01590worker2 # [ 0.672480] Key type asymmetric registered1591worker1 # [ 0.690567] Linux agpgart interface v0.1031592worker1 # [ 0.691352] ACPI: bus type drm_connector registered1593worker2 # [ 0.677120] Asymmetric key parser 'x509' registered1594worker2 # [ 0.677977] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1595lb # [ 0.668873] Key type asymmetric registered1596worker1 # [ 0.696207] usbcore: registered new interface driver usbserial_generic1597lb # [ 0.669576] Asymmetric key parser 'x509' registered1598worker1 # [ 0.697294] usbserial: USB Serial support registered for generic1599worker2 # [ 0.681268] io scheduler mq-deadline registered1600worker2 # [ 0.682035] io scheduler kyber registered1601lb # [ 0.670454] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1602worker1 # [ 0.699779] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1603worker2 # [ 0.684650] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1604worker1 # [ 0.699779] Please enable it if your BIOS has the CPPC option.1605worker1 # [ 0.702074] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1606worker2 # [ 0.685925] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1607lb # [ 0.675985] io scheduler mq-deadline registered1608lb # [ 0.676772] io scheduler kyber registered1609worker1 # [ 0.705923] drop_monitor: Initializing network drop monitor service1610worker1 # [ 0.707159] NET: Registered PF_INET6 protocol family1611lb # [ 0.679455] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1612worker2 # [ 0.691978] Linux agpgart interface v0.1031613lb # [ 0.680752] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1614worker2 # [ 0.692758] ACPI: bus type drm_connector registered1615worker1 # [ 0.710193] Segment Routing with IPv61616worker1 # [ 0.710894] In-situ OAM (IOAM) with IPv61617client # [ 0.670683] Key type asymmetric registered1618client # [ 0.671395] Asymmetric key parser 'x509' registered1619client # [ 0.672307] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1620lb # [ 0.686223] Linux agpgart interface v0.1031621worker2 # [ 0.697249] usbcore: registered new interface driver usbserial_generic1622lb # [ 0.687050] ACPI: bus type drm_connector registered1623worker2 # [ 0.698339] usbserial: USB Serial support registered for generic1624worker1 # [ 0.715033] IPI shorthand broadcast: enabled1625client # [ 0.675682] io scheduler mq-deadline registered1626client # [ 0.676468] io scheduler kyber registered1627lb # [ 0.690270] usbcore: registered new interface driver usbserial_generic1628worker2 # [ 0.701104] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1629worker2 # [ 0.701104] Please enable it if your BIOS has the CPPC option.1630lb # [ 0.691327] usbserial: USB Serial support registered for generic1631worker2 # [ 0.703360] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1632client # [ 0.680129] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1633client # [ 0.681469] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1634worker2 # [ 0.706245] drop_monitor: Initializing network drop monitor service1635lb # [ 0.694986] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1636worker2 # [ 0.707381] NET: Registered PF_INET6 protocol family1637lb # [ 0.694986] Please enable it if your BIOS has the CPPC option.1638worker1 # [ 0.723394] sched_clock: Marking stable (587016052, 135733422)->(793272373, -70522899)1639worker1 # [ 0.724904] registered taskstats version 11640lb # [ 0.697103] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1641worker1 # [ 0.725855] Loading compiled-in X.509 certificates1642client # [ 0.685332] Linux agpgart interface v0.1031643lb # [ 0.698540] drop_monitor: Initializing network drop monitor service1644client # [ 0.686107] ACPI: bus type drm_connector registered1645lb # [ 0.699745] NET: Registered PF_INET6 protocol family1646worker2 # [ 0.712400] Segment Routing with IPv61647worker2 # [ 0.713115] In-situ OAM (IOAM) with IPv61648client # [ 0.688979] usbcore: registered new interface driver usbserial_generic1649client # [ 0.690085] usbserial: USB Serial support registered for generic1650lb # [ 0.704172] Segment Routing with IPv61651worker2 # [ 0.715379] IPI shorthand broadcast: enabled1652lb # [ 0.704823] In-situ OAM (IOAM) with IPv61653client # [ 0.693568] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1654lb # [ 0.708226] IPI shorthand broadcast: enabled1655client # [ 0.693568] Please enable it if your BIOS has the CPPC option.1656client # [ 0.695830] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1657worker2 # [ 0.723726] sched_clock: Marking stable (589015125, 134069909)->(797138764, -74053730)1658client # [ 0.699672] drop_monitor: Initializing network drop monitor service1659client # [ 0.700828] NET: Registered PF_INET6 protocol family1660lb # [ 0.714465] sched_clock: Marking stable (580013084, 133829921)->(788683176, -74840171)1661worker1 # [ 0.743771] Demotion targets for Node 0: null1662client # [ 0.704002] Segment Routing with IPv61663worker2 # [ 0.729192] registered taskstats version 11664worker1 # [ 0.745808] Key type .fscrypt registered1665client # [ 0.705569] In-situ OAM (IOAM) with IPv61666worker1 # [ 0.746480] Key type fscrypt-provisioning registered1667worker2 # [ 0.730156] Loading compiled-in X.509 certificates1668worker1 # [ 0.747410] ima: No TPM chip found, activating TPM-bypass!1669lb # [ 0.720110] registered taskstats version 11670lb # [ 0.721116] Loading compiled-in X.509 certificates1671client # [ 0.707806] IPI shorthand broadcast: enabled1672worker1 # [ 0.751764] ima: Allocated hash algorithm: sha11673worker1 # [ 0.752599] ima: No architecture policies found1674worker1 # [ 0.754764] PM: Magic number: 10:810:9781675worker1 # [ 0.756409] RAS: Correctable Errors collector initialized.1676client # [ 0.715973] sched_clock: Marking stable (580015252, 135530392)->(788717576, -73171932)1677client # [ 0.720647] registered taskstats version 11678client # [ 0.721624] Loading compiled-in X.509 certificates1679worker2 # [ 0.746694] Demotion targets for Node 0: null1680worker2 # [ 0.749146] Key type .fscrypt registered1681worker1 # [ 0.765462] clk: Disabling unused clocks1682worker2 # [ 0.749807] Key type fscrypt-provisioning registered1683lb # [ 0.739869] Demotion targets for Node 0: null1684worker2 # [ 0.750828] ima: No TPM chip found, activating TPM-bypass!1685worker1 # [ 0.767764] PM: genpd: Disabling unused power domains1686lb # [ 0.740744] Key type .fscrypt registered1687lb # [ 0.743856] Key type fscrypt-provisioning registered1688worker2 # [ 0.755114] ima: Allocated hash algorithm: sha11689worker2 # [ 0.755926] ima: No architecture policies found1690lb # [ 0.744774] ima: No TPM chip found, activating TPM-bypass!1691lb # [ 0.745685] ima: Allocated hash algorithm: sha11692lb # [ 0.746507] ima: No architecture policies found1693worker2 # [ 0.758097] PM: Magic number: 10:810:9781694worker2 # [ 0.759757] RAS: Correctable Errors collector initialized.1695lb # [ 0.748862] PM: Magic number: 10:810:9781696lb # [ 0.750475] RAS: Correctable Errors collector initialized.1697client # [ 0.740568] Demotion targets for Node 0: null1698client # [ 0.741479] Key type .fscrypt registered1699client # [ 0.742206] Key type fscrypt-provisioning registered1700worker2 # [ 0.769798] clk: Disabling unused clocks1701client # [ 0.745676] ima: No TPM chip found, activating TPM-bypass!1702client # [ 0.746619] ima: Allocated hash algorithm: sha11703lb # [ 0.760516] clk: Disabling unused clocks1704client # [ 0.747430] ima: No architecture policies found1705worker2 # [ 0.772098] PM: genpd: Disabling unused power domains1706lb # [ 0.762861] PM: genpd: Disabling unused power domains1707client # [ 0.749727] PM: Magic number: 10:810:9781708client # [ 0.751402] RAS: Correctable Errors collector initialized.1709client # [ 0.762255] clk: Disabling unused clocks1710client # [ 0.764559] PM: genpd: Disabling unused power domains1711worker1 # [ 0.928600] Freeing initrd memory: 29092K1712worker1 # [ 0.931727] Freeing unused decrypted memory: 2028K1713worker1 # [ 0.934376] Freeing unused kernel image (initmem) memory: 3644K1714worker1 # [ 0.935519] Write protecting the kernel read-only data: 32768k1715worker1 # [ 0.937407] Freeing unused kernel image (text/rodata gap) memory: 1208K1716worker1 # [ 0.939008] Freeing unused kernel image (rodata/data gap) memory: 752K1717worker2 # [ 0.937274] Freeing initrd memory: 29092K1718worker2 # [ 0.940560] Freeing unused decrypted memory: 2028K1719lb # [ 0.929698] Freeing initrd memory: 29092K1720worker2 # [ 0.943278] Freeing unused kernel image (initmem) memory: 3644K1721lb # [ 0.932941] Freeing unused decrypted memory: 2028K1722worker2 # [ 0.944367] Write protecting the kernel read-only data: 32768k1723client # [ 0.920081] Freeing initrd memory: 29096K1724worker2 # [ 0.946222] Freeing unused kernel image (text/rodata gap) memory: 1208K1725lb # [ 0.935525] Freeing unused kernel image (initmem) memory: 3644K1726client # [ 0.923152] Freeing unused decrypted memory: 2028K1727lb # [ 0.936642] Write protecting the kernel read-only data: 32768k1728worker2 # [ 0.947780] Freeing unused kernel image (rodata/data gap) memory: 752K1729lb # [ 0.938491] Freeing unused kernel image (text/rodata gap) memory: 1208K1730client # [ 0.925626] Freeing unused kernel image (initmem) memory: 3644K1731client # [ 0.926656] Write protecting the kernel read-only data: 32768k1732lb # [ 0.940073] Freeing unused kernel image (rodata/data gap) memory: 752K1733client # [ 0.928475] Freeing unused kernel image (text/rodata gap) memory: 1208K1734client # [ 0.929972] Freeing unused kernel image (rodata/data gap) memory: 752K1735worker1 # [ 0.990135] x86/mm: Checked W+X mappings: passed, no W+X pages found.1736worker1 # [ 0.991259] Run /init as init process1737worker1 # [ 1.001486] systemd[1]: Inserted module 'autofs4'1738worker2 # [ 0.999189] x86/mm: Checked W+X mappings: passed, no W+X pages found.1739worker2 # [ 1.000239] Run /init as init process1740worker1 # [ 1.017909] fuse: init (API version 7.45)1741lb # [ 0.991058] x86/mm: Checked W+X mappings: passed, no W+X pages found.1742lb # [ 0.992177] Run /init as init process1743client # [ 0.981069] x86/mm: Checked W+X mappings: passed, no W+X pages found.1744client # [ 0.982159] Run /init as init process1745worker1 # [ 1.023594] ACPI: \_SB_.GSIG: Enabled at IRQ 221746worker1 # [ 1.026271] ACPI: \_SB_.GSIH: Enabled at IRQ 231747worker2 # [ 1.010485] systemd[1]: Inserted module 'autofs4'1748worker1 # [ 1.029335] ACPI: \_SB_.GSIE: Enabled at IRQ 201749lb # [ 1.002537] systemd[1]: Inserted module 'autofs4'1750worker1 # [ 1.031703] ACPI: \_SB_.GSIF: Enabled at IRQ 211751client # [ 0.992344] systemd[1]: Inserted module 'autofs4'1752worker2 # [ 1.026793] fuse: init (API version 7.45)1753lb # [ 1.018809] fuse: init (API version 7.45)1754worker2 # [ 1.032670] ACPI: \_SB_.GSIG: Enabled at IRQ 221755client # [ 1.008453] fuse: init (API version 7.45)1756worker2 # [ 1.035286] ACPI: \_SB_.GSIH: Enabled at IRQ 231757lb # [ 1.024591] ACPI: \_SB_.GSIG: Enabled at IRQ 221758lb # [ 1.027407] ACPI: \_SB_.GSIH: Enabled at IRQ 231759client # [ 1.014357] ACPI: \_SB_.GSIG: Enabled at IRQ 221760worker2 # [ 1.038880] ACPI: \_SB_.GSIE: Enabled at IRQ 201761client # [ 1.016840] ACPI: \_SB_.GSIH: Enabled at IRQ 231762worker2 # [ 1.041561] ACPI: \_SB_.GSIF: Enabled at IRQ 211763lb # [ 1.030481] ACPI: \_SB_.GSIE: Enabled at IRQ 201764lb # [ 1.032736] ACPI: \_SB_.GSIF: Enabled at IRQ 211765worker1 # [ 1.060490] systemd[1]: Successfully made /usr/ read-only.1766client # [ 1.019984] ACPI: \_SB_.GSIE: Enabled at IRQ 201767client # [ 1.022352] ACPI: \_SB_.GSIF: Enabled at IRQ 211768lb # [ 1.062003] systemd[1]: Successfully made /usr/ read-only.1769worker2 # [ 1.074334] systemd[1]: Successfully made /usr/ read-only.1770client # [ 1.052346] systemd[1]: Successfully made /usr/ read-only.1771worker1 # [ 1.396008] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772worker1 # [ 1.401752] systemd[1]: Detected virtualization kvm.1773worker1 # [ 1.402765] systemd[1]: Detected architecture x86-64.1774worker1 # [ 1.403783] systemd[1]: Running in initrd.1775worker1 # [ 1.405023] systemd[1]: Initializing machine ID from random generator.1776worker1 # [ 1.406428] systemd[1]: Hostname set to <worker1>.1777lb # [ 1.398747] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778worker2 # [ 1.410971] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1779lb # [ 1.410813] systemd[1]: Detected virtualization kvm.1780client # [ 1.389249] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1781worker2 # [ 1.423478] systemd[1]: Detected virtualization kvm.1782lb # [ 1.412981] systemd[1]: Detected architecture x86-64.1783client # [ 1.401201] systemd[1]: Detected virtualization kvm.1784worker2 # [ 1.425921] systemd[1]: Detected architecture x86-64.1785lb # [ 1.415135] systemd[1]: Running in initrd.1786worker2 # [ 1.428136] systemd[1]: Running in initrd.1787client # [ 1.403317] systemd[1]: Detected architecture x86-64.1788lb # [ 1.417737] systemd[1]: Initializing machine ID from random generator.1789client # [ 1.405793] systemd[1]: Running in initrd.1790worker2 # [ 1.430928] systemd[1]: Initializing machine ID from random generator.1791lb # [ 1.420743] systemd[1]: Hostname set to <lb>.1792client # [ 1.408494] systemd[1]: Initializing machine ID from random generator.1793worker2 # [ 1.433829] systemd[1]: Hostname set to <worker2>.1794client # [ 1.411408] systemd[1]: Hostname set to <client>.1795worker1 # [ 1.612444] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796lb # [ 1.628694] systemd[1]: bpf-restrict-fs: LSM BPF program attached1797worker1 # [ 1.656775] systemd[1]: Queued start job for default target Initrd Default Target.1798worker1 # [ 1.660050] systemd[1]: Created slice Slice /system/modprobe.1799worker1 # [ 1.661259] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1800worker2 # [ 1.645653] systemd[1]: bpf-restrict-fs: LSM BPF program attached1801worker1 # [ 1.662667] systemd[1]: Expecting device /dev/disk/by-label/nixos...1802worker1 # [ 1.663794] systemd[1]: Reached target Path Units.1803worker1 # [ 1.664664] systemd[1]: Reached target Slice Units.1804worker1 # [ 1.665554] systemd[1]: Reached target Swaps.1805worker1 # [ 1.666426] systemd[1]: Reached target Timer Units.1806worker1 # [ 1.667424] systemd[1]: Listening on D-Bus System Message Bus Socket.1807worker1 # [ 1.668662] systemd[1]: Listening on Journal Socket (/dev/log).1808worker1 # [ 1.669833] systemd[1]: Listening on Journal Sockets.1809worker1 # [ 1.670820] systemd[1]: Listening on udev Control Socket.1810worker1 # [ 1.671781] systemd[1]: Listening on udev Kernel Socket.1811worker1 # [ 1.672711] systemd[1]: Reached target Socket Units.1812worker1 # [ 1.674523] systemd[1]: Starting Create List of Static Device Nodes...1813client # [ 1.632703] systemd[1]: bpf-restrict-fs: LSM BPF program attached1814worker1 # [ 1.678817] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1815worker1 # [ 1.686817] systemd[1]: Starting Load Kernel Module configfs...1816lb # [ 1.671684] systemd[1]: Queued start job for default target Initrd Default Target.1817worker1 # [ 1.701127] systemd[1]: Starting Journal Service...1818worker2 # [ 1.685957] systemd[1]: Queued start job for default target Initrd Default Target.1819lb # [ 1.676540] systemd[1]: Created slice Slice /system/modprobe.1820lb # [ 1.677914] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1821worker2 # [ 1.690477] systemd[1]: Created slice Slice /system/modprobe.1822lb # [ 1.679398] systemd[1]: Expecting device /dev/disk/by-label/nixos...1823lb # [ 1.680505] systemd[1]: Reached target Path Units.1824worker2 # [ 1.691638] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1825lb # [ 1.681400] systemd[1]: Reached target Slice Units.1826worker1 # [ 1.708937] systemd[1]: Starting Load Kernel Modules...1827worker2 # [ 1.692996] systemd[1]: Expecting device /dev/disk/by-label/nixos...1828lb # [ 1.682375] systemd[1]: Reached target Swaps.1829worker2 # [ 1.694059] systemd[1]: Reached target Path Units.1830lb # [ 1.683225] systemd[1]: Reached target Timer Units.1831worker2 # [ 1.694971] systemd[1]: Reached target Slice Units.1832lb # [ 1.684264] systemd[1]: Listening on D-Bus System Message Bus Socket.1833worker2 # [ 1.695854] systemd[1]: Reached target Swaps.1834worker2 # [ 1.696637] systemd[1]: Reached target Timer Units.1835lb # [ 1.685481] systemd[1]: Listening on Journal Socket (/dev/log).1836worker2 # [ 1.697640] systemd[1]: Listening on D-Bus System Message Bus Socket.1837lb # [ 1.686694] systemd[1]: Listening on Journal Sockets.1838lb # [ 1.687690] systemd[1]: Listening on udev Control Socket.1839worker2 # [ 1.698830] systemd[1]: Listening on Journal Socket (/dev/log).1840lb # [ 1.688703] systemd[1]: Listening on udev Kernel Socket.1841worker2 # [ 1.699957] systemd[1]: Listening on Journal Sockets.1842lb # [ 1.689648] systemd[1]: Reached target Socket Units.1843worker2 # [ 1.700938] systemd[1]: Listening on udev Control Socket.1844worker2 # [ 1.701938] systemd[1]: Listening on udev Kernel Socket.1845worker2 # [ 1.702877] systemd[1]: Reached target Socket Units.1846lb # [ 1.691512] systemd[1]: Starting Create List of Static Device Nodes...1847worker2 # [ 1.704732] systemd[1]: Starting Create List of Static Device Nodes...1848lb # [ 1.696931] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1849worker2 # [ 1.709153] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1850client # [ 1.687894] systemd[1]: Queued start job for default target Initrd Default Target.1851worker1 # [ 1.717827] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1852lb # [ 1.705056] systemd[1]: Starting Load Kernel Module configfs...1853client # [ 1.691925] systemd[1]: Created slice Slice /system/modprobe.1854worker2 # [ 1.717339] systemd[1]: Starting Load Kernel Module configfs...1855client # [ 1.693052] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1856worker1 # [ 1.735364] netfs: FS-Cache loaded1857client # [ 1.694440] systemd[1]: Expecting device /dev/disk/by-label/nixos...1858client # [ 1.695492] systemd[1]: Reached target Path Units.1859client # [ 1.696332] systemd[1]: Reached target Slice Units.1860client # [ 1.697182] systemd[1]: Reached target Swaps.1861client # [ 1.697951] systemd[1]: Reached target Timer Units.1862worker1 # [ 1.740119] 9pnet: Installing 9P2000 support1863client # [ 1.698980] systemd[1]: Listening on D-Bus System Message Bus Socket.1864client # [ 1.700198] systemd[1]: Listening on Journal Socket (/dev/log).1865client # [ 1.701385] systemd[1]: Listening on Journal Sockets.1866client # [ 1.702414] systemd[1]: Listening on udev Control Socket.1867client # [ 1.703462] systemd[1]: Listening on udev Kernel Socket.1868client # [ 1.704447] systemd[1]: Reached target Socket Units.1869worker2 # [ 1.730747] systemd[1]: Starting Journal Service...1870client # [ 1.706403] systemd[1]: Starting Create List of Static Device Nodes...1871lb # [ 1.721556] systemd[1]: Starting Journal Service...1872worker1 # [ 1.749005] systemd[1]: Starting Coldplug All udev Devices...1873client # [ 1.711624] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1874client # [ 1.718257] systemd[1]: Starting Load Kernel Module configfs...1875lb # [ 1.734936] systemd[1]: Starting Load Kernel Modules...1876worker1 # [ 1.762814] systemd[1]: Finished Create List of Static Device Nodes.1877worker2 # [ 1.747173] systemd[1]: Starting Load Kernel Modules...1878worker1 # [ 1.768333] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1879client # [ 1.733858] systemd[1]: Starting Journal Service...1880worker1 # [ 1.775874] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1881worker2 # [ 1.751734] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1882worker1 # [ 1.781162] systemd[1]: modprobe@configfs.service: Deactivated successfully.1883lb # [ 1.741967] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1884worker2 # [ 1.767626] netfs: FS-Cache loaded1885worker1 # [ 1.784606] systemd-journald[67]: Collecting audit messages is disabled.1886lb # [ 1.758231] netfs: FS-Cache loaded1887client # [ 1.747415] systemd[1]: Starting Load Kernel Modules...1888worker2 # [ 1.772855] 9pnet: Installing 9P2000 support1889worker1 # [ 1.789139] systemd[1]: Finished Load Kernel Module configfs.1890lb # [ 1.763370] 9pnet: Installing 9P2000 support1891worker1 # [ 1.795213] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1892worker1 # [ 1.800049] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1893lb # [ 1.774057] systemd[1]: Starting Coldplug All udev Devices...1894worker2 # [ 1.789175] systemd[1]: Starting Coldplug All udev Devices...1895worker1 # [ 1.806825] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1896client # [ 1.754640] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1897worker1 # [ 1.809771] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1898client # [ 1.774441] netfs: FS-Cache loaded1899lb # [ 1.789937] systemd[1]: Finished Create List of Static Device Nodes.1900worker2 # [ 1.804246] systemd[1]: Finished Create List of Static Device Nodes.1901lb # [ 1.795639] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1902client # [ 1.784792] 9pnet: Installing 9P2000 support1903worker2 # [ 1.810334] systemd-journald[67]: Collecting audit messages is disabled.1904client # [ 1.787466] systemd-journald[67]: Collecting audit messages is disabled.1905worker2 # [ 1.812272] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1906lb # [ 1.803303] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1907worker2 # [ 1.819503] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1908lb # [ 1.808793] systemd-journald[67]: Collecting audit messages is disabled.1909lb # [ 1.810480] systemd[1]: modprobe@configfs.service: Deactivated successfully.1910worker1 # [ 1.840296] systemd[1]: Finished Load Kernel Modules.1911client # [ 1.799774] systemd[1]: Starting Coldplug All udev Devices...1912worker2 # [ 1.825551] systemd[1]: modprobe@configfs.service: Deactivated successfully.1913lb # [ 1.818221] systemd[1]: Finished Load Kernel Module configfs.1914worker2 # [ 1.831494] systemd[1]: Finished Load Kernel Module configfs.1915worker1 # [ 1.848934] systemd[1]: Starting Apply Kernel Variables...1916lb # [ 1.822397] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1917worker2 # [ 1.836569] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1918lb # [ 1.827498] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1919worker2 # [ 1.839179] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1920client # [ 1.815655] systemd[1]: Finished Create List of Static Device Nodes.1921worker1 # [ 1.857890] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1922client # [ 1.821213] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1923lb # [ 1.835085] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1924lb # [ 1.836590] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1925worker2 # [ 1.848319] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1926worker2 # [ 1.850086] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1927worker1 # [ 1.867965] systemd[1]: Starting Create Static Device Nodes in /dev...1928client # [ 1.828982] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1929client # [ 1.834964] systemd[1]: modprobe@configfs.service: Deactivated successfully.1930client # [ 1.842932] systemd[1]: Finished Load Kernel Module configfs.1931worker1 # [ 1.888088] systemd[1]: Finished Apply Kernel Variables.1932client # [ 1.846958] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1933client # [ 1.849662] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1934worker2 # [ 1.880638] systemd[1]: Finished Load Kernel Modules.1935lb # [ 1.869497] systemd[1]: Finished Load Kernel Modules.1936client # [ 1.856589] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1937worker1 # [ 1.764248] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.901058] systemd[1]: Started Journal Service.1938worker1 # 1939client # [ 1.860763] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1940worker1 # [ 1.767304] systemd-modules-load[68]: Inserted module 'virtio_balloon'1941lb # [ 1.878069] systemd[1]: Starting Apply Kernel Variables...1942worker2 # [ 1.889361] systemd[1]: Starting Apply Kernel Variables...1943worker1 # [ 1.770271] systemd-modules-load[68]: Inserted module 'virtio_gpu'1944worker1 # [ 1.771243] systemd[1]: Finished Create Static Device Nodes in /dev.1945worker1 # [ 1.773331] systemd[1]: Reached target Preparation for Local File Systems.1946worker1 # [ 1.775414] systemd[1]: Reached target Local File Systems.1947worker1 # [ 1.776354] systemd[1]: Starting Create System Files and Directories...1948worker2 # [ 1.899276] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1949lb # [ 1.890947] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1950worker1 # [ 1.784938] systemd[1]: Starting Rule-based Manager for Device Events and Files...1951worker2 # [ 1.909355] systemd[1]: Starting Create Static Device Nodes in /dev...1952lb # [ 1.901065] systemd[1]: Starting Create Static Device Nodes in /dev...1953client # [ 1.888118] systemd[1]: Finished Load Kernel Modules.1954client # [ 1.896790] systemd[1]: Starting Apply Kernel Variables...1955worker1 # [ 1.806185] systemd[1]: Finished Create System Files and Directories.1956worker2 # [ 1.930239] systemd[1]: Finished Apply Kernel Variables.1957lb # [ 1.921560] systemd[1]: Finished Apply Kernel Variables.1958client # [ 1.770960] systemd-modules-load[68]: Inserted module 'dm_mod'1959client # [ 1.775039] systemd-modules-load[68]: Inserted module 'virtio_balloon'1960worker2 # [ 1.935297] systemd[1]: Started Journal Service.1961client # [ 1.911674] systemd[1]: Started Journal Service.1962worker2 # [ 1.803062] systemd-modules-load[68]: Inserted module 'dm_mod'1963client # [ 1.777341] systemd-modules-load[68]: Inserted module 'virtio_gpu'1964worker2 # [ 1.804335] systemd-modules-load[68]: Inserted module 'virtio_balloon'1965worker2 # [ 1.806293] systemd-modules-load[68]: Inserted module 'virtio_gpu'1966client # [ 1.786088] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1967lb # [ 1.935342] systemd[1]: Started Journal Service.1968lb # [ 1.802592] systemd-modules-load[68]: Inserted module 'dm_mod'1969worker2 # [ 1.816855] systemd[1]: Finished Create Static Device Nodes in /dev.1970lb # [ 1.806554] systemd-modules-load[68]: Inserted module 'virtio_balloon'1971lb # [ 1.808236] systemd-modules-load[68]: Inserted module 'virtio_gpu'1972worker2 # [ 1.822157] systemd[1]: Reached target Preparation for Local File Systems.1973worker2 # [ 1.823140] systemd[1]: Reached target Local File Systems.1974worker1 # [ 1.838410] systemd-udevd[76]: Using default interface naming scheme 'v261'.1975client # [ 1.797812] systemd[1]: Starting Create Static Device Nodes in /dev...1976worker2 # [ 1.825946] systemd[1]: Starting Create System Files and Directories...1977lb # [ 1.815124] systemd[1]: Finished Create Static Device Nodes in /dev.1978client # [ 1.804130] systemd[1]: Finished Apply Kernel Variables.1979lb # [ 1.822120] systemd[1]: Reached target Preparation for Local File Systems.1980worker2 # [ 1.833069] systemd[1]: Starting Rule-based Manager for Device Events and Files...1981lb # [ 1.823410] systemd[1]: Reached target Local File Systems.1982lb # [ 1.826068] systemd[1]: Starting Create System Files and Directories...1983lb # [ 1.832074] systemd[1]: Starting Rule-based Manager for Device Events and Files...1984client # [ 1.820612] systemd[1]: Finished Create Static Device Nodes in /dev.1985worker1 # [ 1.862691] systemd[1]: Started Rule-based Manager for Device Events and Files.1986client # [ 1.822421] systemd[1]: Reached target Preparation for Local File Systems.1987client # [ 1.825155] systemd[1]: Reached target Local File Systems.1988client # [ 1.826280] systemd[1]: Starting Create System Files and Directories...1989worker2 # [ 1.856188] systemd[1]: Finished Create System Files and Directories.1990client # [ 1.834071] systemd[1]: Starting Rule-based Manager for Device Events and Files...1991lb # [ 1.863072] systemd[1]: Finished Create System Files and Directories.1992worker2 # [ 1.883274] systemd-udevd[83]: Using default interface naming scheme 'v261'.1993client # [ 1.859369] systemd[1]: Finished Create System Files and Directories.1994worker1 # [ 1.906129] systemd[1]: Finished Coldplug All udev Devices.1995worker1 # [ 1.907094] systemd[1]: Reached target System Initialization.1996worker1 # [ 1.909399] systemd[1]: Reached target Basic System.1997lb # [ 1.884357] systemd-udevd[83]: Using default interface naming scheme 'v261'.1998client # [ 1.881270] systemd-udevd[83]: Using default interface naming scheme 'v261'.1999worker2 # [ 1.907362] systemd[1]: Started Rule-based Manager for Device Events and Files.2000lb # [ 1.909854] systemd[1]: Started Rule-based Manager for Device Events and Files.

loading 1,734 hidden lines…

3735worker2 # [ 10.537853] systemd[1]: Started D-Bus System Message Bus.3736worker1 # [ 10.552787] systemd-logind[556]: Watching system buttons on /dev/input/event2 (Power Button)3737worker1 # [ 10.554122] systemd-logind[556]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3738worker2 # [ 10.540935] systemd-logind[556]: Watching system buttons on /dev/input/event2 (Power Button)3739worker1 # [ 10.557137] systemd-logind[556]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3740worker2 # [ 10.542981] systemd-logind[556]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3741worker1 # [ 10.559896] systemd[1]: Started User Login Management.3742worker2 # [ 10.544818] systemd-logind[556]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3743worker1 # [ 10.561899] systemd[1]: Starting linger-users.service...3744worker2 # [ 10.548592] systemd[1]: Started User Login Management.3745worker2 # [ 10.551909] systemd[1]: Starting linger-users.service...3746worker1 # [ 10.602457] dbus-broker-launch[536]: Ready3747lb: (finished: waiting for unit network-addresses-eth1.service, in 0.14 seconds)3748worker1 # [ 10.611981] systemd[1]: Started Name Service Cache Daemon (nsncd).3749lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3750lb # [ 10.586458] systemd[1]: Finished Extra networking commands..3751worker2 # [ 10.597897] dbus-broker-launch[537]: Ready3752worker1 # [ 10.613167] nsncd[603]: Sep 20 08:59:36.816 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3753worker1 # [ 10.615791] systemd[1]: Reached target Host and Network Name Lookups.3754worker1 # [ 10.616962] systemd[1]: Reached target User and Group Name Lookups.3755lb # [ 10.592068] systemd[1]: Reached target Network.3756worker2 # [ 10.605576] systemd[1]: Started Name Service Cache Daemon (nsncd).3757worker2 # [ 10.607711] systemd[1]: Reached target Host and Network Name Lookups.3758worker2 # [ 10.609028] nsncd[605]: Sep 20 08:59:36.833 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3759worker1 # [ 10.626280] systemd[1]: linger-users.service: Deactivated successfully.3760worker2 # [ 10.612341] systemd[1]: Reached target User and Group Name Lookups.3761worker1 # [ 10.627389] systemd[1]: Finished linger-users.service.3762lb # [ 10.603436] systemd[1]: Starting PostgreSQL Server...3763lb # [ 10.604654] dhcpcd[652]: dhcpcd-10.3.2 starting3764worker2 # [ 10.618506] systemd[1]: linger-users.service: Deactivated successfully.3765worker2 # [ 10.620113] systemd[1]: Finished linger-users.service.3766worker1 # [ 10.637302] systemd[1]: Finished resolvconf update.3767worker1 # [ 10.637987] systemd[1]: Reached target Preparation for Network.3768worker1 # [ 10.642130] systemd[1]: Starting DHCP Client...3769lb # [ 10.617121] systemd[1]: Starting Permit User Sessions...3770worker2 # [ 10.629297] systemd[1]: Finished resolvconf update.3771worker2 # [ 10.629973] systemd[1]: Reached target Preparation for Network.3772worker1 # [ 10.644790] systemd[1]: Starting Address configuration of eth1...3773lb # [ 10.754072] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)3774worker2 # [ 10.634173] systemd[1]: Starting DHCP Client...3775worker1 # [ 10.648752] systemd[1]: Starting Extra networking commands....3776lb # [ 10.623725] dhcpcd[725]: dev: loaded udev3777worker2 # [ 10.636823] systemd[1]: Starting Address configuration of eth1...3778worker2 # [ 10.640946] systemd[1]: Starting Extra networking commands....3779lb # [ 10.794396] 8021q: 802.1Q VLAN Support v1.83780lb # [ 10.801017] 8021q: adding VLAN 0 to HW filter on device eth13781lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.09 seconds)3782worker1: waiting for unit network-addresses-eth1.service3783worker1: waiting for the VM to finish booting3784worker1: Guest shell says: b'Spawning backdoor root shell...\n'3785worker1: connected to guest root shell3786worker1: (connecting took 0.00 seconds)3787worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3788lb # [ 10.824832] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0)3789lb # [ 10.702362] systemd[1]: Finished Permit User Sessions.3790lb # [ 10.717265] systemd[1]: Started Getty on tty1.3791lb # [ 10.719237] systemd-logind[558]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3792lb # [ 10.721059] systemd[1]: Reached target Login Prompts.3793worker2 # [ 10.735968] network-addresses-eth1-start[633]: adding address 192.168.1.4/24... done3794worker1 # [ 10.754518] network-addresses-eth1-start[632]: adding address 192.168.1.3/24... done3795worker2 # [ 10.752374] network-addresses-eth1-start[633]: adding address 2001:db8:1::4/64... done3796worker1 # [ 10.773434] network-addresses-eth1-start[632]: adding address 2001:db8:1::3/64... done3797worker2 # [ 10.773811] systemd[1]: Finished Address configuration of eth1.3798worker1 # [ 10.799402] systemd[1]: Finished Address configuration of eth1.3799worker2 # [ 10.797736] dhcpcd[640]: dhcpcd-10.3.2 starting3800worker2 # [ 10.806336] dhcpcd[694]: dev: loaded udev3801client # [ 10.787407] systemd[1]: Finished Extra networking commands..3802worker2 # [ 10.814152] systemd[1]: Finished Extra networking commands..3803client # [ 10.789432] systemd[1]: Reached target Network.3804worker2 # [ 10.816177] systemd[1]: Reached target Network.3805client # [ 10.792430] systemd[1]: Starting Permit User Sessions...3806worker1 # [ 10.833941] dhcpcd[642]: dhcpcd-10.3.2 starting3807worker2 # [ 10.819346] systemd[1]: Starting Permit User Sessions...3808worker1 # [ 10.843382] dhcpcd[698]: dev: loaded udev3809worker2 # [ 10.965853] 8021q: 802.1Q VLAN Support v1.83810worker2 # [ 10.966696] 8021q: adding VLAN 0 to HW filter on device eth13811worker1 # [ 10.850234] systemd[1]: Finished Extra networking commands..3812worker1 # [ 10.852140] systemd[1]: Reached target Network.3813worker1 # [ 10.855778] systemd[1]: Starting Permit User Sessions...3814client # [ 10.817929] systemd[1]: Finished Permit User Sessions.3815client # [ 10.821785] systemd[1]: Started Getty on tty1.3816worker2 # [ 10.848490] systemd[1]: Finished Permit User Sessions.3817client # [ 10.822805] systemd[1]: Reached target Login Prompts.3818worker2 # [ 10.851886] systemd[1]: Started Getty on tty1.3819worker2 # [ 10.854480] systemd[1]: Reached target Login Prompts.3820worker1 # [ 11.007532] 8021q: 802.1Q VLAN Support v1.83821worker1 # [ 11.008202] 8021q: adding VLAN 0 to HW filter on device eth13822worker2 # [ 10.871510] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3823worker1 # [ 10.892327] systemd[1]: Finished Permit User Sessions.3824lb # [ 10.867292] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3825worker1 # [ 10.896082] systemd[1]: Started Getty on tty1.3826worker1 # [ 10.896852] systemd[1]: Reached target Login Prompts.3827worker1 # [ 10.913689] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3828lb # [ 10.905044] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3829lb # [ 10.909244] systemd[1]: Stopped Virtual Console Setup.3830worker2 # [ 11.055744] cfg80211: Loading compiled-in X.509 certificates for regulatory database3831lb # [ 10.938511] systemd[1]: Starting Virtual Console Setup...3832worker2 # [ 11.084272] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3833worker2 # [ 11.084926] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3834worker1 # [ 11.101653] cfg80211: Loading compiled-in X.509 certificates for regulatory database3835worker2 # [ 11.088584] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23836worker2 # [ 11.089508] cfg80211: failed to load regulatory.db3837lb # [ 11.086482] cfg80211: Loading compiled-in X.509 certificates for regulatory database3838worker1 # [ 11.125149] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3839worker1 # [ 11.125924] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3840worker1 # [ 11.129202] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23841worker1 # [ 11.130073] cfg80211: failed to load regulatory.db3842worker2 # [ 11.136921] 8021q: adding VLAN 0 to HW filter on device eth03843worker2 # [ 11.004078] dhcpcd[694]: eth0: waiting for carrier3844worker2 # [ 11.004960] dhcpcd[694]: eth0: carrier acquired3845worker2 # [ 11.013333] dhcpcd[694]: DUID 00:01:00:01:32:42:5c:f9:52:54:00:12:34:563846worker2 # [ 11.014352] dhcpcd[694]: eth0: IAID 00:12:34:563847worker2 # [ 11.015094] dhcpcd[694]: eth0: adding address fe80::5054:ff:fe12:34563848lb # [ 11.152389] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3849lb # [ 11.155185] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3850worker1 # [ 11.185136] 8021q: adding VLAN 0 to HW filter on device eth03851worker1 # [ 11.050740] dhcpcd[698]: eth0: waiting for carrier3852lb # [ 11.159424] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23853worker1 # [ 11.051583] dhcpcd[698]: eth0: carrier acquired3854lb # [ 11.160332] cfg80211: failed to load regulatory.db3855worker1 # [ 11.062432] dhcpcd[698]: DUID 00:01:00:01:32:42:5c:f9:52:54:00:12:34:563856worker1 # [ 11.063543] dhcpcd[698]: eth0: IAID 00:12:34:563857worker1 # [ 11.064260] dhcpcd[698]: eth0: adding address fe80::5054:ff:fe12:34563858lb # [ 11.067707] postgresql-pre-start[739]: The files belonging to this database system will be owned by user "postgres".3859lb # [ 11.069839] postgresql-pre-start[739]: This user must also own the server process.3860lb # [ 11.082069] postgresql-pre-start[739]: The database cluster will be initialized with locale "en_US.UTF-8".3861lb # [ 11.083264] postgresql-pre-start[739]: The default database encoding has accordingly been set to "UTF8".3862lb # [ 11.084378] postgresql-pre-start[739]: The default text search configuration will be set to "english".3863lb # [ 11.085491] postgresql-pre-start[739]: Data page checksums are enabled.3864lb # [ 11.086447] postgresql-pre-start[739]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3865lb # [ 11.087584] postgresql-pre-start[739]: creating subdirectories ... ok3866lb # [ 11.090304] postgresql-pre-start[739]: selecting dynamic shared memory implementation ... posix3867lb # [ 11.239727] kvm_amd: TSC scaling supported3868lb # [ 11.240590] kvm_amd: Nested Virtualization enabled3869lb # [ 11.242036] kvm_amd: Nested Paging enabled3870lb # [ 11.242517] kvm_amd: LBR virtualization supported3871lb # [ 11.244167] kvm_amd: Virtual VMLOAD VMSAVE supported3872lb # [ 11.244728] kvm_amd: Virtual GIF supported3873lb # [ 11.245982] kvm_amd: Virtual NMI enabled3874lb # [ 11.260027] 8021q: adding VLAN 0 to HW filter on device eth03875lb # [ 11.127638] dhcpcd[725]: eth0: waiting for carrier3876lb # [ 11.130961] dhcpcd[725]: libudev: received NULL device3877lb # [ 11.132519] dhcpcd[725]: libudev: received NULL device3878lb # [ 11.134920] dhcpcd[725]: eth0: carrier acquired3879lb # [ 11.147479] dhcpcd[725]: DUID 00:01:00:01:32:42:5c:fa:52:54:00:12:34:563880lb # [ 11.150976] dhcpcd[725]: eth0: IAID 00:12:34:563881lb # [ 11.151628] dhcpcd[725]: eth0: adding address fe80::5054:ff:fe12:34563882lb # [ 11.333740] EDAC MC: Ver: 3.0.03883lb # [ 11.241131] postgresql-pre-start[739]: selecting default "max_connections" ... 1003884lb # [ 11.340282] postgresql-pre-start[739]: selecting default "shared_buffers" ... 128MB3885lb # [ 11.366125] systemd-vconsole-setup[745]: Configuration of first virtual console was skipped, ignoring remaining ones.3886lb # [ 11.371870] systemd[1]: Finished Virtual Console Setup.3887worker2 # [ 11.428715] dhcpcd[694]: eth0: soliciting a DHCP lease3888worker2 # [ 11.584957] NET: Registered PF_PACKET protocol family3889worker2 # [ 11.456859] dhcpcd[694]: eth0: offered 10.0.2.15 from 10.0.2.23890worker2 # [ 11.461309] dhcpcd[694]: eth0: probing address 10.0.2.15/243891worker1: (finished: waiting for unit network-addresses-eth1.service, in 1.15 seconds)3892worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3893worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3894worker2: waiting for unit network-addresses-eth1.service3895worker2: waiting for the VM to finish booting3896worker2: Guest shell says: b'Spawning backdoor root shell...\n'3897worker2: connected to guest root shell3898worker2: (connecting took 0.00 seconds)3899worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3900worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds)3901worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3902worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3903lb: waiting for unit niks3.service3904client # [ 12.004405] dhcpcd[565]: eth0: soliciting an IPv6 router3905client # [ 12.007593] dhcpcd[565]: eth0: Router Advertisement from fe80::23906client # [ 12.010110] dhcpcd[565]: eth0: adding address fec0::5054:ff:fe12:3456/643907client # [ 12.012608] dhcpcd[565]: eth0: adding route to fec0::/643908client # [ 12.014790] dhcpcd[565]: eth0: adding default route via fe80::23909worker1 # [ 12.091150] dhcpcd[698]: eth0: soliciting a DHCP lease3910worker1 # [ 12.252959] NET: Registered PF_PACKET protocol family3911worker1 # [ 12.123899] dhcpcd[698]: eth0: offered 10.0.2.15 from 10.0.2.23912worker1 # [ 12.129136] dhcpcd[698]: eth0: probing address 10.0.2.15/243913lb # [ 12.318675] dhcpcd[725]: eth0: soliciting an IPv6 router3914lb # [ 12.320262] dhcpcd[725]: eth0: Router Advertisement from fe80::23915lb # [ 12.321160] dhcpcd[725]: eth0: adding address fec0::5054:ff:fe12:3456/643916lb # [ 12.322089] dhcpcd[725]: eth0: adding route to fec0::/643917lb # [ 12.322950] dhcpcd[725]: eth0: adding default route via fe80::23918worker1 # [ 12.350941] dhcpcd[698]: eth0: soliciting an IPv6 router3919worker1 # [ 12.354310] dhcpcd[698]: eth0: Router Advertisement from fe80::23920worker1 # [ 12.356380] dhcpcd[698]: eth0: adding address fec0::5054:ff:fe12:3456/643921worker1 # [ 12.358597] dhcpcd[698]: eth0: adding route to fec0::/643922worker1 # [ 12.360473] dhcpcd[698]: eth0: adding default route via fe80::23923lb # [ 12.755334] dhcpcd[725]: eth0: soliciting a DHCP lease3924lb # [ 12.906277] NET: Registered PF_PACKET protocol family3925lb # [ 12.776355] dhcpcd[725]: eth0: offered 10.0.2.15 from 10.0.2.23926lb # [ 12.779245] dhcpcd[725]: eth0: probing address 10.0.2.15/243927worker2 # [ 13.332727] dhcpcd[694]: eth0: soliciting an IPv6 router3928worker2 # [ 13.336329] dhcpcd[694]: eth0: Router Advertisement from fe80::23929worker2 # [ 13.338519] dhcpcd[694]: eth0: adding address fec0::5054:ff:fe12:3456/643930worker2 # [ 13.340745] dhcpcd[694]: eth0: adding route to fec0::/643931worker2 # [ 13.342702] dhcpcd[694]: eth0: adding default route via fe80::23932lb # [ 13.418251] postgresql-pre-start[739]: selecting default time zone ... UTC3933lb # [ 13.423402] postgresql-pre-start[739]: creating configuration files ... ok3934lb # [ 13.654026] postgresql-pre-start[739]: running bootstrap script ... ok3935lb # [ 14.262094] postgresql-pre-start[739]: performing post-bootstrap initialization ... ok3936lb # [ 14.399112] postgresql-pre-start[739]: syncing data to disk ... ok3937lb # [ 14.400131] postgresql-pre-start[739]: initdb: warning: enabling "trust" authentication for local connections3938lb # [ 14.402066] postgresql-pre-start[739]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3939lb # [ 14.403889] postgresql-pre-start[739]: Success. You can now start the database server using:3940lb # [ 14.404892] postgresql-pre-start[739]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3941lb # [ 14.514241] postgres[809]: [809] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3942lb # [ 14.518966] postgres[809]: [809] LOG: listening on IPv6 address "::1", port 54323943lb # [ 14.519955] postgres[809]: [809] LOG: listening on IPv4 address "127.0.0.1", port 54323944lb # [ 14.522574] postgres[809]: [809] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3945lb # [ 14.536286] postgres[818]: [818] LOG: database system was shut down at 2026-09-20 08:59:41 GMT3946lb # [ 14.541230] postgres[809]: [809] LOG: database system is ready to accept connections3947lb # [ 14.546951] systemd[1]: Started PostgreSQL Server.3948lb # [ 14.552406] systemd[1]: Starting PostgreSQL Setup Scripts...3949lb # [ 14.736515] postgresql-setup-start[829]: CREATE DATABASE3950lb # [ 14.782127] postgresql-setup-start[834]: CREATE ROLE3951lb # [ 14.804033] postgresql-setup-start[836]: ALTER DATABASE3952lb # [ 14.809784] systemd[1]: Finished PostgreSQL Setup Scripts.3953lb # [ 14.811568] systemd[1]: Reached target PostgreSQL.3954client # [ 15.255606] dhcpcd[565]: eth0: leased 10.0.2.15 for 86400 seconds3955client # [ 15.258561] dhcpcd[565]: eth0: adding route to 10.0.2.0/243956client # [ 15.260859] dhcpcd[565]: eth0: adding default route via 10.0.2.23957client # [ 15.374384] systemd[1]: Started DHCP Client.3958client # [ 15.376201] systemd[1]: Reached target Multi-User System.3959client # [ 15.377849] systemd[1]: Startup finished in 850ms (kernel) + 4.236s (initrd) + 10.290s (userspace) = 15.377s.3960worker2 # [ 16.249803] dhcpcd[694]: eth0: leased 10.0.2.15 for 86400 seconds3961worker2 # [ 16.252446] dhcpcd[694]: eth0: adding route to 10.0.2.0/243962worker2 # [ 16.254685] dhcpcd[694]: eth0: adding default route via 10.0.2.23963worker2 # [ 16.377606] systemd[1]: Started DHCP Client.3964worker2 # [ 16.379288] systemd[1]: Reached target Multi-User System.3965worker2 # [ 16.380527] systemd[1]: Startup finished in 869ms (kernel) + 4.934s (initrd) + 10.576s (userspace) = 16.380s.3966worker1 # [ 17.630632] dhcpcd[698]: eth0: leased 10.0.2.15 for 86400 seconds3967worker1 # [ 17.631846] dhcpcd[698]: eth0: adding route to 10.0.2.0/243968worker1 # [ 17.632845] dhcpcd[698]: eth0: adding default route via 10.0.2.23969worker1 # [ 17.732654] systemd[1]: Started DHCP Client.3970worker1 # [ 17.734522] systemd[1]: Reached target Multi-User System.3971worker1 # [ 17.735697] systemd[1]: Startup finished in 859ms (kernel) + 5.027s (initrd) + 11.848s (userspace) = 17.735s.3972lb # [ 18.467920] dhcpcd[725]: eth0: leased 10.0.2.15 for 86400 seconds3973lb # [ 18.471650] dhcpcd[725]: eth0: adding route to 10.0.2.0/243974lb # [ 18.474269] dhcpcd[725]: eth0: adding default route via 10.0.2.23975lb # [ 18.592899] systemd[1]: Started DHCP Client.3976lb # [ 18.595363] systemd[1]: Reached target Network is Online.3977lb # [ 18.599518] systemd[1]: Started Envoy reverse proxy.3978lb # [ 18.604111] systemd[1]: Started mock-oidc.service.3979lb # [ 18.705834] mock-oidc-server[932]: Mock OIDC Server running3980lb # [ 18.706901] mock-oidc-server[932]: OIDC Address: 192.168.1.2:80803981lb # [ 18.707984] mock-oidc-server[932]: Issue Address: 0.0.0.0:80813982lb # [ 18.709238] mock-oidc-server[932]: Issuer: http://192.168.1.2:8080/oidc3983lb # [ 18.710284] mock-oidc-server[932]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3984lb # [ 18.711489] mock-oidc-server[932]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3985lb # [ 18.712979] mock-oidc-server[932]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3986lb # [ 19.132919] envoy[931]: [2026-09-20 08:59:46.190][931][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3987lb # [ 19.134689] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:469] statically linked extensions:3988lb # [ 19.136177] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3989lb # [ 19.138776] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header3990lb # [ 19.141379] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3991lb # [ 19.143986] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state3992lb # [ 19.147113] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based3993lb # [ 19.148679] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3994lb # [ 19.150326] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23995lb # [ 19.151901] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3996lb # [ 19.153584] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher3997lb # [ 19.156039] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3998lb # [ 19.158434] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3999lb # [ 19.160316] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4000lb # [ 19.161940] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4001lb # [ 19.179630] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4002lb # [ 19.181472] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4003lb # [ 19.183156] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4004lb # [ 19.185053] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4005lb # [ 19.191486] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4006lb # [ 19.193139] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4007lb # [ 19.195498] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4008lb # [ 19.197230] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4009lb # [ 19.199321] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4010lb # [ 19.201187] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4011lb # [ 19.202924] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4012lb # [ 19.207714] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4013lb # [ 19.209632] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4014lb # [ 19.212506] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4015lb # [ 19.214994] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4016lb # [ 19.216654] envoy[931]: [2026-09-20 08:59:46.191][931][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4017lb # [ 19.218387] envoy[931]: [2026-09-20 08:59:46.194][931][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4018lb # [ 19.221977] envoy[931]: [2026-09-20 08:59:46.194][931][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4019lb # [ 19.223733] envoy[931]: [2026-09-20 08:59:46.194][931][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4020lb # [ 19.225985] envoy[931]: [2026-09-20 08:59:46.194][931][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4021lb # [ 19.227420] envoy[931]: [2026-09-20 08:59:46.194][931][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4022lb # [ 19.229536] envoy[931]: [2026-09-20 08:59:46.194][931][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4023lb # [ 19.231613] envoy[931]: [2026-09-20 08:59:46.194][931][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4024lb # [ 19.233280] envoy[931]: [2026-09-20 08:59:46.197][931][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4025lb # [ 19.236119] envoy[931]: [2026-09-20 08:59:46.197][931][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4026lb # [ 19.240164] envoy[931]: [2026-09-20 08:59:46.197][931][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4027lb # [ 19.243389] envoy[931]: [2026-09-20 08:59:46.197][931][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4028lb # [ 19.246180] envoy[931]: [2026-09-20 08:59:46.197][931][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4029lb # [ 19.248272] envoy[931]: [2026-09-20 08:59:46.197][931][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4030lb # [ 19.251242] envoy[931]: [2026-09-20 08:59:46.197][931][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4031lb # [ 19.253080] envoy[931]: [2026-09-20 08:59:46.197][931][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4032lb # [ 19.254889] envoy[931]: [2026-09-20 08:59:46.197][931][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4033lb # [ 19.261395] envoy[931]: [2026-09-20 08:59:46.199][931][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4034lb # [ 19.263702] envoy[931]: [2026-09-20 08:59:46.199][931][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4035lb # [ 19.270669] envoy[931]: [2026-09-20 08:59:46.199][931][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4036lb # [ 19.273310] envoy[931]: [2026-09-20 08:59:46.199][931][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4037lb # [ 19.277799] envoy[931]: [2026-09-20 08:59:46.199][931][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4038lb # [ 19.279897] envoy[931]: [2026-09-20 08:59:46.199][931][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4039lb # [ 19.282466] envoy[931]: [2026-09-20 08:59:46.200][931][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4040lb # [ 19.287178] envoy[931]: [2026-09-20 08:59:46.200][931][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4041lb # [ 19.289181] envoy[931]: [2026-09-20 08:59:46.200][931][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4042lb # [ 19.290982] envoy[931]: [2026-09-20 08:59:46.200][931][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4043lb # [ 19.292798] envoy[931]: [2026-09-20 08:59:46.200][931][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4044lb # [ 19.294617] envoy[931]: [2026-09-20 08:59:46.200][931][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4045lb # [ 19.297638] envoy[931]: [2026-09-20 08:59:46.200][931][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4046lb # [ 19.300507] envoy[931]: [2026-09-20 08:59:46.200][931][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4047lb # [ 19.302485] envoy[931]: [2026-09-20 08:59:46.200][931][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4048lb # [ 19.308519] envoy[931]: [2026-09-20 08:59:46.200][931][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4049lb # [ 19.310234] envoy[931]: [2026-09-20 08:59:46.200][931][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4050lb # [ 19.314363] envoy[931]: [2026-09-20 08:59:46.200][931][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4051lb # [ 19.316872] envoy[931]: [2026-09-20 08:59:46.200][931][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4052lb # [ 19.319526] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4053lb # [ 19.325496] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4054lb # [ 19.327673] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4055lb # [ 19.329472] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4056lb # [ 19.333682] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4057lb # [ 19.335439] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation4058lb # [ 19.337614] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4059lb # [ 19.339448] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4060lb # [ 19.341126] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4061lb # [ 19.342984] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4062lb # [ 19.345505] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4063lb # [ 19.350816] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84064lb # [ 19.352664] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4065lb # [ 19.355973] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4066lb # [ 19.381756] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4067lb # [ 19.384269] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4068lb # [ 19.386737] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4069lb # [ 19.397971] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24070lb # [ 19.399713] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4071lb # [ 19.401359] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4072lb # [ 19.403338] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4073lb # [ 19.405723] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4074lb # [ 19.408070] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14075lb # [ 19.410020] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4076lb # [ 19.411553] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4077lb # [ 19.413606] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4078lb # [ 19.416106] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4079lb # [ 19.419475] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4080lb # [ 19.423903] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24081lb # [ 19.426064] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4082lb # [ 19.428250] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4083lb # [ 19.430108] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4084lb # [ 19.431968] envoy[931]: [2026-09-20 08:59:46.205][931][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4085lb # [ 19.434279] envoy[931]: [2026-09-20 08:59:46.210][931][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4086lb # [ 19.437079] envoy[931]: [2026-09-20 08:59:46.210][931][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4087lb # [ 19.441316] envoy[931]: [2026-09-20 08:59:46.210][931][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4088lb # [ 19.444143] envoy[931]: [2026-09-20 08:59:46.210][931][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4089lb # [ 19.449851] envoy[931]: [2026-09-20 08:59:46.210][931][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4090lb # [ 19.451704] envoy[931]: [2026-09-20 08:59:46.210][931][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4091lb # [ 19.454041] envoy[931]: [2026-09-20 08:59:46.212][931][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4092lb # [ 19.455735] envoy[931]: [2026-09-20 08:59:46.311][931][info][main] [source/server/server.cc:531] HTTP header map info:4093lb # [ 19.457158] envoy[931]: [2026-09-20 08:59:46.367][931][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4094lb # [ 19.471138] envoy[931]: [2026-09-20 08:59:46.367][931][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4095lb # [ 19.472936] envoy[931]: [2026-09-20 08:59:46.367][931][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4096lb # [ 19.480498] envoy[931]: [2026-09-20 08:59:46.367][931][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4097lb # [ 19.511772] envoy[931]: [2026-09-20 08:59:46.570][931][info][main] [source/server/server.cc:968] runtime: {}4098lb # [ 19.517965] envoy[931]: [2026-09-20 08:59:46.576][931][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4099lb # [ 19.520162] envoy[931]: [2026-09-20 08:59:46.578][931][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014100lb # [ 19.522902] envoy[931]: [2026-09-20 08:59:46.581][931][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014101lb # [ 19.525802] envoy[931]: [2026-09-20 08:59:46.584][931][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4102lb # [ 19.527449] envoy[931]: [2026-09-20 08:59:46.586][931][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4103lb # [ 19.529056] envoy[931]: [2026-09-20 08:59:46.586][931][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4104worker1 # [ 19.604791] systemd[1]: Starting Nix worker-protocol over gRPC...4105lb # [ 19.582629] envoy[931]: [2026-09-20 08:59:46.641][931][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4106worker2 # [ 19.601750] systemd[1]: Starting Nix worker-protocol over gRPC...4107lb # [ 19.613676] envoy[931]: [2026-09-20 08:59:46.672][931][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4108lb # [ 19.616297] envoy[931]: [2026-09-20 08:59:46.675][931][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4109lb # [ 19.619255] envoy[931]: [2026-09-20 08:59:46.675][931][info][main] [source/server/server.cc:1077] starting main dispatch loop4110worker1 # [ 19.818190] nix-grpc-daemon[790]: ts=2026-09-20T08:59:46Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4111worker1 # [ 19.830597] nix-grpc-daemon[790]: ts=2026-09-20T08:59:46Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14112worker2 # [ 19.825947] nix-grpc-daemon[787]: ts=2026-09-20T08:59:46Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4113worker2 # [ 19.837600] nix-grpc-daemon[787]: ts=2026-09-20T08:59:46Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14114worker1 # [ 19.863382] nix-grpc-daemon[790]: ts=2026-09-20T08:59:46Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4115worker1 # [ 19.867252] systemd[1]: Started Nix worker-protocol over gRPC.4116worker2 # [ 19.876677] nix-grpc-daemon[787]: ts=2026-09-20T08:59:46Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4117worker2 # [ 19.879858] systemd[1]: Started Nix worker-protocol over gRPC.4118lb # [ 19.893127] envoy[931]: [2026-09-20 08:59:46.951][931][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4119lb # [ 19.897766] envoy[931]: [2026-09-20 08:59:46.956][931][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4120worker1 # [ 19.925936] nix-grpc-daemon[790]: ts=2026-09-20T08:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4121lb # [ 19.902182] envoy[931]: [2026-09-20 08:59:46.956][931][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4122lb # [ 19.906707] envoy[931]: [2026-09-20 08:59:46.956][931][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4123worker2 # [ 19.950987] nix-grpc-daemon[787]: ts=2026-09-20T08:59:46Z level=info event=scheduler_connected addr=lb:500514124worker2 # [ 19.977495] nix-grpc-daemon[787]: ts=2026-09-20T08:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4125worker1 # [ 20.126819] nix-grpc-daemon[790]: ts=2026-09-20T08:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4126worker2 # [ 20.178940] nix-grpc-daemon[787]: ts=2026-09-20T08:59:46Z level=info event=scheduler_connected addr=lb:500514127worker2 # [ 20.192325] nix-grpc-daemon[787]: ts=2026-09-20T08:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4128worker2 # [ 20.392936] nix-grpc-daemon[787]: ts=2026-09-20T08:59:46Z level=info event=scheduler_connected addr=lb:500514129worker2 # [ 20.396090] nix-grpc-daemon[787]: ts=2026-09-20T08:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4130worker1 # [ 20.527514] nix-grpc-daemon[790]: ts=2026-09-20T08:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4131worker2 # [ 20.597274] nix-grpc-daemon[787]: ts=2026-09-20T08:59:46Z level=info event=scheduler_connected addr=lb:500514132worker2 # [ 20.601776] nix-grpc-daemon[787]: ts=2026-09-20T08:59:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4133worker2 # [ 20.802610] nix-grpc-daemon[787]: ts=2026-09-20T08:59:47Z level=info event=scheduler_connected addr=lb:500514134worker2 # [ 20.806684] nix-grpc-daemon[787]: ts=2026-09-20T08:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4135lb # [ 20.836649] envoy[931]: conn peer=192.168.1.3:47164 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24136worker2 # [ 21.009823] nix-grpc-daemon[787]: ts=2026-09-20T08:59:47Z level=info event=scheduler_connected addr=lb:500514137worker2 # [ 21.013879] nix-grpc-daemon[787]: ts=2026-09-20T08:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4138worker2 # [ 21.214253] nix-grpc-daemon[787]: ts=2026-09-20T08:59:47Z level=info event=scheduler_connected addr=lb:500514139worker2 # [ 21.217984] nix-grpc-daemon[787]: ts=2026-09-20T08:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4140worker1 # [ 21.331968] nix-grpc-daemon[790]: ts=2026-09-20T08:59:47Z level=info event=scheduler_connected addr=lb:500514141worker1 # [ 21.336318] nix-grpc-daemon[790]: ts=2026-09-20T08:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4142worker2 # [ 21.418861] nix-grpc-daemon[787]: ts=2026-09-20T08:59:47Z level=info event=scheduler_connected addr=lb:500514143worker2 # [ 21.421788] nix-grpc-daemon[787]: ts=2026-09-20T08:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4144worker1 # [ 21.537431] nix-grpc-daemon[790]: ts=2026-09-20T08:59:47Z level=info event=scheduler_connected addr=lb:500514145worker1 # [ 21.541501] nix-grpc-daemon[790]: ts=2026-09-20T08:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4146worker2 # [ 21.622904] nix-grpc-daemon[787]: ts=2026-09-20T08:59:47Z level=info event=scheduler_connected addr=lb:500514147worker2 # [ 21.626988] nix-grpc-daemon[787]: ts=2026-09-20T08:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4148worker1 # [ 21.742049] nix-grpc-daemon[790]: ts=2026-09-20T08:59:47Z level=info event=scheduler_connected addr=lb:500514149worker1 # [ 21.744456] nix-grpc-daemon[790]: ts=2026-09-20T08:59:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4150worker2 # [ 21.827952] nix-grpc-daemon[787]: ts=2026-09-20T08:59:48Z level=info event=scheduler_connected addr=lb:500514151worker2 # [ 21.832393] nix-grpc-daemon[787]: ts=2026-09-20T08:59:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4152worker1 # [ 21.944957] nix-grpc-daemon[790]: ts=2026-09-20T08:59:48Z level=info event=scheduler_connected addr=lb:500514153worker1 # [ 21.948093] nix-grpc-daemon[790]: ts=2026-09-20T08:59:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4154worker2 # [ 22.034482] nix-grpc-daemon[787]: ts=2026-09-20T08:59:48Z level=info event=scheduler_connected addr=lb:500514155worker2 # [ 22.038521] nix-grpc-daemon[787]: ts=2026-09-20T08:59:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4156worker1 # [ 22.148702] nix-grpc-daemon[790]: ts=2026-09-20T08:59:48Z level=info event=scheduler_connected addr=lb:500514157worker1 # [ 22.151151] nix-grpc-daemon[790]: ts=2026-09-20T08:59:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4158worker2 # [ 22.239442] nix-grpc-daemon[787]: ts=2026-09-20T08:59:48Z level=info event=scheduler_connected addr=lb:500514159worker2 # [ 22.243477] nix-grpc-daemon[787]: ts=2026-09-20T08:59:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4160worker1 # [ 22.352930] nix-grpc-daemon[790]: ts=2026-09-20T08:59:48Z level=info event=scheduler_connected addr=lb:500514161worker1 # [ 22.356855] nix-grpc-daemon[790]: ts=2026-09-20T08:59:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4162worker2 # [ 22.444267] nix-grpc-daemon[787]: ts=2026-09-20T08:59:48Z level=info event=scheduler_connected addr=lb:500514163worker2 # [ 22.448189] nix-grpc-daemon[787]: ts=2026-09-20T08:59:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4164worker1 # [ 22.557735] nix-grpc-daemon[790]: ts=2026-09-20T08:59:48Z level=info event=scheduler_connected addr=lb:500514165worker1 # [ 22.562660] nix-grpc-daemon[790]: ts=2026-09-20T08:59:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4166worker2 # [ 22.649132] nix-grpc-daemon[787]: ts=2026-09-20T08:59:48Z level=info event=scheduler_connected addr=lb:500514167worker2 # [ 22.653177] nix-grpc-daemon[787]: ts=2026-09-20T08:59:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4168worker1 # [ 22.762932] nix-grpc-daemon[790]: ts=2026-09-20T08:59:48Z level=info event=scheduler_connected addr=lb:500514169worker1 # [ 22.767127] nix-grpc-daemon[790]: ts=2026-09-20T08:59:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4170worker2 # [ 22.854089] nix-grpc-daemon[787]: ts=2026-09-20T08:59:49Z level=info event=scheduler_connected addr=lb:500514171worker2 # [ 22.858148] nix-grpc-daemon[787]: ts=2026-09-20T08:59:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4172worker1 # [ 22.967765] nix-grpc-daemon[790]: ts=2026-09-20T08:59:49Z level=info event=scheduler_connected addr=lb:500514173worker1 # [ 22.971724] nix-grpc-daemon[790]: ts=2026-09-20T08:59:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4174worker2 # [ 23.059990] nix-grpc-daemon[787]: ts=2026-09-20T08:59:49Z level=info event=scheduler_connected addr=lb:500514175worker2 # [ 23.063910] nix-grpc-daemon[787]: ts=2026-09-20T08:59:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4176worker1 # [ 23.172482] nix-grpc-daemon[790]: ts=2026-09-20T08:59:49Z level=info event=scheduler_connected addr=lb:500514177worker1 # [ 23.176565] nix-grpc-daemon[790]: ts=2026-09-20T08:59:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4178worker2 # [ 23.264945] nix-grpc-daemon[787]: ts=2026-09-20T08:59:49Z level=info event=scheduler_connected addr=lb:500514179worker2 # [ 23.269230] nix-grpc-daemon[787]: ts=2026-09-20T08:59:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4180worker1 # [ 23.378563] nix-grpc-daemon[790]: ts=2026-09-20T08:59:49Z level=info event=scheduler_connected addr=lb:500514181worker1 # [ 23.382383] nix-grpc-daemon[790]: ts=2026-09-20T08:59:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4182worker2 # [ 23.470205] nix-grpc-daemon[787]: ts=2026-09-20T08:59:49Z level=info event=scheduler_connected addr=lb:500514183worker2 # [ 23.474291] nix-grpc-daemon[787]: ts=2026-09-20T08:59:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4184worker1 # [ 23.583581] nix-grpc-daemon[790]: ts=2026-09-20T08:59:49Z level=info event=scheduler_connected addr=lb:500514185worker1 # [ 23.587808] nix-grpc-daemon[790]: ts=2026-09-20T08:59:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4186worker2 # [ 23.675295] nix-grpc-daemon[787]: ts=2026-09-20T08:59:49Z level=info event=scheduler_connected addr=lb:500514187worker2 # [ 23.679893] nix-grpc-daemon[787]: ts=2026-09-20T08:59:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4188worker1 # [ 23.788722] nix-grpc-daemon[790]: ts=2026-09-20T08:59:49Z level=info event=scheduler_connected addr=lb:500514189worker1 # [ 23.792835] nix-grpc-daemon[790]: ts=2026-09-20T08:59:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4190worker2 # [ 23.880736] nix-grpc-daemon[787]: ts=2026-09-20T08:59:50Z level=info event=scheduler_connected addr=lb:500514191worker2 # [ 23.885215] nix-grpc-daemon[787]: ts=2026-09-20T08:59:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4192worker1 # [ 23.993751] nix-grpc-daemon[790]: ts=2026-09-20T08:59:50Z level=info event=scheduler_connected addr=lb:500514193worker1 # [ 23.997750] nix-grpc-daemon[790]: ts=2026-09-20T08:59:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4194worker2 # [ 24.087240] nix-grpc-daemon[787]: ts=2026-09-20T08:59:50Z level=info event=scheduler_connected addr=lb:500514195worker2 # [ 24.090860] nix-grpc-daemon[787]: ts=2026-09-20T08:59:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4196worker1 # [ 24.198688] nix-grpc-daemon[790]: ts=2026-09-20T08:59:50Z level=info event=scheduler_connected addr=lb:500514197worker1 # [ 24.202584] nix-grpc-daemon[790]: ts=2026-09-20T08:59:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4198worker2 # [ 24.291779] nix-grpc-daemon[787]: ts=2026-09-20T08:59:50Z level=info event=scheduler_connected addr=lb:500514199worker2 # [ 24.295672] nix-grpc-daemon[787]: ts=2026-09-20T08:59:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4200worker1 # [ 24.403212] nix-grpc-daemon[790]: ts=2026-09-20T08:59:50Z level=info event=scheduler_connected addr=lb:500514201worker1 # [ 24.406075] nix-grpc-daemon[790]: ts=2026-09-20T08:59:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4202worker2 # [ 24.496624] nix-grpc-daemon[787]: ts=2026-09-20T08:59:50Z level=info event=scheduler_connected addr=lb:500514203worker2 # [ 24.500592] nix-grpc-daemon[787]: ts=2026-09-20T08:59:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4204worker1 # [ 24.606887] nix-grpc-daemon[790]: ts=2026-09-20T08:59:50Z level=info event=scheduler_connected addr=lb:500514205worker1 # [ 24.611245] nix-grpc-daemon[790]: ts=2026-09-20T08:59:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4206worker2 # [ 24.701592] nix-grpc-daemon[787]: ts=2026-09-20T08:59:50Z level=info event=scheduler_connected addr=lb:500514207worker2 # [ 24.705594] nix-grpc-daemon[787]: ts=2026-09-20T08:59:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4208worker1 # [ 24.811611] nix-grpc-daemon[790]: ts=2026-09-20T08:59:51Z level=info event=scheduler_connected addr=lb:500514209worker1 # [ 24.814314] nix-grpc-daemon[790]: ts=2026-09-20T08:59:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4210worker2 # [ 24.906494] nix-grpc-daemon[787]: ts=2026-09-20T08:59:51Z level=info event=scheduler_connected addr=lb:500514211worker2 # [ 24.910420] nix-grpc-daemon[787]: ts=2026-09-20T08:59:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4212worker1 # [ 25.015161] nix-grpc-daemon[790]: ts=2026-09-20T08:59:51Z level=info event=scheduler_connected addr=lb:500514213worker1 # [ 25.017359] nix-grpc-daemon[790]: ts=2026-09-20T08:59:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4214worker2 # [ 25.111885] nix-grpc-daemon[787]: ts=2026-09-20T08:59:51Z level=info event=scheduler_connected addr=lb:500514215worker2 # [ 25.115697] nix-grpc-daemon[787]: ts=2026-09-20T08:59:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4216worker1 # [ 25.218115] nix-grpc-daemon[790]: ts=2026-09-20T08:59:51Z level=info event=scheduler_connected addr=lb:500514217worker1 # [ 25.220341] nix-grpc-daemon[790]: ts=2026-09-20T08:59:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4218lb # [ 25.223364] rustfs-bucket-start[1004]: mb s3://farm4219lb # [ 25.228825] systemd[1]: Finished rustfs-bucket.service.4220lb # [ 25.235271] systemd[1]: Starting niks3 server...4221worker2 # [ 25.316592] nix-grpc-daemon[787]: ts=2026-09-20T08:59:51Z level=info event=scheduler_connected addr=lb:500514222worker2 # [ 25.320801] nix-grpc-daemon[787]: ts=2026-09-20T08:59:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4223worker1 # [ 25.421774] nix-grpc-daemon[790]: ts=2026-09-20T08:59:51Z level=info event=scheduler_connected addr=lb:500514224worker1 # [ 25.423929] nix-grpc-daemon[790]: ts=2026-09-20T08:59:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4225lb # [ 25.460424] postgres[1020]: [1020] ERROR: relation "goose_db_version" does not exist at character 364226lb # [ 25.461681] postgres[1020]: [1020] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4227lb # [ 25.501204] niks3-server[1014]: 2026/09/20 08:59:52 OK 20241026095416_initial_model.sql (20.91ms)4228lb # [ 25.505206] niks3-server[1014]: 2026/09/20 08:59:52 OK 20251210153512_drop_unused_gin_index.sql (2.51ms)4229lb # [ 25.510084] niks3-server[1014]: 2026/09/20 08:59:52 OK 20251218171726_add_pins.sql (4.58ms)4230worker2 # [ 25.521678] nix-grpc-daemon[787]: ts=2026-09-20T08:59:51Z level=info event=scheduler_connected addr=lb:500514231lb # [ 25.516552] niks3-server[1014]: 2026/09/20 08:59:52 OK 20260628120000_add_object_size_and_stats.sql (6.7ms)4232worker2 # [ 25.525831] nix-grpc-daemon[787]: ts=2026-09-20T08:59:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4233lb # [ 25.520977] niks3-server[1014]: 2026/09/20 08:59:52 OK 20260905000000_add_claims.sql (4.4ms)4234lb # [ 25.525091] niks3-server[1014]: 2026/09/20 08:59:52 OK 20260920000000_drop_claims.sql (4.15ms)4235lb # [ 25.526366] niks3-server[1014]: 2026/09/20 08:59:52 goose: successfully migrated database to version: 202609200000004236lb # [ 25.531530] niks3-server[1014]: 2026/09/20 08:59:52 OK 1_commit_pending_closure.sql (3.81ms)4237lb # [ 25.534199] niks3-server[1014]: 2026/09/20 08:59:52 OK 2_object_stats_trigger.sql (1.45ms)4238lb # [ 25.535365] niks3-server[1014]: 2026/09/20 08:59:52 goose: up to current file version: 24239lb # [ 25.540671] niks3-server[1014]: 2026/09/20 08:59:52 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4240worker1 # [ 25.624560] nix-grpc-daemon[790]: ts=2026-09-20T08:59:51Z level=info event=scheduler_connected addr=lb:500514241worker1 # [ 25.626729] nix-grpc-daemon[790]: ts=2026-09-20T08:59:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4242lb # [ 25.615452] niks3-server[1014]: 2026/09/20 08:59:52 INFO Read proxy enabled — serving cache objects from S34243lb # [ 25.617556] niks3-server[1014]: 2026/09/20 08:59:52 INFO Using socket-activated listener address=0.0.0.0:57514244lb # [ 25.622350] systemd[1]: Started niks3 server.4245lb # [ 25.623050] niks3-server[1014]: 2026/09/20 08:59:52 INFO systemd watchdog enabled interval=15s4246lb # [ 25.624249] systemd[1]: Reached target Multi-User System.4247lb # [ 25.625649] systemd[1]: Startup finished in 861ms (kernel) + 5.032s (initrd) + 19.730s (userspace) = 25.625s.4248lb # [ 25.629561] niks3-server[1014]: 2026/09/20 08:59:52 INFO Starting HTTP server address=0.0.0.0:57514249lb # [ 25.635447] niks3-server[1014]: 2026/09/20 08:59:52 INFO lead: acquired remote=192.168.1.4:437824250worker2 # [ 25.653163] nix-grpc-daemon[787]: ts=2026-09-20T08:59:51Z level=info event=scheduler_take_over4251worker2 # [ 25.726402] nix-grpc-daemon[787]: ts=2026-09-20T08:59:51Z level=info event=scheduler_connected addr=lb:500514252worker2 # [ 25.730364] nix-grpc-daemon[787]: ts=2026-09-20T08:59:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4253worker1 # [ 25.827466] nix-grpc-daemon[790]: ts=2026-09-20T08:59:52Z level=info event=scheduler_connected addr=lb:500514254worker2 # [ 25.815923] nix-grpc-daemon[787]: ts=2026-09-20T08:59:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04255worker2 # [ 25.930813] nix-grpc-daemon[787]: ts=2026-09-20T08:59:52Z level=info event=scheduler_connected addr=lb:500514256worker2 # [ 25.933571] nix-grpc-daemon[787]: ts=2026-09-20T08:59:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4257lb: (finished: waiting for unit niks3.service, in 14.14 seconds)4258lb: waiting for TCP port 5751 on localhost4259worker2 # [ 26.134664] nix-grpc-daemon[787]: ts=2026-09-20T08:59:52Z level=info event=scheduler_connected addr=lb:500514260worker2 # [ 26.136469] nix-grpc-daemon[787]: ts=2026-09-20T08:59:52Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04261lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4262lb: (finished: waiting for TCP port 5751 on localhost, in 0.08 seconds)4263lb: waiting for unit envoy.service4264lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4265lb: waiting for TCP port 50051 on localhost4266lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4267lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4268lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4269??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4270 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284271lb: must succeed: curl -sf localhost:9901/clusters4272lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4273lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds)4274subtest: one node schedules and both builders hold a WorkerSession on it4275lb: must succeed: curl -sf localhost:9901/clusters4276lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)4277worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4278worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)4279(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.10 seconds)4280subtest: balancer auth: client cert, bearer token, nothing, unknown CN4281worker1 # [ 26.875980] nix-grpc-daemon[790]: ts=2026-09-20T08:59:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:564524282worker1 # [ 26.882239] systemd[1]: Started Nix Daemon.4283worker1 # [ 27.091879] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4284worker1 # [ 27.135113] nix-grpc-daemon[790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 46 ms (attempt 1/5)4285worker1 # [ 27.183715] nix-grpc-daemon[790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 2/5)4286worker1 # [ 27.328724] nix-grpc-daemon[790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 353 ms (attempt 3/5)4287worker1 # [ 27.687705] nix-grpc-daemon[790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 4/5)4288worker1 # [ 27.752774] nix-grpc-daemon[790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4289worker1 # [ 27.782312] nix-grpc-daemon[790]: ts=2026-09-20T08:59:53Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:564524290worker1 # [ 27.801299] nix-grpc-daemon[790]: ts=2026-09-20T08:59:54Z level=debug event=path_info_miss path=3yn33ipjwn92p38w4qwdnvyyq096zfzd-nixos-system-client-test error="error: path '/nix/store/3yn33ipjwn92p38w4qwdnvyyq096zfzd-nixos-system-client-test' is required, but there is no substituter that can build it"4291worker2 # [ 27.804321] nix-grpc-daemon[787]: ts=2026-09-20T08:59:54Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:418024292worker2 # [ 27.817148] systemd[1]: Started Nix Daemon.4293worker2 # [ 28.020098] nix-daemon[849]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4294worker2 # [ 28.051342] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 1/5)4295worker2 # [ 28.093834] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 65 ms (attempt 2/5)4296worker2 # [ 28.161681] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 204 ms (attempt 3/5)4297worker2 # [ 28.371785] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 692 ms (attempt 4/5)4298worker2 # [ 29.077457] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4299worker2 # [ 29.098770] nix-grpc-daemon[787]: ts=2026-09-20T08:59:55Z level=debug event=path_info_miss path=3yn33ipjwn92p38w4qwdnvyyq096zfzd-nixos-system-client-test error="error: path '/nix/store/3yn33ipjwn92p38w4qwdnvyyq096zfzd-nixos-system-client-test' is required, but there is no substituter that can build it"4300client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4301client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.09 seconds)4302client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4303client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4304worker1 # [ 29.467533] nix-grpc-daemon[790]: ts=2026-09-20T08:59:55Z level=info event=oidc_jwks provider=mock keys=14305worker1 # [ 29.470624] nix-grpc-daemon[790]: ts=2026-09-20T08:59:55Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:564524306worker2 # [ 29.482768] nix-grpc-daemon[787]: ts=2026-09-20T08:59:55Z level=info event=oidc_jwks provider=mock keys=14307worker2 # [ 29.487546] nix-grpc-daemon[787]: ts=2026-09-20T08:59:55Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:418024308worker2 # [ 29.497043] nix-grpc-daemon[787]: ts=2026-09-20T08:59:55Z level=debug event=path_info_miss path=3yn33ipjwn92p38w4qwdnvyyq096zfzd-nixos-system-client-test error="error: path '/nix/store/3yn33ipjwn92p38w4qwdnvyyq096zfzd-nixos-system-client-test' is required, but there is no substituter that can build it"4309worker2 # [ 29.500929] nix-grpc-daemon[787]: ts=2026-09-20T08:59:55Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:418024310worker2 # [ 29.506054] nix-grpc-daemon[787]: ts=2026-09-20T08:59:55Z level=debug event=path_info_miss path=3yn33ipjwn92p38w4qwdnvyyq096zfzd-nixos-system-client-test error="error: path '/nix/store/3yn33ipjwn92p38w4qwdnvyyq096zfzd-nixos-system-client-test' is required, but there is no substituter that can build it"4311client: must succeed: rm -r /var/lib/nix-grpc-store4312client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4313lb # [ 29.594531] envoy[931]: conn peer=[::1]:53494 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24314lb # [ 29.597734] envoy[931]: conn peer=[2001:db8:1::1]:35144 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=22904315lb # [ 29.601267] envoy[931]: conn peer=[2001:db8:1::1]:35156 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=363 ms=854316worker1 # [ 29.749102] nix-grpc-daemon[790]: ts=2026-09-20T08:59:55Z level=info event=denied method=QueryMissing cn=- role=none4317worker2 # [ 29.955233] nix-grpc-daemon[787]: ts=2026-09-20T08:59:56Z level=info event=denied method=QueryMissing cn=stranger role=none4318(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.42 seconds)4319subtest: DAG build is scheduled across workers and lands in the cache4320client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24321worker2 # [ 30.199659] nix-grpc-daemon[787]: ts=2026-09-20T08:59:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:418024322client # don't know how to build these paths:4323client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4324worker2 # [ 30.210824] nix-grpc-daemon[787]: ts=2026-09-20T08:59:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:418024325worker2 # [ 30.255905] nix-grpc-daemon[787]: ts=2026-09-20T08:59:56Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04326worker2 # [ 30.260464] nix-grpc-daemon[787]: ts=2026-09-20T08:59:56Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14327worker1 # [ 30.322249] nix-grpc-daemon[790]: ts=2026-09-20T08:59:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524328worker1 # [ 30.344973] nix-grpc-daemon[790]: ts=2026-09-20T08:59:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564524329client # copying 1 paths to 'lb:50051'...4330worker1 # [ 30.358254] nix-grpc-daemon[790]: ts=2026-09-20T08:59:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:564524331client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4332worker1 # [ 30.383934] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4333worker1 # [ 30.412469] nix-grpc-daemon[790]: ts=2026-09-20T08:59:56Z level=info event=niks3_push_started pid=8574334worker1 # [ 30.888114] nix-daemon[846]: accepted connection from pid 868, user nix-grpc-daemon (trusted)4335worker1 # [ 30.907265] nix-daemon[846]: reaped child process 872, status = succeeded4336worker1 # [ 31.084238] nix-daemon[846]: accepted connection from pid 874, user nix-grpc-daemon (trusted)4337worker1 # [ 31.099591] nix-daemon[846]: reaped child process 877, status = succeeded4338lb # [ 31.090919] niks3-server[1014]: 2026/09/20 08:59:58 INFO Received uploads request method=POST path=/api/pending_closures4339worker1 # [ 31.154976] nix-grpc-daemon[857]: time=2026-09-20T08:59:57.359Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4340worker1 # [ 31.157563] nix-grpc-daemon[857]: time=2026-09-20T08:59:57.361Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4341lb # [ 31.177094] niks3-server[1014]: 2026/09/20 08:59:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4342lb # [ 31.180236] niks3-server[1014]: 2026/09/20 08:59:58 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4343lb # [ 31.194965] niks3-server[1014]: 2026/09/20 08:59:58 INFO Signed narinfos id=1 count=14344worker1 # [ 31.222682] nix-grpc-daemon[857]: time=2026-09-20T08:59:57.428Z level=INFO msg="Uploading 1 narinfos"4345lb # [ 31.204349] niks3-server[1014]: 2026/09/20 08:59:58 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4346lb # [ 31.209545] niks3-server[1014]: 2026/09/20 08:59:58 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4347lb # [ 31.222706] niks3-server[1014]: 2026/09/20 08:59:58 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4348lb # [ 31.226148] niks3-server[1014]: 2026/09/20 08:59:58 INFO Completed upload id=14349worker1 # [ 31.252366] nix-grpc-daemon[857]: time=2026-09-20T08:59:57.458Z level=INFO msg="Upload complete. (548ms)"4350worker1 # [ 31.257935] nix-grpc-daemon[790]: ts=2026-09-20T08:59:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=0 paths=1 nar_bytes_in=5044351worker1 # [ 31.264894] nix-grpc-daemon[790]: ts=2026-09-20T08:59:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524352worker1 # [ 31.278134] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4353worker1 # [ 31.285998] nix-daemon[846]: reaped child process 855, status = succeeded4354client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4355worker1 # [ 31.296478] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4356client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4357client # farm-a> LOG-farm-a-t14358worker1 # [ 32.515075] nix-daemon[846]: reaped child process 881, status = succeeded4359worker1 # [ 32.677741] nix-daemon[846]: accepted connection from pid 896, user nix-grpc-daemon (trusted)4360worker1 # [ 32.691814] nix-daemon[846]: reaped child process 899, status = succeeded4361lb # [ 32.678255] niks3-server[1014]: 2026/09/20 08:59:59 INFO Received uploads request method=POST path=/api/pending_closures4362worker1 # [ 32.714731] nix-grpc-daemon[857]: time=2026-09-20T08:59:58.920Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4363worker1 # [ 32.716569] nix-grpc-daemon[857]: time=2026-09-20T08:59:58.922Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4364lb # [ 32.714144] niks3-server[1014]: 2026/09/20 08:59:59 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4365lb # [ 32.727114] niks3-server[1014]: 2026/09/20 08:59:59 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4366lb # [ 32.737881] niks3-server[1014]: 2026/09/20 08:59:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4367worker1 # [ 32.768054] nix-grpc-daemon[857]: time=2026-09-20T08:59:58.973Z level=INFO msg="Uploading 1 narinfos"4368lb # [ 32.741983] niks3-server[1014]: 2026/09/20 08:59:59 INFO Signed narinfos id=2 count=14369lb # [ 32.747160] niks3-server[1014]: 2026/09/20 08:59:59 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4370lb # [ 32.757628] niks3-server[1014]: 2026/09/20 08:59:59 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4371lb # [ 32.760589] niks3-server[1014]: 2026/09/20 08:59:59 INFO Completed upload id=24372worker1 # [ 32.786568] nix-grpc-daemon[857]: time=2026-09-20T08:59:58.992Z level=INFO msg="Upload complete. (277ms)"4373lb # [ 32.762599] niks3-server[1014]: 2026/09/20 08:59:59 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4374worker1 # [ 32.791797] nix-grpc-daemon[790]: ts=2026-09-20T08:59:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14375worker1 # [ 32.803775] nix-daemon[846]: reaped child process 879, status = succeeded4376worker2 # [ 32.796804] nix-grpc-daemon[787]: ts=2026-09-20T08:59:59Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04377worker2 # [ 32.801256] nix-grpc-daemon[787]: ts=2026-09-20T08:59:59Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14378worker1 # [ 32.865385] nix-grpc-daemon[790]: ts=2026-09-20T08:59:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524379worker1 # [ 32.879121] nix-grpc-daemon[790]: ts=2026-09-20T08:59:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564524380worker1 # [ 32.893594] nix-grpc-daemon[857]: time=2026-09-20T08:59:59.099Z level=INFO msg="All 1 paths already cached"4381client # copying 1 paths to 'lb:50051'...4382worker1 # [ 32.901227] nix-grpc-daemon[790]: ts=2026-09-20T08:59:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:564524383client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4384worker1 # [ 32.921161] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4385worker1 # [ 33.107389] nix-daemon[846]: accepted connection from pid 903, user nix-grpc-daemon (trusted)4386worker1 # [ 33.124498] nix-daemon[846]: reaped child process 906, status = succeeded4387worker1 # [ 33.285460] nix-daemon[846]: accepted connection from pid 909, user nix-grpc-daemon (trusted)4388worker1 # [ 33.299730] nix-daemon[846]: reaped child process 912, status = succeeded4389lb # [ 33.289683] niks3-server[1014]: 2026/09/20 09:00:00 INFO Received uploads request method=POST path=/api/pending_closures4390worker1 # [ 33.327272] nix-grpc-daemon[857]: time=2026-09-20T08:59:59.533Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4391worker1 # [ 33.328835] nix-grpc-daemon[857]: time=2026-09-20T08:59:59.535Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4392lb # [ 33.322778] niks3-server[1014]: 2026/09/20 09:00:00 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4393lb # [ 33.334555] niks3-server[1014]: 2026/09/20 09:00:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4394worker1 # [ 33.366715] nix-grpc-daemon[857]: time=2026-09-20T08:59:59.572Z level=INFO msg="Uploading 1 narinfos"4395lb # [ 33.341073] niks3-server[1014]: 2026/09/20 09:00:00 INFO Signed narinfos id=3 count=14396lb # [ 33.347667] niks3-server[1014]: 2026/09/20 09:00:00 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4397lb # [ 33.358285] niks3-server[1014]: 2026/09/20 09:00:00 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4398lb # [ 33.364295] niks3-server[1014]: 2026/09/20 09:00:00 INFO Completed upload id=34399worker1 # [ 33.392456] nix-grpc-daemon[857]: time=2026-09-20T08:59:59.598Z level=INFO msg="Upload complete. (455ms)"4400lb # [ 33.367345] niks3-server[1014]: 2026/09/20 09:00:00 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4401worker1 # [ 33.394122] nix-grpc-daemon[790]: ts=2026-09-20T08:59:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=0 paths=1 nar_bytes_in=6244402worker1 # [ 33.401091] nix-grpc-daemon[790]: ts=2026-09-20T08:59:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524403worker1 # [ 33.409318] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4404worker1 # [ 33.411932] nix-daemon[846]: reaped child process 901, status = succeeded4405client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4406client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4407worker1 # [ 33.424799] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4408client # farm-b> LOG-farm-b-t14409worker1 # [ 35.061683] nix-daemon[846]: reaped child process 916, status = succeeded4410worker1 # [ 35.233752] nix-daemon[846]: accepted connection from pid 932, user nix-grpc-daemon (trusted)4411worker1 # [ 35.248585] nix-daemon[846]: reaped child process 935, status = succeeded4412lb # [ 35.240949] niks3-server[1014]: 2026/09/20 09:00:02 INFO Received uploads request method=POST path=/api/pending_closures4413worker1 # [ 35.276113] nix-grpc-daemon[857]: time=2026-09-20T09:00:01.482Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4414worker1 # [ 35.278655] nix-grpc-daemon[857]: time=2026-09-20T09:00:01.484Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4415lb # [ 35.282550] niks3-server[1014]: 2026/09/20 09:00:02 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4416lb # [ 35.289808] niks3-server[1014]: 2026/09/20 09:00:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4417lb # [ 35.295110] niks3-server[1014]: 2026/09/20 09:00:02 INFO Signed narinfos id=4 count=14418worker1 # [ 35.324366] nix-grpc-daemon[857]: time=2026-09-20T09:00:01.530Z level=INFO msg="Uploading 1 narinfos"4419lb # [ 35.303251] niks3-server[1014]: 2026/09/20 09:00:02 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4420lb # [ 35.314869] niks3-server[1014]: 2026/09/20 09:00:02 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4421lb # [ 35.317687] niks3-server[1014]: 2026/09/20 09:00:02 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4422lb # [ 35.324334] niks3-server[1014]: 2026/09/20 09:00:02 INFO Completed upload id=44423lb # [ 35.325579] niks3-server[1014]: 2026/09/20 09:00:02 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4424worker1 # [ 35.350316] nix-grpc-daemon[857]: time=2026-09-20T09:00:01.556Z level=INFO msg="Upload complete. (312ms)"4425worker1 # [ 35.357365] nix-grpc-daemon[790]: ts=2026-09-20T09:00:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14426worker2 # [ 35.348955] nix-grpc-daemon[787]: ts=2026-09-20T09:00:01Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04427worker2 # [ 35.353157] nix-grpc-daemon[787]: ts=2026-09-20T09:00:01Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14428worker1 # [ 35.372266] nix-daemon[846]: reaped child process 914, status = succeeded4429worker1 # [ 35.407548] nix-grpc-daemon[790]: ts=2026-09-20T09:00:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524430worker1 # [ 35.421647] nix-grpc-daemon[790]: ts=2026-09-20T09:00:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564524431worker1 # [ 35.434480] nix-grpc-daemon[857]: time=2026-09-20T09:00:01.640Z level=INFO msg="All 2 paths already cached"4432client # copying 1 paths to 'lb:50051'...4433worker1 # [ 35.442548] nix-grpc-daemon[790]: ts=2026-09-20T09:00:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:564524434client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4435worker1 # [ 35.455479] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4436worker1 # [ 35.611882] nix-daemon[846]: accepted connection from pid 939, user nix-grpc-daemon (trusted)4437worker1 # [ 35.628085] nix-daemon[846]: reaped child process 942, status = succeeded4438worker1 # [ 35.790554] nix-daemon[846]: accepted connection from pid 944, user nix-grpc-daemon (trusted)4439worker1 # [ 35.806186] nix-daemon[846]: reaped child process 947, status = succeeded4440lb # [ 35.795658] niks3-server[1014]: 2026/09/20 09:00:02 INFO Received uploads request method=POST path=/api/pending_closures4441worker1 # [ 35.827603] nix-grpc-daemon[857]: time=2026-09-20T09:00:02.033Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4442worker1 # [ 35.829223] nix-grpc-daemon[857]: time=2026-09-20T09:00:02.035Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4443lb # [ 35.823699] niks3-server[1014]: 2026/09/20 09:00:02 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4444lb # [ 35.831832] niks3-server[1014]: 2026/09/20 09:00:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4445lb # [ 35.838787] niks3-server[1014]: 2026/09/20 09:00:02 INFO Signed narinfos id=5 count=14446worker1 # [ 35.867515] nix-grpc-daemon[857]: time=2026-09-20T09:00:02.073Z level=INFO msg="Uploading 1 narinfos"4447lb # [ 35.844423] niks3-server[1014]: 2026/09/20 09:00:02 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4448lb # [ 35.857731] niks3-server[1014]: 2026/09/20 09:00:02 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4449worker1 # [ 35.889614] nix-grpc-daemon[857]: time=2026-09-20T09:00:02.095Z level=INFO msg="Upload complete. (419ms)"4450lb # [ 35.863821] niks3-server[1014]: 2026/09/20 09:00:02 INFO Completed upload id=54451worker1 # [ 35.891834] nix-grpc-daemon[790]: ts=2026-09-20T09:00:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=0 paths=1 nar_bytes_in=7524452lb # [ 35.867609] niks3-server[1014]: 2026/09/20 09:00:02 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4453worker1 # [ 35.897474] nix-grpc-daemon[790]: ts=2026-09-20T09:00:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524454worker1 # [ 35.903863] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4455worker1 # [ 35.906497] nix-daemon[846]: reaped child process 937, status = succeeded4456worker1 # [ 35.912423] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4457client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4458client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4459client # farm-top> LOG-farm-top-t14460worker1 # [ 37.333973] nix-daemon[846]: reaped child process 951, status = succeeded4461worker1 # [ 37.484090] nix-daemon[846]: accepted connection from pid 967, user nix-grpc-daemon (trusted)4462worker1 # [ 37.496299] nix-daemon[846]: reaped child process 970, status = succeeded4463lb # [ 37.487830] niks3-server[1014]: 2026/09/20 09:00:04 INFO Received uploads request method=POST path=/api/pending_closures4464worker1 # [ 37.524296] nix-grpc-daemon[857]: time=2026-09-20T09:00:03.729Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4465worker1 # [ 37.525687] nix-grpc-daemon[857]: time=2026-09-20T09:00:03.729Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4466lb # [ 37.531952] niks3-server[1014]: 2026/09/20 09:00:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4467lb # [ 37.537810] niks3-server[1014]: 2026/09/20 09:00:04 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4468lb # [ 37.541933] niks3-server[1014]: 2026/09/20 09:00:04 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4469worker1 # [ 37.573308] nix-grpc-daemon[857]: time=2026-09-20T09:00:03.779Z level=INFO msg="Uploading 1 narinfos"4470lb # [ 37.547336] niks3-server[1014]: 2026/09/20 09:00:04 INFO Signed narinfos id=6 count=14471lb # [ 37.553057] niks3-server[1014]: 2026/09/20 09:00:04 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4472lb # [ 37.560258] niks3-server[1014]: 2026/09/20 09:00:04 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4473lb # [ 37.566083] niks3-server[1014]: 2026/09/20 09:00:04 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4474lb # [ 37.569141] niks3-server[1014]: 2026/09/20 09:00:04 INFO Completed upload id=64475worker1 # [ 37.595228] nix-grpc-daemon[857]: time=2026-09-20T09:00:03.801Z level=INFO msg="Upload complete. (274ms)"4476worker1 # [ 37.600639] nix-grpc-daemon[790]: ts=2026-09-20T09:00:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14477worker1 # [ 37.612813] nix-daemon[846]: reaped child process 949, status = succeeded4478client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 7.64 seconds)4479client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4480client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.17 seconds)4481client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4482client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds)4483client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4484client # copying 3 paths...4485client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4486client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4487client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4488client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.34 seconds)4489(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.26 seconds)4490subtest: repeat is answered Cached by the scheduler without building4491worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4492worker1 # finding garbage collector roots...4493worker1 # deleting specified paths...4494worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4495worker1 # deleting unused links...4496worker1 # note: hard linking is currently saving 0.0 KiB4497worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.24 seconds)4498worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4499worker2 # finding garbage collector roots...4500worker2 # deleting specified paths...4501worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4502worker2 # deleting unused links...4503worker2 # note: hard linking is currently saving 0.0 KiB4504worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.27 seconds)4505client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24506worker1 # [ 38.971237] nix-grpc-daemon[790]: ts=2026-09-20T09:00:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:564524507client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4508client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4509worker2 # [ 38.977897] nix-grpc-daemon[787]: ts=2026-09-20T09:00:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:418024510worker2 # [ 39.004079] nix-grpc-daemon[787]: ts=2026-09-20T09:00:05Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14511client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.27 seconds)4512client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4513client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.18 seconds)4514lb: must succeed: curl -sf localhost:9901/clusters4515lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4516lb: must succeed: curl -sf localhost:9901/clusters4517lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4518worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4519worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.07 seconds)4520(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.23 seconds)4521subtest: inputs already in the cache are not sent to the scheduler4522lb: must succeed: curl -sf localhost:9901/clusters4523lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4524lb: must succeed: curl -sf localhost:9901/clusters4525lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4526worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4527lb # [ 39.594561] envoy[931]: conn peer=[2001:db8:1::1]:35160 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=94528worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4529client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24530lb # [ 39.596260] envoy[931]: conn peer=[2001:db8:1::1]:35166 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=124531lb # [ 39.599233] envoy[931]: conn peer=[2001:db8:1::1]:35174 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9524 tx=3841 ms=74304532lb # [ 39.602091] envoy[931]: conn peer=[2001:db8:1::1]:42104 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=624533worker1 # [ 39.827425] nix-grpc-daemon[790]: ts=2026-09-20T09:00:06Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:564524534client # don't know how to build these paths:4535client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4536worker2 # [ 39.822440] nix-grpc-daemon[787]: ts=2026-09-20T09:00:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:418024537worker2 # [ 39.834526] nix-grpc-daemon[787]: ts=2026-09-20T09:00:06Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04538worker2 # [ 39.836450] nix-grpc-daemon[787]: ts=2026-09-20T09:00:06Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.3:50051 clients=14539worker1 # [ 39.894334] nix-grpc-daemon[790]: ts=2026-09-20T09:00:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524540worker1 # [ 39.902262] nix-grpc-daemon[790]: ts=2026-09-20T09:00:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564524541worker1 # [ 39.910197] nix-grpc-daemon[857]: time=2026-09-20T09:00:06.116Z level=INFO msg="All 2 paths already cached"4542client # copying 1 paths to 'lb:50051'...4543worker1 # [ 39.915946] nix-grpc-daemon[790]: ts=2026-09-20T09:00:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:564524544client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4545worker1 # [ 39.921473] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4546worker1 # [ 40.081554] nix-daemon[846]: accepted connection from pid 988, user nix-grpc-daemon (trusted)4547worker1 # [ 40.098614] nix-daemon[846]: reaped child process 991, status = succeeded4548worker1 # [ 40.250906] nix-daemon[846]: accepted connection from pid 993, user nix-grpc-daemon (trusted)4549worker1 # [ 40.265640] nix-daemon[846]: reaped child process 996, status = succeeded4550lb # [ 40.257366] niks3-server[1014]: 2026/09/20 09:00:07 INFO Received uploads request method=POST path=/api/pending_closures4551worker1 # [ 40.293280] nix-grpc-daemon[857]: time=2026-09-20T09:00:06.499Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4552worker1 # [ 40.294894] nix-grpc-daemon[857]: time=2026-09-20T09:00:06.501Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4553lb # [ 40.288113] niks3-server[1014]: 2026/09/20 09:00:07 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4554lb # [ 40.298682] niks3-server[1014]: 2026/09/20 09:00:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4555worker1 # [ 40.328686] nix-grpc-daemon[857]: time=2026-09-20T09:00:06.535Z level=INFO msg="Uploading 1 narinfos"4556lb # [ 40.303114] niks3-server[1014]: 2026/09/20 09:00:07 INFO Signed narinfos id=7 count=14557lb # [ 40.312944] niks3-server[1014]: 2026/09/20 09:00:07 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4558lb # [ 40.322198] niks3-server[1014]: 2026/09/20 09:00:07 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4559worker1 # [ 40.354954] nix-grpc-daemon[857]: time=2026-09-20T09:00:06.561Z level=INFO msg="Upload complete. (425ms)"4560lb # [ 40.329371] niks3-server[1014]: 2026/09/20 09:00:07 INFO Completed upload id=74561lb # [ 40.332986] niks3-server[1014]: 2026/09/20 09:00:07 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4562worker1 # [ 40.360189] nix-grpc-daemon[790]: ts=2026-09-20T09:00:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=0 paths=1 nar_bytes_in=7524563worker1 # [ 40.364930] nix-grpc-daemon[790]: ts=2026-09-20T09:00:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524564worker1 # [ 40.375079] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4565worker1 # [ 40.379789] nix-daemon[846]: reaped child process 986, status = succeeded4566worker1 # [ 40.385534] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4567client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4568client # farm-top> node-a: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4569client # farm-top> LOG-farm-top-t1b4570worker1 # [ 41.817773] nix-daemon[846]: reaped child process 1000, status = succeeded4571worker1 # [ 41.998107] nix-daemon[846]: accepted connection from pid 1015, user nix-grpc-daemon (trusted)4572worker1 # [ 42.012174] nix-daemon[846]: reaped child process 1018, status = succeeded4573lb # [ 42.003199] niks3-server[1014]: 2026/09/20 09:00:09 INFO Received uploads request method=POST path=/api/pending_closures4574worker1 # [ 42.037885] nix-grpc-daemon[857]: time=2026-09-20T09:00:08.243Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4575worker1 # [ 42.039483] nix-grpc-daemon[857]: time=2026-09-20T09:00:08.245Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4576lb # [ 42.052525] niks3-server[1014]: 2026/09/20 09:00:09 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4577lb # [ 42.059107] niks3-server[1014]: 2026/09/20 09:00:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4578worker1 # [ 42.092906] nix-grpc-daemon[857]: time=2026-09-20T09:00:08.298Z level=INFO msg="Uploading 1 narinfos"4579lb # [ 42.067637] niks3-server[1014]: 2026/09/20 09:00:09 INFO Signed narinfos id=8 count=14580lb # [ 42.071150] niks3-server[1014]: 2026/09/20 09:00:09 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4581lb # [ 42.080507] niks3-server[1014]: 2026/09/20 09:00:09 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4582lb # [ 42.084769] niks3-server[1014]: 2026/09/20 09:00:09 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4583lb # [ 42.087421] niks3-server[1014]: 2026/09/20 09:00:09 INFO Completed upload id=84584worker1 # [ 42.113386] nix-grpc-daemon[857]: time=2026-09-20T09:00:08.319Z level=INFO msg="Upload complete. (317ms)"4585lb # [ 42.089777] niks3-server[1014]: 2026/09/20 09:00:09 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4586worker1 # [ 42.120147] nix-grpc-daemon[790]: ts=2026-09-20T09:00:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14587worker1 # [ 42.133326] nix-daemon[846]: reaped child process 998, status = succeeded4588client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.53 seconds)4589client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4590client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.20 seconds)4591lb: must succeed: curl -sf localhost:9901/clusters4592lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4593lb: must succeed: curl -sf localhost:9901/clusters4594lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4595worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4596worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4597(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.03 seconds)4598subtest: two clients wanting the same drv build it once4599client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4600client # [ 42.522722] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4601client # Running as unit: dedup1.service; invocation ID: 338ac4da095644d3a44d6ad56cb62bac4602client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.06 seconds)4603client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4604worker1 # [ 42.770485] nix-grpc-daemon[790]: ts=2026-09-20T09:00:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:564524605client # [ 42.731358] nix[885]: don't know how to build these paths:4606client # [ 42.732344] nix[885]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4607worker2 # [ 42.763595] nix-grpc-daemon[787]: ts=2026-09-20T09:00:08Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04608worker2 # [ 42.766590] nix-grpc-daemon[787]: ts=2026-09-20T09:00:08Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14609worker2 # [ 42.807419] nix-grpc-daemon[787]: ts=2026-09-20T09:00:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:418024610worker2 # [ 42.820469] nix-grpc-daemon[787]: ts=2026-09-20T09:00:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:418024611client # [ 42.802320] nix[885]: copying 1 paths to 'lb:50051'...4612worker2 # [ 42.829068] nix-grpc-daemon[787]: ts=2026-09-20T09:00:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:418024613client # [ 42.805199] nix[885]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4614worker2 # [ 42.839226] nix-daemon[849]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4615worker2 # [ 42.852369] nix-grpc-daemon[787]: ts=2026-09-20T09:00:09Z level=info event=niks3_push_started pid=9024616worker2 # [ 43.255902] nix-daemon[849]: accepted connection from pid 916, user nix-grpc-daemon (trusted)4617worker2 # [ 43.271597] nix-daemon[849]: reaped child process 919, status = succeeded4618worker2 # [ 43.431024] nix-daemon[849]: accepted connection from pid 921, user nix-grpc-daemon (trusted)4619worker2 # [ 43.442980] nix-daemon[849]: reaped child process 924, status = succeeded4620lb # [ 43.447309] niks3-server[1014]: 2026/09/20 09:00:10 INFO Received uploads request method=POST path=/api/pending_closures4621worker2 # [ 43.464255] nix-grpc-daemon[902]: time=2026-09-20T09:00:09.689Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4622worker2 # [ 43.467144] nix-grpc-daemon[902]: time=2026-09-20T09:00:09.692Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4623lb # [ 43.472835] niks3-server[1014]: 2026/09/20 09:00:10 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4624lb # [ 43.476359] niks3-server[1014]: 2026/09/20 09:00:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4625lb # [ 43.478424] niks3-server[1014]: 2026/09/20 09:00:10 INFO Signed narinfos id=9 count=14626worker2 # [ 43.492274] nix-grpc-daemon[902]: time=2026-09-20T09:00:09.718Z level=INFO msg="Uploading 1 narinfos"4627lb # [ 43.484655] niks3-server[1014]: 2026/09/20 09:00:10 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4628lb # [ 43.490073] niks3-server[1014]: 2026/09/20 09:00:10 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4629lb # [ 43.492919] niks3-server[1014]: 2026/09/20 09:00:10 INFO Completed upload id=94630worker2 # [ 43.504099] nix-grpc-daemon[902]: time=2026-09-20T09:00:09.730Z level=INFO msg="Upload complete. (406ms)"4631worker2 # [ 43.506196] nix-grpc-daemon[787]: ts=2026-09-20T09:00:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41802 duration_s=0 paths=1 nar_bytes_in=4324632lb # [ 43.496238] niks3-server[1014]: 2026/09/20 09:00:10 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4633worker2 # [ 43.509680] nix-grpc-daemon[787]: ts=2026-09-20T09:00:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:418024634worker2 # [ 43.516086] nix-daemon[849]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4635worker2 # [ 43.518599] nix-daemon[849]: reaped child process 900, status = succeeded4636worker2 # [ 43.523974] nix-daemon[849]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4637client # [ 43.497279] nix[885]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4638client # [ 43.597912] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4639client # Running as unit: dedup2.service; invocation ID: c53a96ebdf9641d797480ef2b89486ac4640client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds)4641worker2 # [ 43.874137] nix-grpc-daemon[787]: ts=2026-09-20T09:00:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:418024642client # [ 43.861651] nix[900]: this derivation will be built:4643worker1 # [ 43.906709] nix-grpc-daemon[790]: ts=2026-09-20T09:00:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:564524644worker1 # [ 43.923733] nix-grpc-daemon[790]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' from 'http://lb:5751'...4645client # [ 43.904863] nix[900]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4646worker2 # [ 43.939102] nix-grpc-daemon[787]: ts=2026-09-20T09:00:10Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04647worker2 # [ 43.945779] nix-grpc-daemon[787]: ts=2026-09-20T09:00:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:418024648client # [ 43.924947] nix[900]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4649client: must succeed: sleep 24650client: (finished: must succeed: sleep 2, in 2.05 seconds)4651??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4652 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394653client: waiting for success: ! systemctl is-active dedup1 dedup24654??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4655 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394656worker2 # [ 47.139182] nix-daemon[849]: reaped child process 928, status = succeeded4657worker2 # [ 47.302343] nix-daemon[849]: accepted connection from pid 959, user nix-grpc-daemon (trusted)4658worker2 # [ 47.312959] nix-daemon[849]: reaped child process 962, status = succeeded4659lb # [ 47.317424] niks3-server[1014]: 2026/09/20 09:00:14 INFO Received uploads request method=POST path=/api/pending_closures4660worker2 # [ 47.346477] nix-grpc-daemon[902]: time=2026-09-20T09:00:13.572Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4661worker2 # [ 47.347964] nix-grpc-daemon[902]: time=2026-09-20T09:00:13.574Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4662lb # [ 47.374619] niks3-server[1014]: 2026/09/20 09:00:14 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4663lb # [ 47.381636] niks3-server[1014]: 2026/09/20 09:00:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4664lb # [ 47.386777] niks3-server[1014]: 2026/09/20 09:00:14 INFO Signed narinfos id=10 count=14665worker2 # [ 47.401244] nix-grpc-daemon[902]: time=2026-09-20T09:00:13.627Z level=INFO msg="Uploading 1 narinfos"4666lb # [ 47.390238] niks3-server[1014]: 2026/09/20 09:00:14 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4667lb # [ 47.403892] niks3-server[1014]: 2026/09/20 09:00:14 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4668lb # [ 47.409873] niks3-server[1014]: 2026/09/20 09:00:14 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4669lb # [ 47.414613] niks3-server[1014]: 2026/09/20 09:00:14 INFO Completed upload id=104670worker2 # [ 47.427900] nix-grpc-daemon[902]: time=2026-09-20T09:00:13.654Z level=INFO msg="Upload complete. (293ms)"4671lb # [ 47.418397] niks3-server[1014]: 2026/09/20 09:00:14 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4672worker2 # [ 47.435577] nix-grpc-daemon[787]: ts=2026-09-20T09:00:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41802 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14673worker2 # [ 47.440867] nix-grpc-daemon[787]: ts=2026-09-20T09:00:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41802 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14674worker2 # [ 47.451609] nix-daemon[849]: reaped child process 926, status = succeeded4675client # [ 47.454510] systemd[1]: dedup1.service: Deactivated successfully.4676client # [ 47.459225] systemd[1]: dedup1.service: Consumed 105ms CPU time over 4.935s wall clock time, 37.3M memory peak, 8.5K incoming IP traffic, 9.1K outgoing IP traffic.4677client # [ 47.465829] systemd[1]: dedup2.service: Deactivated successfully.4678client # [ 47.468786] systemd[1]: dedup2.service: Consumed 132ms CPU time over 3.870s wall clock time, 33.2M memory peak, 7.9K incoming IP traffic, 6.6K outgoing IP traffic.4679client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.10 seconds)4680client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4681client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4682worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4683worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4684worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4685worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4686worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4687worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4688worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4689worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.05 seconds)4690(finished: subtest: two clients wanting the same drv build it once, in 5.97 seconds)4691subtest: build hook: nix-daemon with builders = grpc://lb4692client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4693client # [ 48.606718] systemd[1]: Started Nix Daemon.4694client # [ 48.754026] nix-daemon[941]: accepted connection from pid 938, user root (trusted)4695worker1 # [ 48.979608] nix-grpc-daemon[790]: ts=2026-09-20T09:00:15Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:564524696worker1 # [ 48.984277] nix-grpc-daemon[790]: ts=2026-09-20T09:00:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564524697worker2 # [ 48.983896] nix-grpc-daemon[787]: ts=2026-09-20T09:00:15Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04698worker2 # [ 48.986263] nix-grpc-daemon[787]: ts=2026-09-20T09:00:15Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=14699worker1 # [ 49.003527] nix-grpc-daemon[790]: ts=2026-09-20T09:00:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524700worker1 # [ 49.015904] nix-grpc-daemon[790]: ts=2026-09-20T09:00:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564524701worker1 # [ 49.028072] nix-grpc-daemon[790]: ts=2026-09-20T09:00:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:564524702worker1 # [ 49.039915] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4703worker1 # [ 49.227255] nix-daemon[846]: accepted connection from pid 1047, user nix-grpc-daemon (trusted)4704worker1 # [ 49.244117] nix-daemon[846]: reaped child process 1050, status = succeeded4705worker1 # [ 49.412927] nix-daemon[846]: accepted connection from pid 1052, user nix-grpc-daemon (trusted)4706worker1 # [ 49.427723] nix-daemon[846]: reaped child process 1055, status = succeeded4707lb # [ 49.419603] niks3-server[1014]: 2026/09/20 09:00:16 INFO Received uploads request method=POST path=/api/pending_closures4708worker1 # [ 49.615577] nix-grpc-daemon[857]: time=2026-09-20T09:00:15.820Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4709worker1 # [ 49.619122] nix-grpc-daemon[857]: time=2026-09-20T09:00:15.820Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4710lb # [ 49.596201] envoy[931]: conn peer=[2001:db8:1::1]:42120 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4195 tx=1726 ms=23024711lb # [ 49.600634] envoy[931]: conn peer=[2001:db8:1::1]:42132 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2955 tx=1355 ms=46934712lb # [ 49.604823] envoy[931]: conn peer=[2001:db8:1::1]:36700 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1589 tx=1487 ms=35824713lb # [ 49.620723] niks3-server[1014]: 2026/09/20 09:00:16 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4714lb # [ 49.632389] niks3-server[1014]: 2026/09/20 09:00:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4715lb # [ 49.638628] niks3-server[1014]: 2026/09/20 09:00:16 INFO Signed narinfos id=11 count=14716worker1 # [ 49.668510] nix-grpc-daemon[857]: time=2026-09-20T09:00:15.874Z level=INFO msg="Uploading 1 narinfos"4717lb # [ 49.651300] niks3-server[1014]: 2026/09/20 09:00:16 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4718lb # [ 49.657684] niks3-server[1014]: 2026/09/20 09:00:16 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4719lb # [ 49.666571] niks3-server[1014]: 2026/09/20 09:00:16 INFO Completed upload id=114720worker1 # [ 49.692545] nix-grpc-daemon[857]: time=2026-09-20T09:00:15.898Z level=INFO msg="Upload complete. (640ms)"4721lb # [ 49.669962] niks3-server[1014]: 2026/09/20 09:00:16 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4722worker1 # [ 49.697503] nix-grpc-daemon[790]: ts=2026-09-20T09:00:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=0 paths=1 nar_bytes_in=5124723worker1 # [ 49.703325] nix-grpc-daemon[790]: ts=2026-09-20T09:00:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524724worker1 # [ 49.715335] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4725worker1 # [ 49.731890] nix-daemon[846]: reaped child process 1045, status = succeeded4726worker1 # [ 49.738168] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4727worker1 # [ 50.558517] nix-daemon[846]: reaped child process 1059, status = succeeded4728worker1 # [ 50.714869] nix-daemon[846]: accepted connection from pid 1074, user nix-grpc-daemon (trusted)4729worker1 # [ 50.729380] nix-daemon[846]: reaped child process 1077, status = succeeded4730lb # [ 50.718289] niks3-server[1014]: 2026/09/20 09:00:17 INFO Received uploads request method=POST path=/api/pending_closures4731worker1 # [ 50.751944] nix-grpc-daemon[857]: time=2026-09-20T09:00:16.957Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4732worker1 # [ 50.756202] nix-grpc-daemon[857]: time=2026-09-20T09:00:16.959Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4733lb # [ 50.756180] niks3-server[1014]: 2026/09/20 09:00:17 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4734lb # [ 50.773930] niks3-server[1014]: 2026/09/20 09:00:17 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4735lb # [ 50.783285] niks3-server[1014]: 2026/09/20 09:00:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4736lb # [ 50.788517] niks3-server[1014]: 2026/09/20 09:00:17 INFO Signed narinfos id=12 count=14737worker1 # [ 50.817176] nix-grpc-daemon[857]: time=2026-09-20T09:00:17.023Z level=INFO msg="Uploading 1 narinfos"4738lb # [ 50.794555] niks3-server[1014]: 2026/09/20 09:00:17 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4739lb # [ 50.800055] niks3-server[1014]: 2026/09/20 09:00:17 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4740lb # [ 50.803777] niks3-server[1014]: 2026/09/20 09:00:17 INFO Completed upload id=124741worker1 # [ 50.829559] nix-grpc-daemon[857]: time=2026-09-20T09:00:17.035Z level=INFO msg="Upload complete. (280ms)"4742lb # [ 50.805697] niks3-server[1014]: 2026/09/20 09:00:17 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4743worker1 # [ 50.835661] nix-grpc-daemon[790]: ts=2026-09-20T09:00:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14744worker2 # [ 50.826464] nix-grpc-daemon[787]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:418024745worker1 # [ 50.849694] nix-daemon[846]: reaped child process 1057, status = succeeded4746worker2 # [ 50.838280] nix-grpc-daemon[787]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4747worker1 # [ 50.890091] nix-grpc-daemon[790]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:564524748worker1 # [ 50.896249] nix-grpc-daemon[790]: ts=2026-09-20T09:00:17Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=0 paths=1 nar_bytes_out=1284749worker1 # [ 51.112852] nix-grpc-daemon[790]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:564524750worker2 # [ 51.100611] nix-grpc-daemon[787]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:418024751worker2 # [ 51.109710] nix-grpc-daemon[902]: time=2026-09-20T09:00:17.335Z level=INFO msg="All 1 paths already cached"4752worker2 # [ 51.121882] nix-grpc-daemon[787]: ts=2026-09-20T09:00:17Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04753worker2 # [ 51.126097] nix-grpc-daemon[787]: ts=2026-09-20T09:00:17Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=14754worker1 # [ 51.181293] nix-grpc-daemon[790]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524755worker1 # [ 51.188810] nix-grpc-daemon[790]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564524756worker1 # [ 51.195038] nix-grpc-daemon[857]: time=2026-09-20T09:00:17.401Z level=INFO msg="All 1 paths already cached"4757worker1 # [ 51.199126] nix-grpc-daemon[790]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:564524758worker1 # [ 51.203286] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4759worker1 # [ 51.372984] nix-daemon[846]: accepted connection from pid 1081, user nix-grpc-daemon (trusted)4760worker1 # [ 51.387956] nix-daemon[846]: reaped child process 1084, status = succeeded4761worker1 # [ 51.551282] nix-daemon[846]: accepted connection from pid 1086, user nix-grpc-daemon (trusted)4762worker1 # [ 51.566506] nix-daemon[846]: reaped child process 1089, status = succeeded4763lb # [ 51.549572] niks3-server[1014]: 2026/09/20 09:00:18 INFO Received uploads request method=POST path=/api/pending_closures4764worker1 # [ 51.599277] nix-grpc-daemon[857]: time=2026-09-20T09:00:17.805Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4765worker1 # [ 51.600706] nix-grpc-daemon[857]: time=2026-09-20T09:00:17.805Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4766lb # [ 51.596643] niks3-server[1014]: 2026/09/20 09:00:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4767lb # [ 51.602400] niks3-server[1014]: 2026/09/20 09:00:18 INFO Signed narinfos id=13 count=14768worker1 # [ 51.631924] nix-grpc-daemon[857]: time=2026-09-20T09:00:17.838Z level=INFO msg="Uploading 1 narinfos"4769lb # [ 51.606572] niks3-server[1014]: 2026/09/20 09:00:18 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4770lb # [ 51.617416] niks3-server[1014]: 2026/09/20 09:00:18 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4771lb # [ 51.625958] niks3-server[1014]: 2026/09/20 09:00:18 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4772lb # [ 51.631805] niks3-server[1014]: 2026/09/20 09:00:18 INFO Completed upload id=134773worker1 # [ 51.657950] nix-grpc-daemon[857]: time=2026-09-20T09:00:17.864Z level=INFO msg="Upload complete. (447ms)"4774lb # [ 51.636071] niks3-server[1014]: 2026/09/20 09:00:18 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4775worker1 # [ 51.662583] nix-grpc-daemon[790]: ts=2026-09-20T09:00:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=0 paths=1 nar_bytes_in=6244776worker1 # [ 51.669331] nix-grpc-daemon[790]: ts=2026-09-20T09:00:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524777worker1 # [ 51.679789] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4778worker1 # [ 51.690221] nix-daemon[846]: reaped child process 1079, status = succeeded4779worker1 # [ 51.695778] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4780worker1 # [ 52.718898] nix-daemon[846]: reaped child process 1093, status = succeeded4781worker1 # [ 52.885814] nix-daemon[846]: accepted connection from pid 1108, user nix-grpc-daemon (trusted)4782worker1 # [ 52.899433] nix-daemon[846]: reaped child process 1111, status = succeeded4783lb # [ 52.889528] niks3-server[1014]: 2026/09/20 09:00:19 INFO Received uploads request method=POST path=/api/pending_closures4784worker1 # [ 52.923385] nix-grpc-daemon[857]: time=2026-09-20T09:00:19.129Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4785worker1 # [ 52.926246] nix-grpc-daemon[857]: time=2026-09-20T09:00:19.131Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4786lb # [ 52.928764] niks3-server[1014]: 2026/09/20 09:00:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4787lb # [ 52.934219] niks3-server[1014]: 2026/09/20 09:00:19 INFO Signed narinfos id=14 count=14788worker1 # [ 52.966028] nix-grpc-daemon[857]: time=2026-09-20T09:00:19.172Z level=INFO msg="Uploading 1 narinfos"4789lb # [ 52.946181] niks3-server[1014]: 2026/09/20 09:00:20 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4790lb # [ 52.951940] niks3-server[1014]: 2026/09/20 09:00:20 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4791lb # [ 52.960452] niks3-server[1014]: 2026/09/20 09:00:20 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4792lb # [ 52.967560] niks3-server[1014]: 2026/09/20 09:00:20 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4793lb # [ 52.970255] niks3-server[1014]: 2026/09/20 09:00:20 INFO Completed upload id=144794worker1 # [ 52.996309] nix-grpc-daemon[857]: time=2026-09-20T09:00:19.202Z level=INFO msg="Upload complete. (293ms)"4795lb # [ 52.972597] niks3-server[1014]: 2026/09/20 09:00:20 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4796worker1 # [ 53.001627] nix-grpc-daemon[790]: ts=2026-09-20T09:00:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14797worker1 # [ 53.014214] nix-daemon[846]: reaped child process 1091, status = succeeded4798worker1 # [ 53.046800] nix-grpc-daemon[790]: ts=2026-09-20T09:00:19Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:564524799worker2 # [ 53.049570] nix-grpc-daemon[787]: ts=2026-09-20T09:00:19Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:418024800worker2 # [ 53.058989] nix-grpc-daemon[787]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4801worker2 # [ 53.070994] nix-grpc-daemon[787]: ts=2026-09-20T09:00:19Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41802 duration_s=0 paths=1 nar_bytes_out=1764802worker1 # [ 53.336554] nix-grpc-daemon[790]: ts=2026-09-20T09:00:19Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:564524803worker2 # [ 53.325854] nix-grpc-daemon[787]: ts=2026-09-20T09:00:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:418024804worker2 # [ 53.345408] nix-grpc-daemon[902]: time=2026-09-20T09:00:19.571Z level=INFO msg="All 2 paths already cached"4805worker2 # [ 53.360716] nix-grpc-daemon[787]: ts=2026-09-20T09:00:19Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04806worker1 # [ 53.378425] nix-grpc-daemon[790]: ts=2026-09-20T09:00:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524807worker2 # [ 53.365176] nix-grpc-daemon[787]: ts=2026-09-20T09:00:19Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=14808worker1 # [ 53.390477] nix-grpc-daemon[790]: ts=2026-09-20T09:00:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564524809worker1 # [ 53.406696] nix-grpc-daemon[857]: time=2026-09-20T09:00:19.612Z level=INFO msg="All 2 paths already cached"4810worker1 # [ 53.413994] nix-grpc-daemon[790]: ts=2026-09-20T09:00:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:564524811worker1 # [ 53.422333] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4812worker1 # [ 53.592252] nix-daemon[846]: accepted connection from pid 1115, user nix-grpc-daemon (trusted)4813worker1 # [ 53.605501] nix-daemon[846]: reaped child process 1118, status = succeeded4814worker1 # [ 53.764327] nix-daemon[846]: accepted connection from pid 1120, user nix-grpc-daemon (trusted)4815worker1 # [ 53.776588] nix-daemon[846]: reaped child process 1123, status = succeeded4816lb # [ 53.764635] niks3-server[1014]: 2026/09/20 09:00:20 INFO Received uploads request method=POST path=/api/pending_closures4817worker1 # [ 53.798928] nix-grpc-daemon[857]: time=2026-09-20T09:00:20.005Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4818worker1 # [ 53.800505] nix-grpc-daemon[857]: time=2026-09-20T09:00:20.006Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4819lb # [ 53.794614] niks3-server[1014]: 2026/09/20 09:00:20 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4820lb # [ 53.805540] niks3-server[1014]: 2026/09/20 09:00:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4821lb # [ 53.811591] niks3-server[1014]: 2026/09/20 09:00:20 INFO Signed narinfos id=15 count=14822worker1 # [ 53.840594] nix-grpc-daemon[857]: time=2026-09-20T09:00:20.046Z level=INFO msg="Uploading 1 narinfos"4823lb # [ 53.815163] niks3-server[1014]: 2026/09/20 09:00:20 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4824lb # [ 53.828113] niks3-server[1014]: 2026/09/20 09:00:20 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4825lb # [ 53.833317] niks3-server[1014]: 2026/09/20 09:00:20 INFO Completed upload id=154826worker1 # [ 53.861528] nix-grpc-daemon[857]: time=2026-09-20T09:00:20.067Z level=INFO msg="Upload complete. (424ms)"4827lb # [ 53.837797] niks3-server[1014]: 2026/09/20 09:00:20 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4828worker1 # [ 53.866138] nix-grpc-daemon[790]: ts=2026-09-20T09:00:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=0 paths=1 nar_bytes_in=7524829worker1 # [ 53.870966] nix-grpc-daemon[790]: ts=2026-09-20T09:00:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524830worker1 # [ 53.879807] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4831worker1 # [ 53.888156] nix-daemon[846]: reaped child process 1113, status = succeeded4832worker1 # [ 53.892161] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4833worker1 # [ 55.322436] nix-daemon[846]: reaped child process 1127, status = succeeded4834worker1 # [ 55.454232] nix-daemon[846]: accepted connection from pid 1142, user nix-grpc-daemon (trusted)4835worker1 # [ 55.466941] nix-daemon[846]: reaped child process 1145, status = succeeded4836lb # [ 55.457370] niks3-server[1014]: 2026/09/20 09:00:22 INFO Received uploads request method=POST path=/api/pending_closures4837worker1 # [ 55.595197] nix-grpc-daemon[857]: time=2026-09-20T09:00:21.800Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4838worker1 # [ 55.603071] nix-grpc-daemon[857]: time=2026-09-20T09:00:21.804Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4839lb # [ 55.620591] niks3-server[1014]: 2026/09/20 09:00:22 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4840lb # [ 55.628712] niks3-server[1014]: 2026/09/20 09:00:22 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4841lb # [ 55.637600] niks3-server[1014]: 2026/09/20 09:00:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4842lb # [ 55.641706] niks3-server[1014]: 2026/09/20 09:00:22 INFO Signed narinfos id=16 count=14843worker1 # [ 55.670614] nix-grpc-daemon[857]: time=2026-09-20T09:00:21.876Z level=INFO msg="Uploading 1 narinfos"4844lb # [ 55.650797] niks3-server[1014]: 2026/09/20 09:00:22 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4845lb # [ 55.652810] niks3-server[1014]: 2026/09/20 09:00:22 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4846lb # [ 55.658121] niks3-server[1014]: 2026/09/20 09:00:22 INFO Completed upload id=164847lb # [ 55.660088] niks3-server[1014]: 2026/09/20 09:00:22 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4848worker1 # [ 55.684338] nix-grpc-daemon[857]: time=2026-09-20T09:00:21.890Z level=INFO msg="Upload complete. (382ms)"4849worker1 # [ 55.691665] nix-grpc-daemon[790]: ts=2026-09-20T09:00:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14850worker2 # [ 55.681715] nix-grpc-daemon[787]: ts=2026-09-20T09:00:21Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:418024851worker2 # [ 55.691104] nix-grpc-daemon[787]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4852worker1 # [ 55.706692] nix-daemon[846]: reaped child process 1125, status = succeeded4853worker2 # [ 55.717119] nix-grpc-daemon[787]: ts=2026-09-20T09:00:21Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:418024854worker2 # [ 55.722234] nix-grpc-daemon[787]: ts=2026-09-20T09:00:21Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:41802 duration_s=0 paths=1 nar_bytes_out=2324855client # [ 55.805829] nix-daemon[941]: reaped child process 943, status = succeeded4856client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.38 seconds)4857client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4858client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4859client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4860client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4861client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4862client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4863(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.47 seconds)4864subtest: an input only one worker has still reaches the builder4865client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4866client # this derivation will be built:4867client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4868client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4869client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.39 seconds)4870client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4871client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.16 seconds)4872worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4873worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.20 seconds)4874worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4875worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4876client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24877client # [ 56.898462] nix-daemon[941]: accepted connection from pid 1021, user root (trusted)4878client # this derivation will be built:4879client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4880worker1 # [ 57.111636] nix-grpc-daemon[790]: ts=2026-09-20T09:00:23Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:564524881worker1 # [ 57.114225] nix-grpc-daemon[790]: ts=2026-09-20T09:00:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564524882client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4883worker1 # [ 57.270730] nix-daemon[846]: accepted connection from pid 1152, user nix-grpc-daemon (trusted)4884worker1 # [ 57.281381] nix-daemon[846]: reaped child process 1155, status = succeeded4885lb # [ 57.273260] niks3-server[1014]: 2026/09/20 09:00:24 INFO Received uploads request method=POST path=/api/pending_closures4886worker1 # [ 57.307596] nix-grpc-daemon[857]: time=2026-09-20T09:00:23.513Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4887worker1 # [ 57.309364] nix-grpc-daemon[857]: time=2026-09-20T09:00:23.515Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4888lb # [ 57.302584] niks3-server[1014]: 2026/09/20 09:00:24 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4889lb # [ 57.312390] niks3-server[1014]: 2026/09/20 09:00:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4890worker1 # [ 57.343883] nix-grpc-daemon[857]: time=2026-09-20T09:00:23.550Z level=INFO msg="Uploading 1 narinfos"4891lb # [ 57.317911] niks3-server[1014]: 2026/09/20 09:00:24 INFO Signed narinfos id=17 count=14892lb # [ 57.324264] niks3-server[1014]: 2026/09/20 09:00:24 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4893lb # [ 57.334223] niks3-server[1014]: 2026/09/20 09:00:24 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4894lb # [ 57.341887] niks3-server[1014]: 2026/09/20 09:00:24 INFO Completed upload id=174895worker1 # [ 57.367842] nix-grpc-daemon[857]: time=2026-09-20T09:00:23.574Z level=INFO msg="Upload complete. (251ms)"4896lb # [ 57.345263] niks3-server[1014]: 2026/09/20 09:00:24 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4897worker2 # [ 57.374918] nix-grpc-daemon[787]: ts=2026-09-20T09:00:23Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04898worker2 # [ 57.380930] nix-grpc-daemon[787]: ts=2026-09-20T09:00:23Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14899worker2 # [ 57.424061] nix-grpc-daemon[787]: ts=2026-09-20T09:00:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:418024900worker2 # [ 57.437207] nix-grpc-daemon[787]: ts=2026-09-20T09:00:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:418024901client # copying 2 paths to 'lb:50051'...4902worker2 # [ 57.453498] nix-grpc-daemon[787]: ts=2026-09-20T09:00:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:418024903client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4904client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4905worker2 # [ 57.474084] nix-daemon[849]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4906worker2 # [ 57.672749] nix-daemon[849]: accepted connection from pid 991, user nix-grpc-daemon (trusted)4907worker2 # [ 57.688668] nix-daemon[849]: reaped child process 994, status = succeeded4908worker2 # [ 57.865293] nix-daemon[849]: accepted connection from pid 996, user nix-grpc-daemon (trusted)4909worker2 # [ 57.879584] nix-daemon[849]: reaped child process 999, status = succeeded4910lb # [ 57.883912] niks3-server[1014]: 2026/09/20 09:00:24 INFO Received uploads request method=POST path=/api/pending_closures4911lb # [ 57.935273] niks3-server[1014]: 2026/09/20 09:00:24 INFO Received uploads request method=POST path=/api/pending_closures4912worker2 # [ 57.956668] nix-grpc-daemon[902]: time=2026-09-20T09:00:24.182Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4913worker2 # [ 57.959259] nix-grpc-daemon[902]: time=2026-09-20T09:00:24.184Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4914worker2 # [ 57.961026] nix-grpc-daemon[902]: time=2026-09-20T09:00:24.184Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4915lb # [ 57.972956] niks3-server[1014]: 2026/09/20 09:00:25 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4916lb # [ 57.991060] niks3-server[1014]: 2026/09/20 09:00:25 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4917lb # [ 57.998435] niks3-server[1014]: 2026/09/20 09:00:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4918lb # [ 58.004512] niks3-server[1014]: 2026/09/20 09:00:25 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4919lb # [ 58.007779] niks3-server[1014]: 2026/09/20 09:00:25 INFO Signed narinfos id=18 count=14920lb # [ 58.010706] niks3-server[1014]: 2026/09/20 09:00:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4921lb # [ 58.013295] niks3-server[1014]: 2026/09/20 09:00:25 INFO Signed narinfos id=19 count=24922worker2 # [ 58.025745] nix-grpc-daemon[902]: time=2026-09-20T09:00:24.251Z level=INFO msg="Uploading 3 narinfos"4923lb # [ 58.018555] niks3-server[1014]: 2026/09/20 09:00:25 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4924lb # [ 58.028121] niks3-server[1014]: 2026/09/20 09:00:25 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4925lb # [ 58.031274] niks3-server[1014]: 2026/09/20 09:00:25 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4926lb # [ 58.034034] niks3-server[1014]: 2026/09/20 09:00:25 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4927lb # [ 58.036495] niks3-server[1014]: 2026/09/20 09:00:25 INFO Completed upload id=184928lb # [ 58.037944] niks3-server[1014]: 2026/09/20 09:00:25 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4929lb # [ 58.040701] niks3-server[1014]: 2026/09/20 09:00:25 INFO Completed upload id=194930lb # [ 58.042190] niks3-server[1014]: 2026/09/20 09:00:25 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4931worker2 # [ 58.051939] nix-grpc-daemon[902]: time=2026-09-20T09:00:24.278Z level=INFO msg="Upload complete. (561ms)"4932worker2 # [ 58.056989] nix-grpc-daemon[787]: ts=2026-09-20T09:00:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41802 duration_s=0 paths=2 nar_bytes_in=9764933worker2 # [ 58.063470] nix-grpc-daemon[787]: ts=2026-09-20T09:00:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:418024934worker2 # [ 58.073594] nix-daemon[849]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4935worker2 # [ 58.088270] nix-daemon[849]: reaped child process 989, status = succeeded4936worker2 # [ 58.096171] nix-grpc-daemon[787]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...4937client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4938worker2 # [ 58.108909] nix-daemon[849]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4939client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4940worker2 # [ 59.327182] nix-daemon[849]: reaped child process 1004, status = succeeded4941worker2 # [ 59.475274] nix-daemon[849]: accepted connection from pid 1019, user nix-grpc-daemon (trusted)4942worker2 # [ 59.486080] nix-daemon[849]: reaped child process 1022, status = succeeded4943lb # [ 59.493290] niks3-server[1014]: 2026/09/20 09:00:26 INFO Received uploads request method=POST path=/api/pending_closures4944worker2 # [ 59.513110] nix-grpc-daemon[902]: time=2026-09-20T09:00:25.739Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4945lb # [ 59.525122] niks3-server[1014]: 2026/09/20 09:00:26 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4946lb # [ 59.531967] niks3-server[1014]: 2026/09/20 09:00:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4947lb # [ 59.536575] niks3-server[1014]: 2026/09/20 09:00:26 INFO Signed narinfos id=20 count=14948worker2 # [ 59.550612] nix-grpc-daemon[902]: time=2026-09-20T09:00:25.777Z level=INFO msg="Uploading 1 narinfos"4949lb # [ 59.542061] niks3-server[1014]: 2026/09/20 09:00:26 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4950lb # [ 59.554873] niks3-server[1014]: 2026/09/20 09:00:26 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4951lb # [ 59.559837] niks3-server[1014]: 2026/09/20 09:00:26 INFO Completed upload id=204952worker2 # [ 59.570876] nix-grpc-daemon[902]: time=2026-09-20T09:00:25.797Z level=INFO msg="Upload complete. (251ms)"4953lb # [ 59.562486] niks3-server[1014]: 2026/09/20 09:00:26 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4954worker2 # [ 59.574957] nix-grpc-daemon[787]: ts=2026-09-20T09:00:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41802 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=14955client # copying 1 paths...4956worker2 # [ 59.586295] nix-grpc-daemon[787]: ts=2026-09-20T09:00:25Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:418024957worker2 # [ 59.589640] nix-daemon[849]: reaped child process 1001, status = succeeded4958client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4959worker1 # [ 59.620074] nix-grpc-daemon[790]: ts=2026-09-20T09:00:25Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:564524960lb # [ 59.596925] envoy[931]: conn peer=[2001:db8:1::1]:36702 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3397 tx=1773 ms=19324961lb # [ 59.600676] envoy[931]: conn peer=[2001:db8:1::1]:36714 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=274962lb # [ 59.604930] envoy[931]: conn peer=[2001:db8:1::1]:36722 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3880 tx=1873 ms=20244963lb # [ 59.607794] envoy[931]: conn peer=[2001:db8:1::1]:38774 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=379 ms=764964lb # [ 59.611645] envoy[931]: conn peer=[2001:db8:1::1]:38778 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4341 tx=2198 ms=24534965lb # [ 59.614445] envoy[931]: conn peer=[2001:db8:1::1]:38782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=574966worker1 # [ 59.650402] nix-grpc-daemon[790]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...4967worker1 # [ 59.664070] nix-grpc-daemon[790]: ts=2026-09-20T09:00:25Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=0 paths=1 nar_bytes_out=1204968client # [ 59.718559] nix-daemon[941]: reaped child process 1024, status = succeeded4969client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.04 seconds)4970client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24971client # [ 59.907873] nix-daemon[941]: accepted connection from pid 1042, user root (trusted)4972client # this derivation will be built:4973client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4974worker2 # [ 60.122576] nix-grpc-daemon[787]: ts=2026-09-20T09:00:26Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:418024975client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4976worker1 # [ 60.140959] nix-grpc-daemon[790]: ts=2026-09-20T09:00:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564524977worker1 # [ 60.150914] nix-grpc-daemon[857]: time=2026-09-20T09:00:26.356Z level=INFO msg="All 1 paths already cached"4978worker2 # [ 60.150819] nix-grpc-daemon[787]: ts=2026-09-20T09:00:26Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=04979worker1 # [ 60.168172] nix-grpc-daemon[790]: ts=2026-09-20T09:00:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564524980worker2 # [ 60.155657] nix-grpc-daemon[787]: ts=2026-09-20T09:00:26Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14981worker1 # [ 60.180731] nix-grpc-daemon[790]: ts=2026-09-20T09:00:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564524982client # copying 1 paths to 'lb:50051'...4983client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...4984worker1 # [ 60.198527] nix-grpc-daemon[790]: ts=2026-09-20T09:00:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:564524985worker1 # [ 60.209627] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)4986worker1 # [ 60.225322] nix-grpc-daemon[790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 1/5)4987worker1 # [ 60.252386] nix-grpc-daemon[790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 2/5)4988worker1 # [ 60.259258] nix-grpc-daemon[790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 339 ms (attempt 3/5)4989worker1 # [ 60.604318] nix-grpc-daemon[790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 597 ms (attempt 4/5)4990worker1 # [ 61.202758] nix-grpc-daemon[790]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4991worker1 # [ 61.209503] nix-grpc-daemon[790]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...4992worker1 # [ 61.411557] nix-daemon[846]: accepted connection from pid 1164, user nix-grpc-daemon (trusted)4993worker1 # [ 61.424636] nix-daemon[846]: reaped child process 1167, status = succeeded4994worker1 # [ 61.585961] nix-daemon[846]: accepted connection from pid 1169, user nix-grpc-daemon (trusted)4995worker1 # [ 61.597910] nix-daemon[846]: reaped child process 1172, status = succeeded4996lb # [ 61.589582] niks3-server[1014]: 2026/09/20 09:00:28 INFO Received uploads request method=POST path=/api/pending_closures4997worker1 # [ 61.626227] nix-grpc-daemon[857]: time=2026-09-20T09:00:27.832Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4998worker1 # [ 61.627783] nix-grpc-daemon[857]: time=2026-09-20T09:00:27.832Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"4999lb # [ 61.626254] niks3-server[1014]: 2026/09/20 09:00:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5000lb # [ 61.633755] niks3-server[1014]: 2026/09/20 09:00:28 INFO Signed narinfos id=21 count=15001worker1 # [ 61.662569] nix-grpc-daemon[857]: time=2026-09-20T09:00:27.868Z level=INFO msg="Uploading 1 narinfos"5002lb # [ 61.639193] niks3-server[1014]: 2026/09/20 09:00:28 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5003lb # [ 61.645846] niks3-server[1014]: 2026/09/20 09:00:28 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5004lb # [ 61.657948] niks3-server[1014]: 2026/09/20 09:00:28 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5005lb # [ 61.663817] niks3-server[1014]: 2026/09/20 09:00:28 INFO Completed upload id=215006worker1 # [ 61.692068] nix-grpc-daemon[857]: time=2026-09-20T09:00:27.898Z level=INFO msg="Upload complete. (462ms)"5007lb # [ 61.666925] niks3-server[1014]: 2026/09/20 09:00:28 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5008worker1 # [ 61.696455] nix-grpc-daemon[790]: ts=2026-09-20T09:00:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=1 paths=1 nar_bytes_in=5605009worker1 # [ 61.703555] nix-grpc-daemon[790]: ts=2026-09-20T09:00:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:564525010worker1 # [ 61.713189] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)5011worker1 # [ 61.723532] nix-daemon[846]: reaped child process 1158, status = succeeded5012worker1 # [ 61.727055] nix-daemon[846]: accepted connection from pid 790, user nix-grpc-daemon (trusted)5013client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5014client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5015worker1 # [ 62.551180] nix-daemon[846]: reaped child process 1176, status = succeeded5016worker1 # [ 62.710584] nix-daemon[846]: accepted connection from pid 1191, user nix-grpc-daemon (trusted)5017worker1 # [ 62.720798] nix-daemon[846]: reaped child process 1194, status = succeeded5018lb # [ 62.710590] niks3-server[1014]: 2026/09/20 09:00:29 INFO Received uploads request method=POST path=/api/pending_closures5019worker1 # [ 62.744276] nix-grpc-daemon[857]: time=2026-09-20T09:00:28.950Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5020lb # [ 62.740687] niks3-server[1014]: 2026/09/20 09:00:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5021worker1 # [ 62.771712] nix-grpc-daemon[857]: time=2026-09-20T09:00:28.978Z level=INFO msg="Uploading 1 narinfos"5022lb # [ 62.746776] niks3-server[1014]: 2026/09/20 09:00:29 INFO Signed narinfos id=22 count=15023lb # [ 62.753911] niks3-server[1014]: 2026/09/20 09:00:29 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5024lb # [ 62.758817] niks3-server[1014]: 2026/09/20 09:00:29 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5025lb # [ 62.772107] niks3-server[1014]: 2026/09/20 09:00:29 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5026worker1 # [ 62.802771] nix-grpc-daemon[857]: time=2026-09-20T09:00:29.009Z level=INFO msg="Upload complete. (267ms)"5027lb # [ 62.777142] niks3-server[1014]: 2026/09/20 09:00:29 INFO Completed upload id=225028lb # [ 62.780568] niks3-server[1014]: 2026/09/20 09:00:29 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5029worker1 # [ 62.807269] nix-grpc-daemon[790]: ts=2026-09-20T09:00:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=15030worker1 # [ 62.817406] nix-daemon[846]: reaped child process 1174, status = succeeded5031client # copying 1 paths...5032worker1 # [ 62.853147] nix-grpc-daemon[790]: ts=2026-09-20T09:00:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:564525033client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5034worker1 # [ 62.874916] nix-grpc-daemon[790]: ts=2026-09-20T09:00:29Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:564525035worker1 # [ 62.879289] nix-grpc-daemon[790]: ts=2026-09-20T09:00:29Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=0 paths=1 nar_bytes_out=1205036client # [ 62.939915] nix-daemon[941]: reaped child process 1045, status = succeeded5037client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.22 seconds)5038client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25039client # [ 63.117257] nix-daemon[941]: accepted connection from pid 1063, user root (trusted)5040client # this derivation will be built:5041client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5042client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5043worker1 # [ 63.333664] nix-grpc-daemon[790]: ts=2026-09-20T09:00:29Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:564525044worker1 # [ 63.340076] nix-grpc-daemon[790]: ts=2026-09-20T09:00:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:564525045worker1 # [ 63.345626] nix-grpc-daemon[857]: time=2026-09-20T09:00:29.551Z level=INFO msg="All 1 paths already cached"5046worker2 # [ 63.345279] nix-grpc-daemon[787]: ts=2026-09-20T09:00:29Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05047worker2 # [ 63.349994] nix-grpc-daemon[787]: ts=2026-09-20T09:00:29Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15048worker2 # [ 63.355518] nix-grpc-daemon[787]: ts=2026-09-20T09:00:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:418025049worker2 # [ 63.363519] nix-grpc-daemon[787]: ts=2026-09-20T09:00:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:418025050worker2 # [ 63.376351] nix-grpc-daemon[902]: time=2026-09-20T09:00:29.602Z level=INFO msg="All 1 paths already cached"5051client # copying 1 paths to 'lb:50051'...5052client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5053worker2 # [ 63.383195] nix-grpc-daemon[787]: ts=2026-09-20T09:00:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:418025054worker2 # [ 63.392688] nix-daemon[849]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5055worker2 # [ 63.579471] nix-daemon[849]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)5056worker2 # [ 63.593383] nix-daemon[849]: reaped child process 1033, status = succeeded5057worker2 # [ 63.757388] nix-daemon[849]: accepted connection from pid 1035, user nix-grpc-daemon (trusted)5058worker2 # [ 63.769156] nix-daemon[849]: reaped child process 1038, status = succeeded5059lb # [ 63.776934] niks3-server[1014]: 2026/09/20 09:00:30 INFO Received uploads request method=POST path=/api/pending_closures5060worker2 # [ 63.794221] nix-grpc-daemon[902]: time=2026-09-20T09:00:30.020Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5061worker2 # [ 63.795631] nix-grpc-daemon[902]: time=2026-09-20T09:00:30.020Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5062lb # [ 63.800096] niks3-server[1014]: 2026/09/20 09:00:30 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5063lb # [ 63.811534] niks3-server[1014]: 2026/09/20 09:00:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5064lb # [ 63.816471] niks3-server[1014]: 2026/09/20 09:00:30 INFO Signed narinfos id=23 count=15065worker2 # [ 63.830443] nix-grpc-daemon[902]: time=2026-09-20T09:00:30.056Z level=INFO msg="Uploading 1 narinfos"5066lb # [ 63.822070] niks3-server[1014]: 2026/09/20 09:00:30 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5067lb # [ 63.833092] niks3-server[1014]: 2026/09/20 09:00:30 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5068worker2 # [ 63.849801] nix-grpc-daemon[902]: time=2026-09-20T09:00:30.076Z level=INFO msg="Upload complete. (442ms)"5069lb # [ 63.838780] niks3-server[1014]: 2026/09/20 09:00:30 INFO Completed upload id=235070worker2 # [ 63.851822] nix-grpc-daemon[787]: ts=2026-09-20T09:00:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41802 duration_s=0 paths=1 nar_bytes_in=5605071lb # [ 63.841885] niks3-server[1014]: 2026/09/20 09:00:30 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5072worker2 # [ 63.857090] nix-grpc-daemon[787]: ts=2026-09-20T09:00:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:418025073worker2 # [ 63.866490] nix-daemon[849]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5074worker2 # [ 63.868475] nix-daemon[849]: reaped child process 1028, status = succeeded5075worker2 # [ 63.873414] nix-daemon[849]: accepted connection from pid 787, user nix-grpc-daemon (trusted)5076client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5077client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5078worker2 # [ 64.901445] nix-daemon[849]: reaped child process 1042, status = succeeded5079worker2 # [ 65.059122] nix-daemon[849]: accepted connection from pid 1057, user nix-grpc-daemon (trusted)5080worker2 # [ 65.072315] nix-daemon[849]: reaped child process 1060, status = succeeded5081lb # [ 65.076385] niks3-server[1014]: 2026/09/20 09:00:32 INFO Received uploads request method=POST path=/api/pending_closures5082worker2 # [ 65.096348] nix-grpc-daemon[902]: time=2026-09-20T09:00:31.321Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5083lb # [ 65.104289] niks3-server[1014]: 2026/09/20 09:00:32 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5084lb # [ 65.108124] niks3-server[1014]: 2026/09/20 09:00:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5085lb # [ 65.110045] niks3-server[1014]: 2026/09/20 09:00:32 INFO Signed narinfos id=24 count=15086worker2 # [ 65.122534] nix-grpc-daemon[902]: time=2026-09-20T09:00:31.349Z level=INFO msg="Uploading 1 narinfos"5087lb # [ 65.114456] niks3-server[1014]: 2026/09/20 09:00:32 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5088lb # [ 65.118622] niks3-server[1014]: 2026/09/20 09:00:32 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5089lb # [ 65.122107] niks3-server[1014]: 2026/09/20 09:00:32 INFO Completed upload id=245090worker2 # [ 65.133249] nix-grpc-daemon[902]: time=2026-09-20T09:00:31.359Z level=INFO msg="Upload complete. (253ms)"5091lb # [ 65.123815] niks3-server[1014]: 2026/09/20 09:00:32 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5092worker2 # [ 65.136663] nix-grpc-daemon[787]: ts=2026-09-20T09:00:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41802 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=15093worker2 # [ 65.144751] nix-daemon[849]: reaped child process 1040, status = succeeded5094client # copying 1 paths...5095worker2 # [ 65.181552] nix-grpc-daemon[787]: ts=2026-09-20T09:00:31Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:418025096client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5097worker1 # [ 65.208236] nix-grpc-daemon[790]: ts=2026-09-20T09:00:31Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:564525098worker1 # [ 65.217241] nix-grpc-daemon[790]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5099worker1 # [ 65.230431] nix-grpc-daemon[790]: ts=2026-09-20T09:00:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:56452 duration_s=0 paths=1 nar_bytes_out=1205100client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.33 seconds)5101(finished: subtest: an input only one worker has still reaches the builder, in 9.37 seconds)5102subtest: upload whose reference the worker lacks is completed from the cache5103client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5104client # [ 65.303762] nix-daemon[941]: reaped child process 1066, status = succeeded5105client # this derivation will be built:5106client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5107client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5108client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.39 seconds)5109client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5110client # this derivation will be built:5111client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5112client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5113client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.38 seconds)5114client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5115client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.18 seconds)5116worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5117worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.23 seconds)5118worker2 # [ 66.551851] systemd[1]: Stopping Nix worker-protocol over gRPC...5119worker2 # [ 66.902086] nix-grpc-daemon[787]: ts=2026-09-20T09:00:33Z level=info event=signal_exit5120worker2 # [ 67.159955] nix-grpc-daemon[787]: ts=2026-09-20T09:00:33Z level=info event=scheduler_yield5121worker2 # [ 67.162950] nix-grpc-daemon[787]: ts=2026-09-20T09:00:33Z level=info event=scheduler_restarting addr=lb:500515122worker2 # [ 67.165706] nix-grpc-daemon[787]: ts=2026-09-20T09:00:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:456125123lb # [ 67.154204] niks3-server[1014]: 2026/09/20 09:00:34 INFO lead: released remote=192.168.1.4:437825124worker2 # [ 67.167543] nix-grpc-daemon[787]: ts=2026-09-20T09:00:33Z level=info event=worker_gone addr=192.168.1.4:500515125worker2 # [ 67.171926] nix-grpc-daemon[787]: ts=2026-09-20T09:00:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:456125126worker1 # [ 67.185857] nix-grpc-daemon[790]: ts=2026-09-20T09:00:33Z level=info event=scheduler_restarting addr=lb:500515127worker2 # [ 67.173312] nix-grpc-daemon[787]: ts=2026-09-20T09:00:33Z level=info event=worker_gone addr=192.168.1.3:500515128worker2 # [ 67.363747] nix-grpc-daemon[787]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500515129worker1 # [ 67.386441] nix-grpc-daemon[790]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500515130worker2 # [ 67.371779] nix-grpc-daemon[787]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5131worker1 # [ 67.391922] nix-grpc-daemon[790]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5132worker2 # [ 67.572778] nix-grpc-daemon[787]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500515133worker1 # [ 67.593253] nix-grpc-daemon[790]: ts=2026-09-20T09:00:33Z level=info event=scheduler_connected addr=lb:500515134worker2 # [ 67.578251] nix-grpc-daemon[787]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5135worker1 # [ 67.598133] nix-grpc-daemon[790]: ts=2026-09-20T09:00:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5136worker2 # [ 67.779358] nix-grpc-daemon[787]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500515137worker2 # [ 67.783976] nix-grpc-daemon[787]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5138worker1 # [ 67.803528] nix-grpc-daemon[790]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500515139worker1 # [ 67.808802] nix-grpc-daemon[790]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5140worker2 # [ 67.986764] nix-grpc-daemon[787]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500515141worker2 # [ 67.990409] nix-grpc-daemon[787]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5142worker1 # [ 68.009839] nix-grpc-daemon[790]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500515143worker1 # [ 68.015166] nix-grpc-daemon[790]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5144worker2 # [ 68.162581] nix-grpc-daemon[787]: ts=2026-09-20T09:00:34Z level=info event=scheduler_restarting5145worker2 # [ 68.187203] nix-daemon[849]: reaped child process 851, status = succeeded5146worker1 # [ 68.217313] nix-grpc-daemon[790]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500515147worker2 # [ 68.201969] nix-grpc-daemon[787]: ts=2026-09-20T09:00:34Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5148worker2 # [ 68.207489] nix-grpc-daemon[787]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5149worker2 # [ 68.210751] nix-grpc-daemon[787]: E0000 00:00:1789894834.433612 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5150worker1 # [ 68.517743] nix-grpc-daemon[790]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5151worker2 # [ 68.521398] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5152worker2 # [ 68.524806] systemd[1]: Stopped Nix worker-protocol over gRPC.5153worker2 # [ 68.528374] systemd[1]: nix-grpc-daemon.service: Consumed 1.428s CPU time over 48.919s wall clock time, 52.7M memory peak, 51.2K incoming IP traffic, 94.7K outgoing IP traffic.5154worker2 # [ 68.540194] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5155worker2 # [ 68.543861] systemd[1]: Closed Nix worker-protocol over gRPC.5156worker2 # [ 68.546354] systemd[1]: nix-grpc-daemon.socket: Consumed 292us CPU time over 58.287s wall clock time, 256K memory peak, 85.7K incoming IP traffic, 73.5K outgoing IP traffic.5157lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5158lb: must succeed: curl -sf localhost:9901/clusters5159lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5160lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.06 seconds)5161client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25162worker1 # [ 68.719141] nix-grpc-daemon[790]: ts=2026-09-20T09:00:34Z level=info event=scheduler_connected addr=lb:500515163worker1 # [ 68.724301] nix-grpc-daemon[790]: ts=2026-09-20T09:00:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5164worker1 # [ 68.810559] nix-grpc-daemon[790]: ts=2026-09-20T09:00:35Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:564525165worker1 # [ 68.814904] nix-grpc-daemon[790]: ts=2026-09-20T09:00:35Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:564525166client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5167client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.22 seconds)5168worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5169worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds)5170worker1 # [ 68.925047] nix-grpc-daemon[790]: ts=2026-09-20T09:00:35Z level=info event=scheduler_connected addr=lb:500515171worker2 # [ 68.911742] systemd[1]: Listening on Nix worker-protocol over gRPC.5172worker2 # [ 68.920890] systemd[1]: Starting Nix worker-protocol over gRPC...5173worker1 # [ 68.994936] systemd[1]: Stopping Nix worker-protocol over gRPC...5174worker2 # [ 69.071101] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5175worker2 # [ 69.074948] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15176worker2 # [ 69.081062] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5177worker2 # [ 69.085133] systemd[1]: Started Nix worker-protocol over gRPC.5178worker2 # [ 69.094128] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:35Z level=info event=scheduler_take_over5179lb # [ 69.082917] niks3-server[1014]: 2026/09/20 09:00:36 INFO lead: acquired remote=192.168.1.4:391985180worker2 # [ 69.100939] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05181worker2 # [ 69.114873] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:35Z level=info event=scheduler_connected addr=lb:500515182worker2 # [ 69.116567] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05183lb # [ 69.597706] envoy[931]: conn peer=[2001:db8:1::1]:38798 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=985184lb # [ 69.602197] envoy[931]: conn peer=[2001:db8:1::1]:38790 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3838 tx=1762 ms=26065185lb # [ 69.606417] envoy[931]: conn peer=[2001:db8:1::1]:56130 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=515186lb # [ 69.610549] envoy[931]: conn peer=[2001:db8:1::1]:38810 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1825 ms=27915187lb # [ 69.614899] envoy[931]: conn peer=[2001:db8:1::1]:56140 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1779 ms=19485188lb # [ 69.619225] envoy[931]: conn peer=[2001:db8:1::1]:56142 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=329 ms=715189lb # [ 69.623506] envoy[931]: conn peer=[2001:db8:1::4]:35866 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=7771 tx=1637 ms=482645190lb # [ 69.628723] envoy[931]: conn peer=[2001:db8:1::1]:56152 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=145191worker1 # [ 69.888224] nix-grpc-daemon[790]: ts=2026-09-20T09:00:36Z level=info event=signal_exit5192worker1 # [ 71.152886] nix-grpc-daemon[790]: ts=2026-09-20T09:00:37Z level=info event=scheduler_restarting5193worker2 # [ 71.143408] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:532685194worker2 # [ 71.145184] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:37Z level=info event=worker_gone addr=192.168.1.3:500515195worker1 # [ 71.174501] nix-grpc-daemon[790]: ts=2026-09-20T09:00:37Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5196worker1 # [ 71.192238] nix-daemon[846]: reaped child process 849, status = succeeded5197worker1 # [ 72.007710] nix-grpc-daemon[790]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5198worker1 # [ 72.011304] nix-grpc-daemon[790]: E0000 00:00:1789894838.213335 833 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5199worker1 # [ 72.015878] nix-grpc-daemon[790]: E0000 00:00:1789894838.213927 833 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5200worker1 # [ 72.486242] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5201worker1 # [ 72.490975] systemd[1]: Stopped Nix worker-protocol over gRPC.5202worker1 # [ 72.494157] systemd[1]: nix-grpc-daemon.service: Consumed 2.772s CPU time over 52.880s wall clock time, 61.7M memory peak, 85.2K incoming IP traffic, 153.6K outgoing IP traffic.5203worker1 # [ 72.505214] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5204worker1 # [ 72.509502] systemd[1]: Closed Nix worker-protocol over gRPC.5205worker1 # [ 72.513617] systemd[1]: nix-grpc-daemon.socket: Consumed 287us CPU time over 1min 2.244s wall clock time, 256K memory peak, 93K incoming IP traffic, 75.6K outgoing IP traffic.5206lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5207lb: must succeed: curl -sf localhost:9901/clusters5208lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5209lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5210client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25211worker2 # [ 72.748168] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:533005212worker2 # [ 72.754093] nix-daemon[849]: accepted connection from pid 1081, user nix-grpc-daemon (trusted)5213worker2 # [ 72.762501] nix-grpc-daemon[1081]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 25 ms (attempt 1/5)5214worker2 # [ 72.790292] nix-grpc-daemon[1081]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 191 ms (attempt 2/5)5215worker2 # [ 72.983775] nix-grpc-daemon[1081]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 311 ms (attempt 3/5)5216worker2 # [ 73.297696] nix-grpc-daemon[1081]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 523 ms (attempt 4/5)5217worker2 # [ 73.827958] nix-grpc-daemon[1081]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5218client # copying 2 paths...5219client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5220client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5221worker2 # [ 73.848848] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:533005222worker2 # [ 73.860269] nix-daemon[849]: accepted connection from pid 1081, user nix-grpc-daemon (trusted)5223worker2 # [ 73.879935] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:40Z level=info event=niks3_push_started pid=11375224worker2 # [ 74.193576] nix-daemon[849]: accepted connection from pid 1150, user nix-grpc-daemon (trusted)5225worker2 # [ 74.205419] nix-daemon[849]: reaped child process 1153, status = succeeded5226lb # [ 74.205640] niks3-server[1014]: 2026/09/20 09:00:41 INFO Received uploads request method=POST path=/api/pending_closures5227lb # [ 74.214471] niks3-server[1014]: 2026/09/20 09:00:41 INFO Received uploads request method=POST path=/api/pending_closures5228worker2 # [ 74.232483] nix-grpc-daemon[1137]: time=2026-09-20T09:00:40.458Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5229worker2 # [ 74.236518] nix-grpc-daemon[1137]: time=2026-09-20T09:00:40.460Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5230worker2 # [ 74.238098] nix-grpc-daemon[1137]: time=2026-09-20T09:00:40.460Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5231lb # [ 74.260311] niks3-server[1014]: 2026/09/20 09:00:41 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5232lb # [ 74.265174] niks3-server[1014]: 2026/09/20 09:00:41 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5233lb # [ 74.281794] niks3-server[1014]: 2026/09/20 09:00:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5234lb # [ 74.285714] niks3-server[1014]: 2026/09/20 09:00:41 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5235lb # [ 74.289310] niks3-server[1014]: 2026/09/20 09:00:41 INFO Signed narinfos id=25 count=15236lb # [ 74.293982] niks3-server[1014]: 2026/09/20 09:00:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5237lb # [ 74.296285] niks3-server[1014]: 2026/09/20 09:00:41 INFO Signed narinfos id=26 count=25238worker2 # [ 74.308129] nix-grpc-daemon[1137]: time=2026-09-20T09:00:40.534Z level=INFO msg="Uploading 3 narinfos"5239lb # [ 74.298587] niks3-server[1014]: 2026/09/20 09:00:41 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5240lb # [ 74.311026] niks3-server[1014]: 2026/09/20 09:00:41 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5241lb # [ 74.313398] niks3-server[1014]: 2026/09/20 09:00:41 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5242lb # [ 74.316901] niks3-server[1014]: 2026/09/20 09:00:41 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5243lb # [ 74.320314] niks3-server[1014]: 2026/09/20 09:00:41 INFO Completed upload id=255244lb # [ 74.321798] niks3-server[1014]: 2026/09/20 09:00:41 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5245lb # [ 74.323595] niks3-server[1014]: 2026/09/20 09:00:41 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5246lb # [ 74.326340] niks3-server[1014]: 2026/09/20 09:00:41 INFO Completed upload id=265247worker2 # [ 74.337697] nix-grpc-daemon[1137]: time=2026-09-20T09:00:40.564Z level=INFO msg="Upload complete. (278ms)"5248worker2 # [ 74.343146] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53300 duration_s=0 paths=2 nar_bytes_in=3125249worker2 # [ 74.354865] nix-daemon[849]: reaped child process 1135, status = succeeded5250client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.80 seconds)5251worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5252worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5253worker1 # [ 74.467793] systemd[1]: Listening on Nix worker-protocol over gRPC.5254worker1 # [ 74.474315] systemd[1]: Starting Nix worker-protocol over gRPC...5255worker1 # [ 74.628466] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:40Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5256worker1 # [ 74.632628] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:40Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15257worker1 # [ 74.639043] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:40Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5258worker1 # [ 74.640618] systemd[1]: Started Nix worker-protocol over gRPC.5259lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5260lb: must succeed: curl -sf localhost:9901/clusters5261worker1 # [ 74.677850] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:40Z level=info event=scheduler_connected addr=lb:500515262worker2 # [ 74.666620] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:40Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05263lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5264lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5265(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 9.41 seconds)5266subtest: scheduler down: the other node takes the lock and keeps it5267lb: must succeed: curl -sf localhost:9901/clusters5268lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5269lb: must succeed: curl -sf localhost:9901/clusters5270lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5271lb: must succeed: curl -sf localhost:9901/clusters5272lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5273lb: must succeed: curl -sf localhost:9901/clusters5274lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5275worker2 # [ 74.980739] systemd[1]: Stopping Nix worker-protocol over gRPC...5276worker2 # [ 75.083631] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:41Z level=info event=signal_exit5277worker2 # [ 75.098809] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:41Z level=info event=scheduler_yield5278worker1 # [ 75.117101] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:41Z level=info event=scheduler_restarting addr=lb:500515279lb # [ 75.090311] niks3-server[1014]: 2026/09/20 09:00:42 INFO lead: released remote=192.168.1.4:391985280worker2 # [ 75.105259] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:41Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:532685281worker2 # [ 75.110970] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:41Z level=info event=worker_gone addr=192.168.1.3:500515282worker2 # [ 75.115403] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:41Z level=info event=scheduler_restarting addr=lb:500515283worker2 # [ 75.119103] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:41Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:532685284worker2 # [ 75.122562] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:41Z level=info event=worker_gone addr=192.168.1.4:500515285worker1 # [ 75.317924] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500515286worker1 # [ 75.322866] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5287worker2 # [ 75.311184] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500515288worker2 # [ 75.321804] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5289worker1 # [ 75.524325] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500515290worker1 # [ 75.529894] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5291worker2 # [ 75.522863] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500515292worker2 # [ 75.528330] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5293worker1 # [ 75.732748] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500515294worker1 # [ 75.736613] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5295worker2 # [ 75.729497] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:41Z level=info event=scheduler_connected addr=lb:500515296worker2 # [ 75.734550] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5297worker1 # [ 75.937656] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:42Z level=info event=scheduler_connected addr=lb:500515298worker1 # [ 75.942840] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5299worker2 # [ 75.935322] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:42Z level=info event=scheduler_connected addr=lb:500515300worker2 # [ 75.939385] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5301worker2 # [ 76.106889] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:42Z level=info event=scheduler_restarting5302worker2 # [ 76.116929] nix-grpc-daemon[1081]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5303worker2 # [ 76.120946] nix-grpc-daemon[1081]: E0000 00:00:1789894842.343450 1124 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5304worker1 # [ 76.143963] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:42Z level=info event=scheduler_connected addr=lb:500515305worker2 # [ 76.128182] nix-grpc-daemon[1081]: E0000 00:00:1789894842.354689 1124 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5306worker1 # [ 76.150094] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5307worker2 # [ 76.150221] nix-daemon[849]: reaped child process 1130, status = succeeded5308worker2 # [ 76.152963] nix-grpc-daemon[1081]: ts=2026-09-20T09:00:42Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5309worker1 # [ 76.351406] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:42Z level=info event=scheduler_connected addr=lb:500515310worker2 # [ 76.338927] nix-grpc-daemon[1081]: E0000 00:00:1789894842.565433 1124 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5311worker1 # [ 77.104379] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:43Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5312worker2 # [ 77.109151] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5313worker2 # [ 77.113714] systemd[1]: Stopped Nix worker-protocol over gRPC.5314worker2 # [ 77.116538] systemd[1]: nix-grpc-daemon.service: Consumed 330ms CPU time over 8.187s wall clock time, 32.6M memory peak, 17.4K incoming IP traffic, 21.9K outgoing IP traffic.5315worker2 # [ 77.127967] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5316worker2 # [ 77.132623] systemd[1]: Closed Nix worker-protocol over gRPC.5317worker2 # [ 77.135551] systemd[1]: nix-grpc-daemon.socket: Consumed 499us CPU time over 8.226s wall clock time, 256K memory peak, 26.8K incoming IP traffic, 22.5K outgoing IP traffic.5318worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5319worker1 # [ 77.304831] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:43Z level=info event=scheduler_connected addr=lb:500515320worker1 # [ 77.308159] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5321worker1 # [ 77.509732] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:43Z level=info event=scheduler_connected addr=lb:500515322worker1 # [ 77.514173] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:43Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5323worker1 # [ 77.714843] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:43Z level=info event=scheduler_connected addr=lb:500515324worker1 # [ 77.719853] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5325worker1 # [ 77.920973] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:44Z level=info event=scheduler_connected addr=lb:500515326worker1 # [ 77.925188] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:44Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5327worker1 # [ 78.127849] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:44Z level=info event=scheduler_connected addr=lb:500515328worker1 # [ 78.131804] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5329worker1 # [ 78.332777] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:44Z level=info event=scheduler_connected addr=lb:500515330worker1 # [ 78.337089] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:44Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5331worker1 # [ 78.537901] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:44Z level=info event=scheduler_connected addr=lb:500515332worker1 # [ 78.542967] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5333worker1 # [ 78.744460] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:44Z level=info event=scheduler_connected addr=lb:500515334worker1 # [ 78.748599] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:44Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5335worker1 # [ 78.949463] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:45Z level=info event=scheduler_connected addr=lb:500515336worker1 # [ 78.952961] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5337worker1 # [ 79.155293] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:45Z level=info event=scheduler_connected addr=lb:500515338worker1 # [ 79.159273] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:45Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5339worker1 # [ 79.360129] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:45Z level=info event=scheduler_connected addr=lb:500515340worker1 # [ 79.364458] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5341worker1 # [ 79.565237] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:45Z level=info event=scheduler_connected addr=lb:500515342worker1 # [ 79.568032] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:45Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5343lb # [ 79.598376] envoy[931]: conn peer=[2001:db8:1::3]:37762 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=7900 tx=1916 ms=503145344lb # [ 79.602381] envoy[931]: conn peer=[2001:db8:1::1]:56158 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1005 tx=305 ms=16065345lb # [ 79.607590] envoy[931]: conn peer=[2001:db8:1::4]:42678 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1323 tx=362 ms=70295346lb # [ 79.630241] niks3-server[1014]: 2026/09/20 09:00:46 INFO lead: acquired remote=192.168.1.3:362005347worker1 # [ 79.659425] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:45Z level=info event=scheduler_take_over5348worker1 # [ 79.769374] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:45Z level=info event=scheduler_connected addr=lb:500515349worker1 # [ 79.773859] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:45Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05350worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 3.25 seconds)5351worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5352worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5353client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&25354worker1 # [ 80.656689] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:429125355worker1 # [ 80.668503] nix-daemon[846]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5356client # don't know how to build these paths:5357client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5358worker1 # [ 80.685241] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429125359worker1 # [ 80.696199] nix-grpc-daemon[1218]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 1/5)5360worker1 # [ 80.751990] nix-grpc-daemon[1218]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 2/5)5361worker1 # [ 80.775594] nix-grpc-daemon[1218]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 3/5)5362worker1 # [ 80.822280] nix-grpc-daemon[1218]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 141 ms (attempt 4/5)5363worker1 # [ 80.970277] nix-grpc-daemon[1218]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5364worker1 # [ 80.994470] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:47Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05365worker1 # [ 80.999437] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:47Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15366worker1 # [ 81.038384] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429125367worker1 # [ 81.049875] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429125368client # copying 1 paths to 'lb:50051'...5369client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5370worker1 # [ 81.060799] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429125371worker1 # [ 81.069510] nix-daemon[846]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5372worker1 # [ 81.092097] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:47Z level=info event=niks3_push_started pid=13055373worker1 # [ 81.427408] nix-daemon[846]: accepted connection from pid 1318, user nix-grpc-daemon (trusted)5374worker1 # [ 81.438924] nix-daemon[846]: reaped child process 1321, status = succeeded5375worker1 # [ 81.615294] nix-daemon[846]: accepted connection from pid 1323, user nix-grpc-daemon (trusted)5376worker1 # [ 81.627056] nix-daemon[846]: reaped child process 1326, status = succeeded5377lb # [ 81.621576] niks3-server[1014]: 2026/09/20 09:00:48 INFO Received uploads request method=POST path=/api/pending_closures5378worker1 # [ 81.658592] nix-grpc-daemon[1305]: time=2026-09-20T09:00:47.864Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5379worker1 # [ 81.661493] nix-grpc-daemon[1305]: time=2026-09-20T09:00:47.866Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5380lb # [ 81.666472] niks3-server[1014]: 2026/09/20 09:00:48 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5381lb # [ 81.674595] niks3-server[1014]: 2026/09/20 09:00:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5382lb # [ 81.680106] niks3-server[1014]: 2026/09/20 09:00:48 INFO Signed narinfos id=27 count=15383worker1 # [ 81.709873] nix-grpc-daemon[1305]: time=2026-09-20T09:00:47.915Z level=INFO msg="Uploading 1 narinfos"5384lb # [ 81.692101] niks3-server[1014]: 2026/09/20 09:00:48 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5385lb # [ 81.700127] niks3-server[1014]: 2026/09/20 09:00:48 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5386lb # [ 81.708038] niks3-server[1014]: 2026/09/20 09:00:48 INFO Completed upload id=275387worker1 # [ 81.733978] nix-grpc-daemon[1305]: time=2026-09-20T09:00:47.940Z level=INFO msg="Upload complete. (451ms)"5388worker1 # [ 81.738780] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42912 duration_s=0 paths=1 nar_bytes_in=5205389worker1 # [ 81.746629] nix-grpc-daemon[1305]: time=2026-09-20T09:00:47.952Z level=WARN msg="Failed to register uploaded object" key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo error="server returned 404: object is not pending upload\n"5390worker1 # [ 81.751125] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429125391worker1 # [ 81.763342] nix-daemon[846]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5392worker1 # [ 81.764767] nix-daemon[846]: reaped child process 1303, status = succeeded5393client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5394client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5395worker1 # [ 81.770429] nix-daemon[846]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5396client # farm-a> LOG-farm-a-on-standby5397worker1 # [ 82.983521] nix-daemon[846]: reaped child process 1330, status = succeeded5398worker1 # [ 83.137677] nix-daemon[846]: accepted connection from pid 1345, user nix-grpc-daemon (trusted)5399worker1 # [ 83.152612] nix-daemon[846]: reaped child process 1348, status = succeeded5400lb # [ 83.144907] niks3-server[1014]: 2026/09/20 09:00:50 INFO Received uploads request method=POST path=/api/pending_closures5401worker1 # [ 83.183104] nix-grpc-daemon[1305]: time=2026-09-20T09:00:49.389Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5402worker1 # [ 83.187061] nix-grpc-daemon[1305]: time=2026-09-20T09:00:49.391Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5403lb # [ 83.192757] niks3-server[1014]: 2026/09/20 09:00:50 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5404lb # [ 83.204068] niks3-server[1014]: 2026/09/20 09:00:50 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5405lb # [ 83.213583] niks3-server[1014]: 2026/09/20 09:00:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5406lb # [ 83.217688] niks3-server[1014]: 2026/09/20 09:00:50 INFO Signed narinfos id=28 count=15407worker1 # [ 83.247067] nix-grpc-daemon[1305]: time=2026-09-20T09:00:49.452Z level=INFO msg="Uploading 1 narinfos"5408lb # [ 83.222580] niks3-server[1014]: 2026/09/20 09:00:50 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5409lb # [ 83.231553] niks3-server[1014]: 2026/09/20 09:00:50 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5410lb # [ 83.238072] niks3-server[1014]: 2026/09/20 09:00:50 INFO Completed upload id=285411worker1 # [ 83.265159] nix-grpc-daemon[1305]: time=2026-09-20T09:00:49.471Z level=INFO msg="Upload complete. (287ms)"5412lb # [ 83.239752] niks3-server[1014]: 2026/09/20 09:00:50 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5413worker1 # [ 83.270935] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42912 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15414worker1 # [ 83.280598] nix-daemon[846]: reaped child process 1328, status = succeeded5415worker1 # [ 83.284059] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:49Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05416worker1 # [ 83.285954] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:49Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15417worker1 # [ 83.330773] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429125418worker1 # [ 83.344595] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429125419worker1 # [ 83.357660] nix-grpc-daemon[1305]: time=2026-09-20T09:00:49.563Z level=INFO msg="All 1 paths already cached"5420client # copying 1 paths to 'lb:50051'...5421client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5422worker1 # [ 83.366470] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429125423worker1 # [ 83.375467] nix-daemon[846]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5424worker1 # [ 83.552413] nix-daemon[846]: accepted connection from pid 1354, user nix-grpc-daemon (trusted)5425worker1 # [ 83.566504] nix-daemon[846]: reaped child process 1357, status = succeeded5426worker1 # [ 83.743884] nix-daemon[846]: accepted connection from pid 1359, user nix-grpc-daemon (trusted)5427worker1 # [ 83.759120] nix-daemon[846]: reaped child process 1362, status = succeeded5428lb # [ 83.750084] niks3-server[1014]: 2026/09/20 09:00:50 INFO Received uploads request method=POST path=/api/pending_closures5429worker1 # [ 83.785144] nix-grpc-daemon[1305]: time=2026-09-20T09:00:49.991Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5430worker1 # [ 83.786883] nix-grpc-daemon[1305]: time=2026-09-20T09:00:49.993Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5431lb # [ 83.779928] niks3-server[1014]: 2026/09/20 09:00:50 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5432lb # [ 83.792759] niks3-server[1014]: 2026/09/20 09:00:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5433lb # [ 83.798368] niks3-server[1014]: 2026/09/20 09:00:50 INFO Signed narinfos id=29 count=15434worker1 # [ 83.826686] nix-grpc-daemon[1305]: time=2026-09-20T09:00:50.032Z level=INFO msg="Uploading 1 narinfos"5435lb # [ 83.804515] niks3-server[1014]: 2026/09/20 09:00:50 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5436lb # [ 83.818229] niks3-server[1014]: 2026/09/20 09:00:50 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5437lb # [ 83.825602] niks3-server[1014]: 2026/09/20 09:00:50 INFO Completed upload id=295438worker1 # [ 83.851201] nix-grpc-daemon[1305]: time=2026-09-20T09:00:50.057Z level=INFO msg="Upload complete. (462ms)"5439lb # [ 83.828906] niks3-server[1014]: 2026/09/20 09:00:50 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5440worker1 # [ 83.855811] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42912 duration_s=0 paths=1 nar_bytes_in=6405441worker1 # [ 83.862139] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429125442worker1 # [ 83.873110] nix-daemon[846]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5443worker1 # [ 83.882978] nix-daemon[846]: reaped child process 1352, status = succeeded5444worker1 # [ 83.886264] nix-daemon[846]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5445client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5446client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5447client # farm-b> LOG-farm-b-on-standby5448worker1 # [ 84.501411] nix-daemon[846]: reaped child process 1366, status = succeeded5449worker1 # [ 84.655330] nix-daemon[846]: accepted connection from pid 1381, user nix-grpc-daemon (trusted)5450worker1 # [ 84.669761] nix-daemon[846]: reaped child process 1384, status = succeeded5451lb # [ 84.663834] niks3-server[1014]: 2026/09/20 09:00:51 INFO Received uploads request method=POST path=/api/pending_closures5452worker1 # [ 84.697087] nix-grpc-daemon[1305]: time=2026-09-20T09:00:50.903Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5453worker1 # [ 84.698702] nix-grpc-daemon[1305]: time=2026-09-20T09:00:50.905Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5454lb # [ 84.704180] niks3-server[1014]: 2026/09/20 09:00:51 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5455lb # [ 84.710759] niks3-server[1014]: 2026/09/20 09:00:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5456lb # [ 84.719380] niks3-server[1014]: 2026/09/20 09:00:51 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5457lb # [ 84.725537] niks3-server[1014]: 2026/09/20 09:00:51 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5458lb # [ 84.733403] niks3-server[1014]: 2026/09/20 09:00:51 INFO Signed narinfos id=30 count=15459worker1 # [ 84.759858] nix-grpc-daemon[1305]: time=2026-09-20T09:00:50.965Z level=INFO msg="Uploading 1 narinfos"5460lb # [ 84.739195] niks3-server[1014]: 2026/09/20 09:00:51 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5461lb # [ 84.745277] niks3-server[1014]: 2026/09/20 09:00:51 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5462lb # [ 84.750601] niks3-server[1014]: 2026/09/20 09:00:51 INFO Completed upload id=305463worker1 # [ 84.776653] nix-grpc-daemon[1305]: time=2026-09-20T09:00:50.982Z level=INFO msg="Upload complete. (284ms)"5464worker1 # [ 84.785667] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42912 duration_s=0 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15465worker1 # [ 84.796475] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:51Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05466worker1 # [ 84.800688] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:51Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15467worker1 # [ 84.810067] nix-daemon[846]: reaped child process 1364, status = succeeded5468worker1 # [ 84.840883] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429125469worker1 # [ 84.855312] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429125470worker1 # [ 84.869911] nix-grpc-daemon[1305]: time=2026-09-20T09:00:51.076Z level=INFO msg="All 2 paths already cached"5471client # copying 1 paths to 'lb:50051'...5472client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5473worker1 # [ 84.878412] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429125474worker1 # [ 84.887313] nix-daemon[846]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5475worker1 # [ 85.068705] nix-daemon[846]: accepted connection from pid 1390, user nix-grpc-daemon (trusted)5476worker1 # [ 85.084044] nix-daemon[846]: reaped child process 1393, status = succeeded5477worker1 # [ 85.254116] nix-daemon[846]: accepted connection from pid 1395, user nix-grpc-daemon (trusted)5478worker1 # [ 85.268064] nix-daemon[846]: reaped child process 1398, status = succeeded5479lb # [ 85.257964] niks3-server[1014]: 2026/09/20 09:00:52 INFO Received uploads request method=POST path=/api/pending_closures5480worker1 # [ 85.295299] nix-grpc-daemon[1305]: time=2026-09-20T09:00:51.501Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5481worker1 # [ 85.297178] nix-grpc-daemon[1305]: time=2026-09-20T09:00:51.503Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5482lb # [ 85.297158] niks3-server[1014]: 2026/09/20 09:00:52 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5483lb # [ 85.302348] niks3-server[1014]: 2026/09/20 09:00:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5484lb # [ 85.307358] niks3-server[1014]: 2026/09/20 09:00:52 INFO Signed narinfos id=31 count=15485worker1 # [ 85.336600] nix-grpc-daemon[1305]: time=2026-09-20T09:00:51.542Z level=INFO msg="Uploading 1 narinfos"5486lb # [ 85.316644] niks3-server[1014]: 2026/09/20 09:00:52 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5487lb # [ 85.326516] niks3-server[1014]: 2026/09/20 09:00:52 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5488lb # [ 85.333552] niks3-server[1014]: 2026/09/20 09:00:52 INFO Completed upload id=315489worker1 # [ 85.359430] nix-grpc-daemon[1305]: time=2026-09-20T09:00:51.565Z level=INFO msg="Upload complete. (458ms)"5490lb # [ 85.335778] niks3-server[1014]: 2026/09/20 09:00:52 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5491worker1 # [ 85.363204] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42912 duration_s=0 paths=1 nar_bytes_in=7685492worker1 # [ 85.369438] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429125493worker1 # [ 85.378130] nix-daemon[846]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5494worker1 # [ 85.389093] nix-daemon[846]: reaped child process 1388, status = succeeded5495worker1 # [ 85.392417] nix-daemon[846]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5496client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5497client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5498client # farm-top> LOG-farm-top-on-standby5499worker1 # [ 87.212186] nix-daemon[846]: reaped child process 1402, status = succeeded5500worker1 # [ 87.366740] nix-daemon[846]: accepted connection from pid 1417, user nix-grpc-daemon (trusted)5501worker1 # [ 87.380752] nix-daemon[846]: reaped child process 1420, status = succeeded5502lb # [ 87.372429] niks3-server[1014]: 2026/09/20 09:00:54 INFO Received uploads request method=POST path=/api/pending_closures5503worker1 # [ 87.408937] nix-grpc-daemon[1305]: time=2026-09-20T09:00:53.614Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5504worker1 # [ 87.410483] nix-grpc-daemon[1305]: time=2026-09-20T09:00:53.616Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5505lb # [ 87.405262] niks3-server[1014]: 2026/09/20 09:00:54 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5506lb # [ 87.421047] niks3-server[1014]: 2026/09/20 09:00:54 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5507lb # [ 87.430145] niks3-server[1014]: 2026/09/20 09:00:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5508worker1 # [ 87.459902] nix-grpc-daemon[1305]: time=2026-09-20T09:00:53.666Z level=INFO msg="Uploading 1 narinfos"5509lb # [ 87.433947] niks3-server[1014]: 2026/09/20 09:00:54 INFO Signed narinfos id=32 count=15510lb # [ 87.439247] niks3-server[1014]: 2026/09/20 09:00:54 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5511lb # [ 87.444471] niks3-server[1014]: 2026/09/20 09:00:54 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5512lb # [ 87.449609] niks3-server[1014]: 2026/09/20 09:00:54 INFO Completed upload id=325513worker1 # [ 87.475418] nix-grpc-daemon[1305]: time=2026-09-20T09:00:53.681Z level=INFO msg="Upload complete. (272ms)"5514lb # [ 87.451820] niks3-server[1014]: 2026/09/20 09:00:54 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5515worker1 # [ 87.482498] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42912 duration_s=2 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15516worker1 # [ 87.494543] nix-daemon[846]: reaped child process 1400, status = succeeded5517client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby >&2, in 7.07 seconds)5518client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath5519client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag on-standby outPath, in 0.19 seconds)5520worker2 # [ 87.753827] systemd[1]: Listening on Nix worker-protocol over gRPC.5521worker2 # [ 87.761181] systemd[1]: Starting Nix worker-protocol over gRPC...5522worker2 # [ 87.933510] nix-grpc-daemon[1174]: ts=2026-09-20T09:00:54Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5523worker2 # [ 87.935758] nix-grpc-daemon[1174]: ts=2026-09-20T09:00:54Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15524worker2 # [ 87.940530] nix-grpc-daemon[1174]: ts=2026-09-20T09:00:54Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5525worker2 # [ 87.944146] systemd[1]: Started Nix worker-protocol over gRPC.5526lb: must succeed: curl -sf localhost:9901/clusters5527worker2 # [ 87.973697] nix-grpc-daemon[1174]: ts=2026-09-20T09:00:54Z level=info event=scheduler_connected addr=lb:500515528worker1 # [ 87.990831] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:54Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05529lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5530worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5531worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5532lb: must succeed: curl -sf localhost:9901/clusters5533lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5534lb: must succeed: curl -sf localhost:9901/clusters5535lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5536worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5537worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5538(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.58 seconds)5539subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5540client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5541client # [ 88.319070] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5542client # Running as unit: rs.service; invocation ID: 17de5ab9fb09459cab2a5cd8ae1d15185543client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds)5544worker1 # [ 88.570636] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:54Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:429125545client # [ 88.536344] nix[1164]: don't know how to build these paths:5546client # [ 88.537308] nix[1164]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5547worker1 # [ 88.584201] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:54Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05548worker1 # [ 88.590696] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:54Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15549worker1 # [ 88.595449] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429125550worker1 # [ 88.606376] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429125551client # [ 88.576519] nix[1164]: copying 1 paths to 'lb:50051'...5552client # [ 88.577477] nix[1164]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5553worker1 # [ 88.618483] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429125554worker1 # [ 88.629716] nix-daemon[846]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5555worker1 # [ 88.797416] nix-daemon[846]: accepted connection from pid 1435, user nix-grpc-daemon (trusted)5556worker1 # [ 88.811425] nix-daemon[846]: reaped child process 1438, status = succeeded5557worker1 # [ 88.976476] nix-daemon[846]: accepted connection from pid 1440, user nix-grpc-daemon (trusted)5558worker1 # [ 88.990339] nix-daemon[846]: reaped child process 1443, status = succeeded5559lb # [ 88.982960] niks3-server[1014]: 2026/09/20 09:00:56 INFO Received uploads request method=POST path=/api/pending_closures5560worker1 # [ 89.015191] nix-grpc-daemon[1305]: time=2026-09-20T09:00:55.221Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5561worker1 # [ 89.016776] nix-grpc-daemon[1305]: time=2026-09-20T09:00:55.223Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5562lb # [ 89.012707] niks3-server[1014]: 2026/09/20 09:00:56 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5563lb # [ 89.022767] niks3-server[1014]: 2026/09/20 09:00:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5564worker1 # [ 89.052797] nix-grpc-daemon[1305]: time=2026-09-20T09:00:55.259Z level=INFO msg="Uploading 1 narinfos"5565lb # [ 89.027668] niks3-server[1014]: 2026/09/20 09:00:56 INFO Signed narinfos id=33 count=15566lb # [ 89.034482] niks3-server[1014]: 2026/09/20 09:00:56 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5567lb # [ 89.044982] niks3-server[1014]: 2026/09/20 09:00:56 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5568lb # [ 89.049866] niks3-server[1014]: 2026/09/20 09:00:56 INFO Completed upload id=335569worker1 # [ 89.078446] nix-grpc-daemon[1305]: time=2026-09-20T09:00:55.284Z level=INFO msg="Upload complete. (437ms)"5570lb # [ 89.054879] niks3-server[1014]: 2026/09/20 09:00:56 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5571worker1 # [ 89.082554] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42912 duration_s=0 paths=1 nar_bytes_in=4165572worker1 # [ 89.087545] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429125573worker1 # [ 89.100122] nix-daemon[846]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5574worker1 # [ 89.103978] nix-daemon[846]: reaped child process 1433, status = succeeded5575client # [ 89.066801] nix[1164]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5576worker1 # [ 89.109103] nix-daemon[846]: accepted connection from pid 1218, user nix-grpc-daemon (trusted)5577lb # [ 89.599319] envoy[931]: conn peer=[2001:db8:1::1]:38504 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9620 tx=3859 ms=68365578lb: must succeed: curl -sf localhost:9901/clusters5579lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5580lb: must succeed: curl -sf localhost:9901/clusters5581lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5582lb: must succeed: curl -sf localhost:9901/clusters5583lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5584lb: must succeed: curl -sf localhost:9901/clusters5585lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5586worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5587worker2 # [ 91.217757] systemd-journald[289]: Received client request to rotate journal, rotating.5588worker2 # [ 91.235115] systemd-journald[289]: Vacuuming done, freed 0B of archived journals from /var/log/journal/b07851c8d6d74a5a85e595bc187bd89e.5589worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.07 seconds)5590worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5591worker1 # [ 91.171292] systemd[1]: Stopping Nix worker-protocol over gRPC...5592worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5593??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5594 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735595client: must succeed: sleep 5.05596worker1 # [ 91.650537] nix-grpc-daemon[1218]: ts=2026-09-20T09:00:57Z level=info event=draining5597client: (finished: must succeed: sleep 5.0, in 5.03 seconds)5598worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5599worker1 # [ 96.540756] nix-daemon[846]: reaped child process 1447, status = succeeded5600worker1 # [ 96.704616] nix-daemon[846]: accepted connection from pid 1487, user nix-grpc-daemon (trusted)5601worker1 # [ 96.715093] nix-daemon[846]: reaped child process 1490, status = succeeded5602lb # [ 96.706979] niks3-server[1014]: 2026/09/20 09:01:03 INFO Received uploads request method=POST path=/api/pending_closures5603worker1 # [ 96.738486] nix-grpc-daemon[1305]: time=2026-09-20T09:01:02.944Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5604worker1 # [ 96.740235] nix-grpc-daemon[1305]: time=2026-09-20T09:01:02.946Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5605lb # [ 96.745068] niks3-server[1014]: 2026/09/20 09:01:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5606lb # [ 96.752547] niks3-server[1014]: 2026/09/20 09:01:03 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5607lb # [ 96.756425] niks3-server[1014]: 2026/09/20 09:01:03 INFO Signed narinfos id=34 count=15608worker1 # [ 96.784689] nix-grpc-daemon[1305]: time=2026-09-20T09:01:02.990Z level=INFO msg="Uploading 1 narinfos"5609lb # [ 96.763987] niks3-server[1014]: 2026/09/20 09:01:03 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5610lb # [ 96.769959] niks3-server[1014]: 2026/09/20 09:01:03 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5611lb # [ 96.772947] niks3-server[1014]: 2026/09/20 09:01:03 INFO Completed upload id=345612lb # [ 96.775135] niks3-server[1014]: 2026/09/20 09:01:03 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5613worker1 # [ 96.800121] nix-grpc-daemon[1305]: time=2026-09-20T09:01:03.006Z level=INFO msg="Upload complete. (277ms)"5614lb # [ 96.777867] niks3-server[1014]: 2026/09/20 09:01:03 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5615worker1 # [ 96.806289] nix-grpc-daemon[1218]: ts=2026-09-20T09:01:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42912 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15616worker1 # [ 96.812869] nix-daemon[846]: reaped child process 1445, status = succeeded5617client # [ 96.801510] systemd[1]: rs.service: Deactivated successfully.5618client # [ 96.804990] systemd[1]: rs.service: Consumed 112ms CPU time over 8.485s wall clock time, 39.1M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic.5619worker1 # [ 97.652156] nix-grpc-daemon[1218]: ts=2026-09-20T09:01:03Z level=info event=signal_exit5620worker1 # [ 97.876109] nix-grpc-daemon[1218]: ts=2026-09-20T09:01:04Z level=info event=scheduler_yield5621lb # [ 97.852620] niks3-server[1014]: 2026/09/20 09:01:04 INFO lead: released remote=192.168.1.3:362005622worker1 # [ 97.879966] nix-grpc-daemon[1218]: ts=2026-09-20T09:01:04Z level=info event=scheduler_restarting addr=lb:500515623worker2 # [ 97.865372] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:04Z level=info event=scheduler_restarting addr=lb:500515624worker1 # [ 97.885150] nix-grpc-daemon[1218]: ts=2026-09-20T09:01:04Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:429065625worker1 # [ 97.888669] nix-grpc-daemon[1218]: ts=2026-09-20T09:01:04Z level=info event=worker_gone addr=192.168.1.4:500515626worker1 # [ 97.891662] nix-grpc-daemon[1218]: ts=2026-09-20T09:01:04Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:429065627worker1 # [ 97.894918] nix-grpc-daemon[1218]: ts=2026-09-20T09:01:04Z level=info event=worker_gone addr=192.168.1.3:500515628lb # [ 97.940753] niks3-server[1014]: 2026/09/20 09:01:04 INFO lead: acquired remote=192.168.1.4:456505629worker2 # [ 97.955401] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:04Z level=info event=scheduler_take_over5630worker2 # [ 98.065262] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:04Z level=info event=scheduler_connected addr=lb:500515631worker1 # [ 98.081399] nix-grpc-daemon[1218]: ts=2026-09-20T09:01:04Z level=info event=scheduler_connected addr=lb:500515632worker2 # [ 98.072422] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:04Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=0 running=05633worker2 # [ 98.078794] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5634worker2 # [ 98.279601] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:04Z level=info event=scheduler_connected addr=lb:500515635worker2 # [ 98.283614] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5636worker2 # [ 98.484462] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:04Z level=info event=scheduler_connected addr=lb:500515637worker2 # [ 98.489701] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:04Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05638worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.14 seconds)5639client: waiting for success: ! systemctl is-active rs5640client: (finished: waiting for success: ! systemctl is-active rs, in 0.05 seconds)5641client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5642client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5643client: must fail: journalctl -u rs | grep -q 'reconnecting'5644client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5645lb: must succeed: curl -sf localhost:9901/clusters5646lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5647worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5648worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5649(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 10.48 seconds)5650subtest: scheduler restart mid-build: build finishes, no double build5651client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5652client # [ 98.778738] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5653client # Running as unit: mid.service; invocation ID: b7fd69e6f25945ca9a4e1332e26fc1265654client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.04 seconds)5655worker2 # [ 98.866570] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:05Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:476725656worker2 # [ 98.868360] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:05Z level=info event=worker_gone addr=192.168.1.3:500515657worker1 # [ 98.884412] nix-grpc-daemon[1218]: ts=2026-09-20T09:01:05Z level=info event=scheduler_restarting5658worker1 # [ 98.897404] nix-grpc-daemon[1218]: ts=2026-09-20T09:01:05Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5659worker1 # [ 98.916041] nix-daemon[846]: reaped child process 1296, status = succeeded5660worker2 # [ 99.002160] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:05Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:476785661worker2 # [ 99.014246] nix-daemon[849]: accepted connection from pid 1174, user nix-grpc-daemon (trusted)5662client # [ 98.999570] nix[1199]: don't know how to build these paths:5663client # [ 99.000584] nix[1199]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5664worker1 # [ 99.041486] nix-grpc-daemon[1218]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5665worker1 # [ 99.044885] nix-grpc-daemon[1218]: E0000 00:00:1789894865.247556 1261 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5666lb # [ 99.599994] envoy[931]: conn peer=[2001:db8:1::1]:38278 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2960 tx=1325 ms=82485667lb # [ 99.603852] envoy[931]: conn peer=[2001:db8:1::3]:53328 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=5388 tx=1319 ms=242105668worker1 # [ 99.707620] nix-grpc-daemon[1218]: E0000 00:00:1789894865.913672 1261 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5669worker1 # [ 99.712635] nix-grpc-daemon[1218]: E0000 00:00:1789894865.913873 1261 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5670client # [ 100.105795] nix[1199]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5671worker1 # [ 100.166646] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5672worker1 # [ 100.170520] systemd[1]: Stopped Nix worker-protocol over gRPC.5673worker1 # [ 100.172551] systemd[1]: nix-grpc-daemon.service: Consumed 1.375s CPU time over 25.691s wall clock time, 35.3M memory peak, 46.5K incoming IP traffic, 87.4K outgoing IP traffic.5674worker1 # [ 100.187604] systemd[1]: Starting Nix worker-protocol over gRPC...5675worker1 # [ 100.367816] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:06Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5676worker1 # [ 100.371680] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:06Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15677worker1 # [ 100.377743] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:06Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5678worker1 # [ 100.380731] systemd[1]: Started Nix worker-protocol over gRPC.5679worker1 # [ 100.404159] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:06Z level=info event=scheduler_connected addr=lb:500515680worker2 # [ 100.392638] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05681worker2 # [ 100.646264] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:06Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05682worker2 # [ 100.652520] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:06Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15683worker2 # [ 100.695928] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476785684worker2 # [ 100.709243] nix-grpc-daemon[1174]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 1/5)5685worker2 # [ 100.800562] nix-grpc-daemon[1174]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 138 ms (attempt 2/5)5686worker2 # [ 100.945376] nix-grpc-daemon[1174]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 261 ms (attempt 3/5)5687worker2 # [ 101.212593] nix-grpc-daemon[1174]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 621 ms (attempt 4/5)5688worker2 # [ 101.839318] nix-grpc-daemon[1174]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5689worker2 # [ 101.856885] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:476785690client # [ 101.840607] nix[1199]: copying 1 paths to 'lb:50051'...5691client # [ 101.844308] nix[1199]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5692worker2 # [ 101.870138] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:476785693worker2 # [ 101.882231] nix-daemon[849]: accepted connection from pid 1174, user nix-grpc-daemon (trusted)5694worker2 # [ 101.899607] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:08Z level=info event=niks3_push_started pid=13015695worker2 # [ 102.243551] nix-daemon[849]: accepted connection from pid 1314, user nix-grpc-daemon (trusted)5696worker2 # [ 102.254303] nix-daemon[849]: reaped child process 1317, status = succeeded5697worker2 # [ 102.411255] nix-daemon[849]: accepted connection from pid 1319, user nix-grpc-daemon (trusted)5698worker2 # [ 102.422805] nix-daemon[849]: reaped child process 1326, status = succeeded5699lb # [ 102.426389] niks3-server[1014]: 2026/09/20 09:01:09 INFO Received uploads request method=POST path=/api/pending_closures5700worker2 # [ 102.442182] nix-grpc-daemon[1301]: time=2026-09-20T09:01:08.668Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5701worker2 # [ 102.445352] nix-grpc-daemon[1301]: time=2026-09-20T09:01:08.670Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5702lb # [ 102.448913] niks3-server[1014]: 2026/09/20 09:01:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5703lb # [ 102.452491] niks3-server[1014]: 2026/09/20 09:01:09 INFO Signed narinfos id=35 count=15704worker2 # [ 102.463814] nix-grpc-daemon[1301]: time=2026-09-20T09:01:08.690Z level=INFO msg="Uploading 1 narinfos"5705lb # [ 102.454425] niks3-server[1014]: 2026/09/20 09:01:09 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5706lb # [ 102.463767] niks3-server[1014]: 2026/09/20 09:01:09 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5707lb # [ 102.468316] niks3-server[1014]: 2026/09/20 09:01:09 INFO Completed upload id=355708worker2 # [ 102.479489] nix-grpc-daemon[1301]: time=2026-09-20T09:01:08.706Z level=INFO msg="Upload complete. (387ms)"5709lb # [ 102.470427] niks3-server[1014]: 2026/09/20 09:01:09 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5710worker2 # [ 102.481771] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:47678 duration_s=0 paths=1 nar_bytes_in=4245711worker2 # [ 102.486388] nix-grpc-daemon[1174]: ts=2026-09-20T09:01:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:476785712lb # [ 102.476684] niks3-server[1014]: 2026/09/20 09:01:09 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5713worker2 # [ 102.492193] nix-daemon[849]: accepted connection from pid 1174, user nix-grpc-daemon (trusted)5714worker2 # [ 102.494520] nix-daemon[849]: reaped child process 1299, status = succeeded5715worker2 # [ 102.499844] nix-daemon[849]: accepted connection from pid 1174, user nix-grpc-daemon (trusted)5716client # [ 102.473227] nix[1199]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5717lb: must succeed: curl -sf localhost:9901/clusters5718lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5719lb: must succeed: curl -sf localhost:9901/clusters5720lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5721worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5722worker2 # [ 104.858402] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1174 (nix-grpc-daemon) on client request.5723worker2 # [ 104.861352] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5724lb # [ 104.857626] niks3-server[1014]: 2026/09/20 09:01:11 INFO lead: released remote=192.168.1.4:456505725client # [ 104.842387] nix[1199]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5726worker1 # [ 104.882220] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:11Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5727client # [ 104.846329] nix[1199]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5728worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)5729client: must succeed: sleep 5.05730worker2 # [ 104.893273] nix-daemon[849]: reaped child process 1328, status = succeeded5731worker2 # [ 104.894836] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5732worker2 # [ 104.896406] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5733worker2 # [ 104.898245] nix-daemon[849]: reaped child process 1284, status = succeeded5734worker2 # [ 104.899161] systemd[1]: nix-grpc-daemon.service: Consumed 430ms CPU time over 17.131s wall clock time, 33.1M memory peak, 13.2K incoming IP traffic, 18.4K outgoing IP traffic.5735worker2 # [ 104.907266] nix-daemon[1330]: unexpected Nix daemon error: error: interrupted by the user5736worker2 # [ 104.911715] nix-daemon[849]: reaped child process 1330, status = failed with exit code 15737worker2 # [ 105.014693] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5738worker2 # [ 105.023154] systemd[1]: Starting Nix worker-protocol over gRPC...5739worker1 # [ 105.082682] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:11Z level=info event=scheduler_connected addr=lb:500515740worker2 # [ 105.203131] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:11Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5741worker2 # [ 105.206296] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:11Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15742worker2 # [ 105.213065] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:11Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5743worker2 # [ 105.216133] systemd[1]: Started Nix worker-protocol over gRPC.5744worker2 # [ 105.226164] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:11Z level=info event=scheduler_take_over5745lb # [ 105.215214] niks3-server[1014]: 2026/09/20 09:01:12 INFO lead: acquired remote=192.168.1.4:505265746worker2 # [ 105.233215] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:11Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05747worker2 # [ 105.246880] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:11Z level=info event=scheduler_connected addr=lb:500515748worker2 # [ 105.248593] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:11Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05749worker2 # [ 105.377121] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:11Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05750worker2 # [ 105.381546] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:11Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15751worker1 # [ 105.446159] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524265752worker1 # [ 105.457262] nix-daemon[846]: accepted connection from pid 1505, user nix-grpc-daemon (trusted)5753worker1 # [ 105.475572] nix-grpc-daemon[1505]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 1/5)5754worker1 # [ 105.486397] nix-grpc-daemon[1505]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 2/5)5755worker1 # [ 105.512094] nix-grpc-daemon[1505]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 166 ms (attempt 3/5)5756worker1 # [ 105.683799] nix-grpc-daemon[1505]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 373 ms (attempt 4/5)5757worker1 # [ 106.063215] nix-grpc-daemon[1505]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5758worker1 # [ 106.074329] nix-grpc-daemon[1505]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' from 'http://lb:5751'...5759worker1 # [ 106.089316] nix-daemon[846]: accepted connection from pid 1505, user nix-grpc-daemon (trusted)5760worker1 # [ 106.097122] nix-daemon[846]: accepted connection from pid 1505, user nix-grpc-daemon (trusted)5761client # [ 106.057965] nix[1199]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5762lb # [ 109.600093] envoy[931]: conn peer=[2001:db8:1::4]:43574 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1172 tx=440 ms=168985763client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5764client: waiting for success: ! systemctl is-active mid5765worker1 # [ 110.314376] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:16Z level=info event=niks3_push_started pid=16065766worker1 # [ 110.345688] nix-daemon[846]: reaped child process 1582, status = succeeded5767worker1 # [ 110.695139] nix-daemon[846]: accepted connection from pid 1619, user nix-grpc-daemon (trusted)5768worker1 # [ 110.708946] nix-daemon[846]: reaped child process 1622, status = succeeded5769lb # [ 110.701771] niks3-server[1014]: 2026/09/20 09:01:17 INFO Received uploads request method=POST path=/api/pending_closures5770worker1 # [ 110.737936] nix-grpc-daemon[1606]: time=2026-09-20T09:01:16.943Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5771worker1 # [ 110.739472] nix-grpc-daemon[1606]: time=2026-09-20T09:01:16.945Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5772lb # [ 110.749527] niks3-server[1014]: 2026/09/20 09:01:17 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5773lb # [ 110.763232] niks3-server[1014]: 2026/09/20 09:01:17 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5774lb # [ 110.769116] niks3-server[1014]: 2026/09/20 09:01:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5775lb # [ 110.772690] niks3-server[1014]: 2026/09/20 09:01:17 INFO Signed narinfos id=36 count=15776worker1 # [ 110.799323] nix-grpc-daemon[1606]: time=2026-09-20T09:01:17.004Z level=INFO msg="Uploading 1 narinfos"5777lb # [ 110.778385] niks3-server[1014]: 2026/09/20 09:01:17 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5778lb # [ 110.786585] niks3-server[1014]: 2026/09/20 09:01:17 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5779lb # [ 110.790751] niks3-server[1014]: 2026/09/20 09:01:17 INFO Completed upload id=365780worker1 # [ 110.816635] nix-grpc-daemon[1606]: time=2026-09-20T09:01:17.022Z level=INFO msg="Upload complete. (282ms)"5781lb # [ 110.792496] niks3-server[1014]: 2026/09/20 09:01:17 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5782worker1 # [ 110.821720] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52426 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15783worker1 # [ 110.834250] nix-daemon[846]: reaped child process 1580, status = succeeded5784client # [ 110.817248] systemd[1]: mid.service: Deactivated successfully.5785client # [ 110.821201] systemd[1]: mid.service: Consumed 126ms CPU time over 12.040s wall clock time, 39.1M memory peak, 10.1K incoming IP traffic, 11.1K outgoing IP traffic.5786client: (finished: waiting for success: ! systemctl is-active mid, in 1.11 seconds)5787client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5788client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)5789(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 12.54 seconds)5790subtest: interrupting the client stops the build on the worker5791client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5792client # [ 111.313402] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5793client # Running as unit: intr.service; invocation ID: 5423518028b04a5e944c5f670cc19cfa5794client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)5795worker2 # [ 111.537638] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:17Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:509325796worker2 # [ 111.548678] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5797client # [ 111.536117] nix[1234]: don't know how to build these paths:5798client # [ 111.537138] nix[1234]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5799worker2 # [ 111.571134] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:17Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05800worker2 # [ 111.576065] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:17Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=15801worker2 # [ 111.620527] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:509325802worker2 # [ 111.632372] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 1/5)5803worker2 # [ 111.661799] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 171 ms (attempt 2/5)5804worker2 # [ 111.838952] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 323 ms (attempt 3/5)5805worker2 # [ 112.167838] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 552 ms (attempt 4/5)5806worker2 # [ 112.726831] nix-grpc-daemon[1366]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5807worker2 # [ 112.745979] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:509325808client # [ 112.732394] nix[1234]: copying 1 paths to 'lb:50051'...5809worker2 # [ 112.759338] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:509325810client # [ 112.734834] nix[1234]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5811worker2 # [ 112.770069] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5812worker2 # [ 112.788596] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:19Z level=info event=niks3_push_started pid=14425813worker2 # [ 113.114549] nix-daemon[849]: accepted connection from pid 1455, user nix-grpc-daemon (trusted)5814worker2 # [ 113.125481] nix-daemon[849]: reaped child process 1458, status = succeeded5815worker2 # [ 113.287411] nix-daemon[849]: accepted connection from pid 1460, user nix-grpc-daemon (trusted)5816worker2 # [ 113.299413] nix-daemon[849]: reaped child process 1463, status = succeeded5817lb # [ 113.304689] niks3-server[1014]: 2026/09/20 09:01:20 INFO Received uploads request method=POST path=/api/pending_closures5818worker2 # [ 113.320767] nix-grpc-daemon[1442]: time=2026-09-20T09:01:19.547Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5819worker2 # [ 113.322363] nix-grpc-daemon[1442]: time=2026-09-20T09:01:19.549Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5820lb # [ 113.325746] niks3-server[1014]: 2026/09/20 09:01:20 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5821lb # [ 113.329063] niks3-server[1014]: 2026/09/20 09:01:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5822lb # [ 113.331870] niks3-server[1014]: 2026/09/20 09:01:20 INFO Signed narinfos id=37 count=15823worker2 # [ 113.342538] nix-grpc-daemon[1442]: time=2026-09-20T09:01:19.569Z level=INFO msg="Uploading 1 narinfos"5824lb # [ 113.336247] niks3-server[1014]: 2026/09/20 09:01:20 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5825lb # [ 113.340156] niks3-server[1014]: 2026/09/20 09:01:20 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5826lb # [ 113.344261] niks3-server[1014]: 2026/09/20 09:01:20 INFO Completed upload id=375827worker2 # [ 113.355342] nix-grpc-daemon[1442]: time=2026-09-20T09:01:19.581Z level=INFO msg="Upload complete. (391ms)"5828lb # [ 113.346208] niks3-server[1014]: 2026/09/20 09:01:20 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5829worker2 # [ 113.357789] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50932 duration_s=0 paths=1 nar_bytes_in=4245830worker2 # [ 113.362804] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:509325831worker2 # [ 113.369613] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5832worker2 # [ 113.371024] nix-daemon[849]: reaped child process 1440, status = succeeded5833worker2 # [ 113.376247] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5834client # [ 113.349805] nix[1234]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5835client: must succeed: systemctl kill -s INT intr5836client # [ 114.886365] systemd[1]: intr.service: Sent signal SIGINT to main process 1234 (nix) on client request.5837client # [ 114.893766] nix[1234]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5838client: (finished: must succeed: systemctl kill -s INT intr, in 0.06 seconds)5839client # [ 114.900692] nix[1234]: error: interrupted by the user5840client # [ 114.932782] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5841client # [ 114.934241] systemd[1]: intr.service: Failed with result 'exit-code'.5842client # [ 114.936299] systemd[1]: intr.service: Consumed 117ms CPU time over 3.622s wall clock time, 39.3M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5843worker2 # [ 114.995549] nix-daemon[1467]: unexpected Nix daemon error: error: interrupted by the user5844worker2 # [ 114.998223] nix-daemon[849]: reaped child process 1465, status = succeeded5845worker2 # [ 115.002484] nix-daemon[849]: reaped child process 1467, status = failed with exit code 15846(finished: subtest: interrupting the client stops the build on the worker, in 3.73 seconds)5847subtest: a deploy mid-build drains: the build finishes, the new generation takes over5848client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5849client # [ 115.062641] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5850client # Running as unit: sw.service; invocation ID: a0f30976c6094e7fb91bded9fc33ec795851client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds)5852worker1 # [ 115.321782] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:21Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:524265853client # [ 115.287472] nix[1254]: don't know how to build these paths:5854client # [ 115.288506] nix[1254]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5855worker2 # [ 115.321846] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:21Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05856worker2 # [ 115.326309] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:21Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=15857worker1 # [ 115.380504] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524265858worker1 # [ 115.394061] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:524265859client # [ 115.363175] nix[1254]: copying 1 paths to 'lb:50051'...5860client # [ 115.366095] nix[1254]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5861worker1 # [ 115.407798] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:524265862worker1 # [ 115.419704] nix-daemon[846]: accepted connection from pid 1505, user nix-grpc-daemon (trusted)5863worker1 # [ 115.589733] nix-daemon[846]: accepted connection from pid 1650, user nix-grpc-daemon (trusted)5864worker1 # [ 115.604329] nix-daemon[846]: reaped child process 1653, status = succeeded5865worker1 # [ 115.776778] nix-daemon[846]: accepted connection from pid 1655, user nix-grpc-daemon (trusted)5866worker1 # [ 115.790879] nix-daemon[846]: reaped child process 1658, status = succeeded5867lb # [ 115.781345] niks3-server[1014]: 2026/09/20 09:01:22 INFO Received uploads request method=POST path=/api/pending_closures5868worker1 # [ 115.813253] nix-grpc-daemon[1606]: time=2026-09-20T09:01:22.019Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5869worker1 # [ 115.814885] nix-grpc-daemon[1606]: time=2026-09-20T09:01:22.021Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5870lb # [ 115.800351] niks3-server[1014]: 2026/09/20 09:01:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5871lb # [ 115.802720] niks3-server[1014]: 2026/09/20 09:01:22 INFO Signed narinfos id=38 count=15872worker1 # [ 115.829708] nix-grpc-daemon[1606]: time=2026-09-20T09:01:22.036Z level=INFO msg="Uploading 1 narinfos"5873lb # [ 115.804270] niks3-server[1014]: 2026/09/20 09:01:22 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5874lb # [ 115.811192] niks3-server[1014]: 2026/09/20 09:01:22 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5875lb # [ 115.813093] niks3-server[1014]: 2026/09/20 09:01:22 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5876lb # [ 115.816347] niks3-server[1014]: 2026/09/20 09:01:22 INFO Completed upload id=385877worker1 # [ 115.843381] nix-grpc-daemon[1606]: time=2026-09-20T09:01:22.049Z level=INFO msg="Upload complete. (411ms)"5878lb # [ 115.818112] niks3-server[1014]: 2026/09/20 09:01:22 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5879worker1 # [ 115.845679] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52426 duration_s=0 paths=1 nar_bytes_in=4165880worker1 # [ 115.848747] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:524265881worker1 # [ 115.856098] nix-daemon[846]: accepted connection from pid 1505, user nix-grpc-daemon (trusted)5882worker1 # [ 115.862132] nix-daemon[846]: reaped child process 1648, status = succeeded5883client # [ 115.823532] nix[1254]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5884worker1 # [ 115.865300] nix-daemon[846]: accepted connection from pid 1505, user nix-grpc-daemon (trusted)5885worker1: must succeed: systemctl reload nix-grpc-daemon.service5886worker1 # [ 117.639372] systemd[1]: Reloading Nix worker-protocol over gRPC...5887worker1 # [ 117.682656] systemd[1]: Reloaded Nix worker-protocol over gRPC.5888worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.09 seconds)5889worker1: must succeed: pgrep -f 'read -t [9]0 x'5890worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5891client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&25892client # don't know how to build these paths:5893worker2 # [ 117.940088] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:509325894client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5895worker1 # [ 117.959376] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:524265896worker2 # [ 117.964515] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:24Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05897worker2 # [ 117.966552] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:24Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=15898worker2 # [ 118.010688] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:509325899worker2 # [ 118.018163] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:509325900client # copying 1 paths to 'lb:50051'...5901worker2 # [ 118.025270] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:509325902client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5903worker2 # [ 118.034975] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5904worker2 # [ 118.187090] nix-daemon[849]: accepted connection from pid 1517, user nix-grpc-daemon (trusted)5905worker2 # [ 118.199613] nix-daemon[849]: reaped child process 1520, status = succeeded5906worker2 # [ 118.360242] nix-daemon[849]: accepted connection from pid 1522, user nix-grpc-daemon (trusted)5907worker1 # [ 118.386694] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:24Z level=info event=draining5908worker2 # [ 118.372805] nix-daemon[849]: reaped child process 1525, status = succeeded5909lb # [ 118.376708] niks3-server[1014]: 2026/09/20 09:01:25 INFO Received uploads request method=POST path=/api/pending_closures5910worker2 # [ 118.396196] nix-grpc-daemon[1442]: time=2026-09-20T09:01:24.622Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5911worker2 # [ 118.397639] nix-grpc-daemon[1442]: time=2026-09-20T09:01:24.622Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5912lb # [ 118.408274] niks3-server[1014]: 2026/09/20 09:01:25 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5913lb # [ 118.415400] niks3-server[1014]: 2026/09/20 09:01:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5914lb # [ 118.420781] niks3-server[1014]: 2026/09/20 09:01:25 INFO Signed narinfos id=39 count=15915worker2 # [ 118.435379] nix-grpc-daemon[1442]: time=2026-09-20T09:01:24.661Z level=INFO msg="Uploading 1 narinfos"5916lb # [ 118.431638] niks3-server[1014]: 2026/09/20 09:01:25 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5917lb # [ 118.441604] niks3-server[1014]: 2026/09/20 09:01:25 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5918lb # [ 118.446538] niks3-server[1014]: 2026/09/20 09:01:25 INFO Completed upload id=395919worker2 # [ 118.460055] nix-grpc-daemon[1442]: time=2026-09-20T09:01:24.686Z level=INFO msg="Upload complete. (420ms)"5920lb # [ 118.450047] niks3-server[1014]: 2026/09/20 09:01:25 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5921worker2 # [ 118.462293] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:24Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50932 duration_s=0 paths=1 nar_bytes_in=5285922worker2 # [ 118.466310] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:509325923worker2 # [ 118.472579] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5924worker2 # [ 118.474805] nix-daemon[849]: reaped child process 1515, status = succeeded5925client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...5926client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5927worker2 # [ 118.479891] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5928worker2 # [ 119.293372] nix-daemon[849]: reaped child process 1529, status = succeeded5929client # farm-a> LOG-farm-a-during-drain5930worker2 # [ 119.434332] nix-daemon[849]: accepted connection from pid 1544, user nix-grpc-daemon (trusted)5931worker2 # [ 119.446362] nix-daemon[849]: reaped child process 1547, status = succeeded5932lb # [ 119.450565] niks3-server[1014]: 2026/09/20 09:01:26 INFO Received uploads request method=POST path=/api/pending_closures5933worker2 # [ 119.466512] nix-grpc-daemon[1442]: time=2026-09-20T09:01:25.692Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5934worker2 # [ 119.468086] nix-grpc-daemon[1442]: time=2026-09-20T09:01:25.694Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"5935lb # [ 119.471477] niks3-server[1014]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5936lb # [ 119.475527] niks3-server[1014]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5937lb # [ 119.478074] niks3-server[1014]: 2026/09/20 09:01:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5938lb # [ 119.479969] niks3-server[1014]: 2026/09/20 09:01:26 INFO Signed narinfos id=40 count=15939worker2 # [ 119.491536] nix-grpc-daemon[1442]: time=2026-09-20T09:01:25.717Z level=INFO msg="Uploading 1 narinfos"5940lb # [ 119.483332] niks3-server[1014]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls5941lb # [ 119.488252] niks3-server[1014]: 2026/09/20 09:01:26 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5942lb # [ 119.491558] niks3-server[1014]: 2026/09/20 09:01:26 INFO Completed upload id=405943worker2 # [ 119.503814] nix-grpc-daemon[1442]: time=2026-09-20T09:01:25.730Z level=INFO msg="Upload complete. (217ms)"5944lb # [ 119.493307] niks3-server[1014]: 2026/09/20 09:01:26 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo5945worker2 # [ 119.506896] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50932 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=15946worker2 # [ 119.512157] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:25Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=05947worker2 # [ 119.514603] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:25Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=15948worker2 # [ 119.518857] nix-daemon[849]: reaped child process 1527, status = succeeded5949worker2 # [ 119.565434] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:509325950worker2 # [ 119.577406] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:509325951worker2 # [ 119.588716] nix-grpc-daemon[1442]: time=2026-09-20T09:01:25.815Z level=INFO msg="All 1 paths already cached"5952client # copying 1 paths to 'lb:50051'...5953worker2 # [ 119.596723] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:509325954client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...5955lb # [ 119.601427] envoy[931]: conn peer=[2001:db8:1::1]:36354 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4050 tx=1827 ms=118195956worker2 # [ 119.615688] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5957lb # [ 119.605213] envoy[931]: conn peer=[2001:db8:1::1]:44826 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=758 ms=34105958worker2 # [ 119.782879] nix-daemon[849]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)5959worker2 # [ 119.794706] nix-daemon[849]: reaped child process 1556, status = succeeded5960worker2 # [ 119.954515] nix-daemon[849]: accepted connection from pid 1558, user nix-grpc-daemon (trusted)5961worker2 # [ 119.966311] nix-daemon[849]: reaped child process 1561, status = succeeded5962lb # [ 119.970945] niks3-server[1014]: 2026/09/20 09:01:27 INFO Received uploads request method=POST path=/api/pending_closures5963worker2 # [ 119.989669] nix-grpc-daemon[1442]: time=2026-09-20T09:01:26.216Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5964worker2 # [ 119.991157] nix-grpc-daemon[1442]: time=2026-09-20T09:01:26.217Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"5965lb # [ 120.001176] niks3-server[1014]: 2026/09/20 09:01:27 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst5966lb # [ 120.011136] niks3-server[1014]: 2026/09/20 09:01:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5967lb # [ 120.015603] niks3-server[1014]: 2026/09/20 09:01:27 INFO Signed narinfos id=41 count=15968worker2 # [ 120.029504] nix-grpc-daemon[1442]: time=2026-09-20T09:01:26.256Z level=INFO msg="Uploading 1 narinfos"5969lb # [ 120.020523] niks3-server[1014]: 2026/09/20 09:01:27 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls5970lb # [ 120.033936] niks3-server[1014]: 2026/09/20 09:01:27 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5971worker2 # [ 120.049765] nix-grpc-daemon[1442]: time=2026-09-20T09:01:26.276Z level=INFO msg="Upload complete. (420ms)"5972lb # [ 120.038795] niks3-server[1014]: 2026/09/20 09:01:27 INFO Completed upload id=415973worker2 # [ 120.051847] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50932 duration_s=0 paths=1 nar_bytes_in=6405974lb # [ 120.042295] niks3-server[1014]: 2026/09/20 09:01:27 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo5975worker2 # [ 120.060264] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:509325976worker2 # [ 120.069544] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5977worker2 # [ 120.072185] nix-daemon[849]: reaped child process 1551, status = succeeded5978worker2 # [ 120.077206] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)5979client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...5980client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5981client # farm-b> LOG-farm-b-during-drain5982worker2 # [ 121.106399] nix-daemon[849]: reaped child process 1565, status = succeeded5983worker2 # [ 121.251415] nix-daemon[849]: accepted connection from pid 1580, user nix-grpc-daemon (trusted)5984worker2 # [ 121.263240] nix-daemon[849]: reaped child process 1583, status = succeeded5985lb # [ 121.261794] niks3-server[1014]: 2026/09/20 09:01:28 INFO Received uploads request method=POST path=/api/pending_closures5986worker2 # [ 121.278826] nix-grpc-daemon[1442]: time=2026-09-20T09:01:27.505Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5987worker2 # [ 121.280432] nix-grpc-daemon[1442]: time=2026-09-20T09:01:27.506Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"5988lb # [ 121.289719] niks3-server[1014]: 2026/09/20 09:01:28 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5989lb # [ 121.305149] niks3-server[1014]: 2026/09/20 09:01:28 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst5990lb # [ 121.313794] niks3-server[1014]: 2026/09/20 09:01:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5991worker2 # [ 121.329766] nix-grpc-daemon[1442]: time=2026-09-20T09:01:27.556Z level=INFO msg="Uploading 1 narinfos"5992lb # [ 121.318772] niks3-server[1014]: 2026/09/20 09:01:28 INFO Signed narinfos id=42 count=15993lb # [ 121.323479] niks3-server[1014]: 2026/09/20 09:01:28 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls5994lb # [ 121.331115] niks3-server[1014]: 2026/09/20 09:01:28 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5995lb # [ 121.337129] niks3-server[1014]: 2026/09/20 09:01:28 INFO Completed upload id=425996worker2 # [ 121.348389] nix-grpc-daemon[1442]: time=2026-09-20T09:01:27.574Z level=INFO msg="Upload complete. (262ms)"5997lb # [ 121.339328] niks3-server[1014]: 2026/09/20 09:01:28 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo5998worker2 # [ 121.356168] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50932 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=15999worker2 # [ 121.363996] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:27Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06000worker2 # [ 121.368227] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:27Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=16001worker2 # [ 121.376226] nix-daemon[849]: reaped child process 1563, status = succeeded6002worker2 # [ 121.408459] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:509326003worker2 # [ 121.419941] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:509326004worker2 # [ 121.432273] nix-grpc-daemon[1442]: time=2026-09-20T09:01:27.658Z level=INFO msg="All 2 paths already cached"6005client # copying 1 paths to 'lb:50051'...6006client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6007worker2 # [ 121.439413] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:509326008worker2 # [ 121.447527] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6009worker2 # [ 121.587235] nix-daemon[849]: accepted connection from pid 1589, user nix-grpc-daemon (trusted)6010worker2 # [ 121.599686] nix-daemon[849]: reaped child process 1592, status = succeeded6011worker2 # [ 121.739827] nix-daemon[849]: accepted connection from pid 1594, user nix-grpc-daemon (trusted)6012worker2 # [ 121.751578] nix-daemon[849]: reaped child process 1597, status = succeeded6013lb # [ 121.749353] niks3-server[1014]: 2026/09/20 09:01:28 INFO Received uploads request method=POST path=/api/pending_closures6014worker2 # [ 121.767448] nix-grpc-daemon[1442]: time=2026-09-20T09:01:27.994Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6015worker2 # [ 121.768880] nix-grpc-daemon[1442]: time=2026-09-20T09:01:27.995Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6016lb # [ 121.779917] niks3-server[1014]: 2026/09/20 09:01:28 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6017lb # [ 121.788407] niks3-server[1014]: 2026/09/20 09:01:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6018worker2 # [ 121.804670] nix-grpc-daemon[1442]: time=2026-09-20T09:01:28.031Z level=INFO msg="Uploading 1 narinfos"6019lb # [ 121.793389] niks3-server[1014]: 2026/09/20 09:01:28 INFO Signed narinfos id=43 count=16020lb # [ 121.798978] niks3-server[1014]: 2026/09/20 09:01:28 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6021lb # [ 121.810415] niks3-server[1014]: 2026/09/20 09:01:28 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6022worker2 # [ 121.827569] nix-grpc-daemon[1442]: time=2026-09-20T09:01:28.054Z level=INFO msg="Upload complete. (367ms)"6023lb # [ 121.816417] niks3-server[1014]: 2026/09/20 09:01:28 INFO Completed upload id=436024worker2 # [ 121.829823] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50932 duration_s=0 paths=1 nar_bytes_in=7686025lb # [ 121.819966] niks3-server[1014]: 2026/09/20 09:01:28 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6026worker2 # [ 121.835307] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:509326027worker2 # [ 121.842536] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6028worker2 # [ 121.847770] nix-daemon[849]: reaped child process 1587, status = succeeded6029worker2 # [ 121.852515] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6030client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6031client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6032client # farm-top> LOG-farm-top-during-drain6033worker2 # [ 123.478781] nix-daemon[849]: reaped child process 1601, status = succeeded6034worker2 # [ 123.626139] nix-daemon[849]: accepted connection from pid 1616, user nix-grpc-daemon (trusted)6035worker2 # [ 123.638174] nix-daemon[849]: reaped child process 1619, status = succeeded6036lb # [ 123.643664] niks3-server[1014]: 2026/09/20 09:01:30 INFO Received uploads request method=POST path=/api/pending_closures6037worker2 # [ 123.662808] nix-grpc-daemon[1442]: time=2026-09-20T09:01:29.889Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6038worker2 # [ 123.664309] nix-grpc-daemon[1442]: time=2026-09-20T09:01:29.890Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6039lb # [ 123.681173] niks3-server[1014]: 2026/09/20 09:01:30 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6040lb # [ 123.688381] niks3-server[1014]: 2026/09/20 09:01:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6041lb # [ 123.693390] niks3-server[1014]: 2026/09/20 09:01:30 INFO Signed narinfos id=44 count=16042worker2 # [ 123.707549] nix-grpc-daemon[1442]: time=2026-09-20T09:01:29.933Z level=INFO msg="Uploading 1 narinfos"6043lb # [ 123.702168] niks3-server[1014]: 2026/09/20 09:01:30 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6044lb # [ 123.711247] niks3-server[1014]: 2026/09/20 09:01:30 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6045lb # [ 123.717207] niks3-server[1014]: 2026/09/20 09:01:30 INFO Completed upload id=446046worker2 # [ 123.728174] nix-grpc-daemon[1442]: time=2026-09-20T09:01:29.954Z level=INFO msg="Upload complete. (266ms)"6047lb # [ 123.720345] niks3-server[1014]: 2026/09/20 09:01:30 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6048lb # [ 123.724896] niks3-server[1014]: 2026/09/20 09:01:30 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6049worker2 # [ 123.734103] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50932 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16050worker2 # [ 123.745877] nix-daemon[849]: reaped child process 1599, status = succeeded6051client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 6.05 seconds)6052client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath6053client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.17 seconds)6054worker1: must succeed: pkill -f 'read -t [9]0 x'6055worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6056client: waiting for success: ! systemctl is-active sw6057worker1 # [ 124.089853] nix-daemon[846]: reaped child process 1662, status = succeeded6058worker1 # [ 124.264106] nix-daemon[846]: accepted connection from pid 1703, user nix-grpc-daemon (trusted)6059worker1 # [ 124.278336] nix-daemon[846]: reaped child process 1706, status = succeeded6060lb # [ 124.270260] niks3-server[1014]: 2026/09/20 09:01:31 INFO Received uploads request method=POST path=/api/pending_closures6061worker1 # [ 124.305545] nix-grpc-daemon[1606]: time=2026-09-20T09:01:30.511Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6062worker1 # [ 124.307954] nix-grpc-daemon[1606]: time=2026-09-20T09:01:30.513Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6063lb # [ 124.303372] niks3-server[1014]: 2026/09/20 09:01:31 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6064lb # [ 124.310550] niks3-server[1014]: 2026/09/20 09:01:31 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6065lb # [ 124.319840] niks3-server[1014]: 2026/09/20 09:01:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6066lb # [ 124.324095] niks3-server[1014]: 2026/09/20 09:01:31 INFO Signed narinfos id=45 count=16067worker1 # [ 124.350334] nix-grpc-daemon[1606]: time=2026-09-20T09:01:30.556Z level=INFO msg="Uploading 1 narinfos"6068lb # [ 124.327146] niks3-server[1014]: 2026/09/20 09:01:31 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6069lb # [ 124.333277] niks3-server[1014]: 2026/09/20 09:01:31 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6070lb # [ 124.335967] niks3-server[1014]: 2026/09/20 09:01:31 INFO Completed upload id=456071worker1 # [ 124.361747] nix-grpc-daemon[1606]: time=2026-09-20T09:01:30.568Z level=INFO msg="Upload complete. (281ms)"6072lb # [ 124.337835] niks3-server[1014]: 2026/09/20 09:01:31 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6073worker1 # [ 124.364587] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:52426 duration_s=8 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16074worker1 # [ 124.373173] nix-daemon[846]: reaped child process 1660, status = succeeded6075worker1 # [ 124.388208] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:30Z level=info event=signal_exit6076client # [ 124.366084] systemd[1]: sw.service: Deactivated successfully.6077client # [ 124.369798] systemd[1]: sw.service: Consumed 118ms CPU time over 9.302s wall clock time, 39.1M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic.6078client: (finished: waiting for success: ! systemctl is-active sw, in 1.08 seconds)6079client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6080client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)6081worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6082worker2 # [ 125.601423] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:31Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:509126083worker2 # [ 125.605097] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:31Z level=info event=worker_gone addr=192.168.1.3:500516084worker1 # [ 125.617469] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:31Z level=info event=scheduler_restarting6085worker1 # [ 125.629512] nix-grpc-daemon[1505]: ts=2026-09-20T09:01:31Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6086worker1 # [ 125.646807] nix-daemon[846]: reaped child process 1574, status = succeeded6087worker1 # [ 126.200074] nix-grpc-daemon[1505]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6088worker1 # [ 126.203567] nix-grpc-daemon[1505]: E0000 00:00:1789894892.405883 1548 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true6089worker1 # [ 126.208272] nix-grpc-daemon[1505]: E0000 00:00:1789894892.406271 1548 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6090worker1 # [ 126.427125] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6091worker1 # [ 126.430959] systemd[1]: nix-grpc-daemon.service: Consumed 680ms CPU time over 26.239s wall clock time, 32.6M memory peak, 20.7K incoming IP traffic, 27.2K outgoing IP traffic.6092worker1 # [ 126.446878] systemd[1]: Starting Nix worker-protocol over gRPC...6093worker1 # [ 126.619743] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:32Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6094worker1 # [ 126.623607] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:32Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16095worker1 # [ 126.629468] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:32Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6096worker1 # [ 126.633829] systemd[1]: Started Nix worker-protocol over gRPC.6097worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.51 seconds)6098lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6099lb: must succeed: curl -sf localhost:9901/clusters6100worker1 # [ 126.662795] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:32Z level=info event=scheduler_connected addr=lb:500516101worker2 # [ 126.651356] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:32Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06102lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6103lb: must succeed: curl -sf localhost:9901/clusters6104lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6105lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.12 seconds)6106lb: must succeed: curl -sf localhost:9901/clusters6107lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6108worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6109worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)6110(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 12.81 seconds)6111subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6112client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16113worker2 # [ 128.031405] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:509326114worker1 # [ 128.052464] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366586115worker1 # [ 128.063784] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6116worker1 # [ 128.079927] nix-grpc-daemon[1720]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 1/5)6117worker1 # [ 128.087711] nix-grpc-daemon[1720]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 51 ms (attempt 2/5)6118worker1 # [ 128.144526] nix-grpc-daemon[1720]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 3/5)6119worker1 # [ 128.290360] nix-grpc-daemon[1720]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 236 ms (attempt 4/5)6120worker1 # [ 128.532677] nix-grpc-daemon[1720]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6121worker2 # [ 128.553950] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:34Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06122worker2 # [ 128.558293] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:34Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16123worker2 # [ 128.562566] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:34Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06124worker2 # [ 128.566475] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:34Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06125worker1 # [ 128.611626] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586126worker1 # [ 128.622615] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366586127worker1 # [ 128.634545] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366586128worker1 # [ 128.644123] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6129worker1 # [ 128.663967] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:34Z level=info event=niks3_push_started pid=17766130worker1 # [ 129.015656] nix-daemon[846]: accepted connection from pid 1789, user nix-grpc-daemon (trusted)6131worker1 # [ 129.026137] nix-daemon[846]: reaped child process 1792, status = succeeded6132worker1 # [ 129.199836] nix-daemon[846]: accepted connection from pid 1794, user nix-grpc-daemon (trusted)6133worker1 # [ 129.211275] nix-daemon[846]: reaped child process 1797, status = succeeded6134lb # [ 129.201886] niks3-server[1014]: 2026/09/20 09:01:36 INFO Received uploads request method=POST path=/api/pending_closures6135worker1 # [ 129.234307] nix-grpc-daemon[1776]: time=2026-09-20T09:01:35.439Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6136worker1 # [ 129.236220] nix-grpc-daemon[1776]: time=2026-09-20T09:01:35.439Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6137lb # [ 129.223619] niks3-server[1014]: 2026/09/20 09:01:36 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6138lb # [ 129.226956] niks3-server[1014]: 2026/09/20 09:01:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6139lb # [ 129.230673] niks3-server[1014]: 2026/09/20 09:01:36 INFO Signed narinfos id=46 count=16140worker1 # [ 129.256729] nix-grpc-daemon[1776]: time=2026-09-20T09:01:35.462Z level=INFO msg="Uploading 1 narinfos"6141lb # [ 129.235063] niks3-server[1014]: 2026/09/20 09:01:36 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6142lb # [ 129.239161] niks3-server[1014]: 2026/09/20 09:01:36 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6143lb # [ 129.242082] niks3-server[1014]: 2026/09/20 09:01:36 INFO Completed upload id=466144worker1 # [ 129.267942] nix-grpc-daemon[1776]: time=2026-09-20T09:01:35.474Z level=INFO msg="Upload complete. (414ms)"6145lb # [ 129.244678] niks3-server[1014]: 2026/09/20 09:01:36 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6146worker1 # [ 129.271266] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=0 paths=1 nar_bytes_in=5046147worker1 # [ 129.273891] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586148worker1 # [ 129.279981] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6149worker1 # [ 129.282257] nix-daemon[846]: reaped child process 1774, status = succeeded6150worker1 # [ 129.287262] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6151lb # [ 129.600995] envoy[931]: conn peer=[2001:db8:1::1]:52298 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9585 tx=3827 ms=58166152lb # [ 129.604865] envoy[931]: conn peer=[2001:db8:1::1]:52290 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2932 tx=1308 ms=90586153lb # [ 129.608313] envoy[931]: conn peer=[2001:db8:1::3]:37172 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1114 tx=448 ms=252166154worker1 # [ 130.111465] nix-daemon[846]: reaped child process 1801, status = succeeded6155worker1 # [ 130.274156] nix-daemon[846]: accepted connection from pid 1816, user nix-grpc-daemon (trusted)6156worker1 # [ 130.284600] nix-daemon[846]: reaped child process 1819, status = succeeded6157lb # [ 130.271043] niks3-server[1014]: 2026/09/20 09:01:37 INFO Received uploads request method=POST path=/api/pending_closures6158worker1 # [ 130.302423] nix-grpc-daemon[1776]: time=2026-09-20T09:01:36.508Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6159worker1 # [ 130.305125] nix-grpc-daemon[1776]: time=2026-09-20T09:01:36.510Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6160lb # [ 130.290391] niks3-server[1014]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6161lb # [ 130.296351] niks3-server[1014]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6162lb # [ 130.300052] niks3-server[1014]: 2026/09/20 09:01:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6163lb # [ 130.301875] niks3-server[1014]: 2026/09/20 09:01:37 INFO Signed narinfos id=47 count=16164worker1 # [ 130.328250] nix-grpc-daemon[1776]: time=2026-09-20T09:01:36.534Z level=INFO msg="Uploading 1 narinfos"6165lb # [ 130.306615] niks3-server[1014]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6166lb # [ 130.310102] niks3-server[1014]: 2026/09/20 09:01:37 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6167lb # [ 130.312837] niks3-server[1014]: 2026/09/20 09:01:37 INFO Completed upload id=476168worker1 # [ 130.338616] nix-grpc-daemon[1776]: time=2026-09-20T09:01:36.544Z level=INFO msg="Upload complete. (244ms)"6169lb # [ 130.315476] niks3-server[1014]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6170worker1 # [ 130.342174] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=7 outputs=16171worker2 # [ 130.327755] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:36Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16172worker1 # [ 130.347757] nix-daemon[846]: reaped child process 1799, status = succeeded6173worker1 # [ 130.349262] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586174worker2 # [ 130.336845] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:36Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06175worker1 # [ 130.355269] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366586176worker1 # [ 130.360546] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366586177worker1 # [ 130.365482] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6178worker1 # [ 130.518990] nix-daemon[846]: accepted connection from pid 1823, user nix-grpc-daemon (trusted)6179worker1 # [ 130.530588] nix-daemon[846]: reaped child process 1826, status = succeeded6180worker1 # [ 130.704548] nix-daemon[846]: accepted connection from pid 1828, user nix-grpc-daemon (trusted)6181worker1 # [ 130.715881] nix-daemon[846]: reaped child process 1831, status = succeeded6182lb # [ 130.707327] niks3-server[1014]: 2026/09/20 09:01:37 INFO Received uploads request method=POST path=/api/pending_closures6183worker1 # [ 130.740285] nix-grpc-daemon[1776]: time=2026-09-20T09:01:36.946Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6184worker1 # [ 130.741637] nix-grpc-daemon[1776]: time=2026-09-20T09:01:36.946Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6185lb # [ 130.732798] niks3-server[1014]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6186lb # [ 130.742560] niks3-server[1014]: 2026/09/20 09:01:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6187lb # [ 130.747123] niks3-server[1014]: 2026/09/20 09:01:37 INFO Signed narinfos id=48 count=16188worker1 # [ 130.775870] nix-grpc-daemon[1776]: time=2026-09-20T09:01:36.982Z level=INFO msg="Uploading 1 narinfos"6189lb # [ 130.753656] niks3-server[1014]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6190lb # [ 130.763326] niks3-server[1014]: 2026/09/20 09:01:37 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6191worker1 # [ 130.793569] nix-grpc-daemon[1776]: time=2026-09-20T09:01:36.999Z level=INFO msg="Upload complete. (423ms)"6192lb # [ 130.767819] niks3-server[1014]: 2026/09/20 09:01:37 INFO Completed upload id=486193worker1 # [ 130.795932] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=0 paths=1 nar_bytes_in=5046194lb # [ 130.772806] niks3-server[1014]: 2026/09/20 09:01:37 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6195worker1 # [ 130.801260] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586196worker1 # [ 130.809042] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6197worker1 # [ 130.811344] nix-daemon[846]: reaped child process 1821, status = succeeded6198worker1 # [ 130.816616] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6199worker1 # [ 131.842326] nix-daemon[846]: reaped child process 1835, status = succeeded6200worker1 # [ 132.001672] nix-daemon[846]: accepted connection from pid 1850, user nix-grpc-daemon (trusted)6201worker1 # [ 132.012385] nix-daemon[846]: reaped child process 1853, status = succeeded6202lb # [ 132.003719] niks3-server[1014]: 2026/09/20 09:01:39 INFO Received uploads request method=POST path=/api/pending_closures6203worker1 # [ 132.037643] nix-grpc-daemon[1776]: time=2026-09-20T09:01:38.243Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6204worker1 # [ 132.039226] nix-grpc-daemon[1776]: time=2026-09-20T09:01:38.245Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6205lb # [ 132.044170] niks3-server[1014]: 2026/09/20 09:01:39 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6206lb # [ 132.049293] niks3-server[1014]: 2026/09/20 09:01:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6207worker1 # [ 132.080472] nix-grpc-daemon[1776]: time=2026-09-20T09:01:38.286Z level=INFO msg="Uploading 1 narinfos"6208lb # [ 132.056138] niks3-server[1014]: 2026/09/20 09:01:39 INFO Signed narinfos id=49 count=16209lb # [ 132.063793] niks3-server[1014]: 2026/09/20 09:01:39 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6210lb # [ 132.069872] niks3-server[1014]: 2026/09/20 09:01:39 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6211lb # [ 132.077943] niks3-server[1014]: 2026/09/20 09:01:39 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6212lb # [ 132.083374] niks3-server[1014]: 2026/09/20 09:01:39 INFO Completed upload id=496213worker1 # [ 132.108611] nix-grpc-daemon[1776]: time=2026-09-20T09:01:38.314Z level=INFO msg="Upload complete. (285ms)"6214lb # [ 132.088716] niks3-server[1014]: 2026/09/20 09:01:39 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6215worker2 # [ 132.098952] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:38Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16216worker1 # [ 132.113499] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=8 outputs=16217worker2 # [ 132.105196] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:38Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06218worker1 # [ 132.120257] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586219worker1 # [ 132.131924] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366586220worker1 # [ 132.134948] nix-daemon[846]: reaped child process 1833, status = succeeded6221worker1 # [ 132.138812] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366586222worker1 # [ 132.142526] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6223worker1 # [ 132.301059] nix-daemon[846]: accepted connection from pid 1857, user nix-grpc-daemon (trusted)6224worker1 # [ 132.311596] nix-daemon[846]: reaped child process 1860, status = succeeded6225worker1 # [ 132.482456] nix-daemon[846]: accepted connection from pid 1862, user nix-grpc-daemon (trusted)6226worker1 # [ 132.493784] nix-daemon[846]: reaped child process 1865, status = succeeded6227lb # [ 132.486131] niks3-server[1014]: 2026/09/20 09:01:39 INFO Received uploads request method=POST path=/api/pending_closures6228worker1 # [ 132.519256] nix-grpc-daemon[1776]: time=2026-09-20T09:01:38.725Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6229worker1 # [ 132.521155] nix-grpc-daemon[1776]: time=2026-09-20T09:01:38.727Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6230lb # [ 132.512371] niks3-server[1014]: 2026/09/20 09:01:39 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6231lb # [ 132.521203] niks3-server[1014]: 2026/09/20 09:01:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6232lb # [ 132.525492] niks3-server[1014]: 2026/09/20 09:01:39 INFO Signed narinfos id=50 count=16233worker1 # [ 132.554216] nix-grpc-daemon[1776]: time=2026-09-20T09:01:38.760Z level=INFO msg="Uploading 1 narinfos"6234lb # [ 132.535148] niks3-server[1014]: 2026/09/20 09:01:39 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6235lb # [ 132.543806] niks3-server[1014]: 2026/09/20 09:01:39 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6236worker1 # [ 132.575221] nix-grpc-daemon[1776]: time=2026-09-20T09:01:38.781Z level=INFO msg="Upload complete. (427ms)"6237lb # [ 132.549722] niks3-server[1014]: 2026/09/20 09:01:39 INFO Completed upload id=506238worker1 # [ 132.577196] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=0 paths=1 nar_bytes_in=5046239lb # [ 132.552885] niks3-server[1014]: 2026/09/20 09:01:39 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6240worker1 # [ 132.583413] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586241worker1 # [ 132.587473] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6242worker1 # [ 132.589953] nix-daemon[846]: reaped child process 1855, status = succeeded6243worker1 # [ 132.595326] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6244worker1 # [ 133.415500] nix-daemon[846]: reaped child process 1869, status = succeeded6245worker1 # [ 133.552483] nix-daemon[846]: accepted connection from pid 1884, user nix-grpc-daemon (trusted)6246worker1 # [ 133.564384] nix-daemon[846]: reaped child process 1887, status = succeeded6247lb # [ 133.555330] niks3-server[1014]: 2026/09/20 09:01:40 INFO Received uploads request method=POST path=/api/pending_closures6248worker1 # [ 133.588709] nix-grpc-daemon[1776]: time=2026-09-20T09:01:39.794Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6249worker1 # [ 133.590228] nix-grpc-daemon[1776]: time=2026-09-20T09:01:39.796Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6250lb # [ 133.585444] niks3-server[1014]: 2026/09/20 09:01:40 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6251lb # [ 133.599154] niks3-server[1014]: 2026/09/20 09:01:40 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6252lb # [ 133.609971] niks3-server[1014]: 2026/09/20 09:01:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6253lb # [ 133.614342] niks3-server[1014]: 2026/09/20 09:01:40 INFO Signed narinfos id=51 count=16254worker1 # [ 133.642702] nix-grpc-daemon[1776]: time=2026-09-20T09:01:39.849Z level=INFO msg="Uploading 1 narinfos"6255lb # [ 133.618992] niks3-server[1014]: 2026/09/20 09:01:40 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6256lb # [ 133.628450] niks3-server[1014]: 2026/09/20 09:01:40 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6257lb # [ 133.634566] niks3-server[1014]: 2026/09/20 09:01:40 INFO Completed upload id=516258worker1 # [ 133.660364] nix-grpc-daemon[1776]: time=2026-09-20T09:01:39.866Z level=INFO msg="Upload complete. (258ms)"6259lb # [ 133.638914] niks3-server[1014]: 2026/09/20 09:01:40 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6260worker1 # [ 133.665768] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=9 outputs=16261worker2 # [ 133.651483] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:39Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16262worker1 # [ 133.675263] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586263worker2 # [ 133.661354] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:39Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06264worker1 # [ 133.684583] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366586265worker1 # [ 133.691453] nix-daemon[846]: reaped child process 1867, status = succeeded6266worker1 # [ 133.694187] nix-grpc-daemon[1776]: time=2026-09-20T09:01:39.900Z level=INFO msg="All 1 paths already cached"6267worker1 # [ 133.697968] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366586268worker1 # [ 133.701715] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6269worker1 # [ 133.856120] nix-daemon[846]: accepted connection from pid 1891, user nix-grpc-daemon (trusted)6270worker1 # [ 133.870378] nix-daemon[846]: reaped child process 1894, status = succeeded6271worker1 # [ 134.027195] nix-daemon[846]: accepted connection from pid 1896, user nix-grpc-daemon (trusted)6272worker1 # [ 134.041284] nix-daemon[846]: reaped child process 1899, status = succeeded6273lb # [ 134.030733] niks3-server[1014]: 2026/09/20 09:01:41 INFO Received uploads request method=POST path=/api/pending_closures6274worker1 # [ 134.064052] nix-grpc-daemon[1776]: time=2026-09-20T09:01:40.270Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6275worker1 # [ 134.065701] nix-grpc-daemon[1776]: time=2026-09-20T09:01:40.272Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6276lb # [ 134.061168] niks3-server[1014]: 2026/09/20 09:01:41 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6277lb # [ 134.068779] niks3-server[1014]: 2026/09/20 09:01:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6278lb # [ 134.075111] niks3-server[1014]: 2026/09/20 09:01:41 INFO Signed narinfos id=52 count=16279worker1 # [ 134.103827] nix-grpc-daemon[1776]: time=2026-09-20T09:01:40.310Z level=INFO msg="Uploading 1 narinfos"6280lb # [ 134.081779] niks3-server[1014]: 2026/09/20 09:01:41 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6281lb # [ 134.094347] niks3-server[1014]: 2026/09/20 09:01:41 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6282lb # [ 134.099437] niks3-server[1014]: 2026/09/20 09:01:41 INFO Completed upload id=526283worker1 # [ 134.125414] nix-grpc-daemon[1776]: time=2026-09-20T09:01:40.331Z level=INFO msg="Upload complete. (418ms)"6284lb # [ 134.101681] niks3-server[1014]: 2026/09/20 09:01:41 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6285worker1 # [ 134.129201] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=0 paths=1 nar_bytes_in=6246286worker1 # [ 134.134587] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586287worker1 # [ 134.143275] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6288worker1 # [ 134.149411] nix-daemon[846]: reaped child process 1889, status = succeeded6289worker1 # [ 134.155139] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6290worker1 # [ 135.182443] nix-daemon[846]: reaped child process 1903, status = succeeded6291worker1 # [ 135.337668] nix-daemon[846]: accepted connection from pid 1918, user nix-grpc-daemon (trusted)6292worker1 # [ 135.351645] nix-daemon[846]: reaped child process 1921, status = succeeded6293lb # [ 135.341794] niks3-server[1014]: 2026/09/20 09:01:42 INFO Received uploads request method=POST path=/api/pending_closures6294worker1 # [ 135.372276] nix-grpc-daemon[1776]: time=2026-09-20T09:01:41.578Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6295worker1 # [ 135.373814] nix-grpc-daemon[1776]: time=2026-09-20T09:01:41.580Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6296lb # [ 135.365096] niks3-server[1014]: 2026/09/20 09:01:42 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6297lb # [ 135.368862] niks3-server[1014]: 2026/09/20 09:01:42 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6298lb # [ 135.371828] niks3-server[1014]: 2026/09/20 09:01:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6299lb # [ 135.374769] niks3-server[1014]: 2026/09/20 09:01:42 INFO Signed narinfos id=53 count=16300worker1 # [ 135.400426] nix-grpc-daemon[1776]: time=2026-09-20T09:01:41.606Z level=INFO msg="Uploading 1 narinfos"6301lb # [ 135.377670] niks3-server[1014]: 2026/09/20 09:01:42 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6302lb # [ 135.381904] niks3-server[1014]: 2026/09/20 09:01:42 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6303lb # [ 135.385571] niks3-server[1014]: 2026/09/20 09:01:42 INFO Completed upload id=536304worker1 # [ 135.411325] nix-grpc-daemon[1776]: time=2026-09-20T09:01:41.617Z level=INFO msg="Upload complete. (248ms)"6305lb # [ 135.388699] niks3-server[1014]: 2026/09/20 09:01:42 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6306worker1 # [ 135.414452] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=10 outputs=16307worker2 # [ 135.401196] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:41Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16308worker1 # [ 135.422325] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586309worker1 # [ 135.424319] nix-daemon[846]: reaped child process 1901, status = succeeded6310worker2 # [ 135.410910] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:41Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06311worker1 # [ 135.429561] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:41Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366586312worker1 # [ 135.435566] nix-grpc-daemon[1776]: time=2026-09-20T09:01:41.641Z level=INFO msg="All 1 paths already cached"6313worker1 # [ 135.438726] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:41Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366586314worker1 # [ 135.442558] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6315worker1 # [ 135.595229] nix-daemon[846]: accepted connection from pid 1925, user nix-grpc-daemon (trusted)6316worker1 # [ 135.609146] nix-daemon[846]: reaped child process 1928, status = succeeded6317worker1 # [ 135.775227] nix-daemon[846]: accepted connection from pid 1930, user nix-grpc-daemon (trusted)6318worker1 # [ 135.789089] nix-daemon[846]: reaped child process 1933, status = succeeded6319lb # [ 135.779349] niks3-server[1014]: 2026/09/20 09:01:42 INFO Received uploads request method=POST path=/api/pending_closures6320worker1 # [ 135.813028] nix-grpc-daemon[1776]: time=2026-09-20T09:01:42.019Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6321worker1 # [ 135.814731] nix-grpc-daemon[1776]: time=2026-09-20T09:01:42.021Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6322lb # [ 135.809795] niks3-server[1014]: 2026/09/20 09:01:42 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6323lb # [ 135.820246] niks3-server[1014]: 2026/09/20 09:01:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6324worker1 # [ 135.850842] nix-grpc-daemon[1776]: time=2026-09-20T09:01:42.057Z level=INFO msg="Uploading 1 narinfos"6325lb # [ 135.825588] niks3-server[1014]: 2026/09/20 09:01:42 INFO Signed narinfos id=54 count=16326lb # [ 135.829700] niks3-server[1014]: 2026/09/20 09:01:42 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6327lb # [ 135.840759] niks3-server[1014]: 2026/09/20 09:01:42 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6328lb # [ 135.846152] niks3-server[1014]: 2026/09/20 09:01:42 INFO Completed upload id=546329worker1 # [ 135.873169] nix-grpc-daemon[1776]: time=2026-09-20T09:01:42.079Z level=INFO msg="Upload complete. (424ms)"6330lb # [ 135.847487] niks3-server[1014]: 2026/09/20 09:01:42 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6331worker1 # [ 135.875552] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=0 paths=1 nar_bytes_in=6246332worker1 # [ 135.878308] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586333worker1 # [ 135.885909] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6334worker1 # [ 135.890357] nix-daemon[846]: reaped child process 1923, status = succeeded6335worker1 # [ 135.895164] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6336worker1 # [ 136.919395] nix-daemon[846]: reaped child process 1937, status = succeeded6337worker1 # [ 137.064947] nix-daemon[846]: accepted connection from pid 1952, user nix-grpc-daemon (trusted)6338worker1 # [ 137.079221] nix-daemon[846]: reaped child process 1955, status = succeeded6339lb # [ 137.070435] niks3-server[1014]: 2026/09/20 09:01:44 INFO Received uploads request method=POST path=/api/pending_closures6340worker1 # [ 137.104943] nix-grpc-daemon[1776]: time=2026-09-20T09:01:43.311Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6341worker1 # [ 137.106543] nix-grpc-daemon[1776]: time=2026-09-20T09:01:43.312Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6342lb # [ 137.106062] niks3-server[1014]: 2026/09/20 09:01:44 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6343lb # [ 137.115615] niks3-server[1014]: 2026/09/20 09:01:44 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6344lb # [ 137.127646] niks3-server[1014]: 2026/09/20 09:01:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6345lb # [ 137.133358] niks3-server[1014]: 2026/09/20 09:01:44 INFO Signed narinfos id=55 count=16346worker1 # [ 137.162477] nix-grpc-daemon[1776]: time=2026-09-20T09:01:43.368Z level=INFO msg="Uploading 1 narinfos"6347lb # [ 137.139578] niks3-server[1014]: 2026/09/20 09:01:44 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6348lb # [ 137.152398] niks3-server[1014]: 2026/09/20 09:01:44 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6349lb # [ 137.155711] niks3-server[1014]: 2026/09/20 09:01:44 INFO Completed upload id=556350worker1 # [ 137.183175] nix-grpc-daemon[1776]: time=2026-09-20T09:01:43.387Z level=WARN msg="Failed to register uploaded object" key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo error="server returned 404: object is not pending upload\n"6351worker2 # [ 137.170835] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:43Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16352worker1 # [ 137.194256] nix-grpc-daemon[1776]: time=2026-09-20T09:01:43.388Z level=INFO msg="Upload complete. (279ms)"6353worker2 # [ 137.183969] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:43Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06354worker1 # [ 137.197905] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:43Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=11 outputs=16355worker1 # [ 137.203832] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586356worker1 # [ 137.216703] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366586357worker1 # [ 137.219109] nix-daemon[846]: reaped child process 1935, status = succeeded6358worker1 # [ 137.224193] nix-grpc-daemon[1776]: time=2026-09-20T09:01:43.430Z level=INFO msg="All 1 paths already cached"6359worker1 # [ 137.228440] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366586360worker1 # [ 137.232424] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6361worker1 # [ 137.394497] nix-daemon[846]: accepted connection from pid 1960, user nix-grpc-daemon (trusted)6362worker1 # [ 137.408706] nix-daemon[846]: reaped child process 1963, status = succeeded6363worker1 # [ 137.577536] nix-daemon[846]: accepted connection from pid 1965, user nix-grpc-daemon (trusted)6364worker1 # [ 137.591631] nix-daemon[846]: reaped child process 1968, status = succeeded6365lb # [ 137.581453] niks3-server[1014]: 2026/09/20 09:01:44 INFO Received uploads request method=POST path=/api/pending_closures6366worker1 # [ 137.615372] nix-grpc-daemon[1776]: time=2026-09-20T09:01:43.821Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6367worker1 # [ 137.616984] nix-grpc-daemon[1776]: time=2026-09-20T09:01:43.823Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6368lb # [ 137.610520] niks3-server[1014]: 2026/09/20 09:01:44 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6369lb # [ 137.621823] niks3-server[1014]: 2026/09/20 09:01:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6370worker1 # [ 137.652396] nix-grpc-daemon[1776]: time=2026-09-20T09:01:43.858Z level=INFO msg="Uploading 1 narinfos"6371lb # [ 137.627158] niks3-server[1014]: 2026/09/20 09:01:44 INFO Signed narinfos id=56 count=16372lb # [ 137.632795] niks3-server[1014]: 2026/09/20 09:01:44 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6373lb # [ 137.644529] niks3-server[1014]: 2026/09/20 09:01:44 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6374lb # [ 137.649297] niks3-server[1014]: 2026/09/20 09:01:44 INFO Completed upload id=566375worker1 # [ 137.675036] nix-grpc-daemon[1776]: time=2026-09-20T09:01:43.881Z level=INFO msg="Upload complete. (436ms)"6376lb # [ 137.651708] niks3-server[1014]: 2026/09/20 09:01:44 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6377worker1 # [ 137.678599] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=0 paths=1 nar_bytes_in=6246378worker1 # [ 137.683491] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586379worker1 # [ 137.691269] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6380worker1 # [ 137.699625] nix-daemon[846]: reaped child process 1958, status = succeeded6381worker1 # [ 137.702800] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6382worker1 # [ 138.519576] nix-daemon[846]: reaped child process 1972, status = succeeded6383worker1 # [ 138.651457] nix-daemon[846]: accepted connection from pid 1987, user nix-grpc-daemon (trusted)6384worker1 # [ 138.666082] nix-daemon[846]: reaped child process 1990, status = succeeded6385lb # [ 138.658837] niks3-server[1014]: 2026/09/20 09:01:45 INFO Received uploads request method=POST path=/api/pending_closures6386worker1 # [ 138.690627] nix-grpc-daemon[1776]: time=2026-09-20T09:01:44.896Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6387worker1 # [ 138.692293] nix-grpc-daemon[1776]: time=2026-09-20T09:01:44.898Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6388lb # [ 138.699160] niks3-server[1014]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6389lb # [ 138.704442] niks3-server[1014]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6390lb # [ 138.714093] niks3-server[1014]: 2026/09/20 09:01:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6391worker1 # [ 138.746451] nix-grpc-daemon[1776]: time=2026-09-20T09:01:44.952Z level=INFO msg="Uploading 1 narinfos"6392lb # [ 138.720584] niks3-server[1014]: 2026/09/20 09:01:45 INFO Signed narinfos id=57 count=16393lb # [ 138.724255] niks3-server[1014]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6394lb # [ 138.733465] niks3-server[1014]: 2026/09/20 09:01:45 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6395lb # [ 138.738842] niks3-server[1014]: 2026/09/20 09:01:45 INFO Completed upload id=576396worker1 # [ 138.764757] nix-grpc-daemon[1776]: time=2026-09-20T09:01:44.971Z level=INFO msg="Upload complete. (254ms)"6397lb # [ 138.743482] niks3-server[1014]: 2026/09/20 09:01:45 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6398worker2 # [ 138.755707] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:44Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16399worker1 # [ 138.769770] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=12 outputs=16400worker1 # [ 138.778279] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586401worker2 # [ 138.765370] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:44Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06402worker1 # [ 138.788538] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366586403worker1 # [ 138.792153] nix-daemon[846]: reaped child process 1970, status = succeeded6404worker1 # [ 138.796511] nix-grpc-daemon[1776]: time=2026-09-20T09:01:45.002Z level=INFO msg="All 2 paths already cached"6405worker1 # [ 138.800496] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366586406worker1 # [ 138.804600] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6407worker1 # [ 138.965446] nix-daemon[846]: accepted connection from pid 1994, user nix-grpc-daemon (trusted)6408worker1 # [ 138.979598] nix-daemon[846]: reaped child process 1997, status = succeeded6409worker1 # [ 139.149205] nix-daemon[846]: accepted connection from pid 1999, user nix-grpc-daemon (trusted)6410worker1 # [ 139.163083] nix-daemon[846]: reaped child process 2002, status = succeeded6411lb # [ 139.153803] niks3-server[1014]: 2026/09/20 09:01:46 INFO Received uploads request method=POST path=/api/pending_closures6412worker1 # [ 139.188032] nix-grpc-daemon[1776]: time=2026-09-20T09:01:45.394Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6413worker1 # [ 139.189499] nix-grpc-daemon[1776]: time=2026-09-20T09:01:45.394Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6414lb # [ 139.182684] niks3-server[1014]: 2026/09/20 09:01:46 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6415lb # [ 139.187558] niks3-server[1014]: 2026/09/20 09:01:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6416worker1 # [ 139.220603] nix-grpc-daemon[1776]: time=2026-09-20T09:01:45.426Z level=INFO msg="Uploading 1 narinfos"6417lb # [ 139.194709] niks3-server[1014]: 2026/09/20 09:01:46 INFO Signed narinfos id=58 count=16418lb # [ 139.201837] niks3-server[1014]: 2026/09/20 09:01:46 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6419lb # [ 139.213323] niks3-server[1014]: 2026/09/20 09:01:46 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6420worker1 # [ 139.244871] nix-grpc-daemon[1776]: time=2026-09-20T09:01:45.451Z level=INFO msg="Upload complete. (433ms)"6421lb # [ 139.219426] niks3-server[1014]: 2026/09/20 09:01:46 INFO Completed upload id=586422worker1 # [ 139.248132] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=0 paths=1 nar_bytes_in=7526423lb # [ 139.223213] niks3-server[1014]: 2026/09/20 09:01:46 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6424worker1 # [ 139.253967] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586425worker1 # [ 139.261801] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6426worker1 # [ 139.267905] nix-daemon[846]: reaped child process 1992, status = succeeded6427worker1 # [ 139.274217] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6428worker1 # [ 140.101400] nix-daemon[846]: reaped child process 2006, status = succeeded6429worker1 # [ 140.242151] nix-daemon[846]: accepted connection from pid 2021, user nix-grpc-daemon (trusted)6430worker1 # [ 140.256514] nix-daemon[846]: reaped child process 2024, status = succeeded6431lb # [ 140.246582] niks3-server[1014]: 2026/09/20 09:01:47 INFO Received uploads request method=POST path=/api/pending_closures6432worker1 # [ 140.280997] nix-grpc-daemon[1776]: time=2026-09-20T09:01:46.487Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6433worker1 # [ 140.282672] nix-grpc-daemon[1776]: time=2026-09-20T09:01:46.489Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6434lb # [ 140.289693] niks3-server[1014]: 2026/09/20 09:01:47 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6435lb # [ 140.296618] niks3-server[1014]: 2026/09/20 09:01:47 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6436lb # [ 140.309618] niks3-server[1014]: 2026/09/20 09:01:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6437lb # [ 140.314464] niks3-server[1014]: 2026/09/20 09:01:47 INFO Signed narinfos id=59 count=16438worker1 # [ 140.343057] nix-grpc-daemon[1776]: time=2026-09-20T09:01:46.549Z level=INFO msg="Uploading 1 narinfos"6439lb # [ 140.319667] niks3-server[1014]: 2026/09/20 09:01:47 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6440lb # [ 140.328723] niks3-server[1014]: 2026/09/20 09:01:47 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6441lb # [ 140.331488] niks3-server[1014]: 2026/09/20 09:01:47 INFO Completed upload id=596442worker1 # [ 140.357488] nix-grpc-daemon[1776]: time=2026-09-20T09:01:46.563Z level=INFO msg="Upload complete. (277ms)"6443lb # [ 140.333884] niks3-server[1014]: 2026/09/20 09:01:47 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6444worker2 # [ 140.348504] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:46Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16445worker1 # [ 140.365563] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=13 outputs=16446worker1 # [ 140.377462] nix-daemon[846]: reaped child process 2004, status = succeeded6447worker1 # [ 140.407518] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586448worker1 # [ 140.419988] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366586449worker1 # [ 140.433427] nix-grpc-daemon[1776]: time=2026-09-20T09:01:46.639Z level=INFO msg="All 2 paths already cached"6450worker1 # [ 140.441992] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366586451worker1 # [ 140.450978] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6452worker1 # [ 140.613215] nix-daemon[846]: accepted connection from pid 2028, user nix-grpc-daemon (trusted)6453worker1 # [ 140.629135] nix-daemon[846]: reaped child process 2031, status = succeeded6454worker1 # [ 140.786172] nix-daemon[846]: accepted connection from pid 2033, user nix-grpc-daemon (trusted)6455worker1 # [ 140.799977] nix-daemon[846]: reaped child process 2036, status = succeeded6456lb # [ 140.789139] niks3-server[1014]: 2026/09/20 09:01:47 INFO Received uploads request method=POST path=/api/pending_closures6457worker1 # [ 140.819138] nix-grpc-daemon[1776]: time=2026-09-20T09:01:47.025Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6458worker1 # [ 140.821091] nix-grpc-daemon[1776]: time=2026-09-20T09:01:47.027Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6459lb # [ 140.803799] niks3-server[1014]: 2026/09/20 09:01:47 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6460lb # [ 140.807113] niks3-server[1014]: 2026/09/20 09:01:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6461lb # [ 140.808782] niks3-server[1014]: 2026/09/20 09:01:47 INFO Signed narinfos id=60 count=16462worker1 # [ 140.835882] nix-grpc-daemon[1776]: time=2026-09-20T09:01:47.042Z level=INFO msg="Uploading 1 narinfos"6463lb # [ 140.814372] niks3-server[1014]: 2026/09/20 09:01:47 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6464lb # [ 140.817030] niks3-server[1014]: 2026/09/20 09:01:47 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6465lb # [ 140.820554] niks3-server[1014]: 2026/09/20 09:01:47 INFO Completed upload id=606466worker1 # [ 140.846168] nix-grpc-daemon[1776]: time=2026-09-20T09:01:47.052Z level=INFO msg="Upload complete. (382ms)"6467lb # [ 140.822149] niks3-server[1014]: 2026/09/20 09:01:47 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6468worker1 # [ 140.848320] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=0 paths=1 nar_bytes_in=7526469worker1 # [ 140.852510] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586470worker1 # [ 140.859289] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6471worker1 # [ 140.861689] nix-daemon[846]: reaped child process 2026, status = succeeded6472worker1 # [ 140.867097] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6473worker1 # [ 142.082696] nix-daemon[846]: reaped child process 2040, status = succeeded6474worker1 # [ 142.227133] nix-daemon[846]: accepted connection from pid 2055, user nix-grpc-daemon (trusted)6475worker1 # [ 142.241438] nix-daemon[846]: reaped child process 2058, status = succeeded6476lb # [ 142.230420] niks3-server[1014]: 2026/09/20 09:01:49 INFO Received uploads request method=POST path=/api/pending_closures6477worker1 # [ 142.265279] nix-grpc-daemon[1776]: time=2026-09-20T09:01:48.470Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6478worker1 # [ 142.266774] nix-grpc-daemon[1776]: time=2026-09-20T09:01:48.470Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6479lb # [ 142.265330] niks3-server[1014]: 2026/09/20 09:01:49 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6480lb # [ 142.269863] niks3-server[1014]: 2026/09/20 09:01:49 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6481lb # [ 142.282803] niks3-server[1014]: 2026/09/20 09:01:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6482lb # [ 142.286655] niks3-server[1014]: 2026/09/20 09:01:49 INFO Signed narinfos id=61 count=16483worker1 # [ 142.315593] nix-grpc-daemon[1776]: time=2026-09-20T09:01:48.521Z level=INFO msg="Uploading 1 narinfos"6484lb # [ 142.298423] niks3-server[1014]: 2026/09/20 09:01:49 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6485lb # [ 142.305189] niks3-server[1014]: 2026/09/20 09:01:49 INFO Completed upload id=616486lb # [ 142.306416] niks3-server[1014]: 2026/09/20 09:01:49 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6487worker1 # [ 142.331202] nix-grpc-daemon[1776]: time=2026-09-20T09:01:48.537Z level=INFO msg="Upload complete. (256ms)"6488worker2 # [ 142.321915] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:48Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16489worker1 # [ 142.339514] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=14 outputs=16490worker1 # [ 142.345172] nix-grpc-daemon[1776]: time=2026-09-20T09:01:48.545Z level=WARN msg="Failed to register uploaded object" key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo error="server returned 404: object is not pending upload\n"6491worker1 # [ 142.356661] nix-daemon[846]: reaped child process 2038, status = succeeded6492worker1 # [ 142.380143] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586493worker1 # [ 142.388616] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366586494worker1 # [ 142.400951] nix-grpc-daemon[1776]: time=2026-09-20T09:01:48.607Z level=INFO msg="All 2 paths already cached"6495worker1 # [ 142.405748] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:366586496worker1 # [ 142.412094] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6497worker1 # [ 142.590181] nix-daemon[846]: accepted connection from pid 2062, user nix-grpc-daemon (trusted)6498worker1 # [ 142.602757] nix-daemon[846]: reaped child process 2065, status = succeeded6499worker1 # [ 142.761037] nix-daemon[846]: accepted connection from pid 2067, user nix-grpc-daemon (trusted)6500worker1 # [ 142.772821] nix-daemon[846]: reaped child process 2070, status = succeeded6501lb # [ 142.761843] niks3-server[1014]: 2026/09/20 09:01:49 INFO Received uploads request method=POST path=/api/pending_closures6502worker1 # [ 142.798458] nix-grpc-daemon[1776]: time=2026-09-20T09:01:49.004Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6503worker1 # [ 142.800335] nix-grpc-daemon[1776]: time=2026-09-20T09:01:49.006Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6504lb # [ 142.802862] niks3-server[1014]: 2026/09/20 09:01:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6505lb # [ 142.810226] niks3-server[1014]: 2026/09/20 09:01:49 INFO Signed narinfos id=62 count=16506worker1 # [ 142.839404] nix-grpc-daemon[1776]: time=2026-09-20T09:01:49.045Z level=INFO msg="Uploading 1 narinfos"6507lb # [ 142.813777] niks3-server[1014]: 2026/09/20 09:01:49 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6508lb # [ 142.820737] niks3-server[1014]: 2026/09/20 09:01:49 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6509lb # [ 142.830863] niks3-server[1014]: 2026/09/20 09:01:49 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6510lb # [ 142.839881] niks3-server[1014]: 2026/09/20 09:01:49 INFO Completed upload id=626511worker1 # [ 142.865749] nix-grpc-daemon[1776]: time=2026-09-20T09:01:49.072Z level=INFO msg="Upload complete. (446ms)"6512lb # [ 142.841853] niks3-server[1014]: 2026/09/20 09:01:49 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6513worker1 # [ 142.869108] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=0 paths=1 nar_bytes_in=7526514worker1 # [ 142.875529] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:366586515worker1 # [ 142.886086] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6516worker1 # [ 142.892336] nix-daemon[846]: reaped child process 2060, status = succeeded6517worker1 # [ 142.897399] nix-daemon[846]: accepted connection from pid 1720, user nix-grpc-daemon (trusted)6518worker1 # [ 143.510291] nix-daemon[846]: reaped child process 2074, status = succeeded6519worker1 # [ 143.650217] nix-daemon[846]: accepted connection from pid 2089, user nix-grpc-daemon (trusted)6520worker1 # [ 143.662128] nix-daemon[846]: reaped child process 2092, status = succeeded6521lb # [ 143.653986] niks3-server[1014]: 2026/09/20 09:01:50 INFO Received uploads request method=POST path=/api/pending_closures6522worker1 # [ 143.688028] nix-grpc-daemon[1776]: time=2026-09-20T09:01:49.894Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6523worker1 # [ 143.689609] nix-grpc-daemon[1776]: time=2026-09-20T09:01:49.895Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6524lb # [ 143.692906] niks3-server[1014]: 2026/09/20 09:01:50 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6525lb # [ 143.704157] niks3-server[1014]: 2026/09/20 09:01:50 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6526worker1 # [ 143.739060] nix-grpc-daemon[1776]: time=2026-09-20T09:01:49.945Z level=INFO msg="Uploading 1 narinfos"6527lb # [ 143.713671] niks3-server[1014]: 2026/09/20 09:01:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6528lb # [ 143.716527] niks3-server[1014]: 2026/09/20 09:01:50 INFO Signed narinfos id=63 count=16529lb # [ 143.721578] niks3-server[1014]: 2026/09/20 09:01:50 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6530lb # [ 143.728807] niks3-server[1014]: 2026/09/20 09:01:50 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6531lb # [ 143.731773] niks3-server[1014]: 2026/09/20 09:01:50 INFO Completed upload id=636532worker1 # [ 143.757726] nix-grpc-daemon[1776]: time=2026-09-20T09:01:49.964Z level=INFO msg="Upload complete. (254ms)"6533lb # [ 143.734439] niks3-server[1014]: 2026/09/20 09:01:50 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6534worker1 # [ 143.762486] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:36658 duration_s=0 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=15 outputs=16535worker1 # [ 143.773797] nix-daemon[846]: reaped child process 2072, status = succeeded6536client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 15.96 seconds)6537worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6538worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.06 seconds)6539client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16540worker1 # [ 144.083571] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:366586541worker1 # [ 144.088513] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366586542worker2 # [ 144.090869] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:50Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06543client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.25 seconds)6544(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 16.28 seconds)6545subtest: low disk drains a worker and builds go to the other6546worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6547worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.97 seconds)6548worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6549worker1 # [ 145.640299] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:51Z level=info event=unhealthy reason=min_free6550worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.09 seconds)6551client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26552client # don't know how to build these paths:6553worker1 # [ 146.371270] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:366586554client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6555worker1 # [ 146.374200] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:366586556worker2 # [ 146.373964] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:52Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06557worker2 # [ 146.378151] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:52Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16558worker2 # [ 146.415139] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:509326559worker2 # [ 146.425372] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:509326560client # copying 1 paths to 'lb:50051'...6561client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6562worker2 # [ 146.434760] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:509326563worker2 # [ 146.443958] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6564worker2 # [ 146.640925] nix-daemon[849]: accepted connection from pid 1646, user nix-grpc-daemon (trusted)6565worker2 # [ 146.653771] nix-daemon[849]: reaped child process 1649, status = succeeded6566worker2 # [ 146.820050] nix-daemon[849]: accepted connection from pid 1651, user nix-grpc-daemon (trusted)6567worker2 # [ 146.831589] nix-daemon[849]: reaped child process 1654, status = succeeded6568lb # [ 146.837990] niks3-server[1014]: 2026/09/20 09:01:53 INFO Received uploads request method=POST path=/api/pending_closures6569worker2 # [ 146.855953] nix-grpc-daemon[1442]: time=2026-09-20T09:01:53.082Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6570worker2 # [ 146.857770] nix-grpc-daemon[1442]: time=2026-09-20T09:01:53.084Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6571lb # [ 146.863075] niks3-server[1014]: 2026/09/20 09:01:53 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6572lb # [ 146.874316] niks3-server[1014]: 2026/09/20 09:01:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6573lb # [ 146.880672] niks3-server[1014]: 2026/09/20 09:01:53 INFO Signed narinfos id=64 count=16574worker2 # [ 146.895885] nix-grpc-daemon[1442]: time=2026-09-20T09:01:53.122Z level=INFO msg="Uploading 1 narinfos"6575lb # [ 146.886538] niks3-server[1014]: 2026/09/20 09:01:53 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6576lb # [ 146.899227] niks3-server[1014]: 2026/09/20 09:01:53 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6577lb # [ 146.905618] niks3-server[1014]: 2026/09/20 09:01:53 INFO Completed upload id=646578worker2 # [ 146.916540] nix-grpc-daemon[1442]: time=2026-09-20T09:01:53.143Z level=INFO msg="Upload complete. (458ms)"6579worker2 # [ 146.920116] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50932 duration_s=0 paths=1 nar_bytes_in=5126580lb # [ 146.909566] niks3-server[1014]: 2026/09/20 09:01:53 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6581worker2 # [ 146.925586] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:509326582worker2 # [ 146.935598] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6583worker2 # [ 146.939064] nix-daemon[849]: reaped child process 1644, status = succeeded6584worker2 # [ 146.943944] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6585client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6586client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6587client # farm-a> LOG-farm-a-drain6588worker2 # [ 148.358934] nix-daemon[849]: reaped child process 1658, status = succeeded6589worker2 # [ 148.505470] nix-daemon[849]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6590worker2 # [ 148.517508] nix-daemon[849]: reaped child process 1676, status = succeeded6591lb # [ 148.522582] niks3-server[1014]: 2026/09/20 09:01:55 INFO Received uploads request method=POST path=/api/pending_closures6592worker2 # [ 148.538971] nix-grpc-daemon[1442]: time=2026-09-20T09:01:54.765Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6593worker2 # [ 148.540484] nix-grpc-daemon[1442]: time=2026-09-20T09:01:54.767Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6594lb # [ 148.544325] niks3-server[1014]: 2026/09/20 09:01:55 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6595lb # [ 148.549143] niks3-server[1014]: 2026/09/20 09:01:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6596lb # [ 148.551501] niks3-server[1014]: 2026/09/20 09:01:55 INFO Signed narinfos id=65 count=16597worker2 # [ 148.562657] nix-grpc-daemon[1442]: time=2026-09-20T09:01:54.789Z level=INFO msg="Uploading 1 narinfos"6598lb # [ 148.554596] niks3-server[1014]: 2026/09/20 09:01:55 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6599lb # [ 148.559097] niks3-server[1014]: 2026/09/20 09:01:55 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6600lb # [ 148.562159] niks3-server[1014]: 2026/09/20 09:01:55 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6601lb # [ 148.564632] niks3-server[1014]: 2026/09/20 09:01:55 INFO Completed upload id=656602worker2 # [ 148.575700] nix-grpc-daemon[1442]: time=2026-09-20T09:01:54.802Z level=INFO msg="Upload complete. (224ms)"6603lb # [ 148.567284] niks3-server[1014]: 2026/09/20 09:01:55 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6604worker2 # [ 148.578545] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50932 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=16 outputs=16605worker2 # [ 148.584269] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:54Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06606worker2 # [ 148.586542] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:54Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16607worker2 # [ 148.590877] nix-daemon[849]: reaped child process 1656, status = succeeded6608worker2 # [ 148.628317] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:509326609worker2 # [ 148.638762] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:509326610worker2 # [ 148.648785] nix-grpc-daemon[1442]: time=2026-09-20T09:01:54.875Z level=INFO msg="All 1 paths already cached"6611client # copying 1 paths to 'lb:50051'...6612client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6613worker2 # [ 148.656062] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:509326614worker2 # [ 148.664133] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6615worker2 # [ 148.826845] nix-daemon[849]: accepted connection from pid 1682, user nix-grpc-daemon (trusted)6616worker2 # [ 148.839882] nix-daemon[849]: reaped child process 1685, status = succeeded6617worker2 # [ 148.992107] nix-daemon[849]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6618worker2 # [ 149.003763] nix-daemon[849]: reaped child process 1690, status = succeeded6619lb # [ 149.008292] niks3-server[1014]: 2026/09/20 09:01:56 INFO Received uploads request method=POST path=/api/pending_closures6620worker2 # [ 149.026331] nix-grpc-daemon[1442]: time=2026-09-20T09:01:55.252Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6621worker2 # [ 149.027706] nix-grpc-daemon[1442]: time=2026-09-20T09:01:55.252Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6622lb # [ 149.033227] niks3-server[1014]: 2026/09/20 09:01:56 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6623lb # [ 149.043126] niks3-server[1014]: 2026/09/20 09:01:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6624worker2 # [ 149.058590] nix-grpc-daemon[1442]: time=2026-09-20T09:01:55.285Z level=INFO msg="Uploading 1 narinfos"6625lb # [ 149.048114] niks3-server[1014]: 2026/09/20 09:01:56 INFO Signed narinfos id=66 count=16626lb # [ 149.054423] niks3-server[1014]: 2026/09/20 09:01:56 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6627lb # [ 149.065449] niks3-server[1014]: 2026/09/20 09:01:56 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6628lb # [ 149.071621] niks3-server[1014]: 2026/09/20 09:01:56 INFO Completed upload id=666629worker2 # [ 149.082814] nix-grpc-daemon[1442]: time=2026-09-20T09:01:55.309Z level=INFO msg="Upload complete. (409ms)"6630lb # [ 149.074988] niks3-server[1014]: 2026/09/20 09:01:56 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6631worker2 # [ 149.087135] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:55Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50932 duration_s=0 paths=1 nar_bytes_in=6246632worker2 # [ 149.092852] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:509326633worker2 # [ 149.101067] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6634worker2 # [ 149.104145] nix-daemon[849]: reaped child process 1680, status = succeeded6635client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6636client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6637worker2 # [ 149.110230] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6638lb # [ 149.601136] envoy[931]: conn peer=[2001:db8:1::1]:49576 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27068 tx=10657 ms=157366639lb # [ 149.602694] envoy[931]: conn peer=[2001:db8:1::1]:59246 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=878 tx=481 ms=396640client # farm-b> LOG-farm-b-drain6641worker2 # [ 150.336505] nix-daemon[849]: reaped child process 1694, status = succeeded6642worker2 # [ 150.489211] nix-daemon[849]: accepted connection from pid 1709, user nix-grpc-daemon (trusted)6643worker2 # [ 150.501186] nix-daemon[849]: reaped child process 1712, status = succeeded6644lb # [ 150.505921] niks3-server[1014]: 2026/09/20 09:01:57 INFO Received uploads request method=POST path=/api/pending_closures6645worker2 # [ 150.524595] nix-grpc-daemon[1442]: time=2026-09-20T09:01:56.751Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6646worker2 # [ 150.526266] nix-grpc-daemon[1442]: time=2026-09-20T09:01:56.752Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6647lb # [ 150.547632] niks3-server[1014]: 2026/09/20 09:01:57 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6648lb # [ 150.552579] niks3-server[1014]: 2026/09/20 09:01:57 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6649lb # [ 150.563202] niks3-server[1014]: 2026/09/20 09:01:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6650worker2 # [ 150.579204] nix-grpc-daemon[1442]: time=2026-09-20T09:01:56.805Z level=INFO msg="Uploading 1 narinfos"6651lb # [ 150.568517] niks3-server[1014]: 2026/09/20 09:01:57 INFO Signed narinfos id=67 count=16652lb # [ 150.573715] niks3-server[1014]: 2026/09/20 09:01:57 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6653lb # [ 150.583259] niks3-server[1014]: 2026/09/20 09:01:57 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6654lb # [ 150.589416] niks3-server[1014]: 2026/09/20 09:01:57 INFO Completed upload id=676655worker2 # [ 150.600754] nix-grpc-daemon[1442]: time=2026-09-20T09:01:56.827Z level=INFO msg="Upload complete. (282ms)"6656lb # [ 150.590945] niks3-server[1014]: 2026/09/20 09:01:57 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6657worker2 # [ 150.606613] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50932 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=17 outputs=16658worker2 # [ 150.618526] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:56Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06659worker2 # [ 150.622483] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:56Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16660worker2 # [ 150.630593] nix-daemon[849]: reaped child process 1692, status = succeeded6661worker2 # [ 150.662483] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:509326662worker2 # [ 150.675153] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:509326663worker2 # [ 150.687974] nix-grpc-daemon[1442]: time=2026-09-20T09:01:56.914Z level=INFO msg="All 2 paths already cached"6664client # copying 1 paths to 'lb:50051'...6665client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6666worker2 # [ 150.695963] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:509326667worker2 # [ 150.706164] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6668worker2 # [ 150.869271] nix-daemon[849]: accepted connection from pid 1718, user nix-grpc-daemon (trusted)6669worker2 # [ 150.882337] nix-daemon[849]: reaped child process 1721, status = succeeded6670worker2 # [ 151.039618] nix-daemon[849]: accepted connection from pid 1723, user nix-grpc-daemon (trusted)6671worker2 # [ 151.052144] nix-daemon[849]: reaped child process 1726, status = succeeded6672lb # [ 151.055551] niks3-server[1014]: 2026/09/20 09:01:58 INFO Received uploads request method=POST path=/api/pending_closures6673worker2 # [ 151.070639] nix-grpc-daemon[1442]: time=2026-09-20T09:01:57.297Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6674worker2 # [ 151.072551] nix-grpc-daemon[1442]: time=2026-09-20T09:01:57.298Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6675lb # [ 151.068397] niks3-server[1014]: 2026/09/20 09:01:58 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6676lb # [ 151.072584] niks3-server[1014]: 2026/09/20 09:01:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6677lb # [ 151.074301] niks3-server[1014]: 2026/09/20 09:01:58 INFO Signed narinfos id=68 count=16678worker2 # [ 151.085546] nix-grpc-daemon[1442]: time=2026-09-20T09:01:57.312Z level=INFO msg="Uploading 1 narinfos"6679lb # [ 151.079626] niks3-server[1014]: 2026/09/20 09:01:58 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6680lb # [ 151.082586] niks3-server[1014]: 2026/09/20 09:01:58 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6681lb # [ 151.085304] niks3-server[1014]: 2026/09/20 09:01:58 INFO Completed upload id=686682worker2 # [ 151.096174] nix-grpc-daemon[1442]: time=2026-09-20T09:01:57.322Z level=INFO msg="Upload complete. (378ms)"6683worker2 # [ 151.098066] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50932 duration_s=0 paths=1 nar_bytes_in=7526684lb # [ 151.087952] niks3-server[1014]: 2026/09/20 09:01:58 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6685worker2 # [ 151.101472] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:509326686worker2 # [ 151.107780] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6687worker2 # [ 151.110222] nix-daemon[849]: reaped child process 1716, status = succeeded6688client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6689worker2 # [ 151.115873] nix-daemon[849]: accepted connection from pid 1366, user nix-grpc-daemon (trusted)6690client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6691client # farm-top> LOG-farm-top-drain6692worker2 # [ 151.940268] nix-daemon[849]: reaped child process 1730, status = succeeded6693worker2 # [ 152.086576] nix-daemon[849]: accepted connection from pid 1745, user nix-grpc-daemon (trusted)6694worker2 # [ 152.098717] nix-daemon[849]: reaped child process 1748, status = succeeded6695lb # [ 152.106211] niks3-server[1014]: 2026/09/20 09:01:59 INFO Received uploads request method=POST path=/api/pending_closures6696worker2 # [ 152.125255] nix-grpc-daemon[1442]: time=2026-09-20T09:01:58.351Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6697worker2 # [ 152.126845] nix-grpc-daemon[1442]: time=2026-09-20T09:01:58.353Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6698lb # [ 152.138154] niks3-server[1014]: 2026/09/20 09:01:59 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6699lb # [ 152.152752] niks3-server[1014]: 2026/09/20 09:01:59 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6700lb # [ 152.161254] niks3-server[1014]: 2026/09/20 09:01:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6701worker2 # [ 152.178911] nix-grpc-daemon[1442]: time=2026-09-20T09:01:58.405Z level=INFO msg="Uploading 1 narinfos"6702lb # [ 152.167589] niks3-server[1014]: 2026/09/20 09:01:59 INFO Signed narinfos id=69 count=16703lb # [ 152.171208] niks3-server[1014]: 2026/09/20 09:01:59 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6704lb # [ 152.180116] niks3-server[1014]: 2026/09/20 09:01:59 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6705lb # [ 152.186309] niks3-server[1014]: 2026/09/20 09:01:59 INFO Completed upload id=696706worker2 # [ 152.197604] nix-grpc-daemon[1442]: time=2026-09-20T09:01:58.424Z level=INFO msg="Upload complete. (275ms)"6707lb # [ 152.188626] niks3-server[1014]: 2026/09/20 09:01:59 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6708worker2 # [ 152.201394] nix-grpc-daemon[1366]: ts=2026-09-20T09:01:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50932 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=18 outputs=16709worker2 # [ 152.208266] nix-daemon[849]: reaped child process 1728, status = succeeded6710client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 6.05 seconds)6711client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6712client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.18 seconds)6713worker1: must succeed: rm /nix/.rw-store/fill6714worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds)6715worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6716worker1 # [ 152.643916] nix-grpc-daemon[1720]: ts=2026-09-20T09:01:58Z level=info event=healthy reason=min_free6717worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 0.05 seconds)6718(finished: subtest: low disk drains a worker and builds go to the other, in 8.53 seconds)6719(finished: run the VM test script, in 153.53 seconds)6720test script finished in 153.78s6721cleanup6722kill QemuMachine (pid 49)6723client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6724kill QemuMachine (pid 50)6725lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6726kill QemuMachine (pid 51)6727worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6728kill QemuMachine (pid 52)6729worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6730(finished: cleanup, in 1.01 seconds)6731additionally exposed symbols:6732 client, lb, worker1, worker2,6733 vlan1,6734 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh

succeeded vm-test-run-nix-grpc-farm checks.x86_64-linux.farm · build #251 · raw

succeeded `vm-test-run-nix-grpc-farm` `checks.x86_64-linux.farm` · build #251 · raw