nixbot

builds

succeeded vm-test-run-nix-grpc-farm checks.x86_64-linux.farm · build #226 · raw

1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12lb # Disk image does not exist, creating the virtualisation disk image...13lb # Formatting '/build/vm-state-lb/tmp.LulLq7PpwG', fmt=raw size=107374182414worker2 # Disk image does not exist, creating the virtualisation disk image...15lb # mke2fs 1.47.4 (6-Mar-2025)16lb # Discarding device blocks: 0/262144 done17lb: QEMU running (pid 50)18worker2 # Formatting '/build/vm-state-worker2/tmp.4JFvwO7BTJ', fmt=raw size=107374182419lb # Creating filesystem with 262144 4k blocks and 65536 inodes20worker1 # Disk image does not exist, creating the virtualisation disk image...21worker1: QEMU running (pid 51)22client: QEMU running (pid 49)23lb # Filesystem UUID: 72db3203-65f5-4c6e-a42e-20a147fc2a9024worker1 # Formatting '/build/vm-state-worker1/tmp.sSwNNmSl0t', fmt=raw size=107374182425worker1 # mke2fs 1.47.4 (6-Mar-2025)26worker1 # Discarding device blocks: 0/262144 done27lb # Superblock backups stored on blocks:28client # Disk image does not exist, creating the virtualisation disk image...29worker2 # mke2fs 1.47.4 (6-Mar-2025)30lb # 32768, 98304, 163840, 22937631client # Formatting '/build/vm-state-client/tmp.lRHafMzY7d', fmt=raw size=107374182432worker2 # Discarding device blocks: 0/262144 done33lb # 34client # mke2fs 1.47.4 (6-Mar-2025)35worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes36lb # Allocating group tables: 0/8 done37client # Discarding device blocks: 0/262144 done38worker2 # Filesystem UUID: daf0be46-5777-4f19-bbdc-7608fd033d1039lb # Writing inode tables: 0/8 done40client # Creating filesystem with 262144 4k blocks and 65536 inodes41worker2 # Superblock backups stored on blocks:42lb # Creating journal (8192 blocks): done43client # Filesystem UUID: 6efc6536-c1dd-48d8-8b83-26fb94dca18a44worker2 # 32768, 98304, 163840, 22937645lb # Writing superblocks and filesystem accounting information: 0/8 done46client # Superblock backups stored on blocks:47worker2 # 48lb # 49client # 32768, 98304, 163840, 22937650worker2 # Allocating group tables: 0/8 done51lb # Virtualisation disk image created.52client # 53worker2 # Writing inode tables: 0/8 done54client # Allocating group tables: 0/8 done55worker2 # Creating journal (8192 blocks): done56worker2: QEMU running (pid 52)57worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes58worker1 # Filesystem UUID: 0b3f55af-a5c3-4df2-9e0f-a51b3fbf6e2359client # Writing inode tables: 0/8 done60worker2 # Writing superblocks and filesystem accounting information: 0/8 done61client # Creating journal (8192 blocks): done62(finished: start all VMs, in 0.29 seconds)63worker1 # Superblock backups stored on blocks:64worker2 # 65client # Writing superblocks and filesystem accounting information: 0/8 done66client: waiting for unit network-addresses-eth1.service67worker1 # 32768, 98304, 163840, 22937668worker1 # 69worker2 # Virtualisation disk image created.70client: waiting for the VM to finish booting71worker1 # Allocating group tables: 0/8 done72client # 73worker1 # Writing inode tables: 0/8 done74worker1 # Creating journal (8192 blocks): done75client # Virtualisation disk image created.76worker1 # Writing superblocks and filesystem accounting information: 0/8 done77worker1 # 78worker1 # Virtualisation disk image created.79worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker2 # 84worker2 # 85worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086client # 87client # 88client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0089worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...90worker2 # 91worker2 # 92worker2 # 93worker2 # 94worker1 # 95worker1 # 96worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0097lb # 98lb # 99worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00100client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...101client # 102client # 103client # 104client # 105lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00106client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00107worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...108worker1 # 109worker1 # 110worker1 # 111worker1 # 112worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...113worker2 # 114worker2 # 115lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...116lb # 117lb # 118lb # 119lb # 120worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00121lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00122client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...123client # 124client # 125worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...126worker1 # 127worker1 # 128lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129lb # 130lb # 131worker2 # Booting from ROM...132client # Booting from ROM...133worker1 # Booting from ROM...134lb # Booting from ROM...135worker2 # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jdxp7lhn2kxznb45yz12dasnikgnvj5j-nixos-system-worker2-test/init regInfo=/nix/store/svpj09m02fz3jmnxrh1wjqam8f3qbhhs-closure-info/registration console=ttyS0,115200n8 console=tty0137worker2 # [ 0.000000] BIOS-provided physical RAM map:138worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026140worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved141worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved142worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable143worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved144worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved145client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qyiq0715rv1yjwa8s84438x9yd9fg920-nixos-system-client-test/init regInfo=/nix/store/c40s04s6abmppbk4s928w1ss235kh6vd-closure-info/registration console=ttyS0,115200n8 console=tty0146client # [ 0.000000] BIOS-provided physical RAM map:147worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved148client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable149worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved150client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved151worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved152client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved153worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved154client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable155worker2 # [ 0.000000] NX (Execute Disable) protection: active156worker2 # [ 0.000000] APIC: Static calls initialized157client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved158worker2 # [ 0.000000] SMBIOS 2.8 present.159client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved160worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014161client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved162worker2 # [ 0.000000] DMI: Memory slots populated: 1/1163worker2 # [ 0.000000] Hypervisor detected: KVM164client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved165worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000166client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved167worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00168client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved169worker2 # [ 0.000000] kvm-clock: using sched offset of 459998990 cycles170client # [ 0.000000] NX (Execute Disable) protection: active171client # [ 0.000000] APIC: Static calls initialized172worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns173client # [ 0.000000] SMBIOS 2.8 present.174worker2 # [ 0.000006] tsc: Detected 2400.012 MHz processor175worker2 # [ 0.000814] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000176client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014177client # [ 0.000000] DMI: Memory slots populated: 1/1178worker2 # [ 0.000842] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs179client # [ 0.000000] Hypervisor detected: KVM180client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000181worker2 # [ 0.000845] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT182client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00183worker2 # [ 0.002749] found SMP MP-table at [mem 0x000f5450-0x000f545f]184client # [ 0.000000] kvm-clock: using sched offset of 460564638 cycles185worker2 # [ 0.002763] Using GB pages for direct mapping186lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026187worker2 # [ 0.002853] RAMDISK: [mem 0x5e367000-0x5ffcffff]188client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns189worker2 # [ 0.002862] ACPI: Early table checksum verification disabled190client # [ 0.000005] tsc: Detected 2400.012 MHz processor191worker2 # [ 0.002866] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )192client # [ 0.000810] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000193worker2 # [ 0.002871] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)194client # [ 0.000837] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs195lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0196worker2 # [ 0.002875] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)197client # [ 0.000840] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT198lb # [ 0.000000] BIOS-provided physical RAM map:199worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026200client # [ 0.002752] found SMP MP-table at [mem 0x000f5450-0x000f545f]201worker2 # [ 0.002883] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)202lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable203client # [ 0.002766] Using GB pages for direct mapping204worker2 # [ 0.002885] ACPI: FACS 0x000000005FFE0000 000040205lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved206client # [ 0.002875] RAMDISK: [mem 0x5e366000-0x5ffcffff]207worker2 # [ 0.002887] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)208client # [ 0.002886] ACPI: Early table checksum verification disabled209lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved210client # [ 0.002903] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )211lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable212worker2 # [ 0.002888] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)213client # [ 0.002908] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)214lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved215worker2 # [ 0.002890] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)216worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3bdvszf23l08hf8wjzf6ig8cylmcinkn-nixos-system-worker1-test/init regInfo=/nix/store/8r0c8f0yrf87d0cgqdfaw8b5w64r8jgv-closure-info/registration console=ttyS0,115200n8 console=tty0217lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved218worker1 # [ 0.000000] BIOS-provided physical RAM map:219client # [ 0.002914] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)220worker2 # [ 0.002891] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)221lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved222worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable223client # [ 0.002924] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)224worker2 # [ 0.002893] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]225lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved226client # [ 0.002926] ACPI: FACS 0x000000005FFE0000 000040227worker2 # [ 0.002894] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]228worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved229lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved230client # [ 0.002928] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)231worker2 # [ 0.002895] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]232worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved233lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved234client # [ 0.002929] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)235worker2 # [ 0.002895] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]236lb # [ 0.000000] NX (Execute Disable) protection: active237worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable238lb # [ 0.000000] APIC: Static calls initialized239worker2 # [ 0.002895] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]240lb # [ 0.000000] SMBIOS 2.8 present.241client # [ 0.002931] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)242worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved243worker2 # [ 0.002896] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]244client # [ 0.002932] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)245lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014246worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved247worker2 # [ 0.002896] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]248lb # [ 0.000000] DMI: Memory slots populated: 1/1249client # [ 0.002934] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]250worker2 # [ 0.003127] No NUMA configuration found251lb # [ 0.000000] Hypervisor detected: KVM252worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved253client # [ 0.002935] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]254worker2 # [ 0.003128] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]255lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000256worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved257lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00258client # [ 0.002936] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]259worker2 # [ 0.003131] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]260worker2 # [ 0.005322] Zone ranges:261lb # [ 0.000001] kvm-clock: using sched offset of 483556922 cycles262client # [ 0.002936] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]263worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved264worker2 # [ 0.005323] DMA [mem 0x0000000000001000-0x0000000000ffffff]265client # [ 0.002937] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]266worker2 # [ 0.005324] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]267lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns268worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved269worker2 # [ 0.005325] Normal empty270lb # [ 0.000006] tsc: Detected 2400.012 MHz processor271worker2 # [ 0.005326] Device empty272client # [ 0.002937] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]273worker1 # [ 0.000000] NX (Execute Disable) protection: active274worker2 # [ 0.005327] Movable zone start for each node275lb # [ 0.000829] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000276worker1 # [ 0.000000] APIC: Static calls initialized277client # [ 0.002938] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]278worker2 # [ 0.005328] Early memory node ranges279worker1 # [ 0.000000] SMBIOS 2.8 present.280client # [ 0.003198] No NUMA configuration found281lb # [ 0.000856] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs282worker2 # [ 0.005328] node 0: [mem 0x0000000000001000-0x000000000009efff]283client # [ 0.003199] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]284worker2 # [ 0.005329] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]285lb # [ 0.000859] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT286worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014287client # [ 0.003202] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]288client # [ 0.005468] Zone ranges:289lb # [ 0.002751] found SMP MP-table at [mem 0x000f5450-0x000f545f]290worker2 # [ 0.005330] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]291worker1 # [ 0.000000] DMI: Memory slots populated: 1/1292lb # [ 0.002764] Using GB pages for direct mapping293client # [ 0.005470] DMA [mem 0x0000000000001000-0x0000000000ffffff]294worker1 # [ 0.000000] Hypervisor detected: KVM295worker2 # [ 0.005350] On node 0, zone DMA: 1 pages in unavailable ranges296lb # [ 0.002895] RAMDISK: [mem 0x5e367000-0x5ffcffff]297client # [ 0.005473] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]298worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000299worker2 # [ 0.005611] On node 0, zone DMA: 97 pages in unavailable ranges300client # [ 0.005474] Normal empty301lb # [ 0.002904] ACPI: Early table checksum verification disabled302client # [ 0.005475] Device empty303worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00304worker2 # [ 0.031136] On node 0, zone DMA32: 40 pages in unavailable ranges305lb # [ 0.002907] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )306client # [ 0.005475] Movable zone start for each node307worker2 # [ 0.031613] ACPI: PM-Timer IO Port: 0x608308client # [ 0.005476] Early memory node ranges309worker1 # [ 0.000000] kvm-clock: using sched offset of 475742821 cycles310worker2 # [ 0.031627] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])311lb # [ 0.002912] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)312client # [ 0.005477] node 0: [mem 0x0000000000001000-0x000000000009efff]313worker2 # [ 0.031654] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23314lb # [ 0.002917] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)315client # [ 0.005478] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]316worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns317worker2 # [ 0.031657] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)318worker1 # [ 0.000006] tsc: Detected 2400.012 MHz processor319client # [ 0.005479] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]320lb # [ 0.002924] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)321worker2 # [ 0.031658] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)322client # [ 0.005501] On node 0, zone DMA: 1 pages in unavailable ranges323lb # [ 0.002926] ACPI: FACS 0x000000005FFE0000 000040324worker1 # [ 0.000818] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000325worker2 # [ 0.031660] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)326client # [ 0.005758] On node 0, zone DMA: 97 pages in unavailable ranges327lb # [ 0.002927] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)328worker1 # [ 0.000845] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs329worker2 # [ 0.031661] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)330client # [ 0.032459] On node 0, zone DMA32: 40 pages in unavailable ranges331client # [ 0.032934] ACPI: PM-Timer IO Port: 0x608332lb # [ 0.002929] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)333worker2 # [ 0.031661] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)334worker1 # [ 0.000848] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT335client # [ 0.032948] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])336worker2 # [ 0.031664] ACPI: Using ACPI (MADT) for SMP configuration information337worker1 # [ 0.002750] found SMP MP-table at [mem 0x000f5450-0x000f545f]338lb # [ 0.002930] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)339client # [ 0.032975] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23340worker2 # [ 0.031665] ACPI: HPET id: 0x8086a201 base: 0xfed00000341worker1 # [ 0.002763] Using GB pages for direct mapping342worker2 # [ 0.031670] TSC deadline timer available343lb # [ 0.002932] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)344client # [ 0.032978] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)345worker1 # [ 0.002924] RAMDISK: [mem 0x5e367000-0x5ffcffff]346worker2 # [ 0.031674] CPU topo: Max. logical packages: 1347lb # [ 0.002933] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]348client # [ 0.032980] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)349worker2 # [ 0.031675] CPU topo: Max. logical dies: 1350worker1 # [ 0.002932] ACPI: Early table checksum verification disabled351worker2 # [ 0.031675] CPU topo: Max. dies per package: 1352client # [ 0.032981] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)353lb # [ 0.002934] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]354worker1 # [ 0.002935] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )355worker2 # [ 0.031679] CPU topo: Max. threads per core: 1356client # [ 0.032982] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)357lb # [ 0.002935] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]358worker2 # [ 0.031679] CPU topo: Num. cores per package: 1359worker1 # [ 0.002940] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)360client # [ 0.032983] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)361lb # [ 0.002935] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]362worker2 # [ 0.031680] CPU topo: Num. threads per package: 1363client # [ 0.032985] ACPI: Using ACPI (MADT) for SMP configuration information364worker2 # [ 0.031680] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs365lb # [ 0.002936] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]366worker1 # [ 0.002945] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)367client # [ 0.032986] ACPI: HPET id: 0x8086a201 base: 0xfed00000368worker2 # [ 0.031703] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()369lb # [ 0.002936] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]370client # [ 0.032992] TSC deadline timer available371client # [ 0.032996] CPU topo: Max. logical packages: 1372worker1 # [ 0.002953] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)373worker2 # [ 0.031739] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]374lb # [ 0.002937] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]375client # [ 0.032997] CPU topo: Max. logical dies: 1376worker1 # [ 0.002955] ACPI: FACS 0x000000005FFE0000 000040377lb # [ 0.003166] No NUMA configuration found378worker2 # [ 0.031740] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]379client # [ 0.032998] CPU topo: Max. dies per package: 1380lb # [ 0.003167] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]381client # [ 0.033001] CPU topo: Max. threads per core: 1382worker2 # [ 0.031742] [mem 0x60000000-0xafffffff] available for PCI devices383worker1 # [ 0.002956] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)384lb # [ 0.003169] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]385client # [ 0.033002] CPU topo: Num. cores per package: 1386worker2 # [ 0.031743] Booting paravirtualized kernel on KVM387lb # [ 0.005416] Zone ranges:388client # [ 0.033002] CPU topo: Num. threads per package: 1389worker1 # [ 0.002958] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)390lb # [ 0.005417] DMA [mem 0x0000000000001000-0x0000000000ffffff]391client # [ 0.033002] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs392worker2 # [ 0.031746] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns393lb # [ 0.005420] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]394lb # [ 0.005421] Normal empty395worker1 # [ 0.002960] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)396client # [ 0.033026] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()397worker2 # [ 0.036226] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1398lb # [ 0.005422] Device empty399lb # [ 0.005422] Movable zone start for each node400client # [ 0.033061] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]401worker2 # [ 0.038335] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152402worker1 # [ 0.002961] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)403lb # [ 0.005423] Early memory node ranges404worker2 # [ 0.038377] kvm-guest: PV spinlocks disabled, single CPU405client # [ 0.033062] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]406lb # [ 0.005423] node 0: [mem 0x0000000000001000-0x000000000009efff]407worker1 # [ 0.002962] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]408client # [ 0.033064] [mem 0x60000000-0xafffffff] available for PCI devices409lb # [ 0.005425] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]410client # [ 0.033065] Booting paravirtualized kernel on KVM411worker1 # [ 0.002963] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]412lb # [ 0.005426] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]413client # [ 0.033069] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns414worker1 # [ 0.002964] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]415lb # [ 0.005446] On node 0, zone DMA: 1 pages in unavailable ranges416lb # [ 0.005878] On node 0, zone DMA: 97 pages in unavailable ranges417client # [ 0.037716] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1418worker1 # [ 0.002964] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]419worker2 # [ 0.038379] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/jdxp7lhn2kxznb45yz12dasnikgnvj5j-nixos-system-worker2-test/init regInfo=/nix/store/svpj09m02fz3jmnxrh1wjqam8f3qbhhs-closure-info/registration console=ttyS0,115200n8 console=tty0420lb # [ 0.031989] On node 0, zone DMA32: 40 pages in unavailable ranges421client # [ 0.039832] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152422lb # [ 0.032465] ACPI: PM-Timer IO Port: 0x608423worker1 # [ 0.002965] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]424client # [ 0.039876] kvm-guest: PV spinlocks disabled, single CPU425lb # [ 0.032481] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])426worker2 # [ 0.038487] Unknown kernel command line parameters "regInfo=/nix/store/svpj09m02fz3jmnxrh1wjqam8f3qbhhs-closure-info/registration", will be passed to user space.427worker1 # [ 0.002965] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]428worker2 # [ 0.038501] random: crng init done429lb # [ 0.032510] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23430worker2 # [ 0.038502] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes431worker1 # [ 0.002966] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]432lb # [ 0.032512] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)433worker1 # [ 0.003190] No NUMA configuration found434lb # [ 0.032514] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)435worker2 # [ 0.040566] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)436worker1 # [ 0.003191] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]437lb # [ 0.032515] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)438worker2 # [ 0.041596] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)439client # [ 0.039878] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qyiq0715rv1yjwa8s84438x9yd9fg920-nixos-system-client-test/init regInfo=/nix/store/c40s04s6abmppbk4s928w1ss235kh6vd-closure-info/registration console=ttyS0,115200n8 console=tty0440worker2 # [ 0.041630] Fallback order for Node 0: 0441worker1 # [ 0.003193] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]442lb # [ 0.032516] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)443worker1 # [ 0.005313] Zone ranges:444worker2 # [ 0.041633] Built 1 zonelists, mobility grouping on. Total pages: 393078445lb # [ 0.032517] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)446worker2 # [ 0.041635] Policy zone: DMA32447client # [ 0.039985] Unknown kernel command line parameters "regInfo=/nix/store/c40s04s6abmppbk4s928w1ss235kh6vd-closure-info/registration", will be passed to user space.448worker1 # [ 0.005314] DMA [mem 0x0000000000001000-0x0000000000ffffff]449client # [ 0.040003] random: crng init done450lb # [ 0.032520] ACPI: Using ACPI (MADT) for SMP configuration information451worker2 # [ 0.044052] mem auto-init: stack:all(zero), heap alloc:on, heap free:off452worker1 # [ 0.005316] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]453lb # [ 0.032521] ACPI: HPET id: 0x8086a201 base: 0xfed00000454client # [ 0.040003] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes455worker1 # [ 0.005317] Normal empty456worker2 # [ 0.047251] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1457lb # [ 0.032527] TSC deadline timer available458worker1 # [ 0.005317] Device empty459worker2 # [ 0.050617] allocated 3145728 bytes of page_ext460lb # [ 0.032531] CPU topo: Max. logical packages: 1461client # [ 0.042223] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)462worker1 # [ 0.005318] Movable zone start for each node463worker2 # [ 0.061030] ftrace: allocating 48731 entries in 192 pages464lb # [ 0.032532] CPU topo: Max. logical dies: 1465worker1 # [ 0.005319] Early memory node ranges466client # [ 0.043266] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)467lb # [ 0.032532] CPU topo: Max. dies per package: 1468worker2 # [ 0.061033] ftrace: allocated 192 pages with 2 groups469client # [ 0.043302] Fallback order for Node 0: 0470worker2 # [ 0.061892] Dynamic Preempt: lazy471lb # [ 0.032536] CPU topo: Max. threads per core: 1472worker1 # [ 0.005319] node 0: [mem 0x0000000000001000-0x000000000009efff]473lb # [ 0.032537] CPU topo: Num. cores per package: 1474worker2 # [ 0.062020] rcu: Preemptible hierarchical RCU implementation.475client # [ 0.043305] Built 1 zonelists, mobility grouping on. Total pages: 393078476worker1 # [ 0.005320] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]477client # [ 0.043306] Policy zone: DMA32478worker2 # [ 0.062021] rcu: RCU event tracing is enabled.479lb # [ 0.032537] CPU topo: Num. threads per package: 1480client # [ 0.045697] mem auto-init: stack:all(zero), heap alloc:on, heap free:off481lb # [ 0.032538] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs482worker2 # [ 0.062021] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.483worker1 # [ 0.005322] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]484worker2 # [ 0.062023] Trampoline variant of Tasks RCU enabled.485client # [ 0.048927] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1486lb # [ 0.032561] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()487worker1 # [ 0.005341] On node 0, zone DMA: 1 pages in unavailable ranges488worker2 # [ 0.062023] Rude variant of Tasks RCU enabled.489client # [ 0.052297] allocated 3145728 bytes of page_ext490worker1 # [ 0.005591] On node 0, zone DMA: 97 pages in unavailable ranges491lb # [ 0.032596] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]492worker2 # [ 0.062023] Tracing variant of Tasks RCU enabled.493client # [ 0.062395] ftrace: allocating 48731 entries in 192 pages494client # [ 0.062398] ftrace: allocated 192 pages with 2 groups495worker1 # [ 0.030853] On node 0, zone DMA32: 40 pages in unavailable ranges496lb # [ 0.032598] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]497worker2 # [ 0.062024] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.498client # [ 0.063248] Dynamic Preempt: lazy499worker1 # [ 0.031322] ACPI: PM-Timer IO Port: 0x608500lb # [ 0.032600] [mem 0x60000000-0xafffffff] available for PCI devices501worker2 # [ 0.062025] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1502client # [ 0.063411] rcu: Preemptible hierarchical RCU implementation.503lb # [ 0.032601] Booting paravirtualized kernel on KVM504worker1 # [ 0.031337] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])505client # [ 0.063412] rcu: RCU event tracing is enabled.506worker2 # [ 0.062035] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.507client # [ 0.063413] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.508worker1 # [ 0.031369] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23509lb # [ 0.032604] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns510client # [ 0.063414] Trampoline variant of Tasks RCU enabled.511worker2 # [ 0.062037] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.512worker1 # [ 0.031371] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)513client # [ 0.063415] Rude variant of Tasks RCU enabled.514lb # [ 0.037129] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1515client # [ 0.063415] Tracing variant of Tasks RCU enabled.516worker2 # [ 0.062038] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.517worker1 # [ 0.031373] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)518lb # [ 0.039215] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152519worker2 # [ 0.066421] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16520client # [ 0.063416] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.521lb # [ 0.039257] kvm-guest: PV spinlocks disabled, single CPU522worker1 # [ 0.031374] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)523worker2 # [ 0.066715] rcu: srcu_init: Setting srcu_struct sizes based on contention.524client # [ 0.063417] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1525worker1 # [ 0.031375] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)526worker2 # [ 0.066721] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns527client # [ 0.063432] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.528worker1 # [ 0.031376] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)529client # [ 0.063434] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.530worker2 # [ 0.066828] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)531worker1 # [ 0.031379] ACPI: Using ACPI (MADT) for SMP configuration information532worker2 # [ 0.070364] Console: colour VGA+ 80x25533lb # [ 0.039259] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0534worker1 # [ 0.031380] ACPI: HPET id: 0x8086a201 base: 0xfed00000535client # [ 0.063435] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.536worker2 # [ 0.070368] printk: legacy console [tty0] enabled537worker1 # [ 0.031385] TSC deadline timer available538worker2 # [ 0.101501] printk: legacy console [ttyS0] enabled539client # [ 0.068006] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16540worker1 # [ 0.031389] CPU topo: Max. logical packages: 1541worker2 # [ 0.198381] ACPI: Core revision 20250807542client # [ 0.068297] rcu: srcu_init: Setting srcu_struct sizes based on contention.543lb # [ 0.039354] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.544worker1 # [ 0.031390] CPU topo: Max. logical dies: 1545lb # [ 0.039367] random: crng init done546worker1 # [ 0.031390] CPU topo: Max. dies per package: 1547client # [ 0.068303] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns548lb # [ 0.039368] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes549worker2 # [ 0.199225] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns550worker1 # [ 0.031394] CPU topo: Max. threads per core: 1551worker1 # [ 0.031395] CPU topo: Num. cores per package: 1552client # [ 0.068414] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)553lb # [ 0.041512] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)554worker2 # [ 0.200813] APIC: Switch to symmetric I/O mode setup555client # [ 0.071979] Console: colour VGA+ 80x25556worker1 # [ 0.031395] CPU topo: Num. threads per package: 1557worker2 # [ 0.201755] x2apic enabled558lb # [ 0.042546] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)559client # [ 0.071983] printk: legacy console [tty0] enabled560lb # [ 0.042583] Fallback order for Node 0: 0561client # [ 0.101497] printk: legacy console [ttyS0] enabled562worker1 # [ 0.031395] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs563worker2 # [ 0.202496] APIC: Switched APIC routing to: physical x2apic564lb # [ 0.042586] Built 1 zonelists, mobility grouping on. Total pages: 393078565client # [ 0.197526] ACPI: Core revision 20250807566worker1 # [ 0.031419] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()567lb # [ 0.042587] Policy zone: DMA32568lb # [ 0.045021] mem auto-init: stack:all(zero), heap alloc:on, heap free:off569worker1 # [ 0.031455] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]570worker2 # [ 0.204282] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1571client # [ 0.198397] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns572lb # [ 0.048758] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1573worker1 # [ 0.031457] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]574lb # [ 0.052054] allocated 3145728 bytes of page_ext575client # [ 0.199963] APIC: Switch to symmetric I/O mode setup576lb # [ 0.061988] ftrace: allocating 48731 entries in 192 pages577worker1 # [ 0.031458] [mem 0x60000000-0xafffffff] available for PCI devices578worker2 # [ 0.205256] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns579client # [ 0.200880] x2apic enabled580lb # [ 0.061991] ftrace: allocated 192 pages with 2 groups581worker1 # [ 0.031460] Booting paravirtualized kernel on KVM582lb # [ 0.062855] Dynamic Preempt: lazy583client # [ 0.201624] APIC: Switched APIC routing to: physical x2apic584worker2 # [ 0.206912] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)585lb # [ 0.062991] rcu: Preemptible hierarchical RCU implementation.586worker1 # [ 0.031464] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns587lb # [ 0.062992] rcu: RCU event tracing is enabled.588worker2 # [ 0.207994] x86/cpu: User Mode Instruction Prevention (UMIP) activated589worker1 # [ 0.035951] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1590lb # [ 0.062993] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.591client # [ 0.203396] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1592lb # [ 0.062994] Trampoline variant of Tasks RCU enabled.593worker2 # [ 0.209020] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127594worker1 # [ 0.038197] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152595lb # [ 0.062994] Rude variant of Tasks RCU enabled.596worker2 # [ 0.209909] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0597worker1 # [ 0.038242] kvm-guest: PV spinlocks disabled, single CPU598lb # [ 0.062995] Tracing variant of Tasks RCU enabled.599client # [ 0.204357] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns600lb # [ 0.062995] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.601client # [ 0.205957] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)602worker2 # [ 0.210912] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto603lb # [ 0.062996] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1604client # [ 0.208032] x86/cpu: User Mode Instruction Prevention (UMIP) activated605lb # [ 0.063011] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.606worker2 # [ 0.211909] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl607client # [ 0.209077] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127608lb # [ 0.063013] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.609worker2 # [ 0.212909] Transient Scheduler Attacks: Vulnerable: No microcode610worker1 # [ 0.038243] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3bdvszf23l08hf8wjzf6ig8cylmcinkn-nixos-system-worker1-test/init regInfo=/nix/store/8r0c8f0yrf87d0cgqdfaw8b5w64r8jgv-closure-info/registration console=ttyS0,115200n8 console=tty0611client # [ 0.209949] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0612lb # [ 0.063013] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.613worker2 # [ 0.213909] Spectre V2 : Mitigation: Enhanced / Automatic IBRS614lb # [ 0.067962] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16615worker2 # [ 0.214909] Speculative Return Stack Overflow: Mitigation: Safe RET616worker1 # [ 0.038338] Unknown kernel command line parameters "regInfo=/nix/store/8r0c8f0yrf87d0cgqdfaw8b5w64r8jgv-closure-info/registration", will be passed to user space.617client # [ 0.210952] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto618lb # [ 0.068286] rcu: srcu_init: Setting srcu_struct sizes based on contention.619worker1 # [ 0.038352] random: crng init done620lb # [ 0.068294] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns621worker1 # [ 0.038353] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes622client # [ 0.211950] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl623client # [ 0.212950] Transient Scheduler Attacks: Vulnerable: No microcode624worker1 # [ 0.040391] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)625lb # [ 0.068419] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)626lb # [ 0.072470] Console: colour VGA+ 80x25627client # [ 0.213949] Spectre V2 : Mitigation: Enhanced / Automatic IBRS628worker1 # [ 0.041415] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)629worker2 # [ 0.215909] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization630lb # [ 0.072475] printk: legacy console [tty0] enabled631worker1 # [ 0.041447] Fallback order for Node 0: 0632lb # [ 0.102385] printk: legacy console [ttyS0] enabled633client # [ 0.214949] Speculative Return Stack Overflow: Mitigation: Safe RET634worker2 # [ 0.217916] Spectre V2 : Enabling IBPB for BPF635lb # [ 0.199398] ACPI: Core revision 20250807636worker1 # [ 0.041450] Built 1 zonelists, mobility grouping on. Total pages: 393078637worker1 # [ 0.041451] Policy zone: DMA32638worker2 # [ 0.218909] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier639worker1 # [ 0.043827] mem auto-init: stack:all(zero), heap alloc:on, heap free:off640worker2 # [ 0.219910] active return thunk: srso_alias_return_thunk641lb # [ 0.200316] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns642worker1 # [ 0.047095] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1643lb # [ 0.201996] APIC: Switch to symmetric I/O mode setup644worker2 # [ 0.220931] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'645worker1 # [ 0.050456] allocated 3145728 bytes of page_ext646client # [ 0.215949] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization647lb # [ 0.203057] x2apic enabled648worker1 # [ 0.060465] ftrace: allocating 48731 entries in 192 pages649worker2 # [ 0.221909] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'650client # [ 0.217957] Spectre V2 : Enabling IBPB for BPF651worker1 # [ 0.060467] ftrace: allocated 192 pages with 2 groups652worker1 # [ 0.061300] Dynamic Preempt: lazy653lb # [ 0.203877] APIC: Switched APIC routing to: physical x2apic654worker2 # [ 0.222909] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'655client # [ 0.218951] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier656worker1 # [ 0.061432] rcu: Preemptible hierarchical RCU implementation.657worker1 # [ 0.061433] rcu: RCU event tracing is enabled.658worker2 # [ 0.223909] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'659client # [ 0.219950] active return thunk: srso_alias_return_thunk660worker1 # [ 0.061433] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.661lb # [ 0.206122] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1662worker2 # [ 0.224908] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'663worker1 # [ 0.061435] Trampoline variant of Tasks RCU enabled.664client # [ 0.221593] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'665worker1 # [ 0.061435] Rude variant of Tasks RCU enabled.666worker2 # [ 0.225909] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'667worker1 # [ 0.061435] Tracing variant of Tasks RCU enabled.668client # [ 0.222890] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'669lb # [ 0.207119] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns670worker2 # [ 0.226908] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'671worker1 # [ 0.061436] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.672client # [ 0.223684] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'673lb # [ 0.208834] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)674worker1 # [ 0.061437] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1675worker2 # [ 0.227909] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256676client # [ 0.224709] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'677lb # [ 0.210918] x86/cpu: User Mode Instruction Prevention (UMIP) activated678worker1 # [ 0.061489] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.679worker2 # [ 0.228908] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64680client # [ 0.225702] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'681worker2 # [ 0.229909] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512682worker1 # [ 0.061491] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.683lb # [ 0.212011] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127684client # [ 0.226683] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'685worker2 # [ 0.230908] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024686worker1 # [ 0.061492] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.687lb # [ 0.212832] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0688client # [ 0.227724] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'689worker1 # [ 0.065865] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16690worker2 # [ 0.231909] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8691client # [ 0.228950] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256692lb # [ 0.213836] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto693worker1 # [ 0.066130] rcu: srcu_init: Setting srcu_struct sizes based on contention.694worker2 # [ 0.232909] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.695client # [ 0.229949] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64696worker1 # [ 0.066136] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns697lb # [ 0.215832] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl698client # [ 0.230948] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512699lb # [ 0.216833] Transient Scheduler Attacks: Vulnerable: No microcode700client # [ 0.231948] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024701worker1 # [ 0.066243] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)702worker1 # [ 0.070137] Console: colour VGA+ 80x25703lb # [ 0.217830] Spectre V2 : Mitigation: Enhanced / Automatic IBRS704client # [ 0.232948] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8705worker1 # [ 0.070141] printk: legacy console [tty0] enabled706lb # [ 0.218799] Speculative Return Stack Overflow: Mitigation: Safe RET707worker1 # [ 0.103943] printk: legacy console [ttyS0] enabled708client # [ 0.233950] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.709worker1 # [ 0.218323] ACPI: Core revision 20250807710worker1 # [ 0.219376] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns711worker1 # [ 0.220903] APIC: Switch to symmetric I/O mode setup712lb # [ 0.219831] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization713worker1 # [ 0.221856] x2apic enabled714lb # [ 0.221840] Spectre V2 : Enabling IBPB for BPF715worker1 # [ 0.222584] APIC: Switched APIC routing to: physical x2apic716lb # [ 0.222832] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier717lb # [ 0.223833] active return thunk: srso_alias_return_thunk718worker1 # [ 0.224404] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1719lb # [ 0.224855] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'720worker1 # [ 0.225375] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns721lb # [ 0.225830] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'722worker1 # [ 0.227026] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)723lb # [ 0.226831] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'724worker1 # [ 0.228109] x86/cpu: User Mode Instruction Prevention (UMIP) activated725lb # [ 0.227831] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'726worker1 # [ 0.229176] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127727lb # [ 0.228830] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'728worker1 # [ 0.230024] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0729lb # [ 0.229830] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'730lb # [ 0.230830] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'731worker1 # [ 0.231028] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto732lb # [ 0.232831] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256733worker1 # [ 0.233025] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl734lb # [ 0.233830] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64735worker1 # [ 0.234024] Transient Scheduler Attacks: Vulnerable: No microcode736lb # [ 0.234830] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512737worker1 # [ 0.235024] Spectre V2 : Mitigation: Enhanced / Automatic IBRS738lb # [ 0.235770] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024739worker1 # [ 0.236024] Speculative Return Stack Overflow: Mitigation: Safe RET740lb # [ 0.236559] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8741lb # [ 0.237570] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.742worker1 # [ 0.237024] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization743worker1 # [ 0.239033] Spectre V2 : Enabling IBPB for BPF744worker1 # [ 0.240025] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier745worker1 # [ 0.241025] active return thunk: srso_alias_return_thunk746worker1 # [ 0.242045] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'747worker1 # [ 0.243024] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'748worker1 # [ 0.244024] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'749worker1 # [ 0.245024] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'750worker1 # [ 0.246024] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'751worker2 # [ 0.270420] Freeing SMP alternatives memory: 44K752worker1 # [ 0.247024] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'753worker2 # [ 0.270913] pid_max: default: 32768 minimum: 301754worker1 # [ 0.248024] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'755worker2 # [ 0.271998] LSM: initializing lsm=capability,landlock,yama,bpf,ima756worker1 # [ 0.249025] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256757worker2 # [ 0.273036] landlock: Up and running.758client # [ 0.270032] Freeing SMP alternatives memory: 44K759worker1 # [ 0.250759] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64760worker2 # [ 0.273910] Yama: becoming mindful.761client # [ 0.270942] pid_max: default: 32768 minimum: 301762worker2 # [ 0.274756] LSM support for eBPF active763worker1 # [ 0.251764] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512764client # [ 0.271585] LSM: initializing lsm=capability,landlock,yama,bpf,ima765worker1 # [ 0.252795] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024766worker2 # [ 0.275509] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)767client # [ 0.272784] landlock: Up and running.768worker1 # [ 0.253735] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8769client # [ 0.273376] Yama: becoming mindful.770worker2 # [ 0.276944] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)771client # [ 0.274169] LSM support for eBPF active772worker1 # [ 0.254777] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.773client # [ 0.275060] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)774worker2 # [ 0.279280] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)775client # [ 0.275986] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)776worker2 # [ 0.280466] Performance Events: Fam17h+ core perfctr, AMD PMU driver.777worker2 # [ 0.280918] ... version: 2778client # [ 0.278769] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)779worker2 # [ 0.281651] ... bit width: 48780worker2 # [ 0.281912] ... generic counters: 6781client # [ 0.279465] Performance Events: Fam17h+ core perfctr, AMD PMU driver.782worker2 # [ 0.282636] ... generic bitmap: 000000000000003f783client # [ 0.279954] ... version: 2784worker2 # [ 0.282911] ... fixed-purpose counters: 0785client # [ 0.280699] ... bit width: 48786worker2 # [ 0.283632] ... fixed-purpose bitmap: 0000000000000000787client # [ 0.280951] ... generic counters: 6788worker2 # [ 0.283912] ... value mask: 0000ffffffffffff789client # [ 0.281670] ... generic bitmap: 000000000000003f790worker2 # [ 0.284821] ... max period: 00007fffffffffff791client # [ 0.281998] ... fixed-purpose counters: 0792worker2 # [ 0.285647] ... global_ctrl mask: 000000000000003f793client # [ 0.282706] ... fixed-purpose bitmap: 0000000000000000794worker2 # [ 0.286024] signal: max sigframe size: 3376795client # [ 0.282951] ... value mask: 0000ffffffffffff796worker2 # [ 0.286813] rcu: Hierarchical SRCU implementation.797client # [ 0.283840] ... max period: 00007fffffffffff798client # [ 0.284676] ... global_ctrl mask: 000000000000003f799worker2 # [ 0.287507] rcu: Max phase no-delay instances is 400.800client # [ 0.285075] signal: max sigframe size: 3376801client # [ 0.285865] rcu: Hierarchical SRCU implementation.802client # [ 0.286570] rcu: Max phase no-delay instances is 400.803lb # [ 0.273871] Freeing SMP alternatives memory: 44K804lb # [ 0.274765] pid_max: default: 32768 minimum: 301805lb # [ 0.275462] LSM: initializing lsm=capability,landlock,yama,bpf,ima806worker2 # [ 0.292515] smp: Bringing up secondary CPUs ...807lb # [ 0.276729] landlock: Up and running.808worker2 # [ 0.292927] smp: Brought up 1 node, 1 CPU809lb # [ 0.277280] Yama: becoming mindful.810lb # [ 0.278055] LSM support for eBPF active811worker2 # [ 0.293641] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)812client # [ 0.291514] smp: Bringing up secondary CPUs ...813lb # [ 0.278948] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)814client # [ 0.291966] smp: Brought up 1 node, 1 CPU815worker2 # [ 0.294101] Memory: 1454556K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)816lb # [ 0.279871] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)817client # [ 0.292615] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)818worker2 # [ 0.295215] devtmpfs: initialized819worker2 # [ 0.296093] x86/mm: Memory block size: 128MB820client # [ 0.293078] Memory: 1454556K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)821lb # [ 0.282635] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)822client # [ 0.294181] devtmpfs: initialized823worker2 # [ 0.297814] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)824lb # [ 0.283345] Performance Events: Fam17h+ core perfctr, AMD PMU driver.825client # [ 0.295073] x86/mm: Memory block size: 128MB826lb # [ 0.283835] ... version: 2827worker2 # [ 0.298803] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).828lb # [ 0.284568] ... bit width: 48829lb # [ 0.284834] ... generic counters: 6830worker2 # [ 0.300012] pinctrl core: initialized pinctrl subsystem831client # [ 0.296902] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)832lb # [ 0.285519] ... generic bitmap: 000000000000003f833worker2 # [ 0.301123] PM: RTC time: 08:05:39, date: 2026-09-20834lb # [ 0.285845] ... fixed-purpose counters: 0835client # [ 0.297855] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).836lb # [ 0.286560] ... fixed-purpose bitmap: 0000000000000000837client # [ 0.299038] pinctrl core: initialized pinctrl subsystem838lb # [ 0.286833] ... value mask: 0000ffffffffffff839client # [ 0.300175] PM: RTC time: 08:05:39, date: 2026-09-20840lb # [ 0.287715] ... max period: 00007fffffffffff841worker2 # [ 0.304542] NET: Registered PF_NETLINK/PF_ROUTE protocol family842lb # [ 0.288519] ... global_ctrl mask: 000000000000003f843lb # [ 0.288944] signal: max sigframe size: 3376844worker1 # [ 0.291185] Freeing SMP alternatives memory: 44K845worker2 # [ 0.305450] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations846lb # [ 0.289739] rcu: Hierarchical SRCU implementation.847worker1 # [ 0.292029] pid_max: default: 32768 minimum: 301848client # [ 0.303560] NET: Registered PF_NETLINK/PF_ROUTE protocol family849lb # [ 0.290387] rcu: Max phase no-delay instances is 400.850worker2 # [ 0.305930] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations851worker1 # [ 0.292903] LSM: initializing lsm=capability,landlock,yama,bpf,ima852worker1 # [ 0.294048] landlock: Up and running.853client # [ 0.304429] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations854worker2 # [ 0.307186] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations855worker1 # [ 0.294662] Yama: becoming mindful.856worker2 # [ 0.307921] audit: initializing netlink subsys (disabled)857client # [ 0.304972] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations858worker1 # [ 0.295245] LSM support for eBPF active859worker2 # [ 0.309133] thermal_sys: Registered thermal governor 'fair_share'860worker1 # [ 0.296130] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)861client # [ 0.306214] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations862worker2 # [ 0.309135] thermal_sys: Registered thermal governor 'bang_bang'863client # [ 0.306960] audit: initializing netlink subsys (disabled)864worker1 # [ 0.297059] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)865lb # [ 0.295354] smp: Bringing up secondary CPUs ...866worker2 # [ 0.309912] thermal_sys: Registered thermal governor 'step_wise'867lb # [ 0.295851] smp: Brought up 1 node, 1 CPU868client # [ 0.307953] audit: type=2000 audit(1789891540.441:1): state=initialized audit_enabled=0 res=1869lb # [ 0.296525] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)870worker2 # [ 0.310914] audit: type=2000 audit(1789891540.435:1): state=initialized audit_enabled=0 res=1871client # [ 0.309119] thermal_sys: Registered thermal governor 'fair_share'872worker1 # [ 0.299826] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)873worker2 # [ 0.312914] thermal_sys: Registered thermal governor 'user_space'874client # [ 0.309121] thermal_sys: Registered thermal governor 'bang_bang'875worker2 # [ 0.312916] thermal_sys: Registered thermal governor 'power_allocator'876worker1 # [ 0.300553] Performance Events: Fam17h+ core perfctr, AMD PMU driver.877lb # [ 0.297067] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)878client # [ 0.309952] thermal_sys: Registered thermal governor 'step_wise'879worker2 # [ 0.313914] cpuidle: using governor menu880worker1 # [ 0.301029] ... version: 2881lb # [ 0.298058] devtmpfs: initialized882client # [ 0.310889] thermal_sys: Registered thermal governor 'user_space'883worker1 # [ 0.301750] ... bit width: 48884lb # [ 0.298828] x86/mm: Memory block size: 128MB885worker2 # [ 0.316121] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5886worker1 # [ 0.302027] ... generic counters: 6887client # [ 0.311662] thermal_sys: Registered thermal governor 'power_allocator'888client # [ 0.311975] cpuidle: using governor menu889worker1 # [ 0.302755] ... generic bitmap: 000000000000003f890worker2 # [ 0.317145] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]891worker1 # [ 0.303039] ... fixed-purpose counters: 0892lb # [ 0.300634] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)893client # [ 0.314181] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5894worker1 # [ 0.303741] ... fixed-purpose bitmap: 0000000000000000895worker2 # [ 0.317914] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry896lb # [ 0.301696] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).897worker1 # [ 0.304026] ... value mask: 0000ffffffffffff898worker2 # [ 0.318923] PCI: Using configuration type 1 for base access899client # [ 0.315196] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]900lb # [ 0.302913] pinctrl core: initialized pinctrl subsystem901worker1 # [ 0.304898] ... max period: 00007fffffffffff902client # [ 0.315954] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry903worker2 # [ 0.320017] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.904worker1 # [ 0.305702] ... global_ctrl mask: 000000000000003f905lb # [ 0.304044] PM: RTC time: 08:05:39, date: 2026-09-20906client # [ 0.316963] PCI: Using configuration type 1 for base access907worker1 # [ 0.306156] signal: max sigframe size: 3376908worker1 # [ 0.306961] rcu: Hierarchical SRCU implementation.909client # [ 0.318098] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.910worker1 # [ 0.307671] rcu: Max phase no-delay instances is 400.911lb # [ 0.307909] NET: Registered PF_NETLINK/PF_ROUTE protocol family912worker2 # [ 0.325193] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages913lb # [ 0.309346] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations914worker2 # [ 0.325912] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page915lb # [ 0.309856] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations916worker1 # [ 0.312506] smp: Bringing up secondary CPUs ...917worker1 # [ 0.313044] smp: Brought up 1 node, 1 CPU918lb # [ 0.311137] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations919client # [ 0.324974] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages920worker1 # [ 0.313716] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)921lb # [ 0.311845] audit: initializing netlink subsys (disabled)922client # [ 0.325953] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page923lb # [ 0.312957] thermal_sys: Registered thermal governor 'fair_share'924worker2 # [ 0.330922] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages925lb # [ 0.312959] thermal_sys: Registered thermal governor 'bang_bang'926worker1 # [ 0.314209] Memory: 1454552K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)927worker2 # [ 0.331911] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page928worker1 # [ 0.315270] devtmpfs: initialized929lb # [ 0.313834] thermal_sys: Registered thermal governor 'step_wise'930lb # [ 0.314792] thermal_sys: Registered thermal governor 'user_space'931worker1 # [ 0.316127] x86/mm: Memory block size: 128MB932lb # [ 0.315562] audit: type=2000 audit(1789891540.462:1): state=initialized audit_enabled=0 res=1933client # [ 0.330952] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages934worker1 # [ 0.317907] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)935lb # [ 0.316836] thermal_sys: Registered thermal governor 'power_allocator'936client # [ 0.331952] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page937lb # [ 0.316864] cpuidle: using governor menu938worker1 # [ 0.318947] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).939lb # [ 0.319054] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5940worker1 # [ 0.320154] pinctrl core: initialized pinctrl subsystem941worker1 # [ 0.321277] PM: RTC time: 08:05:39, date: 2026-09-20942lb # [ 0.320157] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]943lb # [ 0.320838] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry944lb # [ 0.321846] PCI: Using configuration type 1 for base access945worker2 # [ 0.342320] ACPI: Added _OSI(Module Device)946worker2 # [ 0.342913] ACPI: Added _OSI(Processor Device)947worker1 # [ 0.325157] NET: Registered PF_NETLINK/PF_ROUTE protocol family948lb # [ 0.322946] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.949worker2 # [ 0.343632] ACPI: Added _OSI(Processor Aggregator Device)950worker1 # [ 0.326556] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations951worker1 # [ 0.327048] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations952client # [ 0.343262] ACPI: Added _OSI(Module Device)953worker1 # [ 0.328310] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations954client # [ 0.343954] ACPI: Added _OSI(Processor Device)955worker1 # [ 0.329039] audit: initializing netlink subsys (disabled)956client # [ 0.344718] ACPI: Added _OSI(Processor Aggregator Device)957worker1 # [ 0.330188] thermal_sys: Registered thermal governor 'fair_share'958lb # [ 0.330158] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages959worker1 # [ 0.330190] thermal_sys: Registered thermal governor 'bang_bang'960lb # [ 0.330834] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page961worker1 # [ 0.331027] thermal_sys: Registered thermal governor 'step_wise'962lb # [ 0.331835] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages963worker1 # [ 0.331994] thermal_sys: Registered thermal governor 'user_space'964worker2 # [ 0.352462] ACPI: 1 ACPI AML tables successfully acquired and loaded965worker1 # [ 0.332793] audit: type=2000 audit(1789891540.460:1): state=initialized audit_enabled=0 res=1966worker1 # [ 0.334030] thermal_sys: Registered thermal governor 'power_allocator'967worker1 # [ 0.334046] cpuidle: using governor menu968worker2 # [ 0.356310] ACPI: Interpreter enabled969client # [ 0.351941] ACPI: 1 ACPI AML tables successfully acquired and loaded970worker1 # [ 0.336311] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5971worker2 # [ 0.356927] ACPI: PM: (supports S0 S3 S4 S5)972worker2 # [ 0.357657] ACPI: Using IOAPIC for interrupt routing973worker1 # [ 0.337278] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]974lb # [ 0.338834] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page975worker2 # [ 0.357969] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug976worker1 # [ 0.338030] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry977worker2 # [ 0.358912] PCI: Using E820 reservations for host bridge windows978worker1 # [ 0.339040] PCI: Using configuration type 1 for base access979worker1 # [ 0.340242] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.980client # [ 0.358490] ACPI: Interpreter enabled981worker2 # [ 0.362050] ACPI: Enabled 2 GPEs in block 00 to 3F982client # [ 0.358976] ACPI: PM: (supports S0 S3 S4 S5)983client # [ 0.359809] ACPI: Using IOAPIC for interrupt routing984lb # [ 0.345250] ACPI: Added _OSI(Module Device)985lb # [ 0.345834] ACPI: Added _OSI(Processor Device)986lb # [ 0.346566] ACPI: Added _OSI(Processor Aggregator Device)987worker1 # [ 0.345303] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages988worker1 # [ 0.346028] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page989client # [ 0.363020] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug990client # [ 0.363955] PCI: Using E820 reservations for host bridge windows991worker2 # [ 0.370718] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])992client # [ 0.367158] ACPI: Enabled 2 GPEs in block 00 to 3F993worker1 # [ 0.351028] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages994worker2 # [ 0.371730] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]995worker1 # [ 0.352026] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page996worker2 # [ 0.373414] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]997worker2 # [ 0.374047] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]998lb # [ 0.356433] ACPI: 1 ACPI AML tables successfully acquired and loaded999worker2 # [ 0.375255] PCI host bridge to bus 0000:001000lb # [ 0.357810] ACPI: Interpreter enabled1001worker2 # [ 0.375915] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1002lb # [ 0.358327] ACPI: PM: (supports S0 S3 S4 S5)1003worker2 # [ 0.376911] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1004lb # [ 0.358834] ACPI: Using IOAPIC for interrupt routing1005worker2 # [ 0.377911] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1006client # [ 0.375587] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1007lb # [ 0.359747] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1008worker2 # [ 0.378911] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1009client # [ 0.375963] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1010worker2 # [ 0.379911] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1011worker1 # [ 0.362498] ACPI: Added _OSI(Module Device)1012worker2 # [ 0.380911] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1013client # [ 0.377066] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1014worker1 # [ 0.363028] ACPI: Added _OSI(Processor Device)1015worker2 # [ 0.381911] pci_bus 0000:00: root bus resource [bus 00-ff]1016worker1 # [ 0.363735] ACPI: Added _OSI(Processor Aggregator Device)1017client # [ 0.378088] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1018lb # [ 0.364834] PCI: Using E820 reservations for host bridge windows1019worker2 # [ 0.382890] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1020client # [ 0.379356] PCI host bridge to bus 0000:001021lb # [ 0.365931] ACPI: Enabled 2 GPEs in block 00 to 3F1022client # [ 0.379956] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1023worker2 # [ 0.384358] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1024client # [ 0.380952] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1025client # [ 0.381951] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1026client # [ 0.382951] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1027client # [ 0.383951] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1028client # [ 0.384951] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1029worker1 # [ 0.371523] ACPI: 1 ACPI AML tables successfully acquired and loaded1030client # [ 0.385958] pci_bus 0000:00: root bus resource [bus 00-ff]1031worker2 # [ 0.387025] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1032client # [ 0.386973] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1033lb # [ 0.374709] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1034worker2 # [ 0.387975] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1035client # [ 0.388429] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1036worker2 # [ 0.388933] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1037worker1 # [ 0.375429] ACPI: Interpreter enabled1038lb # [ 0.376733] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1039worker1 # [ 0.376042] ACPI: PM: (supports S0 S3 S4 S5)1040worker2 # [ 0.390229] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1041worker1 # [ 0.376725] ACPI: Using IOAPIC for interrupt routing1042lb # [ 0.377912] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1043lb # [ 0.378957] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1044worker2 # [ 0.391615] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1045lb # [ 0.380184] PCI host bridge to bus 0000:001046worker1 # [ 0.379075] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1047lb # [ 0.380837] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1048worker1 # [ 0.380027] PCI: Using E820 reservations for host bridge windows1049lb # [ 0.381835] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1050worker2 # [ 0.393930] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1051lb # [ 0.382834] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1052worker2 # [ 0.394828] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1053client # [ 0.391078] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1054client # [ 0.391964] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1055worker2 # [ 0.395695] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1056lb # [ 0.383834] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1057worker1 # [ 0.383074] ACPI: Enabled 2 GPEs in block 00 to 3F1058client # [ 0.392901] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1059worker2 # [ 0.396740] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1060lb # [ 0.384833] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1061lb # [ 0.385833] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1062client # [ 0.393861] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1063worker2 # [ 0.398256] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1064lb # [ 0.386834] pci_bus 0000:00: root bus resource [bus 00-ff]1065client # [ 0.395691] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1066lb # [ 0.387775] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1067worker2 # [ 0.399930] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1068worker2 # [ 0.400770] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1069lb # [ 0.389290] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1070worker2 # [ 0.401625] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1071client # [ 0.397976] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1072client # [ 0.398817] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1073worker1 # [ 0.391020] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1074worker2 # [ 0.402450] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1075client # [ 0.399721] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1076worker1 # [ 0.392032] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1077client # [ 0.399957] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1078worker1 # [ 0.393107] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1079worker2 # [ 0.404931] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1080client # [ 0.401460] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1081worker1 # [ 0.394153] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1082worker1 # [ 0.395370] PCI host bridge to bus 0000:001083worker2 # [ 0.405764] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1084lb # [ 0.391905] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1085worker1 # [ 0.396031] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1086client # [ 0.402969] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1087worker2 # [ 0.406934] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1088lb # [ 0.392847] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1089client # [ 0.403777] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1090worker1 # [ 0.397028] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1091lb # [ 0.393800] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1092client # [ 0.404647] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1093worker2 # [ 0.408475] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1094worker1 # [ 0.398028] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1095lb # [ 0.394749] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1096worker1 # [ 0.399027] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1097client # [ 0.405518] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1098worker2 # [ 0.409922] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1099worker1 # [ 0.400026] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1100lb # [ 0.396662] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1101worker2 # [ 0.410739] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1102worker1 # [ 0.401027] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1103worker2 # [ 0.411614] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1104worker1 # [ 0.402027] pci_bus 0000:00: root bus resource [bus 00-ff]1105client # [ 0.407984] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1106lb # [ 0.398859] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1107worker2 # [ 0.412463] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1108worker1 # [ 0.403048] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1109client # [ 0.408958] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1110lb # [ 0.399660] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1111client # [ 0.409906] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1112lb # [ 0.400546] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1113worker1 # [ 0.404516] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1114worker2 # [ 0.414528] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1115lb # [ 0.400839] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1116worker2 # [ 0.414919] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1117client # [ 0.411351] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1118worker2 # [ 0.415934] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1119lb # [ 0.402391] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1120client # [ 0.412972] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1121worker2 # [ 0.417481] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1122client # [ 0.413821] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1123lb # [ 0.403866] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1124client # [ 0.414685] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1125lb # [ 0.404728] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1126worker2 # [ 0.418920] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1127worker1 # [ 0.407200] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1128lb # [ 0.405569] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1129worker2 # [ 0.419768] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1130client # [ 0.415518] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1131worker1 # [ 0.408040] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1132worker2 # [ 0.420622] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1133worker1 # [ 0.408972] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1134lb # [ 0.406422] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1135client # [ 0.416959] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1136worker2 # [ 0.421847] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1137worker1 # [ 0.410132] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1138client # [ 0.417801] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1139client # [ 0.418682] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1140worker2 # [ 0.423927] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1141worker1 # [ 0.411752] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1142worker2 # [ 0.424751] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1143lb # [ 0.408865] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1144client # [ 0.419550] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1145worker2 # [ 0.425620] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1146lb # [ 0.409841] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1147worker2 # [ 0.425918] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1148lb # [ 0.410801] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1149worker1 # [ 0.414035] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1150worker1 # [ 0.414859] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1151client # [ 0.421973] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1152worker2 # [ 0.427436] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1153lb # [ 0.412210] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1154worker1 # [ 0.415749] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1155client # [ 0.422817] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1156worker1 # [ 0.416032] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1157client # [ 0.423973] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1158worker2 # [ 0.428924] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1159lb # [ 0.413859] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1160worker2 # [ 0.429934] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1161lb # [ 0.414708] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1162worker1 # [ 0.417545] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1163client # [ 0.425554] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1164lb # [ 0.415587] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1165worker2 # [ 0.431451] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1166client # [ 0.426959] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1167worker1 # [ 0.419042] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1168client # [ 0.427857] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1169worker1 # [ 0.419863] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1170lb # [ 0.416472] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1171worker2 # [ 0.432920] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1172client # [ 0.428669] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1173worker2 # [ 0.433743] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1174worker1 # [ 0.420721] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1175client # [ 0.428957] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1176worker2 # [ 0.434634] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1177lb # [ 0.417855] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1178worker1 # [ 0.421593] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1179lb # [ 0.418737] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1180worker2 # [ 0.435469] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1181lb # [ 0.419580] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1182client # [ 0.430534] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1183lb # [ 0.420434] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1184client # [ 0.431905] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1185worker1 # [ 0.424075] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1186worker2 # [ 0.437172] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1187client # [ 0.432716] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1188worker1 # [ 0.425039] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1189worker2 # [ 0.437926] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1190client # [ 0.433503] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1191worker1 # [ 0.426055] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1192worker2 # [ 0.438950] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1193lb # [ 0.422865] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1194lb # [ 0.423840] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1195lb # [ 0.424854] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1196worker1 # [ 0.427776] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1197client # [ 0.434967] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1198worker2 # [ 0.440650] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1199client # [ 0.435764] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1200lb # [ 0.426409] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1201worker2 # [ 0.442685] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1202client # [ 0.436706] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1203worker1 # [ 0.431003] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1204worker2 # [ 0.443959] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1205lb # [ 0.427841] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1206worker1 # [ 0.432005] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1207client # [ 0.438944] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1208lb # [ 0.428774] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1209worker2 # [ 0.445931] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1210worker1 # [ 0.432935] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1211lb # [ 0.429596] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1212client # [ 0.440959] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1213lb # [ 0.430700] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1214client # [ 0.441794] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1215worker1 # [ 0.434750] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1216client # [ 0.442670] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1217lb # [ 0.432174] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1218client # [ 0.443530] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1219worker1 # [ 0.437036] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1220lb # [ 0.434703] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1221client # [ 0.444529] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1222worker1 # [ 0.438035] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1223lb # [ 0.435606] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1224worker1 # [ 0.439054] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1225client # [ 0.445186] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1226lb # [ 0.437275] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1227client # [ 0.446546] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1228worker1 # [ 0.440819] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1229lb # [ 0.439778] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1230lb # [ 0.440654] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1231worker1 # [ 0.444029] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1232lb # [ 0.441855] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1233worker1 # [ 0.445035] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1234worker2 # [ 0.447143] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1235worker1 # [ 0.446054] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1236lb # [ 0.443399] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1237worker2 # [ 0.449948] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1238lb # [ 0.444862] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1239worker1 # [ 0.447787] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1240lb # [ 0.445833] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1241worker2 # [ 0.451235] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1242lb # [ 0.446818] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1243worker1 # [ 0.451038] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1244client # [ 0.447160] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1245worker2 # [ 0.452922] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1246lb # [ 0.448396] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1247worker1 # [ 0.452037] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1248client # [ 0.449555] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1249worker2 # [ 0.454244] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1250worker1 # [ 0.453058] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1251lb # [ 0.450050] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1252client # [ 0.450209] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1253worker1 # [ 0.454035] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1254lb # [ 0.451064] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1255worker2 # [ 0.455272] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1256client # [ 0.451524] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1257lb # [ 0.452396] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1258worker1 # [ 0.455746] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1259worker2 # [ 0.456254] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1260client # [ 0.452211] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1261client # [ 0.453267] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1262worker1 # [ 0.458062] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1263worker2 # [ 0.457959] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1264client # [ 0.454210] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1265worker1 # [ 0.459056] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1266worker2 # [ 0.458921] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1267client # [ 0.455756] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1268worker1 # [ 0.460709] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1269worker2 # [ 0.460312] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1270client # [ 0.456628] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1271client # [ 0.457281] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1272worker1 # [ 0.463037] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1273worker2 # [ 0.461949] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1274client # [ 0.458547] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1275worker1 # [ 0.463987] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1276worker1 # [ 0.464880] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1277lb # [ 0.453090] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1278worker1 # [ 0.466727] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1279client # [ 0.462089] ACPI: PCI: Interrupt link LNKA configured for IRQ 101280worker2 # [ 0.466613] ACPI: PCI: Interrupt link LNKA configured for IRQ 101281lb # [ 0.455426] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1282client # [ 0.463059] ACPI: PCI: Interrupt link LNKB configured for IRQ 101283worker2 # [ 0.467078] ACPI: PCI: Interrupt link LNKB configured for IRQ 101284lb # [ 0.456082] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1285client # [ 0.464056] ACPI: PCI: Interrupt link LNKC configured for IRQ 111286worker1 # [ 0.469064] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1287worker2 # [ 0.468050] ACPI: PCI: Interrupt link LNKC configured for IRQ 111288client # [ 0.465057] ACPI: PCI: Interrupt link LNKD configured for IRQ 111289lb # [ 0.457597] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1290worker1 # [ 0.470037] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1291worker2 # [ 0.469058] ACPI: PCI: Interrupt link LNKD configured for IRQ 111292client # [ 0.466053] ACPI: PCI: Interrupt link LNKE configured for IRQ 101293worker1 # [ 0.471056] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1294lb # [ 0.458083] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1295client # [ 0.467056] ACPI: PCI: Interrupt link LNKF configured for IRQ 101296worker2 # [ 0.470056] ACPI: PCI: Interrupt link LNKE configured for IRQ 101297client # [ 0.468058] ACPI: PCI: Interrupt link LNKG configured for IRQ 111298lb # [ 0.459120] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1299worker2 # [ 0.471065] ACPI: PCI: Interrupt link LNKF configured for IRQ 101300worker1 # [ 0.472753] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1301client # [ 0.469054] ACPI: PCI: Interrupt link LNKH configured for IRQ 111302worker2 # [ 0.472049] ACPI: PCI: Interrupt link LNKG configured for IRQ 111303lb # [ 0.460088] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1304client # [ 0.469994] ACPI: PCI: Interrupt link GSIA configured for IRQ 161305worker2 # [ 0.473045] ACPI: PCI: Interrupt link LNKH configured for IRQ 111306worker1 # [ 0.474997] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1307client # [ 0.470966] ACPI: PCI: Interrupt link GSIB configured for IRQ 171308lb # [ 0.461834] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1309client # [ 0.471935] ACPI: PCI: Interrupt link GSIC configured for IRQ 181310worker2 # [ 0.473964] ACPI: PCI: Interrupt link GSIA configured for IRQ 161311lb # [ 0.462760] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1312worker1 # [ 0.476250] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1313client # [ 0.472668] ACPI: PCI: Interrupt link GSID configured for IRQ 191314worker2 # [ 0.474935] ACPI: PCI: Interrupt link GSIB configured for IRQ 171315client # [ 0.472968] ACPI: PCI: Interrupt link GSIE configured for IRQ 201316worker1 # [ 0.477758] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1317worker2 # [ 0.475938] ACPI: PCI: Interrupt link GSIC configured for IRQ 181318lb # [ 0.463894] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1319client # [ 0.473937] ACPI: PCI: Interrupt link GSIF configured for IRQ 211320worker2 # [ 0.476936] ACPI: PCI: Interrupt link GSID configured for IRQ 191321client # [ 0.474664] ACPI: PCI: Interrupt link GSIG configured for IRQ 221322lb # [ 0.465378] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1323client # [ 0.474966] ACPI: PCI: Interrupt link GSIH configured for IRQ 231324worker2 # [ 0.477935] ACPI: PCI: Interrupt link GSIE configured for IRQ 201325worker2 # [ 0.478933] ACPI: PCI: Interrupt link GSIF configured for IRQ 211326client # [ 0.477150] iommu: Default domain type: Translated1327worker2 # [ 0.479938] ACPI: PCI: Interrupt link GSIG configured for IRQ 221328client # [ 0.477965] iommu: DMA domain TLB invalidation policy: lazy mode1329lb # [ 0.468880] ACPI: PCI: Interrupt link LNKA configured for IRQ 101330worker2 # [ 0.480928] ACPI: PCI: Interrupt link GSIH configured for IRQ 231331client # [ 0.479201] ACPI: bus type USB registered1332lb # [ 0.469948] ACPI: PCI: Interrupt link LNKB configured for IRQ 101333client # [ 0.479944] usbcore: registered new interface driver usbfs1334lb # [ 0.470939] ACPI: PCI: Interrupt link LNKC configured for IRQ 111335client # [ 0.480879] usbcore: registered new interface driver hub1336worker2 # [ 0.483266] iommu: Default domain type: Translated1337lb # [ 0.471928] ACPI: PCI: Interrupt link LNKD configured for IRQ 111338client # [ 0.481611] usbcore: registered new device driver usb1339worker2 # [ 0.483922] iommu: DMA domain TLB invalidation policy: lazy mode1340lb # [ 0.472930] ACPI: PCI: Interrupt link LNKE configured for IRQ 101341client # [ 0.482899] NetLabel: Initializing1342worker2 # [ 0.485287] ACPI: bus type USB registered1343lb # [ 0.473930] ACPI: PCI: Interrupt link LNKF configured for IRQ 101344client # [ 0.483349] NetLabel: domain hash size = 1281345worker2 # [ 0.485990] usbcore: registered new interface driver usbfs1346lb # [ 0.474932] ACPI: PCI: Interrupt link LNKG configured for IRQ 111347client # [ 0.483951] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1348worker2 # [ 0.486933] usbcore: registered new interface driver hub1349lb # [ 0.475931] ACPI: PCI: Interrupt link LNKH configured for IRQ 111350client # [ 0.484880] NetLabel: unlabeled traffic allowed by default1351client # [ 0.485631] PCI: Using ACPI for IRQ routing1352worker2 # [ 0.487925] usbcore: registered new device driver usb1353lb # [ 0.476876] ACPI: PCI: Interrupt link GSIA configured for IRQ 161354lb # [ 0.477839] ACPI: PCI: Interrupt link GSIB configured for IRQ 171355worker1 # [ 0.478275] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1356lb # [ 0.478790] ACPI: PCI: Interrupt link GSIC configured for IRQ 181357worker2 # [ 0.490169] NetLabel: Initializing1358worker2 # [ 0.490899] NetLabel: domain hash size = 1281359lb # [ 0.479579] ACPI: PCI: Interrupt link GSID configured for IRQ 191360worker1 # [ 0.480839] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1361lb # [ 0.479845] ACPI: PCI: Interrupt link GSIE configured for IRQ 201362worker2 # [ 0.491563] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1363lb # [ 0.480792] ACPI: PCI: Interrupt link GSIF configured for IRQ 211364worker2 # [ 0.492001] NetLabel: unlabeled traffic allowed by default1365worker1 # [ 0.482111] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1366lb # [ 0.481615] ACPI: PCI: Interrupt link GSIG configured for IRQ 221367worker2 # [ 0.492928] PCI: Using ACPI for IRQ routing1368lb # [ 0.481848] ACPI: PCI: Interrupt link GSIH configured for IRQ 231369worker1 # [ 0.483734] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1370worker1 # [ 0.484296] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1371lb # [ 0.484154] iommu: Default domain type: Translated1372lb # [ 0.484849] iommu: DMA domain TLB invalidation policy: lazy mode1373worker1 # [ 0.485357] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1374lb # [ 0.486212] ACPI: bus type USB registered1375worker1 # [ 0.486349] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1376lb # [ 0.486929] usbcore: registered new interface driver usbfs1377lb # [ 0.487856] usbcore: registered new interface driver hub1378worker1 # [ 0.487930] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1379lb # [ 0.488850] usbcore: registered new device driver usb1380worker1 # [ 0.488656] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1381lb # [ 0.490758] NetLabel: Initializing1382worker1 # [ 0.489352] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1383lb # [ 0.491277] NetLabel: domain hash size = 1281384lb # [ 0.491851] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1385worker1 # [ 0.490659] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1386lb # [ 0.492988] NetLabel: unlabeled traffic allowed by default1387lb # [ 0.493846] PCI: Using ACPI for IRQ routing1388worker1 # [ 0.493985] ACPI: PCI: Interrupt link LNKA configured for IRQ 101389worker1 # [ 0.495043] ACPI: PCI: Interrupt link LNKB configured for IRQ 101390worker1 # [ 0.496162] ACPI: PCI: Interrupt link LNKC configured for IRQ 111391worker1 # [ 0.497126] ACPI: PCI: Interrupt link LNKD configured for IRQ 111392worker1 # [ 0.498128] ACPI: PCI: Interrupt link LNKE configured for IRQ 101393worker1 # [ 0.499134] ACPI: PCI: Interrupt link LNKF configured for IRQ 101394worker1 # [ 0.500132] ACPI: PCI: Interrupt link LNKG configured for IRQ 111395worker1 # [ 0.501131] ACPI: PCI: Interrupt link LNKH configured for IRQ 111396worker1 # [ 0.502067] ACPI: PCI: Interrupt link GSIA configured for IRQ 161397worker1 # [ 0.503012] ACPI: PCI: Interrupt link GSIB configured for IRQ 171398worker1 # [ 0.503770] ACPI: PCI: Interrupt link GSIC configured for IRQ 181399worker1 # [ 0.504768] ACPI: PCI: Interrupt link GSID configured for IRQ 191400worker1 # [ 0.505040] ACPI: PCI: Interrupt link GSIE configured for IRQ 201401worker1 # [ 0.505989] ACPI: PCI: Interrupt link GSIF configured for IRQ 211402worker1 # [ 0.506747] ACPI: PCI: Interrupt link GSIG configured for IRQ 221403worker1 # [ 0.507049] ACPI: PCI: Interrupt link GSIH configured for IRQ 231404worker1 # [ 0.509079] iommu: Default domain type: Translated1405worker1 # [ 0.509867] iommu: DMA domain TLB invalidation policy: lazy mode1406worker1 # [ 0.511033] ACPI: bus type USB registered1407worker1 # [ 0.511773] usbcore: registered new interface driver usbfs1408worker1 # [ 0.512085] usbcore: registered new interface driver hub1409client # [ 0.529784] pci 0000:00:01.0: vgaarb: setting as boot VGA device1410worker1 # [ 0.512939] usbcore: registered new device driver usb1411client # [ 0.529948] pci 0000:00:01.0: vgaarb: bridge control possible1412worker1 # [ 0.514551] NetLabel: Initializing1413client # [ 0.529948] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1414worker1 # [ 0.515028] NetLabel: domain hash size = 1281415client # [ 0.529956] vgaarb: loaded1416worker1 # [ 0.515797] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1417client # [ 0.530704] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01418worker1 # [ 0.516062] NetLabel: unlabeled traffic allowed by default1419worker1 # [ 0.516986] PCI: Using ACPI for IRQ routing1420client # [ 0.530952] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421worker2 # [ 0.537494] pci 0000:00:01.0: vgaarb: setting as boot VGA device1422worker2 # [ 0.537907] pci 0000:00:01.0: vgaarb: bridge control possible1423worker2 # [ 0.537907] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1424worker2 # [ 0.537915] vgaarb: loaded1425client # [ 0.534052] clocksource: Switched to clocksource kvm-clock1426worker2 # [ 0.538670] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01427worker2 # [ 0.538913] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1428client # [ 0.537740] VFS: Disk quotas dquot_6.6.01429client # [ 0.538465] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1430client # [ 0.539894] pnp: PnP ACPI init1431worker2 # [ 0.544002] clocksource: Switched to clocksource kvm-clock1432client # [ 0.540716] ACPI: IRQ 4 override to edge(!), high(!)1433client # [ 0.541704] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1434client # [ 0.543261] pnp: PnP ACPI: found 6 devices1435worker2 # [ 0.547525] VFS: Disk quotas dquot_6.6.01436lb # [ 0.538586] pci 0000:00:01.0: vgaarb: setting as boot VGA device1437worker2 # [ 0.548261] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1438worker2 # [ 0.549585] pnp: PnP ACPI init1439lb # [ 0.538829] pci 0000:00:01.0: vgaarb: bridge control possible1440worker2 # [ 0.550386] ACPI: IRQ 4 override to edge(!), high(!)1441lb # [ 0.538829] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1442lb # [ 0.538838] vgaarb: loaded1443worker2 # [ 0.551364] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1444lb # [ 0.539584] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01445worker2 # [ 0.552905] pnp: PnP ACPI: found 6 devices1446lb # [ 0.539836] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1447client # [ 0.550986] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1448client # [ 0.552487] clocksource: Switched to clocksource acpi_pm1449client # [ 0.553485] NET: Registered PF_INET protocol family1450client # [ 0.554741] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1451lb # [ 0.545942] clocksource: Switched to clocksource kvm-clock1452worker2 # [ 0.560534] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1453worker2 # [ 0.562064] clocksource: Switched to clocksource acpi_pm1454worker2 # [ 0.563052] NET: Registered PF_INET protocol family1455lb # [ 0.549578] VFS: Disk quotas dquot_6.6.01456worker2 # [ 0.564276] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1457lb # [ 0.550299] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1458lb # [ 0.551725] pnp: PnP ACPI init1459lb # [ 0.552572] ACPI: IRQ 4 override to edge(!), high(!)1460lb # [ 0.553531] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1461lb # [ 0.555107] pnp: PnP ACPI: found 6 devices1462client # [ 0.571025] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1463client # [ 0.572612] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1464worker1 # [ 0.560124] pci 0000:00:01.0: vgaarb: setting as boot VGA device1465client # [ 0.573983] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1466lb # [ 0.562765] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1467worker1 # [ 0.561023] pci 0000:00:01.0: vgaarb: bridge control possible1468lb # [ 0.564232] clocksource: Switched to clocksource acpi_pm1469client # [ 0.575306] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1470worker1 # [ 0.561023] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1471worker1 # [ 0.561033] vgaarb: loaded1472lb # [ 0.565220] NET: Registered PF_INET protocol family1473client # [ 0.576514] TCP: Hash tables configured (established 16384 bind 16384)1474worker1 # [ 0.561745] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01475worker2 # [ 0.580781] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1476lb # [ 0.566496] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1477client # [ 0.577695] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1478worker1 # [ 0.562029] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1479client # [ 0.578983] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1480worker2 # [ 0.582324] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1481client # [ 0.580131] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1482worker2 # [ 0.583631] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1483client # [ 0.581323] NET: Registered PF_UNIX/PF_LOCAL protocol family1484worker2 # [ 0.584939] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1485client # [ 0.582303] NET: Registered PF_XDP protocol family1486worker2 # [ 0.586176] TCP: Hash tables configured (established 16384 bind 16384)1487client # [ 0.583168] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1488worker1 # [ 0.566114] clocksource: Switched to clocksource kvm-clock1489worker2 # [ 0.587329] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1490client # [ 0.584173] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1491worker1 # [ 0.567743] VFS: Disk quotas dquot_6.6.01492worker2 # [ 0.588581] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1493client # [ 0.585174] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1494client # [ 0.586273] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1495worker2 # [ 0.589637] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1496worker2 # [ 0.590800] NET: Registered PF_UNIX/PF_LOCAL protocol family1497client # [ 0.587348] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1498worker1 # [ 0.570363] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1499worker2 # [ 0.591760] NET: Registered PF_XDP protocol family1500worker1 # [ 0.571683] pnp: PnP ACPI init1501client # [ 0.588421] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1502worker2 # [ 0.592616] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1503worker1 # [ 0.572472] ACPI: IRQ 4 override to edge(!), high(!)1504client # [ 0.590105] ACPI: \_SB_.GSIA: Enabled at IRQ 161505worker2 # [ 0.593638] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1506worker1 # [ 0.573454] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1507worker2 # [ 0.594650] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1508worker1 # [ 0.574958] pnp: PnP ACPI: found 6 devices1509client # [ 0.592384] ACPI: \_SB_.GSIB: Enabled at IRQ 171510worker2 # [ 0.595722] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1511worker2 # [ 0.596840] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1512client # [ 0.594807] ACPI: \_SB_.GSIC: Enabled at IRQ 181513worker2 # [ 0.597994] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1514lb # [ 0.583276] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1515worker2 # [ 0.599723] ACPI: \_SB_.GSIA: Enabled at IRQ 161516lb # [ 0.584848] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1517client # [ 0.596817] ACPI: \_SB_.GSID: Enabled at IRQ 191518lb # [ 0.586149] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1519worker2 # [ 0.602029] ACPI: \_SB_.GSIB: Enabled at IRQ 171520client # [ 0.598734] PCI: CLS 0 bytes, default 641521lb # [ 0.587525] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1522lb # [ 0.588784] TCP: Hash tables configured (established 16384 bind 16384)1523client # [ 0.599595] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1524worker1 # [ 0.582636] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1525worker2 # [ 0.603976] ACPI: \_SB_.GSIC: Enabled at IRQ 181526worker1 # [ 0.584050] clocksource: Switched to clocksource acpi_pm1527client # [ 0.601326] Trying to unpack rootfs image as initramfs...1528lb # [ 0.589900] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1529worker1 # [ 0.585015] NET: Registered PF_INET protocol family1530worker2 # [ 0.605898] ACPI: \_SB_.GSID: Enabled at IRQ 191531lb # [ 0.591164] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1532lb # [ 0.592234] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1533worker1 # [ 0.586144] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1534worker2 # [ 0.607589] PCI: CLS 0 bytes, default 641535lb # [ 0.593507] NET: Registered PF_UNIX/PF_LOCAL protocol family1536lb # [ 0.594513] NET: Registered PF_XDP protocol family1537worker2 # [ 0.608486] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1538lb # [ 0.595388] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1539worker2 # [ 0.610237] Trying to unpack rootfs image as initramfs...1540lb # [ 0.596411] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1541lb # [ 0.597383] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1542lb # [ 0.598435] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1543lb # [ 0.599482] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1544lb # [ 0.600518] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1545lb # [ 0.602296] ACPI: \_SB_.GSIA: Enabled at IRQ 161546lb # [ 0.604674] ACPI: \_SB_.GSIB: Enabled at IRQ 171547lb # [ 0.606921] ACPI: \_SB_.GSIC: Enabled at IRQ 181548lb # [ 0.609299] ACPI: \_SB_.GSID: Enabled at IRQ 191549worker1 # [ 0.603054] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1550lb # [ 0.611039] PCI: CLS 0 bytes, default 641551worker1 # [ 0.604572] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1552worker1 # [ 0.605924] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1553lb # [ 0.611971] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1554lb # [ 0.613682] Trying to unpack rootfs image as initramfs...1555worker1 # [ 0.607296] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1556worker1 # [ 0.608559] TCP: Hash tables configured (established 16384 bind 16384)1557worker1 # [ 0.609747] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1558worker1 # [ 0.611090] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1559worker1 # [ 0.612239] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1560worker1 # [ 0.613511] NET: Registered PF_UNIX/PF_LOCAL protocol family1561worker1 # [ 0.614552] NET: Registered PF_XDP protocol family1562worker1 # [ 0.615439] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1563worker1 # [ 0.616516] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1564worker1 # [ 0.617580] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1565worker1 # [ 0.618727] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1566worker1 # [ 0.619905] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1567worker1 # [ 0.621056] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1568worker1 # [ 0.622846] ACPI: \_SB_.GSIA: Enabled at IRQ 161569worker1 # [ 0.625186] ACPI: \_SB_.GSIB: Enabled at IRQ 171570worker1 # [ 0.627219] ACPI: \_SB_.GSIC: Enabled at IRQ 181571client # [ 0.645806] Initialise system trusted keyrings1572worker1 # [ 0.629322] ACPI: \_SB_.GSID: Enabled at IRQ 191573worker1 # [ 0.631064] PCI: CLS 0 bytes, default 641574client # [ 0.648724] workingset: timestamp_bits=40 max_order=19 bucket_order=01575worker1 # [ 0.632029] Trying to unpack rootfs image as initramfs...1576worker2 # [ 0.656639] Initialise system trusted keyrings1577worker1 # [ 0.636245] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1578worker2 # [ 0.657596] workingset: timestamp_bits=40 max_order=19 bucket_order=01579lb # [ 0.658010] Initialise system trusted keyrings1580client # [ 0.671956] Key type asymmetric registered1581client # [ 0.672714] Asymmetric key parser 'x509' registered1582lb # [ 0.661608] workingset: timestamp_bits=40 max_order=19 bucket_order=01583client # [ 0.673573] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1584client # [ 0.676808] io scheduler mq-deadline registered1585worker2 # [ 0.681334] Key type asymmetric registered1586worker2 # [ 0.682259] Asymmetric key parser 'x509' registered1587client # [ 0.678674] io scheduler kyber registered1588worker2 # [ 0.683099] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1589worker2 # [ 0.686359] io scheduler mq-deadline registered1590client # [ 0.682864] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1591worker2 # [ 0.687108] io scheduler kyber registered1592client # [ 0.684176] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1593worker2 # [ 0.691225] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1594client # [ 0.689472] Linux agpgart interface v0.1031595worker2 # [ 0.692504] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1596client # [ 0.690249] ACPI: bus type drm_connector registered1597client # [ 0.693275] usbcore: registered new interface driver usbserial_generic1598lb # [ 0.683166] Key type asymmetric registered1599client # [ 0.694331] usbserial: USB Serial support registered for generic1600worker2 # [ 0.698007] Linux agpgart interface v0.1031601lb # [ 0.683908] Asymmetric key parser 'x509' registered1602worker2 # [ 0.698767] ACPI: bus type drm_connector registered1603worker1 # [ 0.678332] Initialise system trusted keyrings1604client # [ 0.696676] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1605client # [ 0.696676] Please enable it if your BIOS has the CPPC option.1606lb # [ 0.686624] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1607worker2 # [ 0.701679] usbcore: registered new interface driver usbserial_generic1608client # [ 0.698842] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1609worker1 # [ 0.681961] workingset: timestamp_bits=40 max_order=19 bucket_order=01610worker2 # [ 0.702811] usbserial: USB Serial support registered for generic1611lb # [ 0.689639] io scheduler mq-deadline registered1612lb # [ 0.690436] io scheduler kyber registered1613client # [ 0.702845] drop_monitor: Initializing network drop monitor service1614worker2 # [ 0.706216] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1615client # [ 0.704031] NET: Registered PF_INET6 protocol family1616worker2 # [ 0.706216] Please enable it if your BIOS has the CPPC option.1617lb # [ 0.693191] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1618worker2 # [ 0.708477] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1619lb # [ 0.694480] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1620client # [ 0.709006] Segment Routing with IPv61621worker2 # [ 0.712359] drop_monitor: Initializing network drop monitor service1622client # [ 0.709758] In-situ OAM (IOAM) with IPv61623worker2 # [ 0.713599] NET: Registered PF_INET6 protocol family1624lb # [ 0.699452] Linux agpgart interface v0.1031625lb # [ 0.700207] ACPI: bus type drm_connector registered1626client # [ 0.712973] IPI shorthand broadcast: enabled1627worker2 # [ 0.716658] Segment Routing with IPv61628worker2 # [ 0.719239] In-situ OAM (IOAM) with IPv61629lb # [ 0.705007] usbcore: registered new interface driver usbserial_generic1630worker2 # [ 0.720323] IPI shorthand broadcast: enabled1631lb # [ 0.706103] usbserial: USB Serial support registered for generic1632worker1 # [ 0.703304] Key type asymmetric registered1633worker1 # [ 0.704051] Asymmetric key parser 'x509' registered1634lb # [ 0.709590] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1635client # [ 0.721179] sched_clock: Marking stable (587014224, 133645012)->(799049234, -78389998)1636lb # [ 0.709590] Please enable it if your BIOS has the CPPC option.1637client # [ 0.722857] registered taskstats version 11638lb # [ 0.711890] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1639client # [ 0.723796] Loading compiled-in X.509 certificates1640worker1 # [ 0.706964] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1641worker2 # [ 0.728591] sched_clock: Marking stable (592013590, 136186689)->(808779836, -80579557)1642lb # [ 0.715744] drop_monitor: Initializing network drop monitor service1643lb # [ 0.716966] NET: Registered PF_INET6 protocol family1644worker1 # [ 0.710984] io scheduler mq-deadline registered1645worker1 # [ 0.711748] io scheduler kyber registered1646worker2 # [ 0.733467] registered taskstats version 11647worker2 # [ 0.734438] Loading compiled-in X.509 certificates1648worker1 # [ 0.714101] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1649lb # [ 0.721011] Segment Routing with IPv61650lb # [ 0.721746] In-situ OAM (IOAM) with IPv61651worker1 # [ 0.715435] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1652lb # [ 0.724851] IPI shorthand broadcast: enabled1653worker1 # [ 0.721773] Linux agpgart interface v0.1031654worker1 # [ 0.722586] ACPI: bus type drm_connector registered1655client # [ 0.742670] Demotion targets for Node 0: null1656client # [ 0.743601] Key type .fscrypt registered1657worker1 # [ 0.727060] usbcore: registered new interface driver usbserial_generic1658lb # [ 0.733300] sched_clock: Marking stable (597015050, 135536117)->(804992595, -72441428)1659worker1 # [ 0.728179] usbserial: USB Serial support registered for generic1660client # [ 0.745675] Key type fscrypt-provisioning registered1661client # [ 0.746604] ima: No TPM chip found, activating TPM-bypass!1662client # [ 0.747459] ima: Allocated hash algorithm: sha11663lb # [ 0.736761] registered taskstats version 11664lb # [ 0.737765] Loading compiled-in X.509 certificates1665client # [ 0.749700] ima: No architecture policies found1666worker1 # [ 0.731929] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1667worker2 # [ 0.753219] Demotion targets for Node 0: null1668worker1 # [ 0.731929] Please enable it if your BIOS has the CPPC option.1669worker2 # [ 0.754409] Key type .fscrypt registered1670client # [ 0.751677] PM: Magic number: 10:880:681671worker2 # [ 0.755081] Key type fscrypt-provisioning registered1672worker1 # [ 0.734199] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1673client # [ 0.753230] RAS: Correctable Errors collector initialized.1674worker2 # [ 0.758338] ima: No TPM chip found, activating TPM-bypass!1675worker1 # [ 0.738065] drop_monitor: Initializing network drop monitor service1676worker2 # [ 0.759286] ima: Allocated hash algorithm: sha11677worker1 # [ 0.739274] NET: Registered PF_INET6 protocol family1678worker2 # [ 0.760080] ima: No architecture policies found1679worker2 # [ 0.762400] PM: Magic number: 10:880:681680worker1 # [ 0.743230] Segment Routing with IPv61681worker2 # [ 0.764010] RAS: Correctable Errors collector initialized.1682worker1 # [ 0.743951] In-situ OAM (IOAM) with IPv61683client # [ 0.762394] clk: Disabling unused clocks1684worker1 # [ 0.746228] IPI shorthand broadcast: enabled1685client # [ 0.765686] PM: genpd: Disabling unused power domains1686lb # [ 0.756586] Demotion targets for Node 0: null1687lb # [ 0.757470] Key type .fscrypt registered1688lb # [ 0.758188] Key type fscrypt-provisioning registered1689lb # [ 0.759169] ima: No TPM chip found, activating TPM-bypass!1690worker2 # [ 0.774017] clk: Disabling unused clocks1691worker1 # [ 0.754656] sched_clock: Marking stable (597016274, 156887756)->(830327848, -76423818)1692worker2 # [ 0.776229] PM: genpd: Disabling unused power domains1693lb # [ 0.763569] ima: Allocated hash algorithm: sha11694worker1 # [ 0.758133] registered taskstats version 11695lb # [ 0.764387] ima: No architecture policies found1696worker1 # [ 0.759127] Loading compiled-in X.509 certificates1697lb # [ 0.766568] PM: Magic number: 10:880:681698lb # [ 0.768161] RAS: Correctable Errors collector initialized.1699lb # [ 0.778468] clk: Disabling unused clocks1700lb # [ 0.780567] PM: genpd: Disabling unused power domains1701worker1 # [ 0.777920] Demotion targets for Node 0: null1702worker1 # [ 0.778922] Key type .fscrypt registered1703worker1 # [ 0.779594] Key type fscrypt-provisioning registered1704worker1 # [ 0.780522] ima: No TPM chip found, activating TPM-bypass!1705worker1 # [ 0.784926] ima: Allocated hash algorithm: sha11706worker1 # [ 0.785713] ima: No architecture policies found1707worker1 # [ 0.787929] PM: Magic number: 10:880:681708worker1 # [ 0.789576] RAS: Correctable Errors collector initialized.1709worker1 # [ 0.798728] clk: Disabling unused clocks1710worker1 # [ 0.801938] PM: genpd: Disabling unused power domains1711client # [ 0.935813] Freeing initrd memory: 29096K1712client # [ 0.938910] Freeing unused decrypted memory: 2028K1713worker2 # [ 0.944512] Freeing initrd memory: 29092K1714client # [ 0.941558] Freeing unused kernel image (initmem) memory: 3644K1715client # [ 0.942706] Write protecting the kernel read-only data: 32768k1716worker2 # [ 0.947612] Freeing unused decrypted memory: 2028K1717client # [ 0.944570] Freeing unused kernel image (text/rodata gap) memory: 1208K1718client # [ 0.946116] Freeing unused kernel image (rodata/data gap) memory: 752K1719worker2 # [ 0.950126] Freeing unused kernel image (initmem) memory: 3644K1720worker2 # [ 0.951140] Write protecting the kernel read-only data: 32768k1721worker2 # [ 0.952967] Freeing unused kernel image (text/rodata gap) memory: 1208K1722worker2 # [ 0.954417] Freeing unused kernel image (rodata/data gap) memory: 752K1723lb # [ 0.950516] Freeing initrd memory: 29092K1724lb # [ 0.953706] Freeing unused decrypted memory: 2028K1725lb # [ 0.956319] Freeing unused kernel image (initmem) memory: 3644K1726lb # [ 0.957515] Write protecting the kernel read-only data: 32768k1727lb # [ 0.959438] Freeing unused kernel image (text/rodata gap) memory: 1208K1728lb # [ 0.961004] Freeing unused kernel image (rodata/data gap) memory: 752K1729worker1 # [ 0.968654] Freeing initrd memory: 29092K1730worker1 # [ 0.971766] Freeing unused decrypted memory: 2028K1731worker1 # [ 0.974368] Freeing unused kernel image (initmem) memory: 3644K1732worker1 # [ 0.975417] Write protecting the kernel read-only data: 32768k1733worker1 # [ 0.977251] Freeing unused kernel image (text/rodata gap) memory: 1208K1734worker1 # [ 0.978725] Freeing unused kernel image (rodata/data gap) memory: 752K1735client # [ 0.997404] x86/mm: Checked W+X mappings: passed, no W+X pages found.1736client # [ 0.998449] Run /init as init process1737worker2 # [ 1.005469] x86/mm: Checked W+X mappings: passed, no W+X pages found.1738worker2 # [ 1.006565] Run /init as init process1739client # [ 1.008724] systemd[1]: Inserted module 'autofs4'1740worker2 # [ 1.016777] systemd[1]: Inserted module 'autofs4'1741lb # [ 1.012236] x86/mm: Checked W+X mappings: passed, no W+X pages found.1742lb # [ 1.013307] Run /init as init process1743client # [ 1.025013] fuse: init (API version 7.45)1744worker2 # [ 1.033052] fuse: init (API version 7.45)1745client # [ 1.030993] ACPI: \_SB_.GSIG: Enabled at IRQ 221746client # [ 1.033551] ACPI: \_SB_.GSIH: Enabled at IRQ 231747lb # [ 1.023911] systemd[1]: Inserted module 'autofs4'1748worker2 # [ 1.038948] ACPI: \_SB_.GSIG: Enabled at IRQ 221749client # [ 1.037160] ACPI: \_SB_.GSIE: Enabled at IRQ 201750worker2 # [ 1.041467] ACPI: \_SB_.GSIH: Enabled at IRQ 231751client # [ 1.039993] ACPI: \_SB_.GSIF: Enabled at IRQ 211752worker2 # [ 1.044347] ACPI: \_SB_.GSIE: Enabled at IRQ 201753worker2 # [ 1.046553] ACPI: \_SB_.GSIF: Enabled at IRQ 211754worker1 # [ 1.030465] x86/mm: Checked W+X mappings: passed, no W+X pages found.1755worker1 # [ 1.031528] Run /init as init process1756lb # [ 1.040482] fuse: init (API version 7.45)1757lb # [ 1.046471] ACPI: \_SB_.GSIG: Enabled at IRQ 221758worker1 # [ 1.042106] systemd[1]: Inserted module 'autofs4'1759lb # [ 1.048989] ACPI: \_SB_.GSIH: Enabled at IRQ 231760lb # [ 1.052328] ACPI: \_SB_.GSIE: Enabled at IRQ 201761lb # [ 1.055271] ACPI: \_SB_.GSIF: Enabled at IRQ 211762worker2 # [ 1.074043] systemd[1]: Successfully made /usr/ read-only.1763client # [ 1.074309] systemd[1]: Successfully made /usr/ read-only.1764worker1 # [ 1.059403] fuse: init (API version 7.45)1765worker1 # [ 1.065499] ACPI: \_SB_.GSIG: Enabled at IRQ 221766worker1 # [ 1.067807] ACPI: \_SB_.GSIH: Enabled at IRQ 231767worker1 # [ 1.070969] ACPI: \_SB_.GSIE: Enabled at IRQ 201768worker1 # [ 1.073133] ACPI: \_SB_.GSIF: Enabled at IRQ 211769lb # [ 1.086786] systemd[1]: Successfully made /usr/ read-only.1770worker1 # [ 1.101258] systemd[1]: Successfully made /usr/ read-only.1771worker2 # [ 1.409726] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772worker2 # [ 1.414858] systemd[1]: Detected virtualization kvm.1773worker2 # [ 1.415754] systemd[1]: Detected architecture x86-64.1774worker2 # [ 1.416655] systemd[1]: Running in initrd.1775worker2 # [ 1.417772] systemd[1]: Initializing machine ID from random generator.1776worker2 # [ 1.419072] systemd[1]: Hostname set to <worker2>.1777client # [ 1.411379] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778client # [ 1.423933] systemd[1]: Detected virtualization kvm.1779client # [ 1.426171] systemd[1]: Detected architecture x86-64.1780client # [ 1.428518] systemd[1]: Running in initrd.1781client # [ 1.431370] systemd[1]: Initializing machine ID from random generator.1782client # [ 1.434402] systemd[1]: Hostname set to <client>.1783lb # [ 1.422697] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1784lb # [ 1.427896] systemd[1]: Detected virtualization kvm.1785lb # [ 1.428897] systemd[1]: Detected architecture x86-64.1786lb # [ 1.429913] systemd[1]: Running in initrd.1787lb # [ 1.431337] systemd[1]: Initializing machine ID from random generator.1788lb # [ 1.432701] systemd[1]: Hostname set to <lb>.1789worker1 # [ 1.438259] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790worker1 # [ 1.450768] systemd[1]: Detected virtualization kvm.1791worker1 # [ 1.453234] systemd[1]: Detected architecture x86-64.1792worker1 # [ 1.455407] systemd[1]: Running in initrd.1793worker1 # [ 1.458120] systemd[1]: Initializing machine ID from random generator.1794worker1 # [ 1.461082] systemd[1]: Hostname set to <worker1>.1795worker2 # [ 1.627802] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796lb # [ 1.631557] systemd[1]: bpf-restrict-fs: LSM BPF program attached1797client # [ 1.663177] systemd[1]: bpf-restrict-fs: LSM BPF program attached1798worker2 # [ 1.672401] systemd[1]: Queued start job for default target Initrd Default Target.1799worker2 # [ 1.676626] systemd[1]: Created slice Slice /system/modprobe.1800worker2 # [ 1.677809] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1801worker2 # [ 1.679238] systemd[1]: Expecting device /dev/disk/by-label/nixos...1802worker2 # [ 1.680332] systemd[1]: Reached target Path Units.1803worker2 # [ 1.681167] systemd[1]: Reached target Slice Units.1804worker2 # [ 1.682051] systemd[1]: Reached target Swaps.1805worker2 # [ 1.682829] systemd[1]: Reached target Timer Units.1806worker2 # [ 1.683812] systemd[1]: Listening on D-Bus System Message Bus Socket.1807worker2 # [ 1.685067] systemd[1]: Listening on Journal Socket (/dev/log).1808worker2 # [ 1.686316] systemd[1]: Listening on Journal Sockets.1809worker2 # [ 1.687356] systemd[1]: Listening on udev Control Socket.1810worker2 # [ 1.688406] systemd[1]: Listening on udev Kernel Socket.1811worker2 # [ 1.689385] systemd[1]: Reached target Socket Units.1812lb # [ 1.675246] systemd[1]: Queued start job for default target Initrd Default Target.1813worker2 # [ 1.691274] systemd[1]: Starting Create List of Static Device Nodes...1814lb # [ 1.680162] systemd[1]: Created slice Slice /system/modprobe.1815worker2 # [ 1.695082] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1816worker1 # [ 1.675011] systemd[1]: bpf-restrict-fs: LSM BPF program attached1817lb # [ 1.681442] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1818lb # [ 1.682939] systemd[1]: Expecting device /dev/disk/by-label/nixos...1819lb # [ 1.684096] systemd[1]: Reached target Path Units.1820lb # [ 1.685014] systemd[1]: Reached target Slice Units.1821lb # [ 1.685922] systemd[1]: Reached target Swaps.1822lb # [ 1.686773] systemd[1]: Reached target Timer Units.1823worker2 # [ 1.702286] systemd[1]: Starting Load Kernel Module configfs...1824lb # [ 1.687840] systemd[1]: Listening on D-Bus System Message Bus Socket.1825lb # [ 1.689106] systemd[1]: Listening on Journal Socket (/dev/log).1826lb # [ 1.690375] systemd[1]: Listening on Journal Sockets.1827lb # [ 1.691409] systemd[1]: Listening on udev Control Socket.1828lb # [ 1.692645] systemd[1]: Listening on udev Kernel Socket.1829lb # [ 1.693650] systemd[1]: Reached target Socket Units.1830lb # [ 1.695777] systemd[1]: Starting Create List of Static Device Nodes...1831worker2 # [ 1.714292] systemd[1]: Starting Journal Service...1832lb # [ 1.701640] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1833lb # [ 1.705968] systemd[1]: Starting Load Kernel Module configfs...1834client # [ 1.718513] systemd[1]: Queued start job for default target Initrd Default Target.1835client # [ 1.723189] systemd[1]: Created slice Slice /system/modprobe.1836worker2 # [ 1.726864] systemd[1]: Starting Load Kernel Modules...1837client # [ 1.724400] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1838client # [ 1.725848] systemd[1]: Expecting device /dev/disk/by-label/nixos...1839client # [ 1.726970] systemd[1]: Reached target Path Units.1840client # [ 1.727849] systemd[1]: Reached target Slice Units.1841client # [ 1.728727] systemd[1]: Reached target Swaps.1842client # [ 1.729487] systemd[1]: Reached target Timer Units.1843client # [ 1.730513] systemd[1]: Listening on D-Bus System Message Bus Socket.1844client # [ 1.731780] systemd[1]: Listening on Journal Socket (/dev/log).1845client # [ 1.732952] systemd[1]: Listening on Journal Sockets.1846worker1 # [ 1.715381] systemd[1]: Queued start job for default target Initrd Default Target.1847client # [ 1.733964] systemd[1]: Listening on udev Control Socket.1848client # [ 1.735015] systemd[1]: Listening on udev Kernel Socket.1849client # [ 1.735984] systemd[1]: Reached target Socket Units.1850worker1 # [ 1.719364] systemd[1]: Created slice Slice /system/modprobe.1851lb # [ 1.725667] systemd[1]: Starting Journal Service...1852worker1 # [ 1.720554] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1853client # [ 1.738176] systemd[1]: Starting Create List of Static Device Nodes...1854worker1 # [ 1.721987] systemd[1]: Expecting device /dev/disk/by-label/nixos...1855worker1 # [ 1.723122] systemd[1]: Reached target Path Units.1856worker1 # [ 1.724016] systemd[1]: Reached target Slice Units.1857worker1 # [ 1.724917] systemd[1]: Reached target Swaps.1858worker1 # [ 1.725718] systemd[1]: Reached target Timer Units.1859worker2 # [ 1.734305] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1860client # [ 1.743749] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1861worker1 # [ 1.726824] systemd[1]: Listening on D-Bus System Message Bus Socket.1862worker1 # [ 1.728077] systemd[1]: Listening on Journal Socket (/dev/log).1863worker1 # [ 1.729282] systemd[1]: Listening on Journal Sockets.1864worker1 # [ 1.730329] systemd[1]: Listening on udev Control Socket.1865worker1 # [ 1.731346] systemd[1]: Listening on udev Kernel Socket.1866lb # [ 1.737856] systemd[1]: Starting Load Kernel Modules...1867worker1 # [ 1.732325] systemd[1]: Reached target Socket Units.1868client # [ 1.750343] systemd[1]: Starting Load Kernel Module configfs...1869worker1 # [ 1.734232] systemd[1]: Starting Create List of Static Device Nodes...1870worker2 # [ 1.755624] netfs: FS-Cache loaded1871worker2 # [ 1.760817] 9pnet: Installing 9P2000 support1872worker1 # [ 1.739987] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1873worker1 # [ 1.748000] systemd[1]: Starting Load Kernel Module configfs...1874lb # [ 1.744673] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1875worker2 # [ 1.772891] systemd[1]: Starting Coldplug All udev Devices...1876client # [ 1.769782] systemd[1]: Starting Journal Service...1877lb # [ 1.764066] netfs: FS-Cache loaded1878worker1 # [ 1.758134] systemd[1]: Starting Journal Service...1879lb # [ 1.769381] 9pnet: Installing 9P2000 support1880client # [ 1.784779] systemd[1]: Starting Load Kernel Modules...1881worker2 # [ 1.789388] systemd[1]: Finished Create List of Static Device Nodes.1882worker1 # [ 1.770272] systemd[1]: Starting Load Kernel Modules...1883worker2 # [ 1.794842] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1884lb # [ 1.782650] systemd[1]: Starting Coldplug All udev Devices...1885worker2 # [ 1.802706] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1886worker2 # [ 1.804773] systemd-journald[67]: Collecting audit messages is disabled.1887client # [ 1.792825] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1888worker1 # [ 1.775989] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1889worker2 # [ 1.808682] systemd[1]: modprobe@configfs.service: Deactivated successfully.1890client # [ 1.809321] netfs: FS-Cache loaded1891lb # [ 1.799766] systemd[1]: Finished Create List of Static Device Nodes.1892worker2 # [ 1.816621] systemd[1]: Finished Load Kernel Module configfs.1893worker1 # [ 1.797635] netfs: FS-Cache loaded1894client # [ 1.815146] 9pnet: Installing 9P2000 support1895worker2 # [ 1.821709] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1896lb # [ 1.807710] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1897worker1 # [ 1.803543] 9pnet: Installing 9P2000 support1898worker2 # [ 1.826871] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1899lb # [ 1.813621] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1900client # [ 1.827775] systemd[1]: Starting Coldplug All udev Devices...1901lb # [ 1.819064] systemd[1]: modprobe@configfs.service: Deactivated successfully.1902worker2 # [ 1.833472] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1903worker2 # [ 1.836382] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1904worker1 # [ 1.816240] systemd[1]: Starting Coldplug All udev Devices...1905lb # [ 1.824209] systemd-journald[67]: Collecting audit messages is disabled.1906lb # [ 1.827008] systemd[1]: Finished Load Kernel Module configfs.1907client # [ 1.844770] systemd[1]: Finished Create List of Static Device Nodes.1908lb # [ 1.833179] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1909lb # [ 1.837912] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1910worker1 # [ 1.834226] systemd[1]: Finished Create List of Static Device Nodes.1911client # [ 1.853145] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1912lb # [ 1.845850] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1913worker1 # [ 1.841629] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1914client # [ 1.860803] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1915lb # [ 1.849777] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1916worker1 # [ 1.846038] systemd-journald[67]: Collecting audit messages is disabled.1917worker2 # [ 1.867279] systemd[1]: Finished Load Kernel Modules.1918client # [ 1.868246] systemd[1]: modprobe@configfs.service: Deactivated successfully.1919worker1 # [ 1.851372] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1920client # [ 1.870258] systemd-journald[67]: Collecting audit messages is disabled.1921worker2 # [ 1.875428] systemd[1]: Starting Apply Kernel Variables...1922worker1 # [ 1.855261] systemd[1]: modprobe@configfs.service: Deactivated successfully.1923client # [ 1.875217] systemd[1]: Finished Load Kernel Module configfs.1924worker1 # [ 1.862291] systemd[1]: Finished Load Kernel Module configfs.1925client # [ 1.880293] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1926worker1 # [ 1.863611] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1927client # [ 1.884758] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1928worker1 # [ 1.868395] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1929worker2 # [ 1.892353] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1930worker1 # [ 1.873065] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1931client # [ 1.892972] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1932lb # [ 1.884298] systemd[1]: Finished Load Kernel Modules.1933worker1 # [ 1.878140] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1934client # [ 1.895781] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1935worker2 # [ 1.903565] systemd[1]: Starting Create Static Device Nodes in /dev...1936lb # [ 1.892786] systemd[1]: Starting Apply Kernel Variables...1937worker2 # [ 1.918329] systemd[1]: Finished Apply Kernel Variables.1938lb # [ 1.905689] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1939worker1 # [ 1.904500] systemd[1]: Finished Load Kernel Modules.1940worker2 # [ 1.793256] systemd-modules-load[68]: Inserted module 'dm_mod'1941worker2 # [ 1.794540] systemd-modules-load[68]: Inserted module 'virtio_balloon'1942worker2 # [ 1.931746] systemd[1]: Started Journal Service.1943lb # [ 1.918022] systemd[1]: Starting Create Static Device Nodes in /dev...1944worker2 # [ 1.797362] systemd-modules-load[68]: Inserted module 'virtio_gpu'1945worker1 # [ 1.913146] systemd[1]: Starting Apply Kernel Variables...1946client # [ 1.930776] systemd[1]: Finished Load Kernel Modules.1947client # [ 1.942089] systemd[1]: Starting Apply Kernel Variables...1948worker1 # [ 1.928238] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1949worker2 # [ 1.815672] systemd[1]: Finished Create Static Device Nodes in /dev.1950worker2 # [ 1.818924] systemd[1]: Reached target Preparation for Local File Systems.1951worker2 # [ 1.819983] systemd[1]: Reached target Local File Systems.1952lb # [ 1.942908] systemd[1]: Finished Apply Kernel Variables.1953worker1 # [ 1.938124] systemd[1]: Starting Create Static Device Nodes in /dev...1954worker2 # [ 1.823066] systemd[1]: Starting Create System Files and Directories...1955lb # [ 1.948339] systemd[1]: Started Journal Service.1956worker2 # [ 1.828070] systemd[1]: Starting Rule-based Manager for Device Events and Files...1957lb # [ 1.813935] systemd-modules-load[68]: Inserted module 'dm_mod'1958client # [ 1.964321] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1959lb # [ 1.818304] systemd-modules-load[68]: Inserted module 'virtio_balloon'1960lb # [ 1.822149] systemd-modules-load[68]: Inserted module 'virtio_gpu'1961worker1 # [ 1.954027] systemd[1]: Finished Apply Kernel Variables.1962client # [ 1.978802] systemd[1]: Starting Create Static Device Nodes in /dev...1963lb # [ 1.835089] systemd[1]: Finished Create Static Device Nodes in /dev.1964lb # [ 1.838159] systemd[1]: Reached target Preparation for Local File Systems.1965lb # [ 1.839129] systemd[1]: Reached target Local File Systems.1966lb # [ 1.840137] systemd[1]: Starting Create System Files and Directories...1967worker1 # [ 1.813448] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.971473] systemd[1]: Started Journal Service.1968worker1 # 1969worker1 # [ 1.817344] systemd-modules-load[68]: Inserted module 'virtio_balloon'1970worker1 # [ 1.818449] systemd-modules-load[68]: Inserted module 'virtio_gpu'1971worker2 # [ 1.860251] systemd[1]: Finished Create System Files and Directories.1972lb # [ 1.849071] systemd[1]: Starting Rule-based Manager for Device Events and Files...1973worker1 # [ 1.824188] systemd[1]: Finished Create Static Device Nodes in /dev.1974client # [ 1.867391] systemd-modules-load[68]: Inserted module 'dm_mod'[ 2.002928] systemd[1]: Started Journal Service.1975client # 1976client # [ 1.870368] systemd-modules-load[68]: Inserted module 'virtio_balloon'1977worker1 # [ 1.832114] systemd[1]: Reached target Preparation for Local File Systems.1978client # [ 1.873364] systemd-modules-load[68]: Inserted module 'virtio_gpu'1979worker1 # [ 1.833166] systemd[1]: Reached target Local File Systems.1980worker1 # [ 1.836051] systemd[1]: Starting Create System Files and Directories...1981client # [ 1.879761] systemd[1]: Finished Apply Kernel Variables.1982worker1 # [ 1.843073] systemd[1]: Starting Rule-based Manager for Device Events and Files...1983worker2 # [ 1.885863] systemd-udevd[83]: Using default interface naming scheme 'v261'.1984lb # [ 1.880241] systemd[1]: Finished Create System Files and Directories.1985client # [ 1.900109] systemd[1]: Finished Create Static Device Nodes in /dev.1986client # [ 1.901358] systemd[1]: Reached target Preparation for Local File Systems.1987client # [ 1.902372] systemd[1]: Reached target Local File Systems.1988client # [ 1.907130] systemd[1]: Starting Create System Files and Directories...1989worker2 # [ 1.911084] systemd[1]: Started Rule-based Manager for Device Events and Files.1990worker1 # [ 1.870492] systemd[1]: Finished Create System Files and Directories.1991client # [ 1.916086] systemd[1]: Starting Rule-based Manager for Device Events and Files...1992lb # [ 1.905415] systemd-udevd[83]: Using default interface naming scheme 'v261'.1993worker1 # [ 1.890767] systemd-udevd[83]: Using default interface naming scheme 'v261'.1994lb # [ 1.931480] systemd[1]: Started Rule-based Manager for Device Events and Files.1995worker2 # [ 1.950855] systemd[1]: Finished Coldplug All udev Devices.1996worker2 # [ 1.953135] systemd[1]: Reached target System Initialization.1997client # [ 1.954601] systemd[1]: Finished Create System Files and Directories.1998worker2 # [ 1.955567] systemd[1]: Reached target Basic System.1999worker1 # [ 1.916744] systemd[1]: Started Rule-based Manager for Device Events and Files.2000client # [ 1.978335] systemd-udevd[83]: Using default interface naming scheme 'v261'.3706worker1 # [ 10.546303] systemd-logind[556]: New seat seat0.3707worker1 # [ 10.555456] systemd-logind[556]: Watching system buttons on /dev/input/event2 (Power Button)3708worker1 # [ 10.557188] systemd-logind[556]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3709worker1 # [ 10.561061] systemd-logind[556]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3710worker1 # [ 10.563577] systemd[1]: Started User Login Management.3711worker1 # [ 10.566059] systemd[1]: Starting linger-users.service...3712worker1 # [ 10.581431] dbus-broker-launch[534]: Ready3713lb # [ 10.748097] kvm_amd: TSC scaling supported3714lb # [ 10.751014] kvm_amd: Nested Virtualization enabled3715lb # [ 10.755931] kvm_amd: Nested Paging enabled3716lb # [ 10.756427] kvm_amd: LBR virtualization supported3717client # [ 10.638685] systemd-vconsole-setup[425]: Configuration of first virtual console was skipped, ignoring remaining ones.3718lb # [ 10.762753] kvm_amd: Virtual VMLOAD VMSAVE supported3719lb # [ 10.763264] kvm_amd: Virtual GIF supported3720client # [ 10.641595] systemd[1]: Finished Virtual Console Setup.3721client # [ 10.643124] systemd[1]: Reached target System Initialization.3722lb # [ 10.766837] kvm_amd: Virtual NMI enabled3723client # [ 10.644161] systemd[1]: Started Discard unused filesystem blocks once a week.3724client # [ 10.645572] systemd[1]: Started Daily Cleanup of Temporary Directories.3725client # [ 10.646615] systemd[1]: Reached target Timer Units.3726client # [ 10.648183] systemd[1]: Listening on D-Bus System Message Bus Socket.3727client # [ 10.649120] systemd[1]: Listening on Nix Daemon Socket.3728client # [ 10.649834] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.3729client # [ 10.651146] systemd[1]: Reached target Socket Units.3730client # [ 10.652267] systemd[1]: Reached target Basic System.3731client # [ 10.654913] systemd[1]: Started backdoor.service.3732worker1 # [ 10.616443] systemd[1]: Started Name Service Cache Daemon (nsncd).3733client # [ 10.658059] systemd[1]: Starting Import lastlog data into lastlog2 database...3734worker1 # [ 10.619174] systemd[1]: Reached target Host and Network Name Lookups.3735client # [ 10.662222] systemd[1]: Starting nftables firewall...3736worker1 # [ 10.620592] nsncd[601]: Sep 20 08:05:50.776 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3737worker1 # [ 10.623712] systemd[1]: Reached target User and Group Name Lookups.3738client # [ 10.668156] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3739client # [ 10.675352] systemd[1]: Starting Post-Boot Actions...3740worker1 # [ 10.642290] systemd[1]: linger-users.service: Deactivated successfully.3741worker1 # [ 10.644438] systemd[1]: Finished linger-users.service.3742client # [ 10.687148] systemd[1]: Started Reset console on configuration changes.3743worker1 # [ 10.649105] systemd[1]: Finished resolvconf update.3744worker1 # [ 10.650602] systemd[1]: Reached target Preparation for Network.3745worker1 # [ 10.656824] systemd[1]: Starting DHCP Client...3746worker1 # [ 10.659384] systemd[1]: Starting Address configuration of eth1...3747lb # [ 10.823993] cfg80211: Loading compiled-in X.509 certificates for regulatory database3748client # [ 10.704943] systemd[1]: Starting resolvconf update...3749worker1 # [ 10.664393] systemd[1]: Starting Extra networking commands....3750lb # [ 10.856349] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3751lb # [ 10.859406] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3752lb # [ 10.864910] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23753lb # [ 10.865782] cfg80211: failed to load regulatory.db3754client # [ 10.750153] systemd[1]: Starting D-Bus System Message Bus...3755client # connecting to host...3756client # [ 10.789873] systemd[1]: Finished Post-Boot Actions.3757client # [ 10.792718] nsncd[432]: Sep 20 08:05:50.679 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3758worker1 # [ 10.758414] network-addresses-eth1-start[630]: adding address 192.168.1.3/24... done3759client # [ 10.799324] systemd[1]: Started Name Service Cache Daemon (nsncd).3760lb # [ 10.788693] postgresql-pre-start[790]: The files belonging to this database system will be owned by user "postgres".3761client: Guest shell says: b'Spawning backdoor root shell...\n'3762lb # [ 10.791699] postgresql-pre-start[790]: This user must also own the server process.3763lb # [ 10.798084] postgresql-pre-start[790]: The database cluster will be initialized with locale "en_US.UTF-8".3764lb # [ 10.799294] postgresql-pre-start[790]: The default database encoding has accordingly been set to "UTF8".3765worker1 # [ 10.773450] network-addresses-eth1-start[630]: adding address 2001:db8:1::3/64... done3766lb # [ 10.800461] postgresql-pre-start[790]: The default text search configuration will be set to "english".3767worker1 # [ 10.794892] systemd[1]: Finished Address configuration of eth1.3768lb # [ 10.802171] postgresql-pre-start[790]: Data page checksums are enabled.3769client: connected to guest root shell3770worker1 # [ 10.833403] dhcpcd[639]: dhcpcd-10.3.2 starting3771client # [ 10.824623] systemd[1]: Reached target Host and Network Name Lookups.3772client: (connecting took 11.53 seconds)3773lb # [ 10.803891] postgresql-pre-start[790]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3774client # [ 10.825756] systemd[1]: Reached target User and Group Name Lookups.3775lb # [ 10.806114] postgresql-pre-start[790]: creating subdirectories ... ok3776client # [ 10.844715] systemd[1]: Starting User Login Management...3777lb # [ 10.807747] postgresql-pre-start[790]: selecting dynamic shared memory implementation ... posix3778client # [ 10.858722] systemd[1]: Finished Import lastlog data into lastlog2 database.3779lb # [ 10.836270] systemd-vconsole-setup[760]: Configuration of first virtual console was skipped, ignoring remaining ones.3780client: (finished: waiting for the VM to finish booting, in 11.53 seconds)3781lb # [ 10.981440] EDAC MC: Ver: 3.0.03782lb # [ 10.856235] systemd[1]: Finished Virtual Console Setup.3783lb # [ 10.994977] 8021q: adding VLAN 0 to HW filter on device eth03784lb # [ 10.862076] dhcpcd[775]: eth0: waiting for carrier3785lb # [ 10.863921] dhcpcd[775]: eth0: carrier acquired3786worker1 # [ 10.841480] systemd[1]: Finished Extra networking commands..3787worker1 # [ 10.843426] systemd[1]: Reached target Network.3788lb # [ 10.872851] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3789worker1 # [ 10.845776] systemd[1]: Starting Permit User Sessions...3790worker1 # [ 10.850285] dhcpcd[694]: dev: loaded udev3791lb # [ 10.886851] dhcpcd[775]: DUID 00:01:00:01:32:42:50:5e:52:54:00:12:34:563792lb # [ 10.887813] dhcpcd[775]: eth0: IAID 00:12:34:563793lb # [ 10.889204] dhcpcd[775]: eth0: adding address fe80::5054:ff:fe12:34563794worker1 # [ 11.028919] 8021q: 802.1Q VLAN Support v1.83795worker1 # [ 11.029359] 8021q: adding VLAN 0 to HW filter on device eth13796worker1 # [ 10.875280] systemd[1]: Finished Permit User Sessions.3797worker1 # [ 10.879708] systemd[1]: Started Getty on tty1.3798worker1 # [ 10.880683] systemd[1]: Reached target Login Prompts.3799worker1 # [ 10.903285] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3800client # [ 10.955417] dbus-broker-launch[441]: Looking up NSS user entry for 'systemd-timesync'...3801lb # [ 10.956787] postgresql-pre-start[790]: selecting default "max_connections" ... 1003802worker1 # [ 11.114632] cfg80211: Loading compiled-in X.509 certificates for regulatory database3803client # [ 11.002502] systemd[1]: Stopped target Host and Network Name Lookups.3804client # [ 11.003736] systemd[1]: Stopping Host and Network Name Lookups...3805client # [ 11.006966] systemd[1]: Stopped target User and Group Name Lookups.3806client # [ 11.008876] systemd[1]: Stopping User and Group Name Lookups...3807client # [ 11.011222] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3808client # [ 11.012422] dbus-broker-launch[441]: NSS returned no entry for 'systemd-timesync'3809client # [ 11.016182] dbus-broker-launch[441]: Invalid user-name in /nix/store/i187syzbavbkjz7z897lklr60jwf2ymx-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3810worker1 # [ 11.135662] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3811client # [ 11.019279] systemd[1]: nscd.service: Deactivated successfully.3812worker1 # [ 11.136419] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3813client # [ 11.020113] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3814worker1 # [ 11.139586] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23815worker1 # [ 11.140489] cfg80211: failed to load regulatory.db3816lb # [ 11.037639] postgresql-pre-start[790]: selecting default "shared_buffers" ... 128MB3817client # [ 11.050304] systemd-logind[464]: New seat seat0.3818client # [ 11.057964] systemd-logind[464]: Watching system buttons on /dev/input/event2 (Power Button)3819client # [ 11.060929] systemd-logind[464]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3820client # [ 11.062249] systemd-logind[464]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3821client # [ 11.066795] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3822worker1 # [ 11.184747] 8021q: adding VLAN 0 to HW filter on device eth03823worker1 # [ 11.028963] dhcpcd[694]: eth0: waiting for carrier3824worker1 # [ 11.030312] dhcpcd[694]: eth0: carrier acquired3825client # [ 11.071067] systemd[1]: Started User Login Management.3826worker1 # [ 11.038794] dhcpcd[694]: DUID 00:01:00:01:32:42:50:5f:52:54:00:12:34:563827worker1 # [ 11.039728] dhcpcd[694]: eth0: IAID 00:12:34:563828worker1 # [ 11.040443] dhcpcd[694]: eth0: adding address fe80::5054:ff:fe12:34563829client # [ 11.096549] systemd[1]: Starting linger-users.service...3830client # [ 11.097443] systemd[1]: Started D-Bus System Message Bus.3831client # [ 11.134443] dbus-broker-launch[441]: Ready3832client # [ 11.173063] systemd[1]: Finished resolvconf update.3833client # [ 11.181990] nsncd[522]: Sep 20 08:05:51.068 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3834worker2 # [ 11.184349] dhcpcd[751]: eth0: soliciting a DHCP lease3835client # [ 11.186286] systemd[1]: Starting DHCP Client...3836client # [ 11.188891] systemd[1]: Started Name Service Cache Daemon (nsncd).3837client # [ 11.193196] systemd[1]: Reached target Host and Network Name Lookups.3838client # [ 11.194676] systemd[1]: Reached target User and Group Name Lookups.3839client # [ 11.196927] systemd[1]: linger-users.service: Deactivated successfully.3840client # [ 11.198433] systemd[1]: Finished linger-users.service.3841worker2 # [ 11.337406] NET: Registered PF_PACKET protocol family3842worker2 # [ 11.205473] dhcpcd[751]: eth0: offered 10.0.2.15 from 10.0.2.23843worker2 # [ 11.207144] dhcpcd[751]: eth0: probing address 10.0.2.15/243844client # [ 11.316109] dhcpcd[557]: dhcpcd-10.3.2 starting3845client # [ 11.324538] dhcpcd[565]: dev: loaded udev3846client # [ 11.479469] 8021q: 802.1Q VLAN Support v1.83847client # [ 11.374101] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3848client # [ 11.583157] cfg80211: Loading compiled-in X.509 certificates for regulatory database3849client # [ 11.619033] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3850client # [ 11.621116] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3851client # [ 11.625352] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23852client # [ 11.626265] cfg80211: failed to load regulatory.db3853client # [ 11.494477] systemd[1]: Finished nftables firewall.3854client # [ 11.498406] systemd[1]: Reached target Preparation for Network.3855client # [ 11.502506] systemd[1]: Starting Address configuration of eth1...3856client # [ 11.508245] systemd[1]: Starting Extra networking commands....3857client # [ 11.712992] 8021q: adding VLAN 0 to HW filter on device eth03858client # [ 11.583102] dhcpcd[565]: eth0: waiting for carrier3859client # [ 11.585460] dhcpcd[565]: eth0: carrier acquired3860client # [ 11.600530] dhcpcd[565]: DUID 00:01:00:01:32:42:50:5f:52:54:00:12:34:563861client # [ 11.601741] dhcpcd[565]: eth0: IAID 00:12:34:563862client # [ 11.602870] dhcpcd[565]: eth0: adding address fe80::5054:ff:fe12:34563863client # [ 11.748133] 8021q: adding VLAN 0 to HW filter on device eth13864client # [ 11.631610] network-addresses-eth1-start[583]: adding address 192.168.1.1/24... done3865client # [ 11.645896] network-addresses-eth1-start[583]: adding address 2001:db8:1::1/64... done3866client # [ 11.663710] systemd[1]: Finished Address configuration of eth1.3867client # [ 11.686507] systemd[1]: Finished Extra networking commands..3868client # [ 11.688908] systemd[1]: Reached target Network.3869client # [ 11.692475] systemd[1]: Starting Permit User Sessions...3870client # [ 11.719362] systemd[1]: Finished Permit User Sessions.3871client # [ 11.724690] systemd[1]: Started Getty on tty1.3872client # [ 11.726313] systemd[1]: Reached target Login Prompts.3873worker1 # [ 11.799792] dhcpcd[694]: eth0: soliciting a DHCP lease3874worker1 # [ 11.969623] NET: Registered PF_PACKET protocol family3875worker1 # [ 11.816521] dhcpcd[694]: eth0: offered 10.0.2.15 from 10.0.2.23876worker1 # [ 11.819163] dhcpcd[694]: eth0: probing address 10.0.2.15/243877lb # [ 12.100080] dhcpcd[775]: eth0: soliciting a DHCP lease3878lb # [ 12.255642] NET: Registered PF_PACKET protocol family3879lb # [ 12.126854] dhcpcd[775]: eth0: offered 10.0.2.15 from 10.0.2.23880lb # [ 12.129417] dhcpcd[775]: eth0: probing address 10.0.2.15/243881client: (finished: waiting for unit network-addresses-eth1.service, in 12.84 seconds)3882client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3883client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3884lb: waiting for unit network-addresses-eth1.service3885lb: waiting for the VM to finish booting3886lb: Guest shell says: b'Spawning backdoor root shell...\n'3887lb: connected to guest root shell3888lb: (connecting took 0.00 seconds)3889lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3890lb: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds)3891lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3892lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3893worker1: waiting for unit network-addresses-eth1.service3894worker1: waiting for the VM to finish booting3895worker1: Guest shell says: b'Spawning backdoor root shell...\n'3896worker1: connected to guest root shell3897worker1: (connecting took 0.00 seconds)3898worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3899worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds)3900worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3901worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3902worker2: waiting for unit network-addresses-eth1.service3903worker2: waiting for the VM to finish booting3904worker2: Guest shell says: b'Spawning backdoor root shell...\n'3905worker2: connected to guest root shell3906worker2: (connecting took 0.00 seconds)3907worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3908worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds)3909worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3910worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3911lb: waiting for unit niks3.service3912worker2 # [ 12.510576] dhcpcd[751]: eth0: soliciting an IPv6 router3913worker2 # [ 12.511957] dhcpcd[751]: eth0: Router Advertisement from fe80::23914worker2 # [ 12.512823] dhcpcd[751]: eth0: adding address fec0::5054:ff:fe12:3456/643915worker2 # [ 12.513772] dhcpcd[751]: eth0: adding route to fec0::/643916worker2 # [ 12.514690] dhcpcd[751]: eth0: adding default route via fe80::23917client # [ 12.541816] dhcpcd[565]: eth0: soliciting a DHCP lease3918client # [ 12.693707] NET: Registered PF_PACKET protocol family3919client # [ 12.564492] dhcpcd[565]: eth0: offered 10.0.2.15 from 10.0.2.23920client # [ 12.566126] dhcpcd[565]: eth0: probing address 10.0.2.15/243921lb # [ 12.913640] postgresql-pre-start[790]: selecting default time zone ... UTC3922lb # [ 12.918081] postgresql-pre-start[790]: creating configuration files ... ok3923lb # [ 13.170229] postgresql-pre-start[790]: running bootstrap script ... ok3924worker1 # [ 13.168690] dhcpcd[694]: eth0: soliciting an IPv6 router3925worker1 # [ 13.169954] dhcpcd[694]: eth0: Router Advertisement from fe80::23926worker1 # [ 13.170741] dhcpcd[694]: eth0: adding address fec0::5054:ff:fe12:3456/643927worker1 # [ 13.171580] dhcpcd[694]: eth0: adding route to fec0::/643928worker1 # [ 13.172342] dhcpcd[694]: eth0: adding default route via fe80::23929lb # [ 13.289778] dhcpcd[775]: eth0: soliciting an IPv6 router3930lb # [ 13.291305] dhcpcd[775]: eth0: Router Advertisement from fe80::23931lb # [ 13.293186] dhcpcd[775]: eth0: adding address fec0::5054:ff:fe12:3456/643932lb # [ 13.294074] dhcpcd[775]: eth0: adding route to fec0::/643933lb # [ 13.294797] dhcpcd[775]: eth0: adding default route via fe80::23934client # [ 13.428778] dhcpcd[565]: eth0: soliciting an IPv6 router3935client # [ 13.430404] dhcpcd[565]: eth0: Router Advertisement from fe80::23936client # [ 13.431290] dhcpcd[565]: eth0: adding address fec0::5054:ff:fe12:3456/643937client # [ 13.432249] dhcpcd[565]: eth0: adding route to fec0::/643938client # [ 13.433117] dhcpcd[565]: eth0: adding default route via fe80::23939lb # [ 13.974699] postgresql-pre-start[790]: performing post-bootstrap initialization ... ok3940lb # [ 14.125388] postgresql-pre-start[790]: syncing data to disk ... ok3941lb # [ 14.126469] postgresql-pre-start[790]: initdb: warning: enabling "trust" authentication for local connections3942lb # [ 14.127740] postgresql-pre-start[790]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3943lb # [ 14.129790] postgresql-pre-start[790]: Success. You can now start the database server using:3944lb # [ 14.131149] postgresql-pre-start[790]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3945lb # [ 14.254763] postgres[862]: [862] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3946lb # [ 14.259874] postgres[862]: [862] LOG: listening on IPv6 address "::1", port 54323947lb # [ 14.261066] postgres[862]: [862] LOG: listening on IPv4 address "127.0.0.1", port 54323948lb # [ 14.263720] postgres[862]: [862] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3949lb # [ 14.278477] postgres[871]: [871] LOG: database system was shut down at 2026-09-20 08:05:53 GMT3950lb # [ 14.284486] postgres[862]: [862] LOG: database system is ready to accept connections3951lb # [ 14.288715] systemd[1]: Started PostgreSQL Server.3952lb # [ 14.298293] systemd[1]: Starting PostgreSQL Setup Scripts...3953lb # [ 14.505649] postgresql-setup-start[882]: CREATE DATABASE3954lb # [ 14.573410] postgresql-setup-start[891]: CREATE ROLE3955lb # [ 14.599577] postgresql-setup-start[894]: ALTER DATABASE3956lb # [ 14.607264] systemd[1]: Finished PostgreSQL Setup Scripts.3957lb # [ 14.609186] systemd[1]: Reached target PostgreSQL.3958worker2 # [ 16.915925] dhcpcd[751]: eth0: leased 10.0.2.15 for 86400 seconds3959worker2 # [ 16.917535] dhcpcd[751]: eth0: adding route to 10.0.2.0/243960worker2 # [ 16.918840] dhcpcd[751]: eth0: adding default route via 10.0.2.23961lb # [ 16.904459] dhcpcd[775]: eth0: leased 10.0.2.15 for 86400 seconds3962lb # [ 16.907328] dhcpcd[775]: eth0: adding route to 10.0.2.0/243963lb # [ 16.908730] dhcpcd[775]: eth0: adding default route via 10.0.2.23964worker2 # [ 17.034858] systemd[1]: Started DHCP Client.3965worker2 # [ 17.037546] systemd[1]: Reached target Multi-User System.3966worker2 # [ 17.039239] systemd[1]: Startup finished in 873ms (kernel) + 4.003s (initrd) + 12.161s (userspace) = 17.038s.3967lb # [ 17.041651] systemd[1]: Started DHCP Client.3968lb # [ 17.047079] systemd[1]: Reached target Network is Online.3969lb # [ 17.053532] systemd[1]: Started Envoy reverse proxy.3970lb # [ 17.058513] systemd[1]: Started mock-oidc.service.3971lb # [ 17.188607] mock-oidc-server[980]: Mock OIDC Server running3972lb # [ 17.190971] mock-oidc-server[980]: OIDC Address: 192.168.1.2:80803973lb # [ 17.192729] mock-oidc-server[980]: Issue Address: 0.0.0.0:80813974lb # [ 17.194321] mock-oidc-server[980]: Issuer: http://192.168.1.2:8080/oidc3975lb # [ 17.195634] mock-oidc-server[980]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3976lb # [ 17.197377] mock-oidc-server[980]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3977lb # [ 17.199157] mock-oidc-server[980]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3978worker1 # [ 17.376197] dhcpcd[694]: eth0: leased 10.0.2.15 for 86400 seconds3979worker1 # [ 17.377355] dhcpcd[694]: eth0: adding route to 10.0.2.0/243980worker1 # [ 17.378630] dhcpcd[694]: eth0: adding default route via 10.0.2.23981worker1 # [ 17.511819] systemd[1]: Started DHCP Client.3982worker1 # [ 17.513862] systemd[1]: Reached target Multi-User System.3983worker1 # [ 17.515623] systemd[1]: Startup finished in 878ms (kernel) + 4.972s (initrd) + 11.664s (userspace) = 17.514s.3984lb # [ 17.743869] envoy[979]: [2026-09-20 08:05:57.398][979][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3985lb # [ 17.746452] envoy[979]: [2026-09-20 08:05:57.398][979][info][main] [source/server/server.cc:469] statically linked extensions:3986lb # [ 17.748849] envoy[979]: [2026-09-20 08:05:57.398][979][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name3987lb # [ 17.751642] envoy[979]: [2026-09-20 08:05:57.398][979][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input3988lb # [ 17.754040] envoy[979]: [2026-09-20 08:05:57.398][979][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory3989lb # [ 17.757512] envoy[979]: [2026-09-20 08:05:57.398][979][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3990lb # [ 17.760771] envoy[979]: [2026-09-20 08:05:57.398][979][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian23991lb # [ 17.762631] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3992lb # [ 17.767293] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response3993lb # [ 17.769702] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher3994lb # [ 17.772418] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle3995lb # [ 17.775167] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd3996lb # [ 17.780967] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router3997lb # [ 17.784422] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated3998lb # [ 17.786597] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher3999lb # [ 17.789459] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4000lb # [ 17.792281] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4001lb # [ 17.794227] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4002lb # [ 17.796310] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4003lb # [ 17.799957] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4004lb # [ 17.802303] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4005lb # [ 17.807718] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4006lb # [ 17.824138] envoy[979]: [2026-09-20 08:05:57.401][979][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4007lb # [ 17.827763] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4008lb # [ 17.831535] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4009lb # [ 17.834524] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4010lb # [ 17.838202] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24011lb # [ 17.840904] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4012lb # [ 17.843735] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4013lb # [ 17.847639] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4014lb # [ 17.849748] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4015lb # [ 17.853058] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4016lb # [ 17.857764] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14017lb # [ 17.860198] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4018lb # [ 17.863542] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24019lb # [ 17.866349] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4020lb # [ 17.869596] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4021lb # [ 17.871916] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4022lb # [ 17.879754] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4023lb # [ 17.884151] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4024lb # [ 17.887117] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4025lb # [ 17.889223] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4026lb # [ 17.893872] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4027lb # [ 17.896808] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4028lb # [ 17.902028] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4029lb # [ 17.904185] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4030lb # [ 17.906203] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4031lb # [ 17.909202] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4032lb # [ 17.912878] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4033lb # [ 17.914705] envoy[979]: [2026-09-20 08:05:57.403][979][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4034lb # [ 17.917399] envoy[979]: [2026-09-20 08:05:57.404][979][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4035lb # [ 17.925353] envoy[979]: [2026-09-20 08:05:57.404][979][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4036lb # [ 17.939349] envoy[979]: [2026-09-20 08:05:57.404][979][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4037lb # [ 17.942042] envoy[979]: [2026-09-20 08:05:57.404][979][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4038lb # [ 17.944422] envoy[979]: [2026-09-20 08:05:57.404][979][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4039lb # [ 17.955750] envoy[979]: [2026-09-20 08:05:57.404][979][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4040lb # [ 17.962629] envoy[979]: [2026-09-20 08:05:57.409][979][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4041lb # [ 17.965789] envoy[979]: [2026-09-20 08:05:57.409][979][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4042lb # [ 17.968841] envoy[979]: [2026-09-20 08:05:57.409][979][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4043lb # [ 17.971478] envoy[979]: [2026-09-20 08:05:57.409][979][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4044lb # [ 17.974848] envoy[979]: [2026-09-20 08:05:57.409][979][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4045lb # [ 17.977141] envoy[979]: [2026-09-20 08:05:57.409][979][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4046lb # [ 17.980178] envoy[979]: [2026-09-20 08:05:57.409][979][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4047lb # [ 17.982155] envoy[979]: [2026-09-20 08:05:57.409][979][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4048lb # [ 17.984092] envoy[979]: [2026-09-20 08:05:57.409][979][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4049lb # [ 17.991671] envoy[979]: [2026-09-20 08:05:57.409][979][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4050lb # [ 17.993444] envoy[979]: [2026-09-20 08:05:57.412][979][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4051lb # [ 17.995129] envoy[979]: [2026-09-20 08:05:57.412][979][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4052lb # [ 18.000522] envoy[979]: [2026-09-20 08:05:57.412][979][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4053lb # [ 18.005516] envoy[979]: [2026-09-20 08:05:57.412][979][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4054lb # [ 18.008085] envoy[979]: [2026-09-20 08:05:57.412][979][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4055lb # [ 18.010094] envoy[979]: [2026-09-20 08:05:57.412][979][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84056lb # [ 18.012092] envoy[979]: [2026-09-20 08:05:57.412][979][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4057lb # [ 18.013698] envoy[979]: [2026-09-20 08:05:57.412][979][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4058lb # [ 18.016809] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4059lb # [ 18.018504] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4060lb # [ 18.020193] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4061lb # [ 18.024537] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4062lb # [ 18.026326] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4063lb # [ 18.028591] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4064lb # [ 18.031705] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4065lb # [ 18.033640] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4066lb # [ 18.063316] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4067lb # [ 18.065920] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4068lb # [ 18.067865] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4069lb # [ 18.070548] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation4070lb # [ 18.072875] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4071lb # [ 18.075432] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4072lb # [ 18.077888] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4073lb # [ 18.080375] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4074lb # [ 18.082975] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4075lb # [ 18.085551] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4076lb # [ 18.087624] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4077lb # [ 18.089695] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4078lb # [ 18.092483] envoy[979]: [2026-09-20 08:05:57.427][979][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4079lb # [ 18.095459] envoy[979]: [2026-09-20 08:05:57.430][979][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4080lb # [ 18.097750] envoy[979]: [2026-09-20 08:05:57.430][979][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4081lb # [ 18.100556] envoy[979]: [2026-09-20 08:05:57.430][979][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4082lb # [ 18.103710] envoy[979]: [2026-09-20 08:05:57.430][979][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4083lb # [ 18.106970] envoy[979]: [2026-09-20 08:05:57.430][979][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4084lb # [ 18.109154] envoy[979]: [2026-09-20 08:05:57.430][979][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4085lb # [ 18.113179] envoy[979]: [2026-09-20 08:05:57.436][979][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4086lb # [ 18.119887] envoy[979]: [2026-09-20 08:05:57.436][979][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4087lb # [ 18.122181] envoy[979]: [2026-09-20 08:05:57.436][979][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4088lb # [ 18.124270] envoy[979]: [2026-09-20 08:05:57.436][979][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4089lb # [ 18.130292] envoy[979]: [2026-09-20 08:05:57.436][979][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4090lb # [ 18.132270] envoy[979]: [2026-09-20 08:05:57.597][979][info][main] [source/server/server.cc:531] HTTP header map info:4091lb # [ 18.134578] envoy[979]: [2026-09-20 08:05:57.663][979][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4092lb # [ 18.148463] envoy[979]: [2026-09-20 08:05:57.663][979][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4093lb # [ 18.150649] envoy[979]: [2026-09-20 08:05:57.663][979][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4094lb # [ 18.159195] envoy[979]: [2026-09-20 08:05:57.663][979][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4095lb # [ 18.222755] envoy[979]: [2026-09-20 08:05:57.877][979][info][main] [source/server/server.cc:968] runtime: {}4096lb # [ 18.233507] envoy[979]: [2026-09-20 08:05:57.888][979][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4097lb # [ 18.235957] envoy[979]: [2026-09-20 08:05:57.891][979][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014098lb # [ 18.239550] envoy[979]: [2026-09-20 08:05:57.894][979][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014099lb # [ 18.244066] envoy[979]: [2026-09-20 08:05:57.899][979][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4100lb # [ 18.245900] envoy[979]: [2026-09-20 08:05:57.901][979][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4101lb # [ 18.248036] envoy[979]: [2026-09-20 08:05:57.901][979][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4102worker1 # [ 18.285597] systemd[1]: Starting Nix worker-protocol over gRPC...4103lb # [ 18.316098] envoy[979]: [2026-09-20 08:05:57.971][979][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4104worker2 # [ 18.336343] systemd[1]: Starting Nix worker-protocol over gRPC...4105lb # [ 18.342348] envoy[979]: [2026-09-20 08:05:57.997][979][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4106lb # [ 18.345417] envoy[979]: [2026-09-20 08:05:58.000][979][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4107lb # [ 18.348518] envoy[979]: [2026-09-20 08:05:58.003][979][info][main] [source/server/server.cc:1077] starting main dispatch loop4108client # [ 18.369359] dhcpcd[565]: eth0: leased 10.0.2.15 for 86400 seconds4109client # [ 18.370348] dhcpcd[565]: eth0: adding route to 10.0.2.0/244110client # [ 18.371483] dhcpcd[565]: eth0: adding default route via 10.0.2.24111client # [ 18.462367] systemd[1]: Started DHCP Client.4112client # [ 18.464783] systemd[1]: Reached target Multi-User System.4113client # [ 18.466318] systemd[1]: Startup finished in 868ms (kernel) + 5.141s (initrd) + 12.455s (userspace) = 18.465s.4114worker1 # [ 18.496366] nix-grpc-daemon[784]: ts=2026-09-20T08:05:58Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4115worker2 # [ 18.541881] nix-grpc-daemon[847]: ts=2026-09-20T08:05:58Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4116worker1 # [ 18.506771] nix-grpc-daemon[784]: ts=2026-09-20T08:05:58Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14117worker2 # [ 18.554288] nix-grpc-daemon[847]: ts=2026-09-20T08:05:58Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14118worker1 # [ 18.551703] nix-grpc-daemon[784]: ts=2026-09-20T08:05:58Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4119worker1 # [ 18.555067] systemd[1]: Started Nix worker-protocol over gRPC.4120worker2 # [ 18.603894] nix-grpc-daemon[847]: ts=2026-09-20T08:05:58Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4121worker2 # [ 18.608331] systemd[1]: Started Nix worker-protocol over gRPC.4122worker1 # [ 18.605899] nix-grpc-daemon[784]: ts=2026-09-20T08:05:58Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4123lb # [ 18.636663] envoy[979]: [2026-09-20 08:05:58.291][979][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4124lb # [ 18.639983] envoy[979]: [2026-09-20 08:05:58.295][979][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4125lb # [ 18.642782] envoy[979]: [2026-09-20 08:05:58.295][979][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4126lb # [ 18.645323] envoy[979]: [2026-09-20 08:05:58.297][979][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4127worker2 # [ 18.667155] nix-grpc-daemon[847]: ts=2026-09-20T08:05:58Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4128worker1 # [ 18.807293] nix-grpc-daemon[784]: ts=2026-09-20T08:05:58Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4129worker2 # [ 18.868863] nix-grpc-daemon[847]: ts=2026-09-20T08:05:58Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4130worker1 # [ 19.207856] nix-grpc-daemon[784]: ts=2026-09-20T08:05:59Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4131worker2 # [ 19.269247] nix-grpc-daemon[847]: ts=2026-09-20T08:05:59Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4132worker1 # [ 20.011768] nix-grpc-daemon[784]: ts=2026-09-20T08:06:00Z level=info event=scheduler_connected addr=lb:500514133worker2 # [ 20.072647] nix-grpc-daemon[847]: ts=2026-09-20T08:05:59Z level=info event=scheduler_connected addr=lb:500514134worker1 # [ 20.047660] nix-grpc-daemon[784]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4135worker2 # [ 20.087887] nix-grpc-daemon[847]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4136worker2 # [ 20.289316] nix-grpc-daemon[847]: ts=2026-09-20T08:06:00Z level=info event=scheduler_connected addr=lb:500514137worker1 # [ 20.249801] nix-grpc-daemon[784]: ts=2026-09-20T08:06:00Z level=info event=scheduler_connected addr=lb:500514138worker1 # [ 20.253532] nix-grpc-daemon[784]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4139worker2 # [ 20.294750] nix-grpc-daemon[847]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4140worker2 # [ 20.495474] nix-grpc-daemon[847]: ts=2026-09-20T08:06:00Z level=info event=scheduler_connected addr=lb:500514141worker1 # [ 20.454311] nix-grpc-daemon[784]: ts=2026-09-20T08:06:00Z level=info event=scheduler_connected addr=lb:500514142worker2 # [ 20.498436] nix-grpc-daemon[847]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4143worker1 # [ 20.457136] nix-grpc-daemon[784]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4144worker2 # [ 20.699105] nix-grpc-daemon[847]: ts=2026-09-20T08:06:00Z level=info event=scheduler_connected addr=lb:500514145worker1 # [ 20.658164] nix-grpc-daemon[784]: ts=2026-09-20T08:06:00Z level=info event=scheduler_connected addr=lb:500514146worker2 # [ 20.703752] nix-grpc-daemon[847]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4147worker1 # [ 20.662673] nix-grpc-daemon[784]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4148worker2 # [ 20.904462] nix-grpc-daemon[847]: ts=2026-09-20T08:06:00Z level=info event=scheduler_connected addr=lb:500514149worker1 # [ 20.862961] nix-grpc-daemon[784]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:500514150worker2 # [ 20.907515] nix-grpc-daemon[847]: ts=2026-09-20T08:06:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4151worker1 # [ 20.868931] nix-grpc-daemon[784]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4152worker2 # [ 21.108676] nix-grpc-daemon[847]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:500514153worker1 # [ 21.069966] nix-grpc-daemon[784]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:500514154worker2 # [ 21.114846] nix-grpc-daemon[847]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4155worker1 # [ 21.072876] nix-grpc-daemon[784]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4156worker1 # [ 21.273443] nix-grpc-daemon[784]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:500514157worker2 # [ 21.315644] nix-grpc-daemon[847]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:500514158worker2 # [ 21.319657] nix-grpc-daemon[847]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4159worker1 # [ 21.278454] nix-grpc-daemon[784]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4160worker2 # [ 21.520461] nix-grpc-daemon[847]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:500514161worker1 # [ 21.479289] nix-grpc-daemon[784]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:500514162worker2 # [ 21.525317] nix-grpc-daemon[847]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4163worker1 # [ 21.484065] nix-grpc-daemon[784]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4164worker1 # [ 21.684979] nix-grpc-daemon[784]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:500514165worker2 # [ 21.726473] nix-grpc-daemon[847]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:500514166worker1 # [ 21.691138] nix-grpc-daemon[784]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4167worker2 # [ 21.732081] nix-grpc-daemon[847]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4168worker2 # [ 21.931928] nix-grpc-daemon[847]: ts=2026-09-20T08:06:01Z level=info event=scheduler_connected addr=lb:500514169worker1 # [ 21.891951] nix-grpc-daemon[784]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:500514170worker1 # [ 21.894048] nix-grpc-daemon[784]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4171worker2 # [ 21.935851] nix-grpc-daemon[847]: ts=2026-09-20T08:06:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4172worker1 # [ 22.095118] nix-grpc-daemon[784]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:500514173worker2 # [ 22.137071] nix-grpc-daemon[847]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:500514174worker1 # [ 22.098236] nix-grpc-daemon[784]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4175worker2 # [ 22.140389] nix-grpc-daemon[847]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4176worker2 # [ 22.341120] nix-grpc-daemon[847]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:500514177worker1 # [ 22.299210] nix-grpc-daemon[784]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:500514178worker2 # [ 22.344064] nix-grpc-daemon[847]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4179worker1 # [ 22.302759] nix-grpc-daemon[784]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4180worker2 # [ 22.544799] nix-grpc-daemon[847]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:500514181worker1 # [ 22.503581] nix-grpc-daemon[784]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:500514182worker2 # [ 22.547827] nix-grpc-daemon[847]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4183worker1 # [ 22.506613] nix-grpc-daemon[784]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4184worker2 # [ 22.748497] nix-grpc-daemon[847]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:500514185worker1 # [ 22.707209] nix-grpc-daemon[784]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:500514186worker2 # [ 22.751134] nix-grpc-daemon[847]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4187worker1 # [ 22.710314] nix-grpc-daemon[784]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4188worker2 # [ 22.951881] nix-grpc-daemon[847]: ts=2026-09-20T08:06:02Z level=info event=scheduler_connected addr=lb:500514189worker1 # [ 22.911153] nix-grpc-daemon[784]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:500514190worker2 # [ 22.955457] nix-grpc-daemon[847]: ts=2026-09-20T08:06:02Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4191worker1 # [ 22.914100] nix-grpc-daemon[784]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4192worker1 # [ 23.114956] nix-grpc-daemon[784]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:500514193worker2 # [ 23.156531] nix-grpc-daemon[847]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:500514194worker2 # [ 23.158978] nix-grpc-daemon[847]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4195worker1 # [ 23.117828] nix-grpc-daemon[784]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4196worker1 # [ 23.318635] nix-grpc-daemon[784]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:500514197worker2 # [ 23.359985] nix-grpc-daemon[847]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:500514198worker1 # [ 23.324381] nix-grpc-daemon[784]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4199worker2 # [ 23.365306] nix-grpc-daemon[847]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4200worker2 # [ 23.565630] nix-grpc-daemon[847]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:500514201worker1 # [ 23.525343] nix-grpc-daemon[784]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:500514202worker1 # [ 23.530162] nix-grpc-daemon[784]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4203worker2 # [ 23.572644] nix-grpc-daemon[847]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4204worker1 # [ 23.730782] nix-grpc-daemon[784]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:500514205worker2 # [ 23.773276] nix-grpc-daemon[847]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:500514206worker2 # [ 23.775851] nix-grpc-daemon[847]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4207worker1 # [ 23.734650] nix-grpc-daemon[784]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4208worker2 # [ 23.976770] nix-grpc-daemon[847]: ts=2026-09-20T08:06:03Z level=info event=scheduler_connected addr=lb:500514209worker1 # [ 23.935558] nix-grpc-daemon[784]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:500514210worker2 # [ 23.980303] nix-grpc-daemon[847]: ts=2026-09-20T08:06:03Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4211worker1 # [ 23.938858] nix-grpc-daemon[784]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4212worker2 # [ 24.181617] nix-grpc-daemon[847]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:500514213worker1 # [ 24.140351] nix-grpc-daemon[784]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:500514214worker2 # [ 24.184937] nix-grpc-daemon[847]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4215worker1 # [ 24.143478] nix-grpc-daemon[784]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4216worker2 # [ 24.385841] nix-grpc-daemon[847]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:500514217worker1 # [ 24.344663] nix-grpc-daemon[784]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:500514218worker2 # [ 24.389196] nix-grpc-daemon[847]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4219worker1 # [ 24.347858] nix-grpc-daemon[784]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4220worker2 # [ 24.590086] nix-grpc-daemon[847]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:500514221worker1 # [ 24.548387] nix-grpc-daemon[784]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:500514222worker2 # [ 24.593277] nix-grpc-daemon[847]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4223worker1 # [ 24.551883] nix-grpc-daemon[784]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4224worker2 # [ 24.794219] nix-grpc-daemon[847]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:500514225worker1 # [ 24.752714] nix-grpc-daemon[784]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:500514226worker2 # [ 24.797883] nix-grpc-daemon[847]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4227worker1 # [ 24.756523] nix-grpc-daemon[784]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4228worker2 # [ 24.998689] nix-grpc-daemon[847]: ts=2026-09-20T08:06:04Z level=info event=scheduler_connected addr=lb:500514229worker1 # [ 24.957600] nix-grpc-daemon[784]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:500514230worker2 # [ 25.001993] nix-grpc-daemon[847]: ts=2026-09-20T08:06:04Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4231worker1 # [ 24.960632] nix-grpc-daemon[784]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4232worker2 # [ 25.203214] nix-grpc-daemon[847]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:500514233worker1 # [ 25.161675] nix-grpc-daemon[784]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:500514234worker2 # [ 25.206404] nix-grpc-daemon[847]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4235worker1 # [ 25.165113] nix-grpc-daemon[784]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4236worker2 # [ 25.407363] nix-grpc-daemon[847]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:500514237worker1 # [ 25.366042] nix-grpc-daemon[784]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:500514238worker2 # [ 25.414149] nix-grpc-daemon[847]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4239worker1 # [ 25.375485] nix-grpc-daemon[784]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4240worker2 # [ 25.615119] nix-grpc-daemon[847]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:500514241worker1 # [ 25.576960] nix-grpc-daemon[784]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:500514242worker1 # [ 25.580300] nix-grpc-daemon[784]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4243worker2 # [ 25.621385] nix-grpc-daemon[847]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4244worker1 # [ 25.781256] nix-grpc-daemon[784]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:500514245worker2 # [ 25.822581] nix-grpc-daemon[847]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:500514246worker1 # [ 25.785047] nix-grpc-daemon[784]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4247worker2 # [ 25.828148] nix-grpc-daemon[847]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4248worker1 # [ 25.986465] nix-grpc-daemon[784]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:500514249worker2 # [ 26.028750] nix-grpc-daemon[847]: ts=2026-09-20T08:06:05Z level=info event=scheduler_connected addr=lb:500514250worker2 # [ 26.031644] nix-grpc-daemon[847]: ts=2026-09-20T08:06:05Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4251worker1 # [ 25.990514] nix-grpc-daemon[784]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4252worker2 # [ 26.233085] nix-grpc-daemon[847]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:500514253worker1 # [ 26.193721] nix-grpc-daemon[784]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:500514254worker2 # [ 26.235942] nix-grpc-daemon[847]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4255worker1 # [ 26.196504] nix-grpc-daemon[784]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4256lb # [ 26.380779] rustfs-bucket-start[1070]: mb s3://farm4257lb # [ 26.388834] systemd[1]: Finished rustfs-bucket.service.4258lb # [ 26.396988] systemd[1]: Starting niks3 server...4259worker2 # [ 26.436442] nix-grpc-daemon[847]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:500514260worker1 # [ 26.398146] nix-grpc-daemon[784]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:500514261worker2 # [ 26.439769] nix-grpc-daemon[847]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4262worker1 # [ 26.402229] nix-grpc-daemon[784]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4263worker2 # [ 26.640642] nix-grpc-daemon[847]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:500514264worker2 # [ 26.643627] nix-grpc-daemon[847]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4265worker1 # [ 26.603174] nix-grpc-daemon[784]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:500514266worker1 # [ 26.605826] nix-grpc-daemon[784]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4267lb # [ 26.650560] postgres[1086]: [1086] ERROR: relation "goose_db_version" does not exist at character 364268lb # [ 26.652393] postgres[1086]: [1086] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4269lb # [ 26.702484] niks3-server[1081]: 2026/09/20 08:06:06 OK 20241026095416_initial_model.sql (29.29ms)4270lb # [ 26.706607] niks3-server[1081]: 2026/09/20 08:06:06 OK 20251210153512_drop_unused_gin_index.sql (4.32ms)4271lb # [ 26.712469] niks3-server[1081]: 2026/09/20 08:06:06 OK 20251218171726_add_pins.sql (5.79ms)4272lb # [ 26.718320] niks3-server[1081]: 2026/09/20 08:06:06 OK 20260628120000_add_object_size_and_stats.sql (5.93ms)4273lb # [ 26.724232] niks3-server[1081]: 2026/09/20 08:06:06 OK 20260905000000_add_claims.sql (4.37ms)4274lb # [ 26.730766] niks3-server[1081]: 2026/09/20 08:06:06 OK 20260920000000_drop_claims.sql (6.41ms)4275lb # [ 26.732545] niks3-server[1081]: 2026/09/20 08:06:06 goose: successfully migrated database to version: 202609200000004276lb # [ 26.739259] niks3-server[1081]: 2026/09/20 08:06:06 OK 1_commit_pending_closure.sql (8.44ms)4277lb # [ 26.743107] niks3-server[1081]: 2026/09/20 08:06:06 OK 2_object_stats_trigger.sql (3.85ms)4278lb # [ 26.744248] niks3-server[1081]: 2026/09/20 08:06:06 goose: up to current file version: 24279lb # [ 26.751444] niks3-server[1081]: 2026/09/20 08:06:06 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4280worker2 # [ 26.844275] nix-grpc-daemon[847]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:500514281worker2 # [ 26.846479] nix-grpc-daemon[847]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4282worker1 # [ 26.806028] nix-grpc-daemon[784]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:500514283worker1 # [ 26.808110] nix-grpc-daemon[784]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4284lb # [ 26.840340] niks3-server[1081]: 2026/09/20 08:06:06 INFO Read proxy enabled — serving cache objects from S34285lb # [ 26.842276] niks3-server[1081]: 2026/09/20 08:06:06 INFO Using socket-activated listener address=0.0.0.0:57514286lb # [ 26.849293] systemd[1]: Started niks3 server.4287lb # [ 26.851206] niks3-server[1081]: 2026/09/20 08:06:06 INFO Starting HTTP server address=0.0.0.0:57514288lb # [ 26.853968] systemd[1]: Reached target Multi-User System.4289lb # [ 26.855411] systemd[1]: Startup finished in 881ms (kernel) + 4.064s (initrd) + 21.909s (userspace) = 26.854s.4290lb # [ 26.861547] niks3-server[1081]: 2026/09/20 08:06:06 INFO systemd watchdog enabled interval=15s4291lb # [ 26.864863] niks3-server[1081]: 2026/09/20 08:06:06 INFO lead: acquired remote=192.168.1.4:449724292worker2 # [ 26.885313] nix-grpc-daemon[847]: ts=2026-09-20T08:06:06Z level=info event=scheduler_take_over4293lb: (finished: waiting for unit niks3.service, in 14.49 seconds)4294lb: waiting for TCP port 5751 on localhost4295worker2 # [ 27.047361] nix-grpc-daemon[847]: ts=2026-09-20T08:06:06Z level=info event=scheduler_connected addr=lb:500514296worker1 # [ 27.008826] nix-grpc-daemon[784]: ts=2026-09-20T08:06:07Z level=info event=scheduler_connected addr=lb:500514297worker2 # [ 27.050026] nix-grpc-daemon[847]: ts=2026-09-20T08:06:06Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4298worker2 # [ 27.054404] nix-grpc-daemon[847]: ts=2026-09-20T08:06:06Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04299lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4300lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds)4301lb: waiting for unit envoy.service4302lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4303lb: waiting for TCP port 50051 on localhost4304lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4305lb # [ 27.135615] envoy[979]: conn peer=[::1]:47846 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=34306lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)4307lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4308??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4309 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284310lb: must succeed: curl -sf localhost:9901/clusters4311worker2 # [ 27.250880] nix-grpc-daemon[847]: ts=2026-09-20T08:06:07Z level=info event=scheduler_connected addr=lb:500514312worker2 # [ 27.253585] nix-grpc-daemon[847]: ts=2026-09-20T08:06:07Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4313lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4314lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds)4315subtest: one node schedules and both builders hold a WorkerSession on it4316lb: must succeed: curl -sf localhost:9901/clusters4317lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4318worker2 # [ 27.454448] nix-grpc-daemon[847]: ts=2026-09-20T08:06:07Z level=info event=scheduler_connected addr=lb:500514319worker2 # [ 27.456388] nix-grpc-daemon[847]: ts=2026-09-20T08:06:07Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04320lb: must succeed: curl -sf localhost:9901/clusters4321lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4322worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4323worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)4324(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 1.19 seconds)4325subtest: balancer auth: client cert, bearer token, nothing, unknown CN4326worker2 # [ 28.818339] nix-grpc-daemon[847]: ts=2026-09-20T08:06:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:441204327worker2 # [ 28.831208] systemd[1]: Started Nix Daemon.4328worker2 # [ 29.072388] nix-daemon[909]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4329worker2 # [ 29.121489] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 2 ms (attempt 1/5)4330worker2 # [ 29.125834] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 83 ms (attempt 2/5)4331worker2 # [ 29.211332] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 286 ms (attempt 3/5)4332worker2 # [ 29.500501] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 160 ms (attempt 4/5)4333worker2 # [ 29.667241] nix-grpc-daemon[847]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4334worker2 # [ 29.691314] nix-grpc-daemon[847]: ts=2026-09-20T08:06:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:441204335worker2 # [ 29.703814] nix-grpc-daemon[847]: ts=2026-09-20T08:06:09Z level=debug event=path_info_miss path=qyiq0715rv1yjwa8s84438x9yd9fg920-nixos-system-client-test error="error: path '/nix/store/qyiq0715rv1yjwa8s84438x9yd9fg920-nixos-system-client-test' is required, but there is no substituter that can build it"4336worker2 # [ 29.707932] nix-grpc-daemon[847]: ts=2026-09-20T08:06:09Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:441204337worker2 # [ 29.712111] nix-grpc-daemon[847]: ts=2026-09-20T08:06:09Z level=debug event=path_info_miss path=qyiq0715rv1yjwa8s84438x9yd9fg920-nixos-system-client-test error="error: path '/nix/store/qyiq0715rv1yjwa8s84438x9yd9fg920-nixos-system-client-test' is required, but there is no substituter that can build it"4338client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4339client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.07 seconds)4340client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4341client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4342worker2 # [ 30.018679] nix-grpc-daemon[847]: ts=2026-09-20T08:06:09Z level=info event=oidc_jwks provider=mock keys=14343worker2 # [ 30.022772] nix-grpc-daemon[847]: ts=2026-09-20T08:06:09Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:441204344worker1 # [ 30.007908] nix-grpc-daemon[784]: ts=2026-09-20T08:06:10Z level=info event=oidc_jwks provider=mock keys=14345worker1 # [ 30.009575] nix-grpc-daemon[784]: ts=2026-09-20T08:06:10Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:603824346worker1 # [ 30.017633] systemd[1]: Started Nix Daemon.4347worker1 # [ 30.315719] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4348worker1 # [ 30.345232] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 1/5)4349worker1 # [ 30.404850] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 165 ms (attempt 2/5)4350worker1 # [ 30.572778] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 194 ms (attempt 3/5)4351worker1 # [ 30.770491] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 335 ms (attempt 4/5)4352worker1 # [ 31.114069] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4353worker1 # [ 31.129352] nix-grpc-daemon[784]: ts=2026-09-20T08:06:11Z level=debug event=path_info_miss path=qyiq0715rv1yjwa8s84438x9yd9fg920-nixos-system-client-test error="error: path '/nix/store/qyiq0715rv1yjwa8s84438x9yd9fg920-nixos-system-client-test' is required, but there is no substituter that can build it"4354worker1 # [ 31.135070] nix-grpc-daemon[784]: ts=2026-09-20T08:06:11Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:603824355worker1 # [ 31.141419] nix-grpc-daemon[784]: ts=2026-09-20T08:06:11Z level=debug event=path_info_miss path=qyiq0715rv1yjwa8s84438x9yd9fg920-nixos-system-client-test error="error: path '/nix/store/qyiq0715rv1yjwa8s84438x9yd9fg920-nixos-system-client-test' is required, but there is no substituter that can build it"4356client: must succeed: rm -r /var/lib/nix-grpc-store4357client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.02 seconds)4358worker1 # [ 31.379562] nix-grpc-daemon[784]: ts=2026-09-20T08:06:11Z level=info event=denied method=QueryMissing cn=- role=none4359worker2 # [ 31.652822] nix-grpc-daemon[847]: ts=2026-09-20T08:06:11Z level=info event=denied method=QueryMissing cn=stranger role=none4360(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.16 seconds)4361subtest: DAG build is scheduled across workers and lands in the cache4362client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24363worker2 # [ 31.896480] nix-grpc-daemon[847]: ts=2026-09-20T08:06:11Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:441204364client # don't know how to build these paths:4365client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4366worker2 # [ 31.922419] nix-grpc-daemon[847]: ts=2026-09-20T08:06:11Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04367worker2 # [ 31.927790] nix-grpc-daemon[847]: ts=2026-09-20T08:06:11Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14368worker1 # [ 31.940239] nix-grpc-daemon[784]: ts=2026-09-20T08:06:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603824369worker1 # [ 31.959103] nix-grpc-daemon[784]: ts=2026-09-20T08:06:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603824370client # copying 1 paths to 'lb:50051'...4371worker1 # [ 31.970929] nix-grpc-daemon[784]: ts=2026-09-20T08:06:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603824372client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4373worker1 # [ 31.989420] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4374worker1 # [ 32.016600] nix-grpc-daemon[784]: ts=2026-09-20T08:06:12Z level=info event=niks3_push_started pid=8514375worker1 # [ 32.448352] nix-daemon[841]: accepted connection from pid 863, user nix-grpc-daemon (trusted)4376worker1 # [ 32.468905] nix-daemon[841]: reaped child process 866, status = succeeded4377worker1 # [ 32.611097] nix-daemon[841]: accepted connection from pid 868, user nix-grpc-daemon (trusted)4378worker1 # [ 32.624256] nix-daemon[841]: reaped child process 871, status = succeeded4379lb # [ 32.667073] niks3-server[1081]: 2026/09/20 08:06:12 INFO Received uploads request method=POST path=/api/pending_closures4380worker1 # [ 32.674536] nix-grpc-daemon[851]: time=2026-09-20T08:06:12.831Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4381worker1 # [ 32.678067] nix-grpc-daemon[851]: time=2026-09-20T08:06:12.835Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4382lb # [ 32.753648] niks3-server[1081]: 2026/09/20 08:06:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4383lb # [ 32.766094] niks3-server[1081]: 2026/09/20 08:06:12 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4384lb # [ 32.776057] niks3-server[1081]: 2026/09/20 08:06:12 INFO Signed narinfos id=1 count=14385worker1 # [ 32.750388] nix-grpc-daemon[851]: time=2026-09-20T08:06:12.908Z level=INFO msg="Uploading 1 narinfos"4386lb # [ 32.788803] niks3-server[1081]: 2026/09/20 08:06:12 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4387lb # [ 32.813181] niks3-server[1081]: 2026/09/20 08:06:12 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4388lb # [ 32.834087] niks3-server[1081]: 2026/09/20 08:06:12 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4389lb # [ 32.859762] niks3-server[1081]: 2026/09/20 08:06:12 INFO Completed upload id=14390worker1 # [ 32.832982] nix-grpc-daemon[851]: time=2026-09-20T08:06:12.991Z level=INFO msg="Upload complete. (540ms)"4391worker1 # [ 32.840164] nix-grpc-daemon[784]: ts=2026-09-20T08:06:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=0 paths=1 nar_bytes_in=5044392worker1 # [ 32.847105] nix-grpc-daemon[784]: ts=2026-09-20T08:06:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603824393worker1 # [ 32.858530] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4394worker1 # [ 32.872370] nix-daemon[841]: reaped child process 849, status = succeeded4395client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4396client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4397worker1 # [ 32.881217] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4398client # farm-a> LOG-farm-a-t14399worker1 # [ 33.900466] nix-daemon[841]: reaped child process 875, status = succeeded4400worker1 # [ 34.043812] nix-daemon[841]: accepted connection from pid 891, user nix-grpc-daemon (trusted)4401worker1 # [ 34.056828] nix-daemon[841]: reaped child process 894, status = succeeded4402lb # [ 34.095829] niks3-server[1081]: 2026/09/20 08:06:13 INFO Received uploads request method=POST path=/api/pending_closures4403worker1 # [ 34.074669] nix-grpc-daemon[851]: time=2026-09-20T08:06:14.232Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4404worker1 # [ 34.076239] nix-grpc-daemon[851]: time=2026-09-20T08:06:14.234Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4405lb # [ 34.123731] niks3-server[1081]: 2026/09/20 08:06:13 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4406lb # [ 34.131057] niks3-server[1081]: 2026/09/20 08:06:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4407lb # [ 34.134486] niks3-server[1081]: 2026/09/20 08:06:13 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4408lb # [ 34.136419] niks3-server[1081]: 2026/09/20 08:06:13 INFO Signed narinfos id=2 count=14409worker1 # [ 34.110804] nix-grpc-daemon[851]: time=2026-09-20T08:06:14.268Z level=INFO msg="Uploading 1 narinfos"4410lb # [ 34.138963] niks3-server[1081]: 2026/09/20 08:06:13 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4411lb # [ 34.145054] niks3-server[1081]: 2026/09/20 08:06:13 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4412lb # [ 34.152028] niks3-server[1081]: 2026/09/20 08:06:13 INFO Completed upload id=24413worker1 # [ 34.124688] nix-grpc-daemon[851]: time=2026-09-20T08:06:14.283Z level=INFO msg="Upload complete. (230ms)"4414lb # [ 34.153573] niks3-server[1081]: 2026/09/20 08:06:13 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4415worker1 # [ 34.127652] nix-grpc-daemon[784]: ts=2026-09-20T08:06:14Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14416worker1 # [ 34.134196] nix-daemon[841]: reaped child process 873, status = succeeded4417worker2 # [ 34.185539] nix-grpc-daemon[847]: ts=2026-09-20T08:06:14Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04418worker2 # [ 34.187735] nix-grpc-daemon[847]: ts=2026-09-20T08:06:14Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14419worker1 # [ 34.188089] nix-grpc-daemon[784]: ts=2026-09-20T08:06:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603824420worker1 # [ 34.196248] nix-grpc-daemon[784]: ts=2026-09-20T08:06:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603824421worker1 # [ 34.215442] nix-grpc-daemon[851]: time=2026-09-20T08:06:14.373Z level=INFO msg="All 1 paths already cached"4422client # copying 1 paths to 'lb:50051'...4423client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4424worker1 # [ 34.223142] nix-grpc-daemon[784]: ts=2026-09-20T08:06:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603824425worker1 # [ 34.230539] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4426worker1 # [ 34.392221] nix-daemon[841]: accepted connection from pid 898, user nix-grpc-daemon (trusted)4427worker1 # [ 34.407504] nix-daemon[841]: reaped child process 901, status = succeeded4428worker1 # [ 34.573926] nix-daemon[841]: accepted connection from pid 904, user nix-grpc-daemon (trusted)4429worker1 # [ 34.590424] nix-daemon[841]: reaped child process 907, status = succeeded4430lb # [ 34.632225] niks3-server[1081]: 2026/09/20 08:06:14 INFO Received uploads request method=POST path=/api/pending_closures4431worker1 # [ 34.616622] nix-grpc-daemon[851]: time=2026-09-20T08:06:14.774Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4432worker1 # [ 34.618220] nix-grpc-daemon[851]: time=2026-09-20T08:06:14.776Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4433lb # [ 34.667273] niks3-server[1081]: 2026/09/20 08:06:14 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4434lb # [ 34.680332] niks3-server[1081]: 2026/09/20 08:06:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4435worker1 # [ 34.661871] nix-grpc-daemon[851]: time=2026-09-20T08:06:14.820Z level=INFO msg="Uploading 1 narinfos"4436lb # [ 34.689049] niks3-server[1081]: 2026/09/20 08:06:14 INFO Signed narinfos id=3 count=14437lb # [ 34.693503] niks3-server[1081]: 2026/09/20 08:06:14 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4438lb # [ 34.706489] niks3-server[1081]: 2026/09/20 08:06:14 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4439lb # [ 34.712704] niks3-server[1081]: 2026/09/20 08:06:14 INFO Completed upload id=34440worker1 # [ 34.685729] nix-grpc-daemon[851]: time=2026-09-20T08:06:14.843Z level=INFO msg="Upload complete. (446ms)"4441lb # [ 34.715548] niks3-server[1081]: 2026/09/20 08:06:14 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4442worker1 # [ 34.690174] nix-grpc-daemon[784]: ts=2026-09-20T08:06:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=0 paths=1 nar_bytes_in=6244443worker1 # [ 34.695873] nix-grpc-daemon[784]: ts=2026-09-20T08:06:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603824444worker1 # [ 34.708157] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4445worker1 # [ 34.712971] nix-daemon[841]: reaped child process 896, status = succeeded4446worker1 # [ 34.718839] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4447client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4448client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4449client # farm-b> LOG-farm-b-t14450worker1 # [ 35.744291] nix-daemon[841]: reaped child process 911, status = succeeded4451worker1 # [ 35.905724] nix-daemon[841]: accepted connection from pid 926, user nix-grpc-daemon (trusted)4452worker1 # [ 35.918871] nix-daemon[841]: reaped child process 929, status = succeeded4453lb # [ 35.961923] niks3-server[1081]: 2026/09/20 08:06:15 INFO Received uploads request method=POST path=/api/pending_closures4454worker1 # [ 35.943640] nix-grpc-daemon[851]: time=2026-09-20T08:06:16.101Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4455worker1 # [ 35.946686] nix-grpc-daemon[851]: time=2026-09-20T08:06:16.104Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4456lb # [ 36.005143] niks3-server[1081]: 2026/09/20 08:06:15 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4457lb # [ 36.014094] niks3-server[1081]: 2026/09/20 08:06:15 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4458lb # [ 36.020086] niks3-server[1081]: 2026/09/20 08:06:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4459lb # [ 36.023551] niks3-server[1081]: 2026/09/20 08:06:15 INFO Signed narinfos id=4 count=14460worker1 # [ 35.998851] nix-grpc-daemon[851]: time=2026-09-20T08:06:16.156Z level=INFO msg="Uploading 1 narinfos"4461lb # [ 36.030567] niks3-server[1081]: 2026/09/20 08:06:15 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4462lb # [ 36.036372] niks3-server[1081]: 2026/09/20 08:06:15 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4463lb # [ 36.039887] niks3-server[1081]: 2026/09/20 08:06:15 INFO Completed upload id=44464lb # [ 36.042156] niks3-server[1081]: 2026/09/20 08:06:15 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4465worker1 # [ 36.014122] nix-grpc-daemon[851]: time=2026-09-20T08:06:16.172Z level=INFO msg="Upload complete. (286ms)"4466worker1 # [ 36.019769] nix-grpc-daemon[784]: ts=2026-09-20T08:06:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14467worker2 # [ 36.068797] nix-grpc-daemon[847]: ts=2026-09-20T08:06:15Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04468worker1 # [ 36.033945] nix-daemon[841]: reaped child process 909, status = succeeded4469worker2 # [ 36.073307] nix-grpc-daemon[847]: ts=2026-09-20T08:06:15Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14470worker1 # [ 36.072416] nix-grpc-daemon[784]: ts=2026-09-20T08:06:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603824471worker1 # [ 36.086881] nix-grpc-daemon[784]: ts=2026-09-20T08:06:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603824472worker1 # [ 36.099629] nix-grpc-daemon[851]: time=2026-09-20T08:06:16.257Z level=INFO msg="All 2 paths already cached"4473client # copying 1 paths to 'lb:50051'...4474worker1 # [ 36.107992] nix-grpc-daemon[784]: ts=2026-09-20T08:06:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603824475client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4476worker1 # [ 36.126506] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4477worker1 # [ 36.313813] nix-daemon[841]: accepted connection from pid 933, user nix-grpc-daemon (trusted)4478worker1 # [ 36.328352] nix-daemon[841]: reaped child process 936, status = succeeded4479worker1 # [ 36.494409] nix-daemon[841]: accepted connection from pid 938, user nix-grpc-daemon (trusted)4480worker1 # [ 36.506801] nix-daemon[841]: reaped child process 941, status = succeeded4481lb # [ 36.549205] niks3-server[1081]: 2026/09/20 08:06:16 INFO Received uploads request method=POST path=/api/pending_closures4482worker1 # [ 36.530490] nix-grpc-daemon[851]: time=2026-09-20T08:06:16.688Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4483worker1 # [ 36.531974] nix-grpc-daemon[851]: time=2026-09-20T08:06:16.690Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4484lb # [ 36.580270] niks3-server[1081]: 2026/09/20 08:06:16 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4485lb # [ 36.591880] niks3-server[1081]: 2026/09/20 08:06:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4486worker1 # [ 36.571968] nix-grpc-daemon[851]: time=2026-09-20T08:06:16.730Z level=INFO msg="Uploading 1 narinfos"4487lb # [ 36.599399] niks3-server[1081]: 2026/09/20 08:06:16 INFO Signed narinfos id=5 count=14488lb # [ 36.602992] niks3-server[1081]: 2026/09/20 08:06:16 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4489lb # [ 36.616218] niks3-server[1081]: 2026/09/20 08:06:16 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4490lb # [ 36.622321] niks3-server[1081]: 2026/09/20 08:06:16 INFO Completed upload id=54491worker1 # [ 36.595863] nix-grpc-daemon[851]: time=2026-09-20T08:06:16.753Z level=INFO msg="Upload complete. (452ms)"4492worker1 # [ 36.597250] nix-grpc-daemon[784]: ts=2026-09-20T08:06:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=0 paths=1 nar_bytes_in=7524493lb # [ 36.626528] niks3-server[1081]: 2026/09/20 08:06:16 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4494worker1 # [ 36.601540] nix-grpc-daemon[784]: ts=2026-09-20T08:06:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603824495worker1 # [ 36.606579] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4496worker1 # [ 36.618249] nix-daemon[841]: reaped child process 931, status = succeeded4497client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4498client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4499worker1 # [ 36.627953] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4500client # farm-top> LOG-farm-top-t14501worker1 # [ 37.246714] nix-daemon[841]: reaped child process 945, status = succeeded4502worker1 # [ 37.376981] nix-daemon[841]: accepted connection from pid 961, user nix-grpc-daemon (trusted)4503worker1 # [ 37.388657] nix-daemon[841]: reaped child process 964, status = succeeded4504lb # [ 37.426786] niks3-server[1081]: 2026/09/20 08:06:17 INFO Received uploads request method=POST path=/api/pending_closures4505worker1 # [ 37.409507] nix-grpc-daemon[851]: time=2026-09-20T08:06:17.567Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4506worker1 # [ 37.410981] nix-grpc-daemon[851]: time=2026-09-20T08:06:17.569Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4507lb # [ 37.466638] niks3-server[1081]: 2026/09/20 08:06:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4508worker1 # [ 37.442479] nix-grpc-daemon[851]: time=2026-09-20T08:06:17.600Z level=INFO msg="Uploading 1 narinfos"4509lb # [ 37.470180] niks3-server[1081]: 2026/09/20 08:06:17 INFO Signed narinfos id=6 count=14510lb # [ 37.483777] niks3-server[1081]: 2026/09/20 08:06:17 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4511lb # [ 37.487753] niks3-server[1081]: 2026/09/20 08:06:17 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4512lb # [ 37.496105] niks3-server[1081]: 2026/09/20 08:06:17 INFO Completed upload id=64513worker1 # [ 37.468677] nix-grpc-daemon[851]: time=2026-09-20T08:06:17.627Z level=INFO msg="Upload complete. (231ms)"4514lb # [ 37.497994] niks3-server[1081]: 2026/09/20 08:06:17 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4515worker1 # [ 37.472375] nix-grpc-daemon[784]: ts=2026-09-20T08:06:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=0 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14516lb # [ 37.501385] niks3-server[1081]: 2026/09/20 08:06:17 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4517lb # [ 37.504522] niks3-server[1081]: 2026/09/20 08:06:17 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4518worker1 # [ 37.478119] nix-daemon[841]: reaped child process 943, status = succeeded4519client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 5.87 seconds)4520client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4521client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.19 seconds)4522client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4523client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4524client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4525client # copying 3 paths...4526client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4527client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4528client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4529client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds)4530(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.40 seconds)4531subtest: repeat is answered Cached by the scheduler without building4532worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4533worker1 # finding garbage collector roots...4534worker1 # deleting specified paths...4535worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4536worker1 # deleting unused links...4537worker1 # note: hard linking is currently saving 0.0 KiB4538worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.24 seconds)4539worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4540lb # [ 38.327634] envoy[979]: conn peer=[2001:db8:1::1]:46676 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=715 tx=364 ms=9394541lb # [ 38.329687] envoy[979]: conn peer=[2001:db8:1::1]:46684 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2613 tx=405 ms=11964542lb # [ 38.331855] envoy[979]: conn peer=[2001:db8:1::1]:46698 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=104543lb # [ 38.333554] envoy[979]: conn peer=[2001:db8:1::1]:46710 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=104544lb # [ 38.335377] envoy[979]: conn peer=[2001:db8:1::1]:46726 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9355 tx=3803 ms=56594545worker2 # finding garbage collector roots...4546worker2 # deleting specified paths...4547worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4548worker2 # deleting unused links...4549worker2 # note: hard linking is currently saving 0.0 KiB4550worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.24 seconds)4551client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24552worker1 # [ 38.690859] nix-grpc-daemon[784]: ts=2026-09-20T08:06:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:603824553client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4554client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4555worker2 # [ 38.758771] nix-grpc-daemon[847]: ts=2026-09-20T08:06:18Z level=debug event=want client=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=14556worker2 # [ 38.766736] nix-grpc-daemon[847]: ts=2026-09-20T08:06:18Z level=debug event=want client=2 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=14557worker2 # [ 38.773617] nix-grpc-daemon[847]: ts=2026-09-20T08:06:18Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14558client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 0.25 seconds)4559client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4560client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.19 seconds)4561lb: must succeed: curl -sf localhost:9901/clusters4562lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)4563lb: must succeed: curl -sf localhost:9901/clusters4564lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4565worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4566worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.05 seconds)4567(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.17 seconds)4568subtest: two clients wanting the same drv build it once4569client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4570client # [ 39.290689] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4571client # Running as unit: dedup1.service; invocation ID: 9f64100cd5f5410d9f0f5c2d7489e7fb4572client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.05 seconds)4573client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4574worker2 # [ 39.483302] nix-grpc-daemon[847]: ts=2026-09-20T08:06:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:441204575client # [ 39.489489] nix[868]: don't know how to build these paths:4576client # [ 39.490924] nix[868]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4577worker2 # [ 39.500550] nix-grpc-daemon[847]: ts=2026-09-20T08:06:19Z level=debug event=want client=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04578worker2 # [ 39.506434] nix-grpc-daemon[847]: ts=2026-09-20T08:06:19Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14579worker2 # [ 39.547064] nix-grpc-daemon[847]: ts=2026-09-20T08:06:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441204580worker2 # [ 39.569927] nix-grpc-daemon[847]: ts=2026-09-20T08:06:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441204581client # [ 39.582485] nix[868]: copying 1 paths to 'lb:50051'...4582worker2 # [ 39.584573] nix-grpc-daemon[847]: ts=2026-09-20T08:06:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:441204583client # [ 39.585188] nix[868]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4584worker2 # [ 39.599401] nix-daemon[909]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4585worker2 # [ 39.623532] nix-grpc-daemon[847]: ts=2026-09-20T08:06:19Z level=info event=niks3_push_started pid=9544586worker2 # [ 40.038578] nix-daemon[909]: accepted connection from pid 965, user nix-grpc-daemon (trusted)4587worker2 # [ 40.053585] nix-daemon[909]: reaped child process 969, status = succeeded4588worker2 # [ 40.217239] nix-daemon[909]: accepted connection from pid 971, user nix-grpc-daemon (trusted)4589worker2 # [ 40.231360] nix-daemon[909]: reaped child process 974, status = succeeded4590lb # [ 40.230814] niks3-server[1081]: 2026/09/20 08:06:19 INFO Received uploads request method=POST path=/api/pending_closures4591worker2 # [ 40.331740] nix-grpc-daemon[954]: time=2026-09-20T08:06:20.256Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4592worker2 # [ 40.335551] nix-grpc-daemon[954]: time=2026-09-20T08:06:20.260Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4593lb # [ 40.343061] niks3-server[1081]: 2026/09/20 08:06:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4594lb # [ 40.345986] niks3-server[1081]: 2026/09/20 08:06:20 INFO Signed narinfos id=7 count=14595worker2 # [ 40.361506] nix-grpc-daemon[954]: time=2026-09-20T08:06:20.287Z level=INFO msg="Uploading 1 narinfos"4596lb # [ 40.349290] niks3-server[1081]: 2026/09/20 08:06:20 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4597lb # [ 40.356327] niks3-server[1081]: 2026/09/20 08:06:20 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4598lb # [ 40.360359] niks3-server[1081]: 2026/09/20 08:06:20 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4599client # [ 40.369806] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4600client # Running as unit: dedup2.service; invocation ID: 0885d2266e6c48ddac8749a0225c86c94601lb # [ 40.365840] niks3-server[1081]: 2026/09/20 08:06:20 INFO Completed upload id=74602lb # [ 40.368373] niks3-server[1081]: 2026/09/20 08:06:20 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4603worker2 # [ 40.381623] nix-grpc-daemon[954]: time=2026-09-20T08:06:20.307Z level=INFO msg="Upload complete. (508ms)"4604client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds)4605worker2 # [ 40.386551] nix-grpc-daemon[847]: ts=2026-09-20T08:06:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44120 duration_s=0 paths=1 nar_bytes_in=4324606worker2 # [ 40.391789] nix-grpc-daemon[847]: ts=2026-09-20T08:06:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441204607worker2 # [ 40.399313] nix-daemon[909]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4608worker2 # [ 40.405215] nix-daemon[909]: reaped child process 952, status = succeeded4609client # [ 40.408509] nix[868]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4610worker2 # [ 40.410696] nix-daemon[909]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4611worker1 # [ 40.558890] nix-grpc-daemon[784]: ts=2026-09-20T08:06:20Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:603824612client # [ 40.606195] nix[883]: don't know how to build these paths:4613client # [ 40.607155] nix[883]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4614worker2 # [ 40.613512] nix-grpc-daemon[847]: ts=2026-09-20T08:06:20Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04615worker2 # [ 40.622937] nix-grpc-daemon[847]: ts=2026-09-20T08:06:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441204616client # [ 40.627691] nix[883]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4617client: must succeed: sleep 24618client: (finished: must succeed: sleep 2, in 2.03 seconds)4619??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4620 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394621client: waiting for success: ! systemctl is-active dedup1 dedup24622??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4623 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394624worker2 # [ 43.829109] nix-daemon[909]: reaped child process 978, status = succeeded4625worker2 # [ 43.948086] nix-daemon[909]: accepted connection from pid 1011, user nix-grpc-daemon (trusted)4626worker2 # [ 43.961256] nix-daemon[909]: reaped child process 1014, status = succeeded4627lb # [ 43.957346] niks3-server[1081]: 2026/09/20 08:06:23 INFO Received uploads request method=POST path=/api/pending_closures4628worker2 # [ 43.981095] nix-grpc-daemon[954]: time=2026-09-20T08:06:23.906Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4629worker2 # [ 43.982609] nix-grpc-daemon[954]: time=2026-09-20T08:06:23.908Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4630lb # [ 44.010520] niks3-server[1081]: 2026/09/20 08:06:23 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4631lb # [ 44.019173] niks3-server[1081]: 2026/09/20 08:06:23 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4632lb # [ 44.025847] niks3-server[1081]: 2026/09/20 08:06:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4633lb # [ 44.029922] niks3-server[1081]: 2026/09/20 08:06:23 INFO Signed narinfos id=8 count=14634worker2 # [ 44.046940] nix-grpc-daemon[954]: time=2026-09-20T08:06:23.972Z level=INFO msg="Uploading 1 narinfos"4635lb # [ 44.034138] niks3-server[1081]: 2026/09/20 08:06:23 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4636lb # [ 44.042161] niks3-server[1081]: 2026/09/20 08:06:23 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4637lb # [ 44.047261] niks3-server[1081]: 2026/09/20 08:06:23 INFO Completed upload id=84638worker2 # [ 44.061327] nix-grpc-daemon[954]: time=2026-09-20T08:06:23.987Z level=INFO msg="Upload complete. (236ms)"4639lb # [ 44.048955] niks3-server[1081]: 2026/09/20 08:06:23 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4640worker2 # [ 44.070259] nix-grpc-daemon[847]: ts=2026-09-20T08:06:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44120 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14641worker2 # [ 44.075602] nix-grpc-daemon[847]: ts=2026-09-20T08:06:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44120 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14642worker2 # [ 44.085833] nix-daemon[909]: reaped child process 976, status = succeeded4643client # [ 44.113532] systemd[1]: dedup2.service: Deactivated successfully.4644client # [ 44.118701] systemd[1]: dedup2.service: Consumed 125ms CPU time over 3.747s wall clock time, 31.1M memory peak, 7.4K incoming IP traffic, 6.5K outgoing IP traffic.4645client # [ 44.154401] systemd[1]: dedup1.service: Deactivated successfully.4646client # [ 44.156029] systemd[1]: dedup1.service: Consumed 121ms CPU time over 4.866s wall clock time, 37.3M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic.4647client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds)4648client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4649client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4650worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4651worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.04 seconds)4652worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4653worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.06 seconds)4654worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4655worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4656worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4657worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.06 seconds)4658(finished: subtest: two clients wanting the same drv build it once, in 5.87 seconds)4659subtest: build hook: nix-daemon with builders = grpc://lb4660client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log4661client # [ 45.262142] systemd[1]: Started Nix Daemon.4662client # [ 45.424966] nix-daemon[926]: accepted connection from pid 923, user root (trusted)4663worker1 # [ 45.566396] nix-grpc-daemon[784]: ts=2026-09-20T08:06:25Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:603824664worker1 # [ 45.572638] nix-grpc-daemon[784]: ts=2026-09-20T08:06:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603824665worker2 # [ 45.624808] nix-grpc-daemon[847]: ts=2026-09-20T08:06:25Z level=debug event=want client=5 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04666worker1 # [ 45.589297] nix-grpc-daemon[784]: ts=2026-09-20T08:06:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603824667worker2 # [ 45.629352] nix-grpc-daemon[847]: ts=2026-09-20T08:06:25Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=14668worker1 # [ 45.595499] nix-grpc-daemon[784]: ts=2026-09-20T08:06:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603824669worker1 # [ 45.600722] nix-grpc-daemon[784]: ts=2026-09-20T08:06:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603824670worker1 # [ 45.606794] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4671worker1 # [ 45.766545] nix-daemon[841]: accepted connection from pid 1006, user nix-grpc-daemon (trusted)4672worker1 # [ 45.780342] nix-daemon[841]: reaped child process 1009, status = succeeded4673worker1 # [ 45.944797] nix-daemon[841]: accepted connection from pid 1011, user nix-grpc-daemon (trusted)4674worker1 # [ 45.956094] nix-daemon[841]: reaped child process 1014, status = succeeded4675lb # [ 46.000507] niks3-server[1081]: 2026/09/20 08:06:25 INFO Received uploads request method=POST path=/api/pending_closures4676worker1 # [ 45.981629] nix-grpc-daemon[851]: time=2026-09-20T08:06:26.139Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4677worker1 # [ 45.983462] nix-grpc-daemon[851]: time=2026-09-20T08:06:26.141Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4678lb # [ 46.036177] niks3-server[1081]: 2026/09/20 08:06:25 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4679lb # [ 46.045793] niks3-server[1081]: 2026/09/20 08:06:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4680worker1 # [ 46.025503] nix-grpc-daemon[851]: time=2026-09-20T08:06:26.183Z level=INFO msg="Uploading 1 narinfos"4681lb # [ 46.052893] niks3-server[1081]: 2026/09/20 08:06:25 INFO Signed narinfos id=9 count=14682lb # [ 46.058569] niks3-server[1081]: 2026/09/20 08:06:25 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4683lb # [ 46.071908] niks3-server[1081]: 2026/09/20 08:06:25 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4684lb # [ 46.075575] niks3-server[1081]: 2026/09/20 08:06:25 INFO Completed upload id=94685worker1 # [ 46.048373] nix-grpc-daemon[851]: time=2026-09-20T08:06:26.206Z level=INFO msg="Upload complete. (435ms)"4686lb # [ 46.077656] niks3-server[1081]: 2026/09/20 08:06:25 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4687worker1 # [ 46.050979] nix-grpc-daemon[784]: ts=2026-09-20T08:06:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=0 paths=1 nar_bytes_in=5124688worker1 # [ 46.057203] nix-grpc-daemon[784]: ts=2026-09-20T08:06:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603824689worker1 # [ 46.065147] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4690worker1 # [ 46.074270] nix-daemon[841]: reaped child process 1004, status = succeeded4691worker1 # [ 46.079706] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4692worker1 # [ 46.705854] nix-daemon[841]: reaped child process 1018, status = succeeded4693worker1 # [ 46.835756] nix-daemon[841]: accepted connection from pid 1033, user nix-grpc-daemon (trusted)4694worker1 # [ 46.847726] nix-daemon[841]: reaped child process 1036, status = succeeded4695lb # [ 46.884752] niks3-server[1081]: 2026/09/20 08:06:26 INFO Received uploads request method=POST path=/api/pending_closures4696worker1 # [ 46.865511] nix-grpc-daemon[851]: time=2026-09-20T08:06:27.023Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4697worker1 # [ 46.867070] nix-grpc-daemon[851]: time=2026-09-20T08:06:27.025Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4698lb # [ 46.922672] niks3-server[1081]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4699lb # [ 46.931204] niks3-server[1081]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4700lb # [ 46.942872] niks3-server[1081]: 2026/09/20 08:06:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4701lb # [ 46.948080] niks3-server[1081]: 2026/09/20 08:06:26 INFO Signed narinfos id=10 count=14702worker1 # [ 46.923611] nix-grpc-daemon[851]: time=2026-09-20T08:06:27.081Z level=INFO msg="Uploading 1 narinfos"4703lb # [ 46.953092] niks3-server[1081]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4704lb # [ 46.964621] niks3-server[1081]: 2026/09/20 08:06:26 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4705lb # [ 46.971335] niks3-server[1081]: 2026/09/20 08:06:26 INFO Completed upload id=104706worker1 # [ 46.944234] nix-grpc-daemon[851]: time=2026-09-20T08:06:27.102Z level=INFO msg="Upload complete. (258ms)"4707lb # [ 46.973557] niks3-server[1081]: 2026/09/20 08:06:26 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4708worker1 # [ 46.949697] nix-grpc-daemon[784]: ts=2026-09-20T08:06:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=0 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=5 outputs=14709worker2 # [ 46.995452] nix-grpc-daemon[847]: ts=2026-09-20T08:06:26Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:441204710worker1 # [ 46.964755] nix-daemon[841]: reaped child process 1016, status = succeeded4711worker2 # [ 47.008157] nix-grpc-daemon[847]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4712worker2 # [ 47.041190] nix-grpc-daemon[847]: ts=2026-09-20T08:06:26Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:441204713worker2 # [ 47.047357] nix-grpc-daemon[847]: ts=2026-09-20T08:06:26Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44120 duration_s=0 paths=1 nar_bytes_out=1284714worker2 # [ 47.292914] nix-grpc-daemon[847]: ts=2026-09-20T08:06:27Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:441204715worker2 # [ 47.299387] nix-grpc-daemon[847]: ts=2026-09-20T08:06:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441204716worker2 # [ 47.305540] nix-grpc-daemon[954]: time=2026-09-20T08:06:27.229Z level=INFO msg="All 1 paths already cached"4717worker2 # [ 47.315721] nix-grpc-daemon[847]: ts=2026-09-20T08:06:27Z level=debug event=want client=6 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04718worker2 # [ 47.319524] nix-grpc-daemon[847]: ts=2026-09-20T08:06:27Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=14719worker1 # [ 47.317837] nix-grpc-daemon[784]: ts=2026-09-20T08:06:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603824720worker1 # [ 47.327030] nix-grpc-daemon[784]: ts=2026-09-20T08:06:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603824721worker1 # [ 47.335482] nix-grpc-daemon[851]: time=2026-09-20T08:06:27.493Z level=INFO msg="All 1 paths already cached"4722worker1 # [ 47.340286] nix-grpc-daemon[784]: ts=2026-09-20T08:06:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603824723worker1 # [ 47.344109] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4724worker1 # [ 47.502537] nix-daemon[841]: accepted connection from pid 1040, user nix-grpc-daemon (trusted)4725worker1 # [ 47.516211] nix-daemon[841]: reaped child process 1043, status = succeeded4726worker1 # [ 47.684406] nix-daemon[841]: accepted connection from pid 1045, user nix-grpc-daemon (trusted)4727worker1 # [ 47.697169] nix-daemon[841]: reaped child process 1048, status = succeeded4728lb # [ 47.737354] niks3-server[1081]: 2026/09/20 08:06:27 INFO Received uploads request method=POST path=/api/pending_closures4729worker1 # [ 47.718162] nix-grpc-daemon[851]: time=2026-09-20T08:06:27.876Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4730worker1 # [ 47.719577] nix-grpc-daemon[851]: time=2026-09-20T08:06:27.876Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4731lb # [ 47.762724] niks3-server[1081]: 2026/09/20 08:06:27 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4732lb # [ 47.775152] niks3-server[1081]: 2026/09/20 08:06:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4733lb # [ 47.779387] niks3-server[1081]: 2026/09/20 08:06:27 INFO Signed narinfos id=11 count=14734worker1 # [ 47.755786] nix-grpc-daemon[851]: time=2026-09-20T08:06:27.913Z level=INFO msg="Uploading 1 narinfos"4735lb # [ 47.786813] niks3-server[1081]: 2026/09/20 08:06:27 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4736lb # [ 47.796348] niks3-server[1081]: 2026/09/20 08:06:27 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4737lb # [ 47.801303] niks3-server[1081]: 2026/09/20 08:06:27 INFO Completed upload id=114738worker1 # [ 47.776062] nix-grpc-daemon[851]: time=2026-09-20T08:06:27.934Z level=INFO msg="Upload complete. (425ms)"4739worker1 # [ 47.779114] nix-grpc-daemon[784]: ts=2026-09-20T08:06:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=0 paths=1 nar_bytes_in=6244740lb # [ 47.806231] niks3-server[1081]: 2026/09/20 08:06:27 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4741worker1 # [ 47.782816] nix-grpc-daemon[784]: ts=2026-09-20T08:06:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603824742worker1 # [ 47.791406] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4743worker1 # [ 47.793908] nix-daemon[841]: reaped child process 1038, status = succeeded4744worker1 # [ 47.799560] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4745lb # [ 48.327567] envoy[979]: conn peer=[2001:db8:1::1]:47074 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1158 tx=481 ms=554746lb # [ 48.331245] envoy[979]: conn peer=[2001:db8:1::1]:47098 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1085 ms=34924747lb # [ 48.334707] envoy[979]: conn peer=[2001:db8:1::1]:47082 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2972 tx=1373 ms=46514748lb # [ 48.338277] envoy[979]: conn peer=[2001:db8:1::1]:58982 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3382 tx=1748 ms=14924749lb # [ 48.342101] envoy[979]: conn peer=[2001:db8:1::1]:58998 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=333 ms=604750worker1 # [ 48.626541] nix-daemon[841]: reaped child process 1052, status = succeeded4751worker1 # [ 48.777096] nix-daemon[841]: accepted connection from pid 1067, user nix-grpc-daemon (trusted)4752worker1 # [ 48.788659] nix-daemon[841]: reaped child process 1070, status = succeeded4753lb # [ 48.827440] niks3-server[1081]: 2026/09/20 08:06:28 INFO Received uploads request method=POST path=/api/pending_closures4754worker1 # [ 48.804665] nix-grpc-daemon[851]: time=2026-09-20T08:06:28.962Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4755worker1 # [ 48.807065] nix-grpc-daemon[851]: time=2026-09-20T08:06:28.964Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4756lb # [ 48.851271] niks3-server[1081]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4757lb # [ 48.854075] niks3-server[1081]: 2026/09/20 08:06:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4758lb # [ 48.856666] niks3-server[1081]: 2026/09/20 08:06:28 INFO Signed narinfos id=12 count=14759worker1 # [ 48.829553] nix-grpc-daemon[851]: time=2026-09-20T08:06:28.987Z level=INFO msg="Uploading 1 narinfos"4760lb # [ 48.860584] niks3-server[1081]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4761lb # [ 48.862975] niks3-server[1081]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4762lb # [ 48.867087] niks3-server[1081]: 2026/09/20 08:06:28 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4763lb # [ 48.870712] niks3-server[1081]: 2026/09/20 08:06:28 INFO Completed upload id=124764worker1 # [ 48.843198] nix-grpc-daemon[851]: time=2026-09-20T08:06:29.001Z level=INFO msg="Upload complete. (236ms)"4765lb # [ 48.872346] niks3-server[1081]: 2026/09/20 08:06:28 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4766worker1 # [ 48.845532] nix-grpc-daemon[784]: ts=2026-09-20T08:06:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=6 outputs=14767worker1 # [ 48.852340] nix-daemon[841]: reaped child process 1050, status = succeeded4768worker1 # [ 48.891448] nix-grpc-daemon[784]: ts=2026-09-20T08:06:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:603824769worker1 # [ 48.908430] nix-grpc-daemon[784]: ts=2026-09-20T08:06:29Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:603824770worker1 # [ 48.913901] nix-grpc-daemon[784]: ts=2026-09-20T08:06:29Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=0 paths=1 nar_bytes_out=1764771worker2 # [ 49.201710] nix-grpc-daemon[847]: ts=2026-09-20T08:06:29Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:441204772worker2 # [ 49.204870] nix-grpc-daemon[847]: ts=2026-09-20T08:06:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441204773worker2 # [ 49.213285] nix-grpc-daemon[954]: time=2026-09-20T08:06:29.139Z level=INFO msg="All 1 paths already cached"4774worker2 # [ 49.222075] nix-grpc-daemon[847]: ts=2026-09-20T08:06:29Z level=debug event=want client=7 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04775worker2 # [ 49.224528] nix-grpc-daemon[847]: ts=2026-09-20T08:06:29Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=14776worker1 # [ 49.226839] nix-grpc-daemon[784]: ts=2026-09-20T08:06:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603824777worker1 # [ 49.237178] nix-grpc-daemon[784]: ts=2026-09-20T08:06:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603824778worker1 # [ 49.247172] nix-grpc-daemon[851]: time=2026-09-20T08:06:29.405Z level=INFO msg="All 2 paths already cached"4779worker1 # [ 49.253230] nix-grpc-daemon[784]: ts=2026-09-20T08:06:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603824780worker1 # [ 49.261362] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4781worker1 # [ 49.429315] nix-daemon[841]: accepted connection from pid 1074, user nix-grpc-daemon (trusted)4782worker1 # [ 49.443365] nix-daemon[841]: reaped child process 1077, status = succeeded4783worker1 # [ 49.591373] nix-daemon[841]: accepted connection from pid 1079, user nix-grpc-daemon (trusted)4784worker1 # [ 49.603806] nix-daemon[841]: reaped child process 1082, status = succeeded4785lb # [ 49.640443] niks3-server[1081]: 2026/09/20 08:06:29 INFO Received uploads request method=POST path=/api/pending_closures4786worker1 # [ 49.617429] nix-grpc-daemon[851]: time=2026-09-20T08:06:29.775Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4787worker1 # [ 49.618881] nix-grpc-daemon[851]: time=2026-09-20T08:06:29.777Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4788lb # [ 49.656546] niks3-server[1081]: 2026/09/20 08:06:29 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4789lb # [ 49.663169] niks3-server[1081]: 2026/09/20 08:06:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4790lb # [ 49.667588] niks3-server[1081]: 2026/09/20 08:06:29 INFO Signed narinfos id=13 count=14791worker1 # [ 49.643468] nix-grpc-daemon[851]: time=2026-09-20T08:06:29.801Z level=INFO msg="Uploading 1 narinfos"4792lb # [ 49.673717] niks3-server[1081]: 2026/09/20 08:06:29 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4793lb # [ 49.685405] niks3-server[1081]: 2026/09/20 08:06:29 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4794lb # [ 49.690936] niks3-server[1081]: 2026/09/20 08:06:29 INFO Completed upload id=134795worker1 # [ 49.663633] nix-grpc-daemon[851]: time=2026-09-20T08:06:29.821Z level=INFO msg="Upload complete. (388ms)"4796lb # [ 49.693593] niks3-server[1081]: 2026/09/20 08:06:29 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4797worker1 # [ 49.665819] nix-grpc-daemon[784]: ts=2026-09-20T08:06:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=0 paths=1 nar_bytes_in=7524798worker1 # [ 49.668584] nix-grpc-daemon[784]: ts=2026-09-20T08:06:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603824799worker1 # [ 49.674552] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4800worker1 # [ 49.677978] nix-daemon[841]: reaped child process 1072, status = succeeded4801worker1 # [ 49.683048] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4802worker1 # [ 50.296506] nix-daemon[841]: reaped child process 1086, status = succeeded4803worker1 # [ 50.452114] nix-daemon[841]: accepted connection from pid 1101, user nix-grpc-daemon (trusted)4804worker1 # [ 50.464503] nix-daemon[841]: reaped child process 1104, status = succeeded4805lb # [ 50.508745] niks3-server[1081]: 2026/09/20 08:06:30 INFO Received uploads request method=POST path=/api/pending_closures4806worker1 # [ 50.489923] nix-grpc-daemon[851]: time=2026-09-20T08:06:30.648Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4807worker1 # [ 50.491837] nix-grpc-daemon[851]: time=2026-09-20T08:06:30.649Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4808lb # [ 50.540902] niks3-server[1081]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4809lb # [ 50.555653] niks3-server[1081]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4810lb # [ 50.567108] niks3-server[1081]: 2026/09/20 08:06:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4811worker1 # [ 50.544338] nix-grpc-daemon[851]: time=2026-09-20T08:06:30.702Z level=INFO msg="Uploading 1 narinfos"4812lb # [ 50.571518] niks3-server[1081]: 2026/09/20 08:06:30 INFO Signed narinfos id=14 count=14813lb # [ 50.576617] niks3-server[1081]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4814lb # [ 50.585729] niks3-server[1081]: 2026/09/20 08:06:30 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4815lb # [ 50.588542] niks3-server[1081]: 2026/09/20 08:06:30 INFO Completed upload id=144816worker1 # [ 50.561517] nix-grpc-daemon[851]: time=2026-09-20T08:06:30.719Z level=INFO msg="Upload complete. (272ms)"4817lb # [ 50.590982] niks3-server[1081]: 2026/09/20 08:06:30 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4818worker1 # [ 50.567665] nix-grpc-daemon[784]: ts=2026-09-20T08:06:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=0 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=7 outputs=14819worker1 # [ 50.575506] nix-grpc-daemon[784]: ts=2026-09-20T08:06:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:603824820worker1 # [ 50.584212] nix-daemon[841]: reaped child process 1084, status = succeeded4821worker2 # [ 50.629399] nix-grpc-daemon[847]: ts=2026-09-20T08:06:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:441204822worker2 # [ 50.641235] nix-grpc-daemon[847]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4823worker2 # [ 50.651726] nix-grpc-daemon[847]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4824worker2 # [ 50.659991] nix-grpc-daemon[847]: ts=2026-09-20T08:06:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44120 duration_s=0 paths=1 nar_bytes_out=2324825client # [ 50.754287] nix-daemon[926]: reaped child process 928, status = succeeded4826client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log, in 5.65 seconds)4827client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4828client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)4829client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4830client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds)4831client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4832client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4833(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 5.73 seconds)4834subtest: an input only one worker has still reaches the builder4835client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4836client # this derivation will be built:4837client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4838client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4839client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.40 seconds)4840client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4841client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.17 seconds)4842worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4843worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.15 seconds)4844worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4845worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.02 seconds)4846client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24847client # [ 51.767757] nix-daemon[926]: accepted connection from pid 1006, user root (trusted)4848client # this derivation will be built:4849client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4850worker2 # [ 51.948867] nix-grpc-daemon[847]: ts=2026-09-20T08:06:31Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:441204851client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4852worker1 # [ 51.910748] nix-grpc-daemon[784]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603824853worker1 # [ 52.092508] nix-daemon[841]: accepted connection from pid 1111, user nix-grpc-daemon (trusted)4854worker1 # [ 52.103208] nix-daemon[841]: reaped child process 1114, status = succeeded4855lb # [ 52.146943] niks3-server[1081]: 2026/09/20 08:06:31 INFO Received uploads request method=POST path=/api/pending_closures4856worker1 # [ 52.128454] nix-grpc-daemon[851]: time=2026-09-20T08:06:32.286Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4857worker1 # [ 52.129931] nix-grpc-daemon[851]: time=2026-09-20T08:06:32.286Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4858lb # [ 52.179090] niks3-server[1081]: 2026/09/20 08:06:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4859lb # [ 52.184779] niks3-server[1081]: 2026/09/20 08:06:31 INFO Signed narinfos id=15 count=14860worker1 # [ 52.160599] nix-grpc-daemon[851]: time=2026-09-20T08:06:32.318Z level=INFO msg="Uploading 1 narinfos"4861lb # [ 52.194178] niks3-server[1081]: 2026/09/20 08:06:31 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4862lb # [ 52.200130] niks3-server[1081]: 2026/09/20 08:06:31 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4863lb # [ 52.212204] niks3-server[1081]: 2026/09/20 08:06:31 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4864lb # [ 52.218083] niks3-server[1081]: 2026/09/20 08:06:31 INFO Completed upload id=154865worker1 # [ 52.192937] nix-grpc-daemon[851]: time=2026-09-20T08:06:32.351Z level=INFO msg="Upload complete. (277ms)"4866lb # [ 52.223382] niks3-server[1081]: 2026/09/20 08:06:31 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4867worker2 # [ 52.251326] nix-grpc-daemon[847]: ts=2026-09-20T08:06:32Z level=debug event=want client=8 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04868worker2 # [ 52.255821] nix-grpc-daemon[847]: ts=2026-09-20T08:06:32Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=14869worker2 # [ 52.306074] nix-grpc-daemon[847]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441204870worker2 # [ 52.321621] nix-grpc-daemon[847]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441204871client # copying 2 paths to 'lb:50051'...4872client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4873worker2 # [ 52.342849] nix-grpc-daemon[847]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:441204874client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4875worker2 # [ 52.354948] nix-daemon[909]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4876worker2 # [ 52.550796] nix-daemon[909]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)4877worker2 # [ 52.564376] nix-daemon[909]: reaped child process 1046, status = succeeded4878worker2 # [ 52.689681] nix-daemon[909]: accepted connection from pid 1048, user nix-grpc-daemon (trusted)4879worker2 # [ 52.701315] nix-daemon[909]: reaped child process 1051, status = succeeded4880lb # [ 52.701841] niks3-server[1081]: 2026/09/20 08:06:32 INFO Received uploads request method=POST path=/api/pending_closures4881lb # [ 52.814874] niks3-server[1081]: 2026/09/20 08:06:32 INFO Received uploads request method=POST path=/api/pending_closures4882worker2 # [ 52.851469] nix-grpc-daemon[954]: time=2026-09-20T08:06:32.777Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4883worker2 # [ 52.853975] nix-grpc-daemon[954]: time=2026-09-20T08:06:32.779Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4884worker2 # [ 52.855589] nix-grpc-daemon[954]: time=2026-09-20T08:06:32.779Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4885lb # [ 52.873302] niks3-server[1081]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4886lb # [ 52.886278] niks3-server[1081]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4887lb # [ 52.891066] niks3-server[1081]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4888lb # [ 52.902679] niks3-server[1081]: 2026/09/20 08:06:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4889lb # [ 52.904898] niks3-server[1081]: 2026/09/20 08:06:32 INFO Signed narinfos id=16 count=14890lb # [ 52.907657] niks3-server[1081]: 2026/09/20 08:06:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4891lb # [ 52.909390] niks3-server[1081]: 2026/09/20 08:06:32 INFO Signed narinfos id=17 count=24892worker2 # [ 52.923966] nix-grpc-daemon[954]: time=2026-09-20T08:06:32.849Z level=INFO msg="Uploading 3 narinfos"4893lb # [ 52.912900] niks3-server[1081]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4894lb # [ 52.925773] niks3-server[1081]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4895lb # [ 52.933603] niks3-server[1081]: 2026/09/20 08:06:32 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4896lb # [ 52.939989] niks3-server[1081]: 2026/09/20 08:06:32 INFO Completed upload id=164897lb # [ 52.941651] niks3-server[1081]: 2026/09/20 08:06:32 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4898lb # [ 52.943572] niks3-server[1081]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4899lb # [ 52.946913] niks3-server[1081]: 2026/09/20 08:06:32 INFO Completed upload id=174900worker2 # [ 52.962163] nix-grpc-daemon[954]: time=2026-09-20T08:06:32.888Z level=INFO msg="Upload complete. (589ms)"4901lb # [ 52.948992] niks3-server[1081]: 2026/09/20 08:06:32 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4902worker2 # [ 52.964663] nix-grpc-daemon[847]: ts=2026-09-20T08:06:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44120 duration_s=0 paths=2 nar_bytes_in=9764903worker2 # [ 52.967959] nix-grpc-daemon[847]: ts=2026-09-20T08:06:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441204904worker2 # [ 52.973697] nix-daemon[909]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4905worker2 # [ 52.978034] nix-daemon[909]: reaped child process 1041, status = succeeded4906worker2 # [ 52.985295] nix-grpc-daemon[847]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...4907worker2 # [ 52.992570] nix-daemon[909]: accepted connection from pid 847, user nix-grpc-daemon (trusted)4908client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4909client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4910worker2 # [ 54.617219] nix-daemon[909]: reaped child process 1056, status = succeeded4911worker2 # [ 54.779421] nix-daemon[909]: accepted connection from pid 1071, user nix-grpc-daemon (trusted)4912worker2 # [ 54.790344] nix-daemon[909]: reaped child process 1074, status = succeeded4913lb # [ 54.793799] niks3-server[1081]: 2026/09/20 08:06:34 INFO Received uploads request method=POST path=/api/pending_closures4914worker2 # [ 54.818723] nix-grpc-daemon[954]: time=2026-09-20T08:06:34.744Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4915lb # [ 54.829224] niks3-server[1081]: 2026/09/20 08:06:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4916lb # [ 54.834090] niks3-server[1081]: 2026/09/20 08:06:34 INFO Signed narinfos id=18 count=14917worker2 # [ 54.850960] nix-grpc-daemon[954]: time=2026-09-20T08:06:34.777Z level=INFO msg="Uploading 1 narinfos"4918lb # [ 54.849050] niks3-server[1081]: 2026/09/20 08:06:34 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4919lb # [ 54.970396] niks3-server[1081]: 2026/09/20 08:06:34 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4920lb # [ 54.977864] niks3-server[1081]: 2026/09/20 08:06:34 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4921lb # [ 54.987897] niks3-server[1081]: 2026/09/20 08:06:34 INFO Completed upload id=184922worker2 # [ 55.005272] nix-grpc-daemon[954]: time=2026-09-20T08:06:34.931Z level=INFO msg="Upload complete. (403ms)"4923lb # [ 54.991375] niks3-server[1081]: 2026/09/20 08:06:34 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4924worker2 # [ 55.013625] nix-grpc-daemon[847]: ts=2026-09-20T08:06:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44120 duration_s=2 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=8 outputs=14925worker2 # [ 55.026647] nix-daemon[909]: reaped child process 1053, status = succeeded4926client # copying 1 paths...4927worker2 # [ 55.058161] nix-grpc-daemon[847]: ts=2026-09-20T08:06:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:441204928client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4929worker2 # [ 55.083160] nix-grpc-daemon[847]: ts=2026-09-20T08:06:35Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:441204930worker2 # [ 55.087228] nix-grpc-daemon[847]: ts=2026-09-20T08:06:35Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44120 duration_s=0 paths=1 nar_bytes_out=1204931client # [ 55.196759] nix-daemon[926]: reaped child process 1009, status = succeeded4932client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.61 seconds)4933client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24934client # [ 55.374609] nix-daemon[926]: accepted connection from pid 1027, user root (trusted)4935client # this derivation will be built:4936client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4937worker1 # [ 55.506359] nix-grpc-daemon[784]: ts=2026-09-20T08:06:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:603824938client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...4939worker2 # [ 55.553829] nix-grpc-daemon[847]: ts=2026-09-20T08:06:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441204940worker2 # [ 55.563654] nix-grpc-daemon[954]: time=2026-09-20T08:06:35.489Z level=INFO msg="All 1 paths already cached"4941worker2 # [ 55.572508] nix-grpc-daemon[847]: ts=2026-09-20T08:06:35Z level=debug event=want client=9 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=04942worker2 # [ 55.574395] nix-grpc-daemon[847]: ts=2026-09-20T08:06:35Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=14943worker1 # [ 55.536800] nix-grpc-daemon[784]: ts=2026-09-20T08:06:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603824944worker1 # [ 55.544686] nix-grpc-daemon[784]: ts=2026-09-20T08:06:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603824945client # copying 1 paths to 'lb:50051'...4946client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...4947worker1 # [ 55.563167] nix-grpc-daemon[784]: ts=2026-09-20T08:06:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:603824948worker1 # [ 55.574228] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4949worker1 # [ 55.589611] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 50 ms (attempt 1/5)4950worker1 # [ 55.644396] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 104 ms (attempt 2/5)4951worker1 # [ 55.754387] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 85 ms (attempt 3/5)4952worker1 # [ 55.845115] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 280 ms (attempt 4/5)4953worker1 # [ 56.131058] nix-grpc-daemon[784]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4954worker1 # [ 56.133784] nix-grpc-daemon[784]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...4955worker1 # [ 56.302831] nix-daemon[841]: accepted connection from pid 1122, user nix-grpc-daemon (trusted)4956worker1 # [ 56.315669] nix-daemon[841]: reaped child process 1125, status = succeeded4957worker1 # [ 56.451415] nix-daemon[841]: accepted connection from pid 1127, user nix-grpc-daemon (trusted)4958worker1 # [ 56.462753] nix-daemon[841]: reaped child process 1130, status = succeeded4959lb # [ 56.502889] niks3-server[1081]: 2026/09/20 08:06:36 INFO Received uploads request method=POST path=/api/pending_closures4960worker1 # [ 56.483921] nix-grpc-daemon[851]: time=2026-09-20T08:06:36.642Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4961worker1 # [ 56.485673] nix-grpc-daemon[851]: time=2026-09-20T08:06:36.643Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"4962lb # [ 56.528844] niks3-server[1081]: 2026/09/20 08:06:36 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst4963lb # [ 56.540547] niks3-server[1081]: 2026/09/20 08:06:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4964lb # [ 56.545643] niks3-server[1081]: 2026/09/20 08:06:36 INFO Signed narinfos id=19 count=14965worker1 # [ 56.521343] nix-grpc-daemon[851]: time=2026-09-20T08:06:36.679Z level=INFO msg="Uploading 1 narinfos"4966lb # [ 56.558637] niks3-server[1081]: 2026/09/20 08:06:36 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4967lb # [ 56.610593] niks3-server[1081]: 2026/09/20 08:06:36 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls4968worker1 # [ 56.587270] nix-grpc-daemon[851]: time=2026-09-20T08:06:36.745Z level=INFO msg="Upload complete. (441ms)"4969lb # [ 56.614563] niks3-server[1081]: 2026/09/20 08:06:36 INFO Completed upload id=194970worker1 # [ 56.589776] nix-grpc-daemon[784]: ts=2026-09-20T08:06:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=1 paths=1 nar_bytes_in=5604971lb # [ 56.620254] niks3-server[1081]: 2026/09/20 08:06:36 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo4972worker1 # [ 56.593180] nix-grpc-daemon[784]: ts=2026-09-20T08:06:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:603824973worker1 # [ 56.598531] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4974worker1 # [ 56.605084] nix-daemon[841]: reaped child process 1116, status = succeeded4975worker1 # [ 56.609506] nix-daemon[841]: accepted connection from pid 784, user nix-grpc-daemon (trusted)4976client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...4977client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4978worker1 # [ 57.429130] nix-daemon[841]: reaped child process 1134, status = succeeded4979worker1 # [ 57.573473] nix-daemon[841]: accepted connection from pid 1149, user nix-grpc-daemon (trusted)4980worker1 # [ 57.585843] nix-daemon[841]: reaped child process 1152, status = succeeded4981lb # [ 57.628225] niks3-server[1081]: 2026/09/20 08:06:37 INFO Received uploads request method=POST path=/api/pending_closures4982worker1 # [ 57.611219] nix-grpc-daemon[851]: time=2026-09-20T08:06:37.767Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4983lb # [ 57.658487] niks3-server[1081]: 2026/09/20 08:06:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4984worker1 # [ 57.638805] nix-grpc-daemon[851]: time=2026-09-20T08:06:37.796Z level=INFO msg="Uploading 1 narinfos"4985lb # [ 57.665976] niks3-server[1081]: 2026/09/20 08:06:37 INFO Signed narinfos id=20 count=14986lb # [ 57.671120] niks3-server[1081]: 2026/09/20 08:06:37 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls4987lb # [ 57.675093] niks3-server[1081]: 2026/09/20 08:06:37 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4988lb # [ 57.684158] niks3-server[1081]: 2026/09/20 08:06:37 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4989worker1 # [ 57.661123] nix-grpc-daemon[851]: time=2026-09-20T08:06:37.819Z level=INFO msg="Upload complete. (245ms)"4990lb # [ 57.688609] niks3-server[1081]: 2026/09/20 08:06:37 INFO Completed upload id=204991lb # [ 57.690916] niks3-server[1081]: 2026/09/20 08:06:37 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo4992worker1 # [ 57.664256] nix-grpc-daemon[784]: ts=2026-09-20T08:06:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=9 outputs=14993worker1 # [ 57.670946] nix-daemon[841]: reaped child process 1132, status = succeeded4994client # copying 1 paths...4995worker2 # [ 57.749523] nix-grpc-daemon[847]: ts=2026-09-20T08:06:37Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:441204996worker2 # [ 57.755542] nix-grpc-daemon[847]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...4997client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...4998worker2 # [ 57.779290] nix-grpc-daemon[847]: ts=2026-09-20T08:06:37Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:441204999worker2 # [ 57.781282] nix-grpc-daemon[847]: ts=2026-09-20T08:06:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:44120 duration_s=0 paths=1 nar_bytes_out=1205000client # [ 57.872064] nix-daemon[926]: reaped child process 1030, status = succeeded5001client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.67 seconds)5002client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25003client # [ 58.047922] nix-daemon[926]: accepted connection from pid 1048, user root (trusted)5004client # this derivation will be built:5005client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5006worker2 # [ 58.210175] nix-grpc-daemon[847]: ts=2026-09-20T08:06:38Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:441205007worker1 # [ 58.172118] nix-grpc-daemon[784]: ts=2026-09-20T08:06:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:603825008client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5009worker1 # [ 58.177412] nix-grpc-daemon[851]: time=2026-09-20T08:06:38.335Z level=INFO msg="All 1 paths already cached"5010worker2 # [ 58.230762] nix-grpc-daemon[847]: ts=2026-09-20T08:06:38Z level=debug event=want client=10 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05011worker2 # [ 58.237401] nix-grpc-daemon[847]: ts=2026-09-20T08:06:38Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15012worker2 # [ 58.242285] nix-grpc-daemon[847]: ts=2026-09-20T08:06:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441205013worker2 # [ 58.253580] nix-grpc-daemon[847]: ts=2026-09-20T08:06:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:441205014worker2 # [ 58.263969] nix-grpc-daemon[954]: time=2026-09-20T08:06:38.189Z level=INFO msg="All 1 paths already cached"5015client # copying 1 paths to 'lb:50051'...5016client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5017worker2 # [ 58.270578] nix-grpc-daemon[847]: ts=2026-09-20T08:06:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:441205018worker2 # [ 58.281846] nix-daemon[909]: accepted connection from pid 847, user nix-grpc-daemon (trusted)5019lb # [ 58.328128] envoy[979]: conn peer=[2001:db8:1::1]:59002 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3880 tx=1876 ms=17135020lb # [ 58.331927] envoy[979]: conn peer=[2001:db8:1::1]:59008 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=555021lb # [ 58.335464] envoy[979]: conn peer=[2001:db8:1::1]:59016 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4315 tx=2107 ms=15075022lb # [ 58.339064] envoy[979]: conn peer=[2001:db8:1::1]:59024 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=815023lb # [ 58.342648] envoy[979]: conn peer=[2001:db8:1::1]:59026 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3851 tx=1766 ms=31885024lb # [ 58.346261] envoy[979]: conn peer=[2001:db8:1::1]:49012 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=555025lb # [ 58.350433] envoy[979]: conn peer=[2001:db8:1::1]:49016 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3698 tx=1913 ms=22855026lb # [ 58.354075] envoy[979]: conn peer=[2001:db8:1::1]:49030 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=525027worker2 # [ 58.438604] nix-daemon[909]: accepted connection from pid 1083, user nix-grpc-daemon (trusted)5028worker2 # [ 58.456410] nix-daemon[909]: reaped child process 1086, status = succeeded5029worker2 # [ 58.592048] nix-daemon[909]: accepted connection from pid 1088, user nix-grpc-daemon (trusted)5030worker2 # [ 58.606611] nix-daemon[909]: reaped child process 1091, status = succeeded5031lb # [ 58.600693] niks3-server[1081]: 2026/09/20 08:06:38 INFO Received uploads request method=POST path=/api/pending_closures5032worker2 # [ 58.622561] nix-grpc-daemon[954]: time=2026-09-20T08:06:38.548Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5033worker2 # [ 58.624516] nix-grpc-daemon[954]: time=2026-09-20T08:06:38.550Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5034lb # [ 58.630734] niks3-server[1081]: 2026/09/20 08:06:38 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5035lb # [ 58.641707] niks3-server[1081]: 2026/09/20 08:06:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5036worker2 # [ 58.660535] nix-grpc-daemon[954]: time=2026-09-20T08:06:38.586Z level=INFO msg="Uploading 1 narinfos"5037lb # [ 58.646980] niks3-server[1081]: 2026/09/20 08:06:38 INFO Signed narinfos id=21 count=15038lb # [ 58.652776] niks3-server[1081]: 2026/09/20 08:06:38 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5039lb # [ 58.663973] niks3-server[1081]: 2026/09/20 08:06:38 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5040worker2 # [ 58.683585] nix-grpc-daemon[954]: time=2026-09-20T08:06:38.609Z level=INFO msg="Upload complete. (390ms)"5041lb # [ 58.669490] niks3-server[1081]: 2026/09/20 08:06:38 INFO Completed upload id=215042worker2 # [ 58.686046] nix-grpc-daemon[847]: ts=2026-09-20T08:06:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44120 duration_s=0 paths=1 nar_bytes_in=5605043worker2 # [ 58.689176] nix-grpc-daemon[847]: ts=2026-09-20T08:06:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:441205044lb # [ 58.675513] niks3-server[1081]: 2026/09/20 08:06:38 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5045worker2 # [ 58.697907] nix-daemon[909]: accepted connection from pid 847, user nix-grpc-daemon (trusted)5046worker2 # [ 58.703955] nix-daemon[909]: reaped child process 1081, status = succeeded5047client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5048worker2 # [ 58.707333] nix-daemon[909]: accepted connection from pid 847, user nix-grpc-daemon (trusted)5049client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5050worker2 # [ 59.925425] nix-daemon[909]: reaped child process 1095, status = succeeded5051worker2 # [ 60.090841] nix-daemon[909]: accepted connection from pid 1110, user nix-grpc-daemon (trusted)5052worker2 # [ 60.105517] nix-daemon[909]: reaped child process 1113, status = succeeded5053lb # [ 60.107214] niks3-server[1081]: 2026/09/20 08:06:39 INFO Received uploads request method=POST path=/api/pending_closures5054worker2 # [ 60.125877] nix-grpc-daemon[954]: time=2026-09-20T08:06:40.051Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5055lb # [ 60.122591] niks3-server[1081]: 2026/09/20 08:06:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5056lb # [ 60.125906] niks3-server[1081]: 2026/09/20 08:06:39 INFO Signed narinfos id=22 count=15057worker2 # [ 60.141693] nix-grpc-daemon[954]: time=2026-09-20T08:06:40.067Z level=INFO msg="Uploading 1 narinfos"5058lb # [ 60.131147] niks3-server[1081]: 2026/09/20 08:06:39 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5059lb # [ 60.134347] niks3-server[1081]: 2026/09/20 08:06:39 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5060lb # [ 60.141143] niks3-server[1081]: 2026/09/20 08:06:39 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5061worker2 # [ 60.158861] nix-grpc-daemon[954]: time=2026-09-20T08:06:40.084Z level=INFO msg="Upload complete. (243ms)"5062lb # [ 60.144992] niks3-server[1081]: 2026/09/20 08:06:39 INFO Completed upload id=225063lb # [ 60.147537] niks3-server[1081]: 2026/09/20 08:06:39 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5064worker2 # [ 60.161935] nix-grpc-daemon[847]: ts=2026-09-20T08:06:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:44120 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=10 outputs=15065worker2 # [ 60.169036] nix-daemon[909]: reaped child process 1093, status = succeeded5066client # copying 1 paths...5067worker1 # [ 60.165162] nix-grpc-daemon[784]: ts=2026-09-20T08:06:40Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:603825068worker1 # [ 60.176698] nix-grpc-daemon[784]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5069client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5070worker1 # [ 60.204341] nix-grpc-daemon[784]: ts=2026-09-20T08:06:40Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:603825071worker1 # [ 60.209786] nix-grpc-daemon[784]: ts=2026-09-20T08:06:40Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60382 duration_s=0 paths=1 nar_bytes_out=1205072client # [ 60.358234] nix-daemon[926]: reaped child process 1051, status = succeeded5073client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.49 seconds)5074(finished: subtest: an input only one worker has still reaches the builder, in 9.53 seconds)5075subtest: upload whose reference the worker lacks is completed from the cache5076client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5077client # this derivation will be built:5078client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5079client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5080client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.37 seconds)5081client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5082client # this derivation will be built:5083client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5084client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5085client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.32 seconds)5086client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5087client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.16 seconds)5088worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5089worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.18 seconds)5090worker2 # [ 61.469844] systemd[1]: Stopping Nix worker-protocol over gRPC...5091worker2 # [ 61.627858] nix-grpc-daemon[847]: ts=2026-09-20T08:06:41Z level=info event=signal_exit5092worker2 # [ 61.873175] nix-grpc-daemon[847]: ts=2026-09-20T08:06:41Z level=info event=scheduler_yield5093worker2 # [ 61.876298] nix-grpc-daemon[847]: ts=2026-09-20T08:06:41Z level=info event=scheduler_restarting addr=lb:500515094worker1 # [ 61.837766] nix-grpc-daemon[784]: ts=2026-09-20T08:06:41Z level=info event=scheduler_take_over5095worker2 # [ 61.878939] nix-grpc-daemon[847]: ts=2026-09-20T08:06:41Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:432805096worker2 # [ 61.880795] nix-grpc-daemon[847]: ts=2026-09-20T08:06:41Z level=info event=worker_gone addr=192.168.1.4:500515097worker1 # [ 61.839757] nix-grpc-daemon[784]: ts=2026-09-20T08:06:41Z level=info event=scheduler_restarting addr=lb:500515098lb # [ 61.864856] niks3-server[1081]: 2026/09/20 08:06:41 INFO lead: released remote=192.168.1.4:449725099worker2 # [ 61.883071] nix-grpc-daemon[847]: ts=2026-09-20T08:06:41Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:432805100lb # [ 61.869532] niks3-server[1081]: 2026/09/20 08:06:41 INFO lead: acquired remote=192.168.1.3:474465101worker2 # [ 61.884754] nix-grpc-daemon[847]: ts=2026-09-20T08:06:41Z level=info event=worker_gone addr=192.168.1.3:500515102worker2 # [ 62.077219] nix-grpc-daemon[847]: ts=2026-09-20T08:06:42Z level=info event=scheduler_connected addr=lb:500515103worker1 # [ 62.037934] nix-grpc-daemon[784]: ts=2026-09-20T08:06:42Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05104worker1 # [ 62.040674] nix-grpc-daemon[784]: ts=2026-09-20T08:06:42Z level=info event=scheduler_connected addr=lb:500515105worker1 # [ 62.048509] nix-grpc-daemon[784]: ts=2026-09-20T08:06:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5106worker1 # [ 62.249073] nix-grpc-daemon[784]: ts=2026-09-20T08:06:42Z level=info event=scheduler_connected addr=lb:500515107worker1 # [ 62.250880] nix-grpc-daemon[784]: ts=2026-09-20T08:06:42Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05108worker2 # [ 62.878623] nix-grpc-daemon[847]: ts=2026-09-20T08:06:42Z level=info event=scheduler_restarting5109worker1 # [ 62.839406] nix-grpc-daemon[784]: ts=2026-09-20T08:06:42Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:574925110worker1 # [ 62.842899] nix-grpc-daemon[784]: ts=2026-09-20T08:06:42Z level=info event=worker_gone addr=192.168.1.4:500515111worker2 # [ 62.892064] nix-grpc-daemon[847]: ts=2026-09-20T08:06:42Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5112worker2 # [ 62.910483] nix-daemon[909]: reaped child process 911, status = succeeded5113worker2 # [ 63.162489] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5114worker2 # [ 63.166835] systemd[1]: Stopped Nix worker-protocol over gRPC.5115worker2 # [ 63.168917] systemd[1]: nix-grpc-daemon.service: Consumed 1.390s CPU time over 44.826s wall clock time, 50.3M memory peak, 53K incoming IP traffic, 94.8K outgoing IP traffic.5116worker2 # [ 63.177970] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5117worker2 # [ 63.181542] systemd[1]: Closed Nix worker-protocol over gRPC.5118worker2 # [ 63.184570] systemd[1]: nix-grpc-daemon.socket: Consumed 360us CPU time over 53.637s wall clock time, 256K memory peak, 82.6K incoming IP traffic, 69.4K outgoing IP traffic.5119lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5120lb: must succeed: curl -sf localhost:9901/clusters5121lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5122lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5123client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25124worker1 # [ 63.421250] nix-grpc-daemon[784]: ts=2026-09-20T08:06:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:603825125worker1 # [ 63.426192] nix-grpc-daemon[784]: ts=2026-09-20T08:06:43Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:603825126client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5127client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.24 seconds)5128worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5129worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5130worker2 # [ 63.553884] systemd[1]: Listening on Nix worker-protocol over gRPC.5131worker1 # [ 63.559914] systemd[1]: Stopping Nix worker-protocol over gRPC...5132worker1 # [ 63.580459] nix-grpc-daemon[784]: ts=2026-09-20T08:06:43Z level=info event=signal_exit5133worker2 # [ 63.770527] systemd[1]: Starting Nix worker-protocol over gRPC...5134worker1 # [ 63.833229] nix-grpc-daemon[784]: ts=2026-09-20T08:06:43Z level=info event=scheduler_yield5135lb # [ 63.864684] niks3-server[1081]: 2026/09/20 08:06:43 INFO lead: released remote=192.168.1.3:474465136worker1 # [ 63.836617] nix-grpc-daemon[784]: ts=2026-09-20T08:06:43Z level=info event=scheduler_restarting addr=lb:500515137worker1 # [ 63.841759] nix-grpc-daemon[784]: ts=2026-09-20T08:06:43Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:574925138worker1 # [ 63.845108] nix-grpc-daemon[784]: ts=2026-09-20T08:06:43Z level=info event=worker_gone addr=192.168.1.3:500515139worker2 # [ 63.935866] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:43Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5140worker2 # [ 63.938595] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:43Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15141worker2 # [ 63.945060] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:43Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5142worker2 # [ 63.949155] systemd[1]: Started Nix worker-protocol over gRPC.5143lb # [ 63.945395] niks3-server[1081]: 2026/09/20 08:06:43 INFO lead: acquired remote=192.168.1.4:557385144worker2 # [ 63.959463] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:43Z level=info event=scheduler_take_over5145worker2 # [ 63.965579] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:43Z level=info event=scheduler_connected addr=lb:500515146worker2 # [ 63.973047] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5147worker1 # [ 64.037171] nix-grpc-daemon[784]: ts=2026-09-20T08:06:44Z level=info event=scheduler_connected addr=lb:500515148worker1 # [ 64.039985] nix-grpc-daemon[784]: ts=2026-09-20T08:06:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5149worker2 # [ 64.174505] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:44Z level=info event=scheduler_connected addr=lb:500515150worker2 # [ 64.179501] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5151worker1 # [ 64.240899] nix-grpc-daemon[784]: ts=2026-09-20T08:06:44Z level=info event=scheduler_connected addr=lb:500515152worker1 # [ 64.245582] nix-grpc-daemon[784]: ts=2026-09-20T08:06:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5153worker2 # [ 64.379840] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:44Z level=info event=scheduler_connected addr=lb:500515154worker2 # [ 64.383433] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5155worker1 # [ 64.446603] nix-grpc-daemon[784]: ts=2026-09-20T08:06:44Z level=info event=scheduler_connected addr=lb:500515156worker1 # [ 64.450647] nix-grpc-daemon[784]: ts=2026-09-20T08:06:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5157worker2 # [ 64.584436] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:44Z level=info event=scheduler_connected addr=lb:500515158worker2 # [ 64.588962] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5159worker1 # [ 64.654612] nix-grpc-daemon[784]: ts=2026-09-20T08:06:44Z level=info event=scheduler_connected addr=lb:500515160worker1 # [ 64.657052] nix-grpc-daemon[784]: ts=2026-09-20T08:06:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5161worker2 # [ 64.789780] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:44Z level=info event=scheduler_connected addr=lb:500515162worker2 # [ 64.800882] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:44Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05163worker1 # [ 64.833739] nix-grpc-daemon[784]: ts=2026-09-20T08:06:44Z level=info event=scheduler_restarting5164worker1 # [ 64.849186] nix-daemon[841]: reaped child process 844, status = succeeded5165worker1 # [ 64.863363] nix-grpc-daemon[784]: ts=2026-09-20T08:06:45Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5166worker1 # [ 65.063677] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5167worker1 # [ 65.066551] systemd[1]: Stopped Nix worker-protocol over gRPC.5168worker1 # [ 65.071107] systemd[1]: nix-grpc-daemon.service: Consumed 2.400s CPU time over 46.777s wall clock time, 58.2M memory peak, 75.2K incoming IP traffic, 137.3K outgoing IP traffic.5169worker1 # [ 65.081970] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5170worker1 # [ 65.086422] systemd[1]: Closed Nix worker-protocol over gRPC.5171worker1 # [ 65.089641] systemd[1]: nix-grpc-daemon.socket: Consumed 290us CPU time over 54.834s wall clock time, 256K memory peak, 91.1K incoming IP traffic, 76.3K outgoing IP traffic.5172lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5173lb: must succeed: curl -sf localhost:9901/clusters5174lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5175lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5176client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25177worker2 # [ 65.420379] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:383585178worker2 # [ 65.431330] nix-daemon[909]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5179worker2 # [ 65.448448] nix-grpc-daemon[1134]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 1/5)5180worker2 # [ 65.459241] nix-grpc-daemon[1134]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 136 ms (attempt 2/5)5181worker2 # [ 65.601278] nix-grpc-daemon[1134]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 206 ms (attempt 3/5)5182worker2 # [ 65.813573] nix-grpc-daemon[1134]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 614 ms (attempt 4/5)5183worker2 # [ 66.434744] nix-grpc-daemon[1134]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5184client # copying 2 paths...5185client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5186client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5187worker2 # [ 66.457169] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:383585188worker2 # [ 66.469401] nix-daemon[909]: accepted connection from pid 1134, user nix-grpc-daemon (trusted)5189worker2 # [ 66.489172] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:46Z level=info event=niks3_push_started pid=11905190worker2 # [ 66.826105] nix-daemon[909]: accepted connection from pid 1203, user nix-grpc-daemon (trusted)5191worker2 # [ 66.838594] nix-daemon[909]: reaped child process 1206, status = succeeded5192lb # [ 66.843265] niks3-server[1081]: 2026/09/20 08:06:46 INFO Received uploads request method=POST path=/api/pending_closures5193lb # [ 66.852790] niks3-server[1081]: 2026/09/20 08:06:46 INFO Received uploads request method=POST path=/api/pending_closures5194worker2 # [ 66.874180] nix-grpc-daemon[1190]: time=2026-09-20T08:06:46.799Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5195worker2 # [ 66.876668] nix-grpc-daemon[1190]: time=2026-09-20T08:06:46.802Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5196worker2 # [ 66.880230] nix-grpc-daemon[1190]: time=2026-09-20T08:06:46.802Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5197lb # [ 66.916729] niks3-server[1081]: 2026/09/20 08:06:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5198lb # [ 66.921389] niks3-server[1081]: 2026/09/20 08:06:46 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5199lb # [ 66.924170] niks3-server[1081]: 2026/09/20 08:06:46 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5200lb # [ 66.930680] niks3-server[1081]: 2026/09/20 08:06:46 INFO Signed narinfos id=24 count=25201lb # [ 66.932060] niks3-server[1081]: 2026/09/20 08:06:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5202lb # [ 66.934305] niks3-server[1081]: 2026/09/20 08:06:46 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5203lb # [ 66.935968] niks3-server[1081]: 2026/09/20 08:06:46 INFO Signed narinfos id=23 count=15204worker2 # [ 66.949133] nix-grpc-daemon[1190]: time=2026-09-20T08:06:46.874Z level=INFO msg="Uploading 3 narinfos"5205lb # [ 66.937183] niks3-server[1081]: 2026/09/20 08:06:46 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5206lb # [ 66.948632] niks3-server[1081]: 2026/09/20 08:06:46 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5207lb # [ 66.954898] niks3-server[1081]: 2026/09/20 08:06:46 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5208lb # [ 66.958462] niks3-server[1081]: 2026/09/20 08:06:46 INFO Completed upload id=235209lb # [ 66.959918] niks3-server[1081]: 2026/09/20 08:06:46 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5210lb # [ 66.962253] niks3-server[1081]: 2026/09/20 08:06:46 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5211lb # [ 66.964312] niks3-server[1081]: 2026/09/20 08:06:46 INFO Completed upload id=245212worker2 # [ 66.978738] nix-grpc-daemon[1190]: time=2026-09-20T08:06:46.904Z level=INFO msg="Upload complete. (316ms)"5213lb # [ 66.966916] niks3-server[1081]: 2026/09/20 08:06:46 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5214worker2 # [ 66.984143] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:38358 duration_s=0 paths=2 nar_bytes_in=3125215worker2 # [ 66.993657] nix-daemon[909]: reaped child process 1188, status = succeeded5216client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.81 seconds)5217worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5218worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5219worker1 # [ 67.048664] systemd[1]: Listening on Nix worker-protocol over gRPC.5220worker1 # [ 67.056570] systemd[1]: Starting Nix worker-protocol over gRPC...5221worker1 # [ 67.215176] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5222worker1 # [ 67.218600] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15223worker1 # [ 67.225059] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5224worker1 # [ 67.226603] systemd[1]: Started Nix worker-protocol over gRPC.5225lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5226lb: must succeed: curl -sf localhost:9901/clusters5227worker1 # [ 67.247795] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:47Z level=info event=scheduler_connected addr=lb:500515228worker2 # [ 67.290790] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05229lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5230lb # [ 68.329655] envoy[979]: conn peer=[2001:db8:1::1]:49054 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=565231lb # [ 68.334067] envoy[979]: conn peer=[2001:db8:1::1]:49038 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1918 ms=20945232lb: must succeed: curl -sf localhost:9901/clusters5233lb # [ 68.337910] envoy[979]: conn peer=[2001:db8:1::4]:35948 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=8366 tx=1693 ms=432545234lb # [ 68.341743] envoy[979]: conn peer=[2001:db8:1::1]:35458 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=195235lb # [ 68.345267] envoy[979]: conn peer=192.168.1.3:44530 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=9937 tx=2188 ms=454365236lb # [ 68.349879] envoy[979]: conn peer=[2001:db8:1::1]:35460 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1005 tx=282 ms=15765237lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5238lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.15 seconds)5239(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 8.05 seconds)5240subtest: scheduler down: the other node takes the lock and keeps it5241lb: must succeed: curl -sf localhost:9901/clusters5242lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5243lb: must succeed: curl -sf localhost:9901/clusters5244lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5245lb: must succeed: curl -sf localhost:9901/clusters5246lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5247lb: must succeed: curl -sf localhost:9901/clusters5248lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5249worker2 # [ 68.643571] systemd[1]: Stopping Nix worker-protocol over gRPC...5250worker2 # [ 68.946907] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:48Z level=info event=signal_exit5251worker2 # [ 68.958914] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:48Z level=info event=scheduler_yield5252lb # [ 68.947790] niks3-server[1081]: 2026/09/20 08:06:48 INFO lead: released remote=192.168.1.4:557385253worker1 # [ 68.921065] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:49Z level=info event=scheduler_restarting addr=lb:500515254worker2 # [ 68.964714] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:383545255worker2 # [ 68.971736] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:48Z level=info event=worker_gone addr=192.168.1.3:500515256worker2 # [ 68.974666] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:48Z level=info event=scheduler_restarting addr=lb:500515257worker2 # [ 68.977517] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:48Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:383545258worker2 # [ 68.980632] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:48Z level=info event=worker_gone addr=192.168.1.4:500515259worker1 # [ 69.121746] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:49Z level=info event=scheduler_connected addr=lb:500515260worker1 # [ 69.129575] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5261worker2 # [ 69.170337] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:49Z level=info event=scheduler_connected addr=lb:500515262worker2 # [ 69.180883] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5263worker1 # [ 69.330142] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:49Z level=info event=scheduler_connected addr=lb:500515264worker1 # [ 69.332714] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5265worker2 # [ 69.381954] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:49Z level=info event=scheduler_connected addr=lb:500515266worker2 # [ 69.387341] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5267worker1 # [ 69.533808] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:49Z level=info event=scheduler_connected addr=lb:500515268worker1 # [ 69.538657] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5269worker2 # [ 69.588086] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:49Z level=info event=scheduler_connected addr=lb:500515270worker2 # [ 69.593313] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5271worker1 # [ 69.739149] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:49Z level=info event=scheduler_connected addr=lb:500515272worker1 # [ 69.741942] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5273worker2 # [ 69.793951] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:49Z level=info event=scheduler_connected addr=lb:500515274worker2 # [ 69.796496] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5275worker2 # [ 69.961314] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:49Z level=info event=scheduler_restarting5276worker2 # [ 69.969459] nix-grpc-daemon[1134]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5277worker2 # [ 69.971264] nix-grpc-daemon[1134]: E0000 00:00:1789891609.895328 1177 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5278worker2 # [ 69.974114] nix-grpc-daemon[1134]: E0000 00:00:1789891609.899379 1177 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5279worker2 # [ 69.978246] nix-daemon[909]: reaped child process 1183, status = succeeded5280worker1 # [ 69.945090] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:50Z level=info event=scheduler_connected addr=lb:500515281worker1 # [ 69.948246] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5282worker2 # [ 70.005528] nix-grpc-daemon[1134]: ts=2026-09-20T08:06:49Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5283worker1 # [ 70.145765] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:50Z level=info event=scheduler_connected addr=lb:500515284worker2 # [ 70.189460] nix-grpc-daemon[1134]: E0000 00:00:1789891610.115367 1177 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5285worker1 # [ 71.920951] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5286worker2 # [ 71.980069] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5287worker2 # [ 71.983914] systemd[1]: Stopped Nix worker-protocol over gRPC.5288worker2 # [ 71.986427] systemd[1]: nix-grpc-daemon.service: Consumed 359ms CPU time over 8.207s wall clock time, 30.4M memory peak, 18.5K incoming IP traffic, 24.3K outgoing IP traffic.5289worker2 # [ 71.996557] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5290worker2 # [ 72.000752] systemd[1]: Closed Nix worker-protocol over gRPC.5291worker2 # [ 72.005216] systemd[1]: nix-grpc-daemon.socket: Consumed 337us CPU time over 8.450s wall clock time, 256K memory peak, 25.8K incoming IP traffic, 21.8K outgoing IP traffic.5292worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5293worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.07 seconds)5294worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5295worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.03 seconds)5296worker1 # [ 72.120809] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:52Z level=info event=scheduler_connected addr=lb:500515297worker1 # [ 72.123707] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5298lb # [ 72.262674] niks3-server[1081]: 2026/09/20 08:06:51 INFO lead: acquired remote=192.168.1.3:461025299worker1 # [ 72.238717] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:52Z level=info event=scheduler_take_over5300worker1 # [ 72.324583] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:52Z level=info event=scheduler_connected addr=lb:500515301worker1 # [ 72.328717] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:52Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5302worker1 # [ 72.529690] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:52Z level=info event=scheduler_connected addr=lb:500515303worker1 # [ 72.533888] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:52Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05304worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5305worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)5306client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&25307worker1 # [ 73.335928] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:546305308worker1 # [ 73.340843] nix-daemon[841]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5309client # don't know how to build these paths:5310client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5311worker1 # [ 73.352536] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:53Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05312worker1 # [ 73.354586] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:53Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15313worker1 # [ 73.398825] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546305314worker1 # [ 73.404572] nix-grpc-daemon[1177]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 1/5)5315worker1 # [ 73.462122] nix-grpc-daemon[1177]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 2/5)5316worker1 # [ 73.477819] nix-grpc-daemon[1177]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 222 ms (attempt 3/5)5317worker1 # [ 73.706166] nix-grpc-daemon[1177]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 494 ms (attempt 4/5)5318worker1 # [ 74.200302] nix-grpc-daemon[1177]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5319worker1 # [ 74.218359] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546305320client # copying 1 paths to 'lb:50051'...5321client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5322worker1 # [ 74.230776] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546305323worker1 # [ 74.238811] nix-daemon[841]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5324worker1 # [ 74.260294] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:54Z level=info event=niks3_push_started pid=12515325worker1 # [ 74.564043] nix-daemon[841]: accepted connection from pid 1264, user nix-grpc-daemon (trusted)5326worker1 # [ 74.574453] nix-daemon[841]: reaped child process 1267, status = succeeded5327worker1 # [ 74.713482] nix-daemon[841]: accepted connection from pid 1269, user nix-grpc-daemon (trusted)5328worker1 # [ 74.724854] nix-daemon[841]: reaped child process 1272, status = succeeded5329lb # [ 74.764965] niks3-server[1081]: 2026/09/20 08:06:54 INFO Received uploads request method=POST path=/api/pending_closures5330worker1 # [ 74.743480] nix-grpc-daemon[1251]: time=2026-09-20T08:06:54.901Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5331worker1 # [ 74.747074] nix-grpc-daemon[1251]: time=2026-09-20T08:06:54.903Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5332lb # [ 74.808688] niks3-server[1081]: 2026/09/20 08:06:54 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5333lb # [ 74.811208] niks3-server[1081]: 2026/09/20 08:06:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5334lb # [ 74.814221] niks3-server[1081]: 2026/09/20 08:06:54 INFO Signed narinfos id=25 count=15335worker1 # [ 74.786827] nix-grpc-daemon[1251]: time=2026-09-20T08:06:54.944Z level=INFO msg="Uploading 1 narinfos"5336lb # [ 74.818870] niks3-server[1081]: 2026/09/20 08:06:54 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5337lb # [ 74.822600] niks3-server[1081]: 2026/09/20 08:06:54 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5338lb # [ 74.828553] niks3-server[1081]: 2026/09/20 08:06:54 INFO Completed upload id=255339worker1 # [ 74.802627] nix-grpc-daemon[1251]: time=2026-09-20T08:06:54.960Z level=INFO msg="Upload complete. (391ms)"5340lb # [ 74.830192] niks3-server[1081]: 2026/09/20 08:06:54 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo5341worker1 # [ 74.805213] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54630 duration_s=0 paths=1 nar_bytes_in=5205342worker1 # [ 74.809713] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546305343worker1 # [ 74.816093] nix-daemon[841]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5344worker1 # [ 74.819116] nix-daemon[841]: reaped child process 1249, status = succeeded5345client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5346worker1 # [ 74.823968] nix-daemon[841]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5347client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5348client # farm-a> LOG-farm-a-on-standby5349worker1 # [ 75.853426] nix-daemon[841]: reaped child process 1276, status = succeeded5350worker1 # [ 76.006759] nix-daemon[841]: accepted connection from pid 1291, user nix-grpc-daemon (trusted)5351worker1 # [ 76.018674] nix-daemon[841]: reaped child process 1294, status = succeeded5352lb # [ 76.060720] niks3-server[1081]: 2026/09/20 08:06:55 INFO Received uploads request method=POST path=/api/pending_closures5353worker1 # [ 76.043879] nix-grpc-daemon[1251]: time=2026-09-20T08:06:56.202Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5354worker1 # [ 76.045450] nix-grpc-daemon[1251]: time=2026-09-20T08:06:56.203Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5355lb # [ 76.110072] niks3-server[1081]: 2026/09/20 08:06:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5356lb # [ 76.117336] niks3-server[1081]: 2026/09/20 08:06:55 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5357lb # [ 76.124576] niks3-server[1081]: 2026/09/20 08:06:55 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5358lb # [ 76.131986] niks3-server[1081]: 2026/09/20 08:06:55 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5359lb # [ 76.138454] niks3-server[1081]: 2026/09/20 08:06:55 INFO Signed narinfos id=26 count=15360worker1 # [ 76.112207] nix-grpc-daemon[1251]: time=2026-09-20T08:06:56.269Z level=INFO msg="Uploading 1 narinfos"5361lb # [ 76.146946] niks3-server[1081]: 2026/09/20 08:06:55 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5362lb # [ 76.154091] niks3-server[1081]: 2026/09/20 08:06:55 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5363lb # [ 76.157179] niks3-server[1081]: 2026/09/20 08:06:55 INFO Completed upload id=265364worker1 # [ 76.131182] nix-grpc-daemon[1251]: time=2026-09-20T08:06:56.289Z level=INFO msg="Upload complete. (300ms)"5365worker1 # [ 76.144881] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:56Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54630 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15366worker1 # [ 76.157303] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:56Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05367worker1 # [ 76.161594] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:56Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15368worker1 # [ 76.168689] nix-daemon[841]: reaped child process 1274, status = succeeded5369worker1 # [ 76.201390] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546305370worker1 # [ 76.214948] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546305371worker1 # [ 76.228909] nix-grpc-daemon[1251]: time=2026-09-20T08:06:56.387Z level=INFO msg="All 1 paths already cached"5372client # copying 1 paths to 'lb:50051'...5373client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5374worker1 # [ 76.235955] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546305375worker1 # [ 76.242997] nix-daemon[841]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5376worker1 # [ 76.392529] nix-daemon[841]: accepted connection from pid 1300, user nix-grpc-daemon (trusted)5377worker1 # [ 76.405463] nix-daemon[841]: reaped child process 1303, status = succeeded5378worker1 # [ 76.537803] nix-daemon[841]: accepted connection from pid 1305, user nix-grpc-daemon (trusted)5379worker1 # [ 76.550072] nix-daemon[841]: reaped child process 1308, status = succeeded5380lb # [ 76.588365] niks3-server[1081]: 2026/09/20 08:06:56 INFO Received uploads request method=POST path=/api/pending_closures5381worker1 # [ 76.584142] nix-grpc-daemon[1251]: time=2026-09-20T08:06:56.742Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5382worker1 # [ 76.585716] nix-grpc-daemon[1251]: time=2026-09-20T08:06:56.744Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5383lb # [ 76.641285] niks3-server[1081]: 2026/09/20 08:06:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5384lb # [ 76.648364] niks3-server[1081]: 2026/09/20 08:06:56 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5385worker1 # [ 76.625636] nix-grpc-daemon[1251]: time=2026-09-20T08:06:56.783Z level=INFO msg="Uploading 1 narinfos"5386lb # [ 76.653444] niks3-server[1081]: 2026/09/20 08:06:56 INFO Signed narinfos id=27 count=15387lb # [ 76.664269] niks3-server[1081]: 2026/09/20 08:06:56 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5388lb # [ 76.933784] niks3-server[1081]: 2026/09/20 08:06:56 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5389lb # [ 76.943427] niks3-server[1081]: 2026/09/20 08:06:56 INFO Completed upload id=275390worker1 # [ 76.916253] nix-grpc-daemon[1251]: time=2026-09-20T08:06:57.074Z level=INFO msg="Upload complete. (661ms)"5391lb # [ 76.949535] niks3-server[1081]: 2026/09/20 08:06:56 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5392worker1 # [ 76.920987] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54630 duration_s=0 paths=1 nar_bytes_in=6405393worker1 # [ 76.930180] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546305394worker1 # [ 76.943883] nix-daemon[841]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5395worker1 # [ 76.949892] nix-daemon[841]: reaped child process 1298, status = succeeded5396client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5397client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5398worker1 # [ 76.962377] nix-daemon[841]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5399lb # [ 78.330124] envoy[979]: conn peer=[2001:db8:1::4]:46270 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=2099 tx=520 ms=60405400client # farm-b> LOG-farm-b-on-standby5401worker1 # [ 78.585849] nix-daemon[841]: reaped child process 1312, status = succeeded5402worker1 # [ 78.744198] nix-daemon[841]: accepted connection from pid 1327, user nix-grpc-daemon (trusted)5403worker1 # [ 78.757986] nix-daemon[841]: reaped child process 1330, status = succeeded5404lb # [ 78.799270] niks3-server[1081]: 2026/09/20 08:06:58 INFO Received uploads request method=POST path=/api/pending_closures5405worker1 # [ 78.776584] nix-grpc-daemon[1251]: time=2026-09-20T08:06:58.934Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5406worker1 # [ 78.778172] nix-grpc-daemon[1251]: time=2026-09-20T08:06:58.936Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5407lb # [ 78.819704] niks3-server[1081]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5408lb # [ 78.824383] niks3-server[1081]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5409lb # [ 78.826613] niks3-server[1081]: 2026/09/20 08:06:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5410lb # [ 78.828645] niks3-server[1081]: 2026/09/20 08:06:58 INFO Signed narinfos id=28 count=15411worker1 # [ 78.802769] nix-grpc-daemon[1251]: time=2026-09-20T08:06:58.960Z level=INFO msg="Uploading 1 narinfos"5412lb # [ 78.832198] niks3-server[1081]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5413lb # [ 78.836490] niks3-server[1081]: 2026/09/20 08:06:58 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5414lb # [ 78.840547] niks3-server[1081]: 2026/09/20 08:06:58 INFO Completed upload id=285415worker1 # [ 78.813145] nix-grpc-daemon[1251]: time=2026-09-20T08:06:58.971Z level=INFO msg="Upload complete. (237ms)"5416lb # [ 78.842234] niks3-server[1081]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5417worker1 # [ 78.815765] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:58Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54630 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15418worker1 # [ 78.822771] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:58Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05419worker1 # [ 78.824741] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:58Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15420worker1 # [ 78.828977] nix-daemon[841]: reaped child process 1310, status = succeeded5421worker1 # [ 78.866841] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546305422worker1 # [ 78.876526] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546305423worker1 # [ 78.886258] nix-grpc-daemon[1251]: time=2026-09-20T08:06:59.044Z level=INFO msg="All 2 paths already cached"5424client # copying 1 paths to 'lb:50051'...5425client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5426worker1 # [ 78.892162] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546305427worker1 # [ 78.900078] nix-daemon[841]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5428worker1 # [ 79.053248] nix-daemon[841]: accepted connection from pid 1336, user nix-grpc-daemon (trusted)5429worker1 # [ 79.065092] nix-daemon[841]: reaped child process 1339, status = succeeded5430worker1 # [ 79.227458] nix-daemon[841]: accepted connection from pid 1341, user nix-grpc-daemon (trusted)5431worker1 # [ 79.240823] nix-daemon[841]: reaped child process 1344, status = succeeded5432lb # [ 79.278871] niks3-server[1081]: 2026/09/20 08:06:58 INFO Received uploads request method=POST path=/api/pending_closures5433worker1 # [ 79.263032] nix-grpc-daemon[1251]: time=2026-09-20T08:06:59.421Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5434worker1 # [ 79.264458] nix-grpc-daemon[1251]: time=2026-09-20T08:06:59.421Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5435lb # [ 79.309590] niks3-server[1081]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5436lb # [ 79.320651] niks3-server[1081]: 2026/09/20 08:06:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5437worker1 # [ 79.298058] nix-grpc-daemon[1251]: time=2026-09-20T08:06:59.456Z level=INFO msg="Uploading 1 narinfos"5438lb # [ 79.326251] niks3-server[1081]: 2026/09/20 08:06:58 INFO Signed narinfos id=29 count=15439lb # [ 79.332140] niks3-server[1081]: 2026/09/20 08:06:58 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5440lb # [ 79.341799] niks3-server[1081]: 2026/09/20 08:06:58 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5441lb # [ 79.346444] niks3-server[1081]: 2026/09/20 08:06:59 INFO Completed upload id=295442worker1 # [ 79.319479] nix-grpc-daemon[1251]: time=2026-09-20T08:06:59.477Z level=INFO msg="Upload complete. (413ms)"5443lb # [ 79.348382] niks3-server[1081]: 2026/09/20 08:06:59 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5444worker1 # [ 79.321577] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54630 duration_s=0 paths=1 nar_bytes_in=7685445worker1 # [ 79.325590] nix-grpc-daemon[1177]: ts=2026-09-20T08:06:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546305446worker1 # [ 79.331480] nix-daemon[841]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5447worker1 # [ 79.333822] nix-daemon[841]: reaped child process 1334, status = succeeded5448worker1 # [ 79.339189] nix-daemon[841]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5449client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5450client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5451worker1 # [ 80.551915] nix-daemon[841]: reaped child process 1348, status = succeeded5452client # farm-top> LOG-farm-top-on-standby5453worker1 # [ 80.702090] nix-daemon[841]: accepted connection from pid 1363, user nix-grpc-daemon (trusted)5454worker1 # [ 80.713354] nix-daemon[841]: reaped child process 1366, status = succeeded5455lb # [ 80.757694] niks3-server[1081]: 2026/09/20 08:07:00 INFO Received uploads request method=POST path=/api/pending_closures5456worker1 # [ 80.740689] nix-grpc-daemon[1251]: time=2026-09-20T08:07:00.898Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5457worker1 # [ 80.742373] nix-grpc-daemon[1251]: time=2026-09-20T08:07:00.900Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5458lb # [ 80.799840] niks3-server[1081]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5459lb # [ 80.809982] niks3-server[1081]: 2026/09/20 08:07:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5460lb # [ 80.815488] niks3-server[1081]: 2026/09/20 08:07:00 INFO Signed narinfos id=30 count=15461worker1 # [ 80.790800] nix-grpc-daemon[1251]: time=2026-09-20T08:07:00.948Z level=INFO msg="Uploading 1 narinfos"5462lb # [ 80.821288] niks3-server[1081]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5463lb # [ 80.824257] niks3-server[1081]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5464lb # [ 80.828162] niks3-server[1081]: 2026/09/20 08:07:00 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5465lb # [ 80.832310] niks3-server[1081]: 2026/09/20 08:07:00 INFO Completed upload id=305466lb # [ 80.834203] niks3-server[1081]: 2026/09/20 08:07:00 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5467worker1 # [ 80.806498] nix-grpc-daemon[1251]: time=2026-09-20T08:07:00.964Z level=INFO msg="Upload complete. (260ms)"5468worker1 # [ 80.812503] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54630 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15469worker1 # [ 80.824212] nix-daemon[841]: reaped child process 1346, status = succeeded5470client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&2, in 7.72 seconds)5471client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath5472client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath, in 0.19 seconds)5473worker2 # [ 81.125555] systemd[1]: Listening on Nix worker-protocol over gRPC.5474worker2 # [ 81.129447] systemd[1]: Starting Nix worker-protocol over gRPC...5475worker2 # [ 81.277330] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:01Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5476worker2 # [ 81.280874] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:01Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15477worker2 # [ 81.286900] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:01Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5478worker2 # [ 81.288444] systemd[1]: Started Nix worker-protocol over gRPC.5479lb: must succeed: curl -sf localhost:9901/clusters5480worker2 # [ 81.304843] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:01Z level=info event=scheduler_connected addr=lb:500515481worker1 # [ 81.264981] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05482lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5483worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5484worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5485lb: must succeed: curl -sf localhost:9901/clusters5486lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5487lb: must succeed: curl -sf localhost:9901/clusters5488lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5489worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5490worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5491(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 13.13 seconds)5492subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5493client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5494client # [ 81.599813] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5495client # Running as unit: rs.service; invocation ID: 7f0d54b1ddab44818d3b4b1bca54f6a55496client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.07 seconds)5497worker1 # [ 81.783202] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:546305498client # [ 81.830598] nix[1150]: don't know how to build these paths:5499client # [ 81.831610] nix[1150]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5500worker1 # [ 81.798948] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:01Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05501worker1 # [ 81.804708] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:01Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15502worker1 # [ 81.810711] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546305503worker1 # [ 81.824335] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:546305504client # [ 81.878137] nix[1150]: copying 1 paths to 'lb:50051'...5505client # [ 81.879033] nix[1150]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5506worker1 # [ 81.838571] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:546305507worker1 # [ 81.851357] nix-daemon[841]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5508worker1 # [ 82.038284] nix-daemon[841]: accepted connection from pid 1381, user nix-grpc-daemon (trusted)5509worker1 # [ 82.051107] nix-daemon[841]: reaped child process 1384, status = succeeded5510worker1 # [ 82.226522] nix-daemon[841]: accepted connection from pid 1386, user nix-grpc-daemon (trusted)5511worker1 # [ 82.240632] nix-daemon[841]: reaped child process 1389, status = succeeded5512lb # [ 82.284849] niks3-server[1081]: 2026/09/20 08:07:01 INFO Received uploads request method=POST path=/api/pending_closures5513worker1 # [ 82.267689] nix-grpc-daemon[1251]: time=2026-09-20T08:07:02.425Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5514worker1 # [ 82.269238] nix-grpc-daemon[1251]: time=2026-09-20T08:07:02.425Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5515lb # [ 82.313613] niks3-server[1081]: 2026/09/20 08:07:01 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5516lb # [ 82.326264] niks3-server[1081]: 2026/09/20 08:07:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5517worker1 # [ 82.305062] nix-grpc-daemon[1251]: time=2026-09-20T08:07:02.463Z level=INFO msg="Uploading 1 narinfos"5518lb # [ 82.332122] niks3-server[1081]: 2026/09/20 08:07:01 INFO Signed narinfos id=31 count=15519lb # [ 82.339087] niks3-server[1081]: 2026/09/20 08:07:01 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5520lb # [ 82.349762] niks3-server[1081]: 2026/09/20 08:07:02 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5521lb # [ 82.357311] niks3-server[1081]: 2026/09/20 08:07:02 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5522lb # [ 82.360497] niks3-server[1081]: 2026/09/20 08:07:02 INFO Completed upload id=315523worker1 # [ 82.333226] nix-grpc-daemon[1251]: time=2026-09-20T08:07:02.491Z level=INFO msg="Upload complete. (469ms)"5524worker1 # [ 82.335294] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54630 duration_s=0 paths=1 nar_bytes_in=4165525worker1 # [ 82.338241] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:546305526worker1 # [ 82.343510] nix-daemon[841]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5527worker1 # [ 82.348196] nix-daemon[841]: reaped child process 1379, status = succeeded5528client # [ 82.393125] nix[1150]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5529worker1 # [ 82.355190] nix-daemon[841]: accepted connection from pid 1177, user nix-grpc-daemon (trusted)5530lb: must succeed: curl -sf localhost:9901/clusters5531lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5532lb: must succeed: curl -sf localhost:9901/clusters5533lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5534lb: must succeed: curl -sf localhost:9901/clusters5535lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5536lb: must succeed: curl -sf localhost:9901/clusters5537lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5538worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5539worker2 # [ 84.390010] systemd-journald[287]: Received client request to rotate journal, rotating.5540worker2 # [ 84.405377] systemd-journald[287]: Vacuuming done, freed 0B of archived journals from /var/log/journal/cc8d5529cc624d6c9425acfafb250952.5541worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.05 seconds)5542worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5543worker1 # [ 84.275948] systemd[1]: Stopping Nix worker-protocol over gRPC...5544worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.05 seconds)5545??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5546 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735547client: must succeed: sleep 5.05548worker1 # [ 85.231603] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:05Z level=info event=draining5549lb # [ 88.331256] envoy[979]: conn peer=[2001:db8:1::1]:33750 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9455 tx=3809 ms=74855550client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5551worker1 # [ 89.576805] nix-daemon[841]: reaped child process 1393, status = succeeded5552worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5553worker1 # [ 89.709412] nix-daemon[841]: accepted connection from pid 1433, user nix-grpc-daemon (trusted)5554worker1 # [ 89.720259] nix-daemon[841]: reaped child process 1436, status = succeeded5555lb # [ 89.760912] niks3-server[1081]: 2026/09/20 08:07:09 INFO Received uploads request method=POST path=/api/pending_closures5556worker1 # [ 89.740674] nix-grpc-daemon[1251]: time=2026-09-20T08:07:09.898Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5557worker1 # [ 89.742161] nix-grpc-daemon[1251]: time=2026-09-20T08:07:09.900Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5558lb # [ 89.807367] niks3-server[1081]: 2026/09/20 08:07:09 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5559lb # [ 89.814413] niks3-server[1081]: 2026/09/20 08:07:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5560lb # [ 89.821669] niks3-server[1081]: 2026/09/20 08:07:09 INFO Signed narinfos id=32 count=15561worker1 # [ 89.797787] nix-grpc-daemon[1251]: time=2026-09-20T08:07:09.955Z level=INFO msg="Uploading 1 narinfos"5562lb # [ 89.825126] niks3-server[1081]: 2026/09/20 08:07:09 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5563lb # [ 89.831914] niks3-server[1081]: 2026/09/20 08:07:09 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5564lb # [ 89.839971] niks3-server[1081]: 2026/09/20 08:07:09 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5565lb # [ 89.846688] niks3-server[1081]: 2026/09/20 08:07:09 INFO Completed upload id=325566worker1 # [ 89.819241] nix-grpc-daemon[1251]: time=2026-09-20T08:07:09.977Z level=INFO msg="Upload complete. (251ms)"5567lb # [ 89.848319] niks3-server[1081]: 2026/09/20 08:07:09 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5568worker1 # [ 89.822187] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54630 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15569worker1 # [ 89.830109] nix-daemon[841]: reaped child process 1391, status = succeeded5570client # [ 89.903071] systemd[1]: rs.service: Deactivated successfully.5571client # [ 89.906310] systemd[1]: rs.service: Consumed 146ms CPU time over 8.302s wall clock time, 37.1M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.5572worker1 # [ 90.235152] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:10Z level=info event=signal_exit5573worker1 # [ 90.453918] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:10Z level=info event=scheduler_yield5574lb # [ 90.484929] niks3-server[1081]: 2026/09/20 08:07:10 INFO lead: released remote=192.168.1.3:461025575worker1 # [ 90.458811] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:10Z level=info event=scheduler_restarting addr=lb:500515576worker2 # [ 90.502389] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:10Z level=info event=scheduler_restarting addr=lb:500515577worker1 # [ 90.463528] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:432225578worker1 # [ 90.467148] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:10Z level=info event=worker_gone addr=192.168.1.3:500515579worker1 # [ 90.470519] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:10Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:432225580worker1 # [ 90.474174] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:10Z level=info event=worker_gone addr=192.168.1.4:500515581worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 1.07 seconds)5582client: waiting for success: ! systemctl is-active rs5583worker1 # [ 90.659739] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:10Z level=info event=scheduler_connected addr=lb:500515584worker2 # [ 90.701619] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:10Z level=info event=scheduler_connected addr=lb:500515585worker1 # [ 90.663129] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5586worker2 # [ 90.705202] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5587client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)5588client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5589client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)5590client: must fail: journalctl -u rs | grep -q 'reconnecting'5591client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5592lb: must succeed: curl -sf localhost:9901/clusters5593lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5594worker1 # [ 90.864183] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:11Z level=info event=scheduler_connected addr=lb:500515595worker2 # [ 90.905962] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:10Z level=info event=scheduler_connected addr=lb:500515596worker1 # [ 90.874663] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5597worker2 # [ 90.916089] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:10Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5598worker1 # [ 91.075820] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:11Z level=info event=scheduler_connected addr=lb:500515599worker2 # [ 91.117146] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:11Z level=info event=scheduler_connected addr=lb:500515600worker1 # [ 91.081403] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5601worker2 # [ 91.124500] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5602worker2 # [ 91.297901] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:11Z level=info event=scheduler_take_over5603lb # [ 91.283863] niks3-server[1081]: 2026/09/20 08:07:10 INFO lead: acquired remote=192.168.1.4:591925604worker1 # [ 91.281451] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:11Z level=info event=scheduler_connected addr=lb:500515605worker2 # [ 91.325156] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:11Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=0 running=05606worker2 # [ 91.331766] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:11Z level=info event=scheduler_connected addr=lb:500515607worker2 # [ 91.336231] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:11Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5608worker1 # [ 91.455299] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:11Z level=info event=scheduler_restarting5609worker2 # [ 91.506224] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:11Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:359145610worker2 # [ 91.510666] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:11Z level=info event=worker_gone addr=192.168.1.3:500515611worker1 # [ 91.477727] nix-grpc-daemon[1177]: ts=2026-09-20T08:07:11Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5612worker2 # [ 91.536806] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:11Z level=info event=scheduler_connected addr=lb:500515613worker1 # [ 91.498469] nix-daemon[841]: reaped child process 1242, status = succeeded5614worker2 # [ 91.542873] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:11Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05615worker1 # [ 91.732869] nix-grpc-daemon[1177]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5616worker1 # [ 91.736489] nix-grpc-daemon[1177]: E0000 00:00:1789891631.890554 1220 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5617worker1 # [ 91.741555] nix-grpc-daemon[1177]: E0000 00:00:1789891631.899566 1220 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5618lb: must succeed: curl -sf localhost:9901/clusters5619lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5620lb: must succeed: curl -sf localhost:9901/clusters5621lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5622worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5623worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5624worker1 # [ 93.377374] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5625worker1 # [ 93.378419] systemd[1]: Stopped Nix worker-protocol over gRPC.5626worker1 # [ 93.379251] systemd[1]: nix-grpc-daemon.service: Consumed 1.256s CPU time over 26.320s wall clock time, 33.4M memory peak, 45.9K incoming IP traffic, 86.2K outgoing IP traffic.5627worker1 # [ 93.386250] systemd[1]: Starting Nix worker-protocol over gRPC...5628worker1 # [ 93.520418] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5629worker1 # [ 93.523107] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:13Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15630worker1 # [ 93.529058] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5631worker1 # [ 93.532791] systemd[1]: Started Nix worker-protocol over gRPC.5632worker1 # [ 93.545515] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:13Z level=info event=scheduler_connected addr=lb:500515633worker2 # [ 93.588895] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:13Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05634lb: must succeed: curl -sf localhost:9901/clusters5635lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5636worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5637worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5638(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.55 seconds)5639subtest: scheduler restart mid-build: build finishes, no double build5640client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5641client # [ 94.142328] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5642client # Running as unit: mid.service; invocation ID: 124cbeb1490a4ddfa6b32402e26a38965643client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.05 seconds)5644worker2 # [ 94.330479] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:528345645worker2 # [ 94.335870] nix-daemon[909]: accepted connection from pid 1227, user nix-grpc-daemon (trusted)5646client # [ 94.343892] nix[1184]: don't know how to build these paths:5647client # [ 94.344884] nix[1184]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5648worker2 # [ 94.350632] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:14Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05649worker2 # [ 94.352458] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:14Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15650worker2 # [ 94.398988] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:528345651worker2 # [ 94.406294] nix-grpc-daemon[1227]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 1/5)5652worker2 # [ 94.413784] nix-grpc-daemon[1227]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 127 ms (attempt 2/5)5653worker2 # [ 94.543418] nix-grpc-daemon[1227]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 296 ms (attempt 3/5)5654worker2 # [ 94.842858] nix-grpc-daemon[1227]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 627 ms (attempt 4/5)5655worker2 # [ 95.474095] nix-grpc-daemon[1227]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5656worker2 # [ 95.492451] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:528345657client # [ 95.502691] nix[1184]: copying 1 paths to 'lb:50051'...5658client # [ 95.505977] nix[1184]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5659worker2 # [ 95.507303] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:528345660worker2 # [ 95.518294] nix-daemon[909]: accepted connection from pid 1227, user nix-grpc-daemon (trusted)5661worker2 # [ 95.537127] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:15Z level=info event=niks3_push_started pid=13495662worker2 # [ 95.895654] nix-daemon[909]: accepted connection from pid 1362, user nix-grpc-daemon (trusted)5663worker2 # [ 95.907495] nix-daemon[909]: reaped child process 1365, status = succeeded5664worker2 # [ 96.056459] nix-daemon[909]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5665worker2 # [ 96.068773] nix-daemon[909]: reaped child process 1370, status = succeeded5666lb # [ 96.068989] niks3-server[1081]: 2026/09/20 08:07:15 INFO Received uploads request method=POST path=/api/pending_closures5667worker2 # [ 96.089827] nix-grpc-daemon[1349]: time=2026-09-20T08:07:16.015Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5668worker2 # [ 96.093370] nix-grpc-daemon[1349]: time=2026-09-20T08:07:16.017Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5669lb # [ 96.101193] niks3-server[1081]: 2026/09/20 08:07:15 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5670lb # [ 96.114078] niks3-server[1081]: 2026/09/20 08:07:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5671worker2 # [ 96.134684] nix-grpc-daemon[1349]: time=2026-09-20T08:07:16.060Z level=INFO msg="Uploading 1 narinfos"5672lb # [ 96.121315] niks3-server[1081]: 2026/09/20 08:07:15 INFO Signed narinfos id=33 count=15673lb # [ 96.134144] niks3-server[1081]: 2026/09/20 08:07:15 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5674lb # [ 96.139218] niks3-server[1081]: 2026/09/20 08:07:15 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5675lb # [ 96.147866] niks3-server[1081]: 2026/09/20 08:07:15 INFO Completed upload id=335676worker2 # [ 96.162101] nix-grpc-daemon[1349]: time=2026-09-20T08:07:16.088Z level=INFO msg="Upload complete. (422ms)"5677lb # [ 96.149866] niks3-server[1081]: 2026/09/20 08:07:15 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5678worker2 # [ 96.164622] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:52834 duration_s=0 paths=1 nar_bytes_in=4245679worker2 # [ 96.168638] nix-grpc-daemon[1227]: ts=2026-09-20T08:07:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:528345680worker2 # [ 96.174549] nix-daemon[909]: accepted connection from pid 1227, user nix-grpc-daemon (trusted)5681worker2 # [ 96.177474] nix-daemon[909]: reaped child process 1347, status = succeeded5682worker2 # [ 96.182520] nix-daemon[909]: accepted connection from pid 1227, user nix-grpc-daemon (trusted)5683client # [ 96.181324] nix[1184]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5684lb: must succeed: curl -sf localhost:9901/clusters5685lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5686lb: must succeed: curl -sf localhost:9901/clusters5687lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5688worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5689worker2 # [ 97.821201] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1227 (nix-grpc-daemon) on client request.5690worker2 # [ 97.823976] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5691lb # [ 97.818577] niks3-server[1081]: 2026/09/20 08:07:17 INFO lead: released remote=192.168.1.4:591925692client # [ 97.833415] nix[1184]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5693worker1 # [ 97.792316] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:17Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5694client # [ 97.837698] nix[1184]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5695worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)5696client: must succeed: sleep 5.05697worker2 # [ 97.857464] nix-daemon[909]: reaped child process 1372, status = succeeded5698worker2 # [ 97.858620] nix-daemon[909]: reaped child process 1336, status = succeeded5699worker2 # [ 97.862322] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5700worker2 # [ 97.864095] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5701worker2 # [ 97.865890] systemd[1]: nix-grpc-daemon.service: Consumed 432ms CPU time over 16.731s wall clock time, 30.8M memory peak, 13.9K incoming IP traffic, 20.7K outgoing IP traffic.5702worker2 # [ 97.875243] nix-daemon[1374]: unexpected Nix daemon error: error: interrupted by the user5703worker2 # [ 97.878306] nix-daemon[909]: reaped child process 1374, status = failed with exit code 15704worker2 # [ 98.010340] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5705worker2 # [ 98.020170] systemd[1]: Starting Nix worker-protocol over gRPC...5706worker1 # [ 97.992445] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:18Z level=info event=scheduler_connected addr=lb:500515707worker2 # [ 98.207584] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:18Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5708worker2 # [ 98.210736] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:18Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15709worker2 # [ 98.217503] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:18Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5710worker2 # [ 98.221478] systemd[1]: Started Nix worker-protocol over gRPC.5711lb # [ 98.214959] niks3-server[1081]: 2026/09/20 08:07:17 INFO lead: acquired remote=192.168.1.4:490345712worker2 # [ 98.228992] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:18Z level=info event=scheduler_take_over5713worker2 # [ 98.232145] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:18Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05714worker2 # [ 98.238723] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:18Z level=info event=scheduler_connected addr=lb:500515715worker2 # [ 98.243827] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:18Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05716worker2 # [ 98.341819] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:18Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05717lb # [ 98.332227] envoy[979]: conn peer=[2001:db8:1::1]:33756 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2930 tx=1308 ms=80535718lb # [ 98.333774] envoy[979]: conn peer=[2001:db8:1::3]:57712 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=3989 tx=1077 ms=242285719worker2 # [ 98.345811] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:18Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.3:50051 clients=15720lb # [ 98.335261] envoy[979]: conn peer=[2001:db8:1::4]:58962 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1560 tx=473 ms=165305721worker1 # [ 98.349608] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598785722worker1 # [ 98.360832] nix-daemon[841]: accepted connection from pid 1443, user nix-grpc-daemon (trusted)5723worker1 # [ 98.378318] nix-grpc-daemon[1443]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 6 ms (attempt 1/5)5724worker1 # [ 98.389974] nix-grpc-daemon[1443]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 45 ms (attempt 2/5)5725worker1 # [ 98.440865] nix-grpc-daemon[1443]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 342 ms (attempt 3/5)5726worker1 # [ 98.788663] nix-grpc-daemon[1443]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 4/5)5727worker1 # [ 98.792886] nix-grpc-daemon[1443]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5728worker1 # [ 98.804223] nix-grpc-daemon[1443]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' from 'http://lb:5751'...5729worker1 # [ 98.818210] nix-daemon[841]: accepted connection from pid 1443, user nix-grpc-daemon (trusted)5730worker1 # [ 98.825948] nix-daemon[841]: accepted connection from pid 1443, user nix-grpc-daemon (trusted)5731client # [ 98.867517] nix[1184]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5732client: (finished: must succeed: sleep 5.0, in 5.04 seconds)5733worker1 # [ 103.038265] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:23Z level=info event=niks3_push_started pid=15445734worker1 # [ 103.048818] nix-daemon[841]: reaped child process 1520, status = succeeded5735client: waiting for success: ! systemctl is-active mid5736worker1 # [ 103.354650] nix-daemon[841]: accepted connection from pid 1557, user nix-grpc-daemon (trusted)5737worker1 # [ 103.366585] nix-daemon[841]: reaped child process 1560, status = succeeded5738lb # [ 103.411872] niks3-server[1081]: 2026/09/20 08:07:23 INFO Received uploads request method=POST path=/api/pending_closures5739worker1 # [ 103.393925] nix-grpc-daemon[1544]: time=2026-09-20T08:07:23.552Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5740worker1 # [ 103.396614] nix-grpc-daemon[1544]: time=2026-09-20T08:07:23.554Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5741lb # [ 103.460948] niks3-server[1081]: 2026/09/20 08:07:23 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5742worker1 # [ 103.450530] nix-grpc-daemon[1544]: time=2026-09-20T08:07:23.608Z level=INFO msg="Uploading 1 narinfos"5743lb # [ 103.477109] niks3-server[1081]: 2026/09/20 08:07:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5744lb # [ 103.480319] niks3-server[1081]: 2026/09/20 08:07:23 INFO Signed narinfos id=34 count=15745lb # [ 103.493678] niks3-server[1081]: 2026/09/20 08:07:23 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5746lb # [ 103.496427] niks3-server[1081]: 2026/09/20 08:07:23 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5747lb # [ 103.504494] niks3-server[1081]: 2026/09/20 08:07:23 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5748lb # [ 103.507140] niks3-server[1081]: 2026/09/20 08:07:23 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5749lb # [ 103.514436] niks3-server[1081]: 2026/09/20 08:07:23 INFO Completed upload id=345750worker1 # [ 103.487518] nix-grpc-daemon[1544]: time=2026-09-20T08:07:23.645Z level=INFO msg="Upload complete. (281ms)"5751worker1 # [ 103.492565] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59878 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15752worker1 # [ 103.505860] nix-daemon[841]: reaped child process 1518, status = succeeded5753client # [ 103.559956] systemd[1]: mid.service: Deactivated successfully.5754client # [ 103.561900] systemd[1]: mid.service: Consumed 121ms CPU time over 9.418s wall clock time, 37.2M memory peak, 9.5K incoming IP traffic, 10.6K outgoing IP traffic.5755client: (finished: waiting for success: ! systemctl is-active mid, in 1.06 seconds)5756client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5757client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.02 seconds)5758(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.07 seconds)5759subtest: interrupting the client stops the build on the worker5760client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5761client # [ 104.194346] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5762client # Running as unit: intr.service; invocation ID: adceb2fa639f4df28c2456e400caaea65763client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.03 seconds)5764worker1 # [ 104.339249] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:24Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:598785765client # [ 104.386412] nix[1219]: don't know how to build these paths:5766client # [ 104.387381] nix[1219]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5767worker2 # [ 104.394966] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:24Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05768worker2 # [ 104.397156] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:24Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.4:50051 clients=15769worker2 # [ 104.444913] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:390645770worker2 # [ 104.456101] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5771worker2 # [ 104.472933] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 1/5)5772worker2 # [ 104.539846] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 90 ms (attempt 2/5)5773worker2 # [ 104.636152] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 41 ms (attempt 3/5)5774worker2 # [ 104.682756] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 714 ms (attempt 4/5)5775worker2 # [ 105.405971] nix-grpc-daemon[1410]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5776worker2 # [ 105.427585] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:390645777client # [ 105.440889] nix[1219]: copying 1 paths to 'lb:50051'...5778worker2 # [ 105.442489] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:390645779client # [ 105.444144] nix[1219]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5780worker2 # [ 105.457875] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5781worker2 # [ 105.470642] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:25Z level=info event=niks3_push_started pid=14865782worker2 # [ 105.774105] nix-daemon[909]: accepted connection from pid 1499, user nix-grpc-daemon (trusted)5783worker2 # [ 105.785653] nix-daemon[909]: reaped child process 1502, status = succeeded5784worker2 # [ 105.950135] nix-daemon[909]: accepted connection from pid 1504, user nix-grpc-daemon (trusted)5785worker2 # [ 105.962621] nix-daemon[909]: reaped child process 1507, status = succeeded5786lb # [ 105.966502] niks3-server[1081]: 2026/09/20 08:07:25 INFO Received uploads request method=POST path=/api/pending_closures5787worker2 # [ 105.993032] nix-grpc-daemon[1486]: time=2026-09-20T08:07:25.917Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5788worker2 # [ 105.994647] nix-grpc-daemon[1486]: time=2026-09-20T08:07:25.917Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5789lb # [ 106.006174] niks3-server[1081]: 2026/09/20 08:07:25 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5790lb # [ 106.012537] niks3-server[1081]: 2026/09/20 08:07:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5791lb # [ 106.018489] niks3-server[1081]: 2026/09/20 08:07:25 INFO Signed narinfos id=35 count=15792worker2 # [ 106.035742] nix-grpc-daemon[1486]: time=2026-09-20T08:07:25.961Z level=INFO msg="Uploading 1 narinfos"5793lb # [ 106.030084] niks3-server[1081]: 2026/09/20 08:07:25 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5794lb # [ 106.036729] niks3-server[1081]: 2026/09/20 08:07:25 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5795lb # [ 106.046965] niks3-server[1081]: 2026/09/20 08:07:25 INFO Completed upload id=355796lb # [ 106.049251] niks3-server[1081]: 2026/09/20 08:07:25 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5797worker2 # [ 106.061305] nix-grpc-daemon[1486]: time=2026-09-20T08:07:25.987Z level=INFO msg="Upload complete. (425ms)"5798worker2 # [ 106.065162] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39064 duration_s=0 paths=1 nar_bytes_in=4245799worker2 # [ 106.071281] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:390645800worker2 # [ 106.078861] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5801worker2 # [ 106.091318] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5802client # [ 106.090499] nix[1219]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5803worker2 # [ 106.093579] nix-daemon[909]: reaped child process 1484, status = succeeded5804client: must succeed: systemctl kill -s INT intr5805client # [ 107.715272] systemd[1]: intr.service: Sent signal SIGINT to main process 1219 (nix) on client request.5806client # [ 107.717926] nix[1219]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5807client: (finished: must succeed: systemctl kill -s INT intr, in 0.03 seconds)5808client # [ 107.720892] nix[1219]: error: interrupted by the user5809client # [ 107.744971] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5810client # [ 107.746397] systemd[1]: intr.service: Failed with result 'exit-code'.5811client # [ 107.748378] systemd[1]: intr.service: Consumed 106ms CPU time over 3.553s wall clock time, 39.1M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5812worker2 # [ 107.910308] nix-daemon[909]: reaped child process 1509, status = succeeded5813worker2 # [ 107.913170] nix-daemon[1511]: unexpected Nix daemon error: error: interrupted by the user5814worker2 # [ 107.916696] nix-daemon[909]: reaped child process 1511, status = failed with exit code 15815lb # [ 108.331612] envoy[979]: conn peer=[2001:db8:1::1]:49498 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3835 tx=1661 ms=92215816lb # [ 108.335454] envoy[979]: conn peer=[2001:db8:1::1]:54490 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2924 tx=757 ms=33515817(finished: subtest: interrupting the client stops the build on the worker, in 4.79 seconds)5818subtest: a deploy mid-build drains: the build finishes, the new generation takes over5819client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5820client # [ 109.015908] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5821client # Running as unit: sw.service; invocation ID: 4b91889879434e7a8a69ac66a4d5aab65822client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds)5823worker1 # [ 109.184655] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:29Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:598785824client # [ 109.231529] nix[1239]: don't know how to build these paths:5825client # [ 109.232529] nix[1239]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5826worker2 # [ 109.245746] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:29Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05827worker2 # [ 109.251370] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:29Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.3:50051 clients=15828worker1 # [ 109.247393] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598785829worker1 # [ 109.260690] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:598785830client # [ 109.311482] nix[1239]: copying 1 paths to 'lb:50051'...5831worker1 # [ 109.271965] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:598785832client # [ 109.314141] nix[1239]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5833worker1 # [ 109.282962] nix-daemon[841]: accepted connection from pid 1443, user nix-grpc-daemon (trusted)5834worker1 # [ 109.440283] nix-daemon[841]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5835worker1 # [ 109.452789] nix-daemon[841]: reaped child process 1595, status = succeeded5836worker1 # [ 109.586969] nix-daemon[841]: accepted connection from pid 1597, user nix-grpc-daemon (trusted)5837worker1 # [ 109.598936] nix-daemon[841]: reaped child process 1600, status = succeeded5838lb # [ 109.640726] niks3-server[1081]: 2026/09/20 08:07:29 INFO Received uploads request method=POST path=/api/pending_closures5839worker1 # [ 109.622443] nix-grpc-daemon[1544]: time=2026-09-20T08:07:29.780Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5840worker1 # [ 109.624157] nix-grpc-daemon[1544]: time=2026-09-20T08:07:29.782Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5841lb # [ 109.675235] niks3-server[1081]: 2026/09/20 08:07:29 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5842lb # [ 109.685098] niks3-server[1081]: 2026/09/20 08:07:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5843worker1 # [ 109.663835] nix-grpc-daemon[1544]: time=2026-09-20T08:07:29.821Z level=INFO msg="Uploading 1 narinfos"5844lb # [ 109.691189] niks3-server[1081]: 2026/09/20 08:07:29 INFO Signed narinfos id=36 count=15845lb # [ 109.698755] niks3-server[1081]: 2026/09/20 08:07:29 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5846lb # [ 109.704069] niks3-server[1081]: 2026/09/20 08:07:29 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5847lb # [ 109.709762] niks3-server[1081]: 2026/09/20 08:07:29 INFO Completed upload id=365848lb # [ 109.711414] niks3-server[1081]: 2026/09/20 08:07:29 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5849worker1 # [ 109.685117] nix-grpc-daemon[1544]: time=2026-09-20T08:07:29.842Z level=INFO msg="Upload complete. (387ms)"5850worker1 # [ 109.687964] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59878 duration_s=0 paths=1 nar_bytes_in=4165851worker1 # [ 109.694270] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:598785852worker1 # [ 109.701195] nix-daemon[841]: accepted connection from pid 1443, user nix-grpc-daemon (trusted)5853worker1 # [ 109.706422] nix-daemon[841]: reaped child process 1590, status = succeeded5854worker1 # [ 109.711412] nix-daemon[841]: accepted connection from pid 1443, user nix-grpc-daemon (trusted)5855client # [ 109.751523] nix[1239]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5856worker1: must succeed: systemctl reload nix-grpc-daemon.service5857worker1 # [ 111.444648] systemd[1]: Reloading Nix worker-protocol over gRPC...5858worker1 # [ 111.484887] systemd[1]: Reloaded Nix worker-protocol over gRPC.5859worker1: (finished: must succeed: systemctl reload nix-grpc-daemon.service, in 0.08 seconds)5860worker1: must succeed: pgrep -f 'read -t [9]0 x'5861worker1: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.04 seconds)5862client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&25863worker1 # [ 111.537784] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:31Z level=info event=draining5864client # don't know how to build these paths:5865worker2 # [ 111.798616] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:31Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:390645866client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5867worker2 # [ 111.806766] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:31Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05868worker2 # [ 111.808871] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:31Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.4:50051 clients=15869worker2 # [ 111.852290] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:390645870worker2 # [ 111.858645] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:390645871client # copying 1 paths to 'lb:50051'...5872worker2 # [ 111.864858] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:390645873client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5874worker2 # [ 111.883528] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5875worker2 # [ 112.062989] nix-daemon[909]: accepted connection from pid 1565, user nix-grpc-daemon (trusted)5876worker2 # [ 112.075978] nix-daemon[909]: reaped child process 1568, status = succeeded5877worker2 # [ 112.251236] nix-daemon[909]: accepted connection from pid 1570, user nix-grpc-daemon (trusted)5878worker2 # [ 112.264981] nix-daemon[909]: reaped child process 1573, status = succeeded5879lb # [ 112.268800] niks3-server[1081]: 2026/09/20 08:07:31 INFO Received uploads request method=POST path=/api/pending_closures5880worker2 # [ 112.292256] nix-grpc-daemon[1486]: time=2026-09-20T08:07:32.218Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5881worker2 # [ 112.293835] nix-grpc-daemon[1486]: time=2026-09-20T08:07:32.219Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5882lb # [ 112.300226] niks3-server[1081]: 2026/09/20 08:07:31 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5883lb # [ 112.309113] niks3-server[1081]: 2026/09/20 08:07:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5884worker2 # [ 112.329182] nix-grpc-daemon[1486]: time=2026-09-20T08:07:32.255Z level=INFO msg="Uploading 1 narinfos"5885lb # [ 112.316308] niks3-server[1081]: 2026/09/20 08:07:31 INFO Signed narinfos id=37 count=15886lb # [ 112.323310] niks3-server[1081]: 2026/09/20 08:07:31 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5887lb # [ 112.333191] niks3-server[1081]: 2026/09/20 08:07:31 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5888lb # [ 112.340612] niks3-server[1081]: 2026/09/20 08:07:31 INFO Completed upload id=375889worker2 # [ 112.354580] nix-grpc-daemon[1486]: time=2026-09-20T08:07:32.280Z level=INFO msg="Upload complete. (459ms)"5890lb # [ 112.343266] niks3-server[1081]: 2026/09/20 08:07:31 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5891worker2 # [ 112.358361] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39064 duration_s=0 paths=1 nar_bytes_in=5285892worker2 # [ 112.364320] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:390645893worker2 # [ 112.375081] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5894worker2 # [ 112.378697] nix-daemon[909]: reaped child process 1563, status = succeeded5895worker2 # [ 112.384361] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5896client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...5897client # farm-a> worker2: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5898worker2 # [ 113.197742] nix-daemon[909]: reaped child process 1577, status = succeeded5899client # farm-a> LOG-farm-a-during-drain5900worker2 # [ 113.349087] nix-daemon[909]: accepted connection from pid 1592, user nix-grpc-daemon (trusted)5901worker2 # [ 113.360585] nix-daemon[909]: reaped child process 1595, status = succeeded5902lb # [ 113.362995] niks3-server[1081]: 2026/09/20 08:07:33 INFO Received uploads request method=POST path=/api/pending_closures5903worker2 # [ 113.383047] nix-grpc-daemon[1486]: time=2026-09-20T08:07:33.308Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5904worker2 # [ 113.385051] nix-grpc-daemon[1486]: time=2026-09-20T08:07:33.310Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"5905lb # [ 113.401677] niks3-server[1081]: 2026/09/20 08:07:33 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5906lb # [ 113.410058] niks3-server[1081]: 2026/09/20 08:07:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5907worker2 # [ 113.428753] nix-grpc-daemon[1486]: time=2026-09-20T08:07:33.354Z level=INFO msg="Uploading 1 narinfos"5908lb # [ 113.414392] niks3-server[1081]: 2026/09/20 08:07:33 INFO Signed narinfos id=38 count=15909lb # [ 113.421225] niks3-server[1081]: 2026/09/20 08:07:33 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5910lb # [ 113.429674] niks3-server[1081]: 2026/09/20 08:07:33 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls5911lb # [ 113.434087] niks3-server[1081]: 2026/09/20 08:07:33 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5912lb # [ 113.437050] niks3-server[1081]: 2026/09/20 08:07:33 INFO Completed upload id=385913worker2 # [ 113.452494] nix-grpc-daemon[1486]: time=2026-09-20T08:07:33.378Z level=INFO msg="Upload complete. (261ms)"5914lb # [ 113.438878] niks3-server[1081]: 2026/09/20 08:07:33 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo5915worker2 # [ 113.457434] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39064 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=15916worker2 # [ 113.465923] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:33Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=05917worker2 # [ 113.467895] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:33Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.4:50051 clients=15918worker2 # [ 113.472493] nix-daemon[909]: reaped child process 1575, status = succeeded5919worker2 # [ 113.511650] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:390645920worker2 # [ 113.530868] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:390645921worker2 # [ 113.544233] nix-grpc-daemon[1486]: time=2026-09-20T08:07:33.470Z level=INFO msg="All 1 paths already cached"5922client # copying 1 paths to 'lb:50051'...5923worker2 # [ 113.552391] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:390645924client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...5925worker2 # [ 113.568585] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5926worker2 # [ 113.726179] nix-daemon[909]: accepted connection from pid 1601, user nix-grpc-daemon (trusted)5927worker2 # [ 113.738686] nix-daemon[909]: reaped child process 1604, status = succeeded5928worker2 # [ 113.900786] nix-daemon[909]: accepted connection from pid 1606, user nix-grpc-daemon (trusted)5929worker2 # [ 113.912913] nix-daemon[909]: reaped child process 1609, status = succeeded5930lb # [ 113.914423] niks3-server[1081]: 2026/09/20 08:07:33 INFO Received uploads request method=POST path=/api/pending_closures5931worker2 # [ 113.937037] nix-grpc-daemon[1486]: time=2026-09-20T08:07:33.863Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5932worker2 # [ 113.938610] nix-grpc-daemon[1486]: time=2026-09-20T08:07:33.864Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"5933lb # [ 113.943802] niks3-server[1081]: 2026/09/20 08:07:33 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst5934lb # [ 113.956995] niks3-server[1081]: 2026/09/20 08:07:33 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5935lb # [ 113.962350] niks3-server[1081]: 2026/09/20 08:07:33 INFO Signed narinfos id=39 count=15936worker2 # [ 113.979329] nix-grpc-daemon[1486]: time=2026-09-20T08:07:33.905Z level=INFO msg="Uploading 1 narinfos"5937lb # [ 113.968663] niks3-server[1081]: 2026/09/20 08:07:33 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls5938lb # [ 113.980332] niks3-server[1081]: 2026/09/20 08:07:33 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5939worker2 # [ 114.000550] nix-grpc-daemon[1486]: time=2026-09-20T08:07:33.926Z level=INFO msg="Upload complete. (424ms)"5940lb # [ 113.986926] niks3-server[1081]: 2026/09/20 08:07:33 INFO Completed upload id=395941lb # [ 113.990550] niks3-server[1081]: 2026/09/20 08:07:33 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo5942worker2 # [ 114.003781] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:33Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39064 duration_s=0 paths=1 nar_bytes_in=6405943worker2 # [ 114.009240] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:390645944worker2 # [ 114.017939] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5945worker2 # [ 114.026104] nix-daemon[909]: reaped child process 1599, status = succeeded5946worker2 # [ 114.031158] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5947client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...5948client # farm-b> worker2: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5949client # farm-b> LOG-farm-b-during-drain5950worker2 # [ 115.044824] nix-daemon[909]: reaped child process 1613, status = succeeded5951worker2 # [ 115.187787] nix-daemon[909]: accepted connection from pid 1628, user nix-grpc-daemon (trusted)5952worker2 # [ 115.199966] nix-daemon[909]: reaped child process 1631, status = succeeded5953lb # [ 115.199041] niks3-server[1081]: 2026/09/20 08:07:34 INFO Received uploads request method=POST path=/api/pending_closures5954worker2 # [ 115.218161] nix-grpc-daemon[1486]: time=2026-09-20T08:07:35.144Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5955worker2 # [ 115.219632] nix-grpc-daemon[1486]: time=2026-09-20T08:07:35.145Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"5956lb # [ 115.219894] niks3-server[1081]: 2026/09/20 08:07:34 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst5957lb # [ 115.223239] niks3-server[1081]: 2026/09/20 08:07:34 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5958lb # [ 115.226229] niks3-server[1081]: 2026/09/20 08:07:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5959lb # [ 115.228141] niks3-server[1081]: 2026/09/20 08:07:34 INFO Signed narinfos id=40 count=15960worker2 # [ 115.243527] nix-grpc-daemon[1486]: time=2026-09-20T08:07:35.169Z level=INFO msg="Uploading 1 narinfos"5961lb # [ 115.233357] niks3-server[1081]: 2026/09/20 08:07:34 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls5962lb # [ 115.236214] niks3-server[1081]: 2026/09/20 08:07:34 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5963lb # [ 115.242126] niks3-server[1081]: 2026/09/20 08:07:34 INFO Completed upload id=405964worker2 # [ 115.257364] nix-grpc-daemon[1486]: time=2026-09-20T08:07:35.183Z level=INFO msg="Upload complete. (219ms)"5965lb # [ 115.243674] niks3-server[1081]: 2026/09/20 08:07:34 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo5966worker2 # [ 115.260348] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:35Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39064 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=15967worker2 # [ 115.267459] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:35Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=05968worker2 # [ 115.269587] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:35Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.4:50051 clients=15969worker2 # [ 115.272648] nix-daemon[909]: reaped child process 1611, status = succeeded5970worker2 # [ 115.312101] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:390645971worker2 # [ 115.324543] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:390645972worker2 # [ 115.336717] nix-grpc-daemon[1486]: time=2026-09-20T08:07:35.262Z level=INFO msg="All 2 paths already cached"5973client # copying 1 paths to 'lb:50051'...5974worker2 # [ 115.344256] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:390645975client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...5976worker2 # [ 115.364322] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5977worker2 # [ 115.526409] nix-daemon[909]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)5978worker2 # [ 115.538915] nix-daemon[909]: reaped child process 1640, status = succeeded5979worker2 # [ 115.694540] nix-daemon[909]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)5980worker2 # [ 115.706697] nix-daemon[909]: reaped child process 1645, status = succeeded5981lb # [ 115.705519] niks3-server[1081]: 2026/09/20 08:07:35 INFO Received uploads request method=POST path=/api/pending_closures5982worker2 # [ 115.723748] nix-grpc-daemon[1486]: time=2026-09-20T08:07:35.649Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5983worker2 # [ 115.725222] nix-grpc-daemon[1486]: time=2026-09-20T08:07:35.651Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"5984lb # [ 115.721313] niks3-server[1081]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst5985lb # [ 115.725555] niks3-server[1081]: 2026/09/20 08:07:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5986lb # [ 115.727189] niks3-server[1081]: 2026/09/20 08:07:35 INFO Signed narinfos id=41 count=15987worker2 # [ 115.742467] nix-grpc-daemon[1486]: time=2026-09-20T08:07:35.668Z level=INFO msg="Uploading 1 narinfos"5988lb # [ 115.730629] niks3-server[1081]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls5989lb # [ 115.736651] niks3-server[1081]: 2026/09/20 08:07:35 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5990worker2 # [ 115.754049] nix-grpc-daemon[1486]: time=2026-09-20T08:07:35.680Z level=INFO msg="Upload complete. (378ms)"5991lb # [ 115.741652] niks3-server[1081]: 2026/09/20 08:07:35 INFO Completed upload id=415992worker2 # [ 115.756437] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39064 duration_s=0 paths=1 nar_bytes_in=7685993lb # [ 115.745060] niks3-server[1081]: 2026/09/20 08:07:35 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo5994worker2 # [ 115.761619] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:390645995worker2 # [ 115.768310] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5996worker2 # [ 115.770867] nix-daemon[909]: reaped child process 1635, status = succeeded5997client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...5998worker2 # [ 115.777793] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5999client # farm-top> worker2: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6000client # farm-top> LOG-farm-top-during-drain6001worker2 # [ 116.806491] nix-daemon[909]: reaped child process 1649, status = succeeded6002worker2 # [ 116.953451] nix-daemon[909]: accepted connection from pid 1664, user nix-grpc-daemon (trusted)6003worker2 # [ 116.967992] nix-daemon[909]: reaped child process 1667, status = succeeded6004lb # [ 116.964347] niks3-server[1081]: 2026/09/20 08:07:36 INFO Received uploads request method=POST path=/api/pending_closures6005worker2 # [ 116.987286] nix-grpc-daemon[1486]: time=2026-09-20T08:07:36.912Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6006worker2 # [ 116.988612] nix-grpc-daemon[1486]: time=2026-09-20T08:07:36.912Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6007lb # [ 116.995070] niks3-server[1081]: 2026/09/20 08:07:36 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6008lb # [ 117.010339] niks3-server[1081]: 2026/09/20 08:07:36 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6009lb # [ 117.016901] niks3-server[1081]: 2026/09/20 08:07:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6010lb # [ 117.021068] niks3-server[1081]: 2026/09/20 08:07:36 INFO Signed narinfos id=42 count=16011worker2 # [ 117.038237] nix-grpc-daemon[1486]: time=2026-09-20T08:07:36.964Z level=INFO msg="Uploading 1 narinfos"6012lb # [ 117.032886] niks3-server[1081]: 2026/09/20 08:07:36 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6013lb # [ 117.039132] niks3-server[1081]: 2026/09/20 08:07:36 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6014lb # [ 117.044516] niks3-server[1081]: 2026/09/20 08:07:36 INFO Completed upload id=426015worker2 # [ 117.060657] nix-grpc-daemon[1486]: time=2026-09-20T08:07:36.986Z level=INFO msg="Upload complete. (272ms)"6016lb # [ 117.048212] niks3-server[1081]: 2026/09/20 08:07:36 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6017worker2 # [ 117.066794] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39064 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16018worker2 # [ 117.081068] nix-daemon[909]: reaped child process 1647, status = succeeded6019client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&2, in 5.53 seconds)6020client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath6021client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath, in 0.21 seconds)6022worker1: must succeed: pkill -f 'read -t [9]0 x'6023worker1: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)6024client: waiting for success: ! systemctl is-active sw6025worker1 # [ 117.544715] nix-daemon[841]: reaped child process 1604, status = succeeded6026worker1 # [ 117.681505] nix-daemon[841]: accepted connection from pid 1644, user nix-grpc-daemon (trusted)6027worker1 # [ 117.693471] nix-daemon[841]: reaped child process 1647, status = succeeded6028lb # [ 117.732314] niks3-server[1081]: 2026/09/20 08:07:37 INFO Received uploads request method=POST path=/api/pending_closures6029worker1 # [ 117.713227] nix-grpc-daemon[1544]: time=2026-09-20T08:07:37.871Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6030worker1 # [ 117.714791] nix-grpc-daemon[1544]: time=2026-09-20T08:07:37.872Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6031lb # [ 117.769350] niks3-server[1081]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6032lb # [ 117.781429] niks3-server[1081]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6033lb # [ 117.788582] niks3-server[1081]: 2026/09/20 08:07:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6034lb # [ 117.794065] niks3-server[1081]: 2026/09/20 08:07:37 INFO Signed narinfos id=43 count=16035worker1 # [ 117.767116] nix-grpc-daemon[1544]: time=2026-09-20T08:07:37.924Z level=INFO msg="Uploading 1 narinfos"6036lb # [ 117.797985] niks3-server[1081]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6037lb # [ 117.808129] niks3-server[1081]: 2026/09/20 08:07:37 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6038lb # [ 117.814308] niks3-server[1081]: 2026/09/20 08:07:37 INFO Completed upload id=436039worker1 # [ 117.786790] nix-grpc-daemon[1544]: time=2026-09-20T08:07:37.945Z level=INFO msg="Upload complete. (259ms)"6040lb # [ 117.816591] niks3-server[1081]: 2026/09/20 08:07:37 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6041worker1 # [ 117.794190] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59878 duration_s=8 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16042worker1 # [ 117.805632] nix-daemon[841]: reaped child process 1602, status = succeeded6043client # [ 117.874204] systemd[1]: sw.service: Deactivated successfully.6044client # [ 117.878258] systemd[1]: sw.service: Consumed 126ms CPU time over 8.862s wall clock time, 37.1M memory peak, 8.5K incoming IP traffic, 9K outgoing IP traffic.6045lb # [ 118.332262] envoy[979]: conn peer=[2001:db8:1::1]:54500 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9429 tx=3774 ms=52956046lb # [ 118.334030] envoy[979]: conn peer=[2001:db8:1::1]:54492 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2936 tx=1349 ms=86226047client: (finished: waiting for success: ! systemctl is-active sw, in 1.10 seconds)6048client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6049client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)6050worker1: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6051worker1: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.05 seconds)6052lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6053lb: must succeed: curl -sf localhost:9901/clusters6054worker1 # [ 118.540128] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:38Z level=info event=signal_exit6055lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6056lb: must succeed: curl -sf localhost:9901/clusters6057lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6058worker1 # [ 119.763641] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:39Z level=info event=scheduler_restarting6059worker2 # [ 119.811566] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:528646060worker2 # [ 119.815254] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:39Z level=info event=worker_gone addr=192.168.1.3:500516061worker1 # [ 119.777754] nix-grpc-daemon[1443]: ts=2026-09-20T08:07:39Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6062worker1 # [ 119.794990] nix-daemon[841]: reaped child process 1512, status = succeeded6063worker1 # [ 120.426319] nix-grpc-daemon[1443]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6064worker1 # [ 120.430210] nix-grpc-daemon[1443]: E0000 00:00:1789891660.584350 1486 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 15, started true, shutdown true6065worker1 # [ 120.435083] nix-grpc-daemon[1443]: E0000 00:00:1789891660.584827 1486 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6066lb: must succeed: curl -sf localhost:9901/clusters6067lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6068worker1 # [ 121.564787] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6069worker1 # [ 121.566462] systemd[1]: nix-grpc-daemon.service: Consumed 594ms CPU time over 28.178s wall clock time, 30.1M memory peak, 21K incoming IP traffic, 27.5K outgoing IP traffic.6070lb: must succeed: curl -sf localhost:9901/clusters6071lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6072worker1 # [ 122.564193] systemd[1]: Starting Nix worker-protocol over gRPC...6073lb: must succeed: curl -sf localhost:9901/clusters6074worker1 # [ 122.738126] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:42Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6075worker1 # [ 122.741275] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:42Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=16076worker1 # [ 122.747057] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:42Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6077worker1 # [ 122.748874] systemd[1]: Started Nix worker-protocol over gRPC.6078worker1 # [ 122.772797] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:42Z level=info event=scheduler_connected addr=lb:500516079worker2 # [ 122.818973] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:42Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06080lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6081lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 4.31 seconds)6082lb: must succeed: curl -sf localhost:9901/clusters6083lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6084worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6085worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.08 seconds)6086(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 14.01 seconds)6087subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6088client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16089worker1 # [ 123.156553] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:431486090worker1 # [ 123.167696] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6091worker2 # [ 123.227646] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:43Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06092worker2 # [ 123.230174] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:43Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16093worker2 # [ 123.232365] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:43Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06094worker2 # [ 123.234258] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:43Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06095worker1 # [ 123.230524] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486096worker1 # [ 123.241750] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 1/5)6097worker1 # [ 123.322817] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 192 ms (attempt 2/5)6098worker1 # [ 123.515353] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 47 ms (attempt 3/5)6099worker1 # [ 123.568244] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 772 ms (attempt 4/5)6100worker1 # [ 124.346593] nix-grpc-daemon[1659]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6101worker1 # [ 124.360764] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:431486102worker1 # [ 124.373184] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:431486103worker1 # [ 124.378547] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6104worker1 # [ 124.387868] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:44Z level=info event=niks3_push_started pid=17156105worker1 # [ 124.656524] nix-daemon[841]: accepted connection from pid 1728, user nix-grpc-daemon (trusted)6106worker1 # [ 124.669247] nix-daemon[841]: reaped child process 1731, status = succeeded6107worker1 # [ 124.800129] nix-daemon[841]: accepted connection from pid 1733, user nix-grpc-daemon (trusted)6108worker1 # [ 124.812254] nix-daemon[841]: reaped child process 1736, status = succeeded6109lb # [ 124.850613] niks3-server[1081]: 2026/09/20 08:07:44 INFO Received uploads request method=POST path=/api/pending_closures6110worker1 # [ 124.831857] nix-grpc-daemon[1715]: time=2026-09-20T08:07:44.989Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6111worker1 # [ 124.833386] nix-grpc-daemon[1715]: time=2026-09-20T08:07:44.991Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6112lb # [ 124.883179] niks3-server[1081]: 2026/09/20 08:07:44 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6113lb # [ 124.902535] niks3-server[1081]: 2026/09/20 08:07:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6114worker1 # [ 124.879487] nix-grpc-daemon[1715]: time=2026-09-20T08:07:45.037Z level=INFO msg="Uploading 1 narinfos"6115lb # [ 124.906926] niks3-server[1081]: 2026/09/20 08:07:44 INFO Signed narinfos id=44 count=16116lb # [ 124.919591] niks3-server[1081]: 2026/09/20 08:07:44 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6117lb # [ 124.923469] niks3-server[1081]: 2026/09/20 08:07:44 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6118lb # [ 124.927183] niks3-server[1081]: 2026/09/20 08:07:44 INFO Completed upload id=446119worker1 # [ 124.901097] nix-grpc-daemon[1715]: time=2026-09-20T08:07:45.059Z level=INFO msg="Upload complete. (372ms)"6120lb # [ 124.928683] niks3-server[1081]: 2026/09/20 08:07:44 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6121worker1 # [ 124.903765] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=0 paths=1 nar_bytes_in=5046122worker1 # [ 124.909479] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486123worker1 # [ 124.913612] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6124worker1 # [ 124.918576] nix-daemon[841]: reaped child process 1713, status = succeeded6125worker1 # [ 124.923303] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6126worker1 # [ 125.735484] nix-daemon[841]: reaped child process 1740, status = succeeded6127worker1 # [ 125.892293] nix-daemon[841]: accepted connection from pid 1755, user nix-grpc-daemon (trusted)6128worker1 # [ 125.903732] nix-daemon[841]: reaped child process 1758, status = succeeded6129lb # [ 125.947933] niks3-server[1081]: 2026/09/20 08:07:45 INFO Received uploads request method=POST path=/api/pending_closures6130worker1 # [ 125.928594] nix-grpc-daemon[1715]: time=2026-09-20T08:07:46.086Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6131worker1 # [ 125.930709] nix-grpc-daemon[1715]: time=2026-09-20T08:07:46.088Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6132lb # [ 125.979117] niks3-server[1081]: 2026/09/20 08:07:45 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6133lb # [ 125.988805] niks3-server[1081]: 2026/09/20 08:07:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6134lb # [ 125.991474] niks3-server[1081]: 2026/09/20 08:07:45 INFO Signed narinfos id=45 count=16135worker1 # [ 125.964235] nix-grpc-daemon[1715]: time=2026-09-20T08:07:46.122Z level=INFO msg="Uploading 1 narinfos"6136lb # [ 125.994852] niks3-server[1081]: 2026/09/20 08:07:45 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6137lb # [ 125.997678] niks3-server[1081]: 2026/09/20 08:07:45 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6138lb # [ 126.001748] niks3-server[1081]: 2026/09/20 08:07:45 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6139lb # [ 126.004964] niks3-server[1081]: 2026/09/20 08:07:45 INFO Completed upload id=456140worker1 # [ 125.977676] nix-grpc-daemon[1715]: time=2026-09-20T08:07:46.136Z level=INFO msg="Upload complete. (248ms)"6141worker1 # [ 125.980347] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=7 outputs=16142worker1 # [ 125.984681] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486143worker2 # [ 126.023872] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:45Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16144worker1 # [ 125.991365] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:431486145worker1 # [ 125.994427] nix-daemon[841]: reaped child process 1738, status = succeeded6146worker2 # [ 126.033571] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:45Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06147worker1 # [ 125.998177] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:431486148worker1 # [ 126.003177] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6149lb # [ 126.056943] niks3-server[1081]: 2026/09/20 08:07:45 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6150worker1 # [ 126.159465] nix-daemon[841]: accepted connection from pid 1762, user nix-grpc-daemon (trusted)6151worker1 # [ 126.171716] nix-daemon[841]: reaped child process 1765, status = succeeded6152worker1 # [ 126.337350] nix-daemon[841]: accepted connection from pid 1767, user nix-grpc-daemon (trusted)6153worker1 # [ 126.349317] nix-daemon[841]: reaped child process 1770, status = succeeded6154lb # [ 126.393135] niks3-server[1081]: 2026/09/20 08:07:46 INFO Received uploads request method=POST path=/api/pending_closures6155worker1 # [ 126.373696] nix-grpc-daemon[1715]: time=2026-09-20T08:07:46.531Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6156worker1 # [ 126.375264] nix-grpc-daemon[1715]: time=2026-09-20T08:07:46.531Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6157lb # [ 126.417133] niks3-server[1081]: 2026/09/20 08:07:46 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6158lb # [ 126.428095] niks3-server[1081]: 2026/09/20 08:07:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6159worker1 # [ 126.407984] nix-grpc-daemon[1715]: time=2026-09-20T08:07:46.566Z level=INFO msg="Uploading 1 narinfos"6160lb # [ 126.435126] niks3-server[1081]: 2026/09/20 08:07:46 INFO Signed narinfos id=46 count=16161lb # [ 126.439715] niks3-server[1081]: 2026/09/20 08:07:46 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6162lb # [ 126.451616] niks3-server[1081]: 2026/09/20 08:07:46 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6163lb # [ 126.456378] niks3-server[1081]: 2026/09/20 08:07:46 INFO Completed upload id=466164worker1 # [ 126.431181] nix-grpc-daemon[1715]: time=2026-09-20T08:07:46.589Z level=INFO msg="Upload complete. (423ms)"6165lb # [ 126.460563] niks3-server[1081]: 2026/09/20 08:07:46 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6166worker1 # [ 126.435125] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=0 paths=1 nar_bytes_in=5046167worker1 # [ 126.440597] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486168worker1 # [ 126.450501] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6169worker1 # [ 126.454173] nix-daemon[841]: reaped child process 1760, status = succeeded6170worker1 # [ 126.459137] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6171worker1 # [ 127.673207] nix-daemon[841]: reaped child process 1774, status = succeeded6172worker1 # [ 127.813367] nix-daemon[841]: accepted connection from pid 1789, user nix-grpc-daemon (trusted)6173worker1 # [ 127.824203] nix-daemon[841]: reaped child process 1792, status = succeeded6174lb # [ 127.866686] niks3-server[1081]: 2026/09/20 08:07:47 INFO Received uploads request method=POST path=/api/pending_closures6175worker1 # [ 127.847658] nix-grpc-daemon[1715]: time=2026-09-20T08:07:48.005Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6176worker1 # [ 127.849193] nix-grpc-daemon[1715]: time=2026-09-20T08:07:48.007Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6177lb # [ 127.904348] niks3-server[1081]: 2026/09/20 08:07:47 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6178lb # [ 127.911634] niks3-server[1081]: 2026/09/20 08:07:47 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6179lb # [ 127.919311] niks3-server[1081]: 2026/09/20 08:07:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6180lb # [ 127.924233] niks3-server[1081]: 2026/09/20 08:07:47 INFO Signed narinfos id=47 count=16181worker1 # [ 127.899913] nix-grpc-daemon[1715]: time=2026-09-20T08:07:48.058Z level=INFO msg="Uploading 1 narinfos"6182lb # [ 127.933534] niks3-server[1081]: 2026/09/20 08:07:47 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6183lb # [ 127.942282] niks3-server[1081]: 2026/09/20 08:07:47 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6184lb # [ 127.947881] niks3-server[1081]: 2026/09/20 08:07:47 INFO Completed upload id=476185worker1 # [ 127.920416] nix-grpc-daemon[1715]: time=2026-09-20T08:07:48.078Z level=INFO msg="Upload complete. (254ms)"6186lb # [ 127.949529] niks3-server[1081]: 2026/09/20 08:07:47 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6187worker1 # [ 127.925694] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=8 outputs=16188worker2 # [ 127.967867] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:47Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16189worker1 # [ 127.935146] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486190worker2 # [ 127.977340] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:47Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06191worker1 # [ 127.946733] nix-daemon[841]: reaped child process 1772, status = succeeded6192worker1 # [ 127.949192] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:431486193worker1 # [ 127.958339] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:431486194worker1 # [ 127.965135] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6195worker1 # [ 128.120433] nix-daemon[841]: accepted connection from pid 1796, user nix-grpc-daemon (trusted)6196worker1 # [ 128.132103] nix-daemon[841]: reaped child process 1799, status = succeeded6197worker1 # [ 128.296295] nix-daemon[841]: accepted connection from pid 1801, user nix-grpc-daemon (trusted)6198worker1 # [ 128.306553] nix-daemon[841]: reaped child process 1804, status = succeeded6199lb # [ 128.333166] envoy[979]: conn peer=[2001:db8:1::3]:58204 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1114 tx=425 ms=262276200lb # [ 128.349241] niks3-server[1081]: 2026/09/20 08:07:48 INFO Received uploads request method=POST path=/api/pending_closures6201worker1 # [ 128.330541] nix-grpc-daemon[1715]: time=2026-09-20T08:07:48.488Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6202worker1 # [ 128.332071] nix-grpc-daemon[1715]: time=2026-09-20T08:07:48.490Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6203lb # [ 128.378381] niks3-server[1081]: 2026/09/20 08:07:48 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6204lb # [ 128.390096] niks3-server[1081]: 2026/09/20 08:07:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6205lb # [ 128.394492] niks3-server[1081]: 2026/09/20 08:07:48 INFO Signed narinfos id=48 count=16206worker1 # [ 128.370084] nix-grpc-daemon[1715]: time=2026-09-20T08:07:48.528Z level=INFO msg="Uploading 1 narinfos"6207lb # [ 128.404676] niks3-server[1081]: 2026/09/20 08:07:48 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6208lb # [ 128.412509] niks3-server[1081]: 2026/09/20 08:07:48 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6209lb # [ 128.417273] niks3-server[1081]: 2026/09/20 08:07:48 INFO Completed upload id=486210worker1 # [ 128.389704] nix-grpc-daemon[1715]: time=2026-09-20T08:07:48.548Z level=INFO msg="Upload complete. (418ms)"6211worker1 # [ 128.393248] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=0 paths=1 nar_bytes_in=5046212lb # [ 128.423719] niks3-server[1081]: 2026/09/20 08:07:48 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6213worker1 # [ 128.398271] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486214worker1 # [ 128.406481] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6215worker1 # [ 128.413812] nix-daemon[841]: reaped child process 1794, status = succeeded6216worker1 # [ 128.417733] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6217worker1 # [ 129.243472] nix-daemon[841]: reaped child process 1808, status = succeeded6218worker1 # [ 129.397338] nix-daemon[841]: accepted connection from pid 1823, user nix-grpc-daemon (trusted)6219worker1 # [ 129.408797] nix-daemon[841]: reaped child process 1826, status = succeeded6220lb # [ 129.451045] niks3-server[1081]: 2026/09/20 08:07:49 INFO Received uploads request method=POST path=/api/pending_closures6221worker1 # [ 129.427945] nix-grpc-daemon[1715]: time=2026-09-20T08:07:49.586Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6222worker1 # [ 129.429490] nix-grpc-daemon[1715]: time=2026-09-20T08:07:49.587Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6223lb # [ 129.467469] niks3-server[1081]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6224lb # [ 129.473599] niks3-server[1081]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6225lb # [ 129.476874] niks3-server[1081]: 2026/09/20 08:07:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6226lb # [ 129.478646] niks3-server[1081]: 2026/09/20 08:07:49 INFO Signed narinfos id=49 count=16227worker1 # [ 129.452862] nix-grpc-daemon[1715]: time=2026-09-20T08:07:49.611Z level=INFO msg="Uploading 1 narinfos"6228lb # [ 129.482755] niks3-server[1081]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6229lb # [ 129.487048] niks3-server[1081]: 2026/09/20 08:07:49 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6230lb # [ 129.490050] niks3-server[1081]: 2026/09/20 08:07:49 INFO Completed upload id=496231worker1 # [ 129.462622] nix-grpc-daemon[1715]: time=2026-09-20T08:07:49.620Z level=INFO msg="Upload complete. (238ms)"6232lb # [ 129.492695] niks3-server[1081]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6233worker1 # [ 129.464978] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=9 outputs=16234worker2 # [ 129.507951] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:49Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16235worker1 # [ 129.471705] nix-daemon[841]: reaped child process 1806, status = succeeded6236worker1 # [ 129.473313] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486237worker2 # [ 129.517498] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:49Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06238worker1 # [ 129.479589] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:431486239worker1 # [ 129.484806] nix-grpc-daemon[1715]: time=2026-09-20T08:07:49.643Z level=INFO msg="All 1 paths already cached"6240worker1 # [ 129.488555] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:431486241worker1 # [ 129.492383] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6242worker1 # [ 129.652103] nix-daemon[841]: accepted connection from pid 1830, user nix-grpc-daemon (trusted)6243worker1 # [ 129.665189] nix-daemon[841]: reaped child process 1833, status = succeeded6244worker1 # [ 129.837376] nix-daemon[841]: accepted connection from pid 1835, user nix-grpc-daemon (trusted)6245worker1 # [ 129.848920] nix-daemon[841]: reaped child process 1838, status = succeeded6246lb # [ 129.893157] niks3-server[1081]: 2026/09/20 08:07:49 INFO Received uploads request method=POST path=/api/pending_closures6247worker1 # [ 129.873676] nix-grpc-daemon[1715]: time=2026-09-20T08:07:50.031Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6248worker1 # [ 129.875121] nix-grpc-daemon[1715]: time=2026-09-20T08:07:50.031Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6249lb # [ 129.919796] niks3-server[1081]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6250lb # [ 129.927223] niks3-server[1081]: 2026/09/20 08:07:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6251lb # [ 129.931496] niks3-server[1081]: 2026/09/20 08:07:49 INFO Signed narinfos id=50 count=16252worker1 # [ 129.907059] nix-grpc-daemon[1715]: time=2026-09-20T08:07:50.065Z level=INFO msg="Uploading 1 narinfos"6253lb # [ 129.943192] niks3-server[1081]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6254lb # [ 129.949346] niks3-server[1081]: 2026/09/20 08:07:49 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6255worker1 # [ 129.927601] nix-grpc-daemon[1715]: time=2026-09-20T08:07:50.085Z level=INFO msg="Upload complete. (429ms)"6256lb # [ 129.955057] niks3-server[1081]: 2026/09/20 08:07:49 INFO Completed upload id=506257worker1 # [ 129.929766] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=0 paths=1 nar_bytes_in=6246258lb # [ 129.960641] niks3-server[1081]: 2026/09/20 08:07:49 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6259worker1 # [ 129.935259] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486260worker1 # [ 129.942250] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6261worker1 # [ 129.947351] nix-daemon[841]: reaped child process 1828, status = succeeded6262worker1 # [ 129.952337] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6263worker1 # [ 131.577442] nix-daemon[841]: reaped child process 1842, status = succeeded6264worker1 # [ 131.736806] nix-daemon[841]: accepted connection from pid 1857, user nix-grpc-daemon (trusted)6265worker1 # [ 131.748656] nix-daemon[841]: reaped child process 1860, status = succeeded6266lb # [ 131.791426] niks3-server[1081]: 2026/09/20 08:07:51 INFO Received uploads request method=POST path=/api/pending_closures6267worker1 # [ 131.773504] nix-grpc-daemon[1715]: time=2026-09-20T08:07:51.931Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6268worker1 # [ 131.777883] nix-grpc-daemon[1715]: time=2026-09-20T08:07:51.933Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6269lb # [ 131.829142] niks3-server[1081]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6270lb # [ 131.842211] niks3-server[1081]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6271lb # [ 131.849619] niks3-server[1081]: 2026/09/20 08:07:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6272lb # [ 131.851723] niks3-server[1081]: 2026/09/20 08:07:51 INFO Signed narinfos id=51 count=16273worker1 # [ 131.824580] nix-grpc-daemon[1715]: time=2026-09-20T08:07:51.982Z level=INFO msg="Uploading 1 narinfos"6274lb # [ 131.855602] niks3-server[1081]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6275lb # [ 131.860099] niks3-server[1081]: 2026/09/20 08:07:51 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6276lb # [ 131.863198] niks3-server[1081]: 2026/09/20 08:07:51 INFO Completed upload id=516277worker1 # [ 131.837239] nix-grpc-daemon[1715]: time=2026-09-20T08:07:51.995Z level=INFO msg="Upload complete. (276ms)"6278lb # [ 131.866595] niks3-server[1081]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6279worker2 # [ 131.884192] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:51Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16280worker1 # [ 131.843425] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=10 outputs=16281worker2 # [ 131.889992] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:51Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06282worker1 # [ 131.851241] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486283worker1 # [ 131.860290] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:431486284worker1 # [ 131.862738] nix-daemon[841]: reaped child process 1840, status = succeeded6285worker1 # [ 131.866728] nix-grpc-daemon[1715]: time=2026-09-20T08:07:52.025Z level=INFO msg="All 1 paths already cached"6286worker1 # [ 131.870716] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:431486287worker1 # [ 131.879106] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6288worker1 # [ 132.026953] nix-daemon[841]: accepted connection from pid 1864, user nix-grpc-daemon (trusted)6289worker1 # [ 132.039507] nix-daemon[841]: reaped child process 1867, status = succeeded6290worker1 # [ 132.204145] nix-daemon[841]: accepted connection from pid 1869, user nix-grpc-daemon (trusted)6291worker1 # [ 132.216266] nix-daemon[841]: reaped child process 1872, status = succeeded6292lb # [ 132.259910] niks3-server[1081]: 2026/09/20 08:07:51 INFO Received uploads request method=POST path=/api/pending_closures6293worker1 # [ 132.241465] nix-grpc-daemon[1715]: time=2026-09-20T08:07:52.399Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6294worker1 # [ 132.243069] nix-grpc-daemon[1715]: time=2026-09-20T08:07:52.399Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6295lb # [ 132.292166] niks3-server[1081]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6296lb # [ 132.301334] niks3-server[1081]: 2026/09/20 08:07:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6297worker1 # [ 132.279765] nix-grpc-daemon[1715]: time=2026-09-20T08:07:52.437Z level=INFO msg="Uploading 1 narinfos"6298lb # [ 132.307144] niks3-server[1081]: 2026/09/20 08:07:51 INFO Signed narinfos id=52 count=16299lb # [ 132.313498] niks3-server[1081]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6300lb # [ 132.323978] niks3-server[1081]: 2026/09/20 08:07:51 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6301worker1 # [ 132.303404] nix-grpc-daemon[1715]: time=2026-09-20T08:07:52.461Z level=INFO msg="Upload complete. (418ms)"6302lb # [ 132.331058] niks3-server[1081]: 2026/09/20 08:07:51 INFO Completed upload id=526303lb # [ 132.333663] niks3-server[1081]: 2026/09/20 08:07:51 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6304worker1 # [ 132.307123] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=0 paths=1 nar_bytes_in=6246305worker1 # [ 132.311679] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486306worker1 # [ 132.321239] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6307worker1 # [ 132.325062] nix-daemon[841]: reaped child process 1862, status = succeeded6308worker1 # [ 132.330408] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6309worker1 # [ 133.759610] nix-daemon[841]: reaped child process 1876, status = succeeded6310worker1 # [ 133.921946] nix-daemon[841]: accepted connection from pid 1891, user nix-grpc-daemon (trusted)6311worker1 # [ 133.934138] nix-daemon[841]: reaped child process 1894, status = succeeded6312lb # [ 133.977798] niks3-server[1081]: 2026/09/20 08:07:53 INFO Received uploads request method=POST path=/api/pending_closures6313worker1 # [ 133.959834] nix-grpc-daemon[1715]: time=2026-09-20T08:07:54.117Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6314worker1 # [ 133.961396] nix-grpc-daemon[1715]: time=2026-09-20T08:07:54.119Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6315lb # [ 134.014647] niks3-server[1081]: 2026/09/20 08:07:53 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6316lb # [ 134.030421] niks3-server[1081]: 2026/09/20 08:07:53 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6317lb # [ 134.037289] niks3-server[1081]: 2026/09/20 08:07:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6318worker1 # [ 134.016206] nix-grpc-daemon[1715]: time=2026-09-20T08:07:54.174Z level=INFO msg="Uploading 1 narinfos"6319lb # [ 134.043943] niks3-server[1081]: 2026/09/20 08:07:53 INFO Signed narinfos id=53 count=16320lb # [ 134.049701] niks3-server[1081]: 2026/09/20 08:07:53 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6321lb # [ 134.058794] niks3-server[1081]: 2026/09/20 08:07:53 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6322lb # [ 134.064319] niks3-server[1081]: 2026/09/20 08:07:53 INFO Completed upload id=536323worker1 # [ 134.036587] nix-grpc-daemon[1715]: time=2026-09-20T08:07:54.194Z level=INFO msg="Upload complete. (298ms)"6324lb # [ 134.067367] niks3-server[1081]: 2026/09/20 08:07:53 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6325worker2 # [ 134.085196] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:54Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16326worker1 # [ 134.041945] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=11 outputs=16327worker1 # [ 134.051770] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486328worker2 # [ 134.096237] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:54Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06329worker1 # [ 134.064977] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:54Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:431486330worker1 # [ 134.069277] nix-daemon[841]: reaped child process 1874, status = succeeded6331worker1 # [ 134.075732] nix-grpc-daemon[1715]: time=2026-09-20T08:07:54.234Z level=INFO msg="All 1 paths already cached"6332worker1 # [ 134.081857] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:54Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:431486333worker1 # [ 134.086760] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6334worker1 # [ 134.235819] nix-daemon[841]: accepted connection from pid 1898, user nix-grpc-daemon (trusted)6335worker1 # [ 134.248134] nix-daemon[841]: reaped child process 1901, status = succeeded6336worker1 # [ 134.419109] nix-daemon[841]: accepted connection from pid 1903, user nix-grpc-daemon (trusted)6337worker1 # [ 134.430352] nix-daemon[841]: reaped child process 1906, status = succeeded6338lb # [ 134.472615] niks3-server[1081]: 2026/09/20 08:07:54 INFO Received uploads request method=POST path=/api/pending_closures6339worker1 # [ 134.450478] nix-grpc-daemon[1715]: time=2026-09-20T08:07:54.608Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6340worker1 # [ 134.451989] nix-grpc-daemon[1715]: time=2026-09-20T08:07:54.610Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6341lb # [ 134.496827] niks3-server[1081]: 2026/09/20 08:07:54 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6342lb # [ 134.505555] niks3-server[1081]: 2026/09/20 08:07:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6343lb # [ 134.511106] niks3-server[1081]: 2026/09/20 08:07:54 INFO Signed narinfos id=54 count=16344worker1 # [ 134.486806] nix-grpc-daemon[1715]: time=2026-09-20T08:07:54.645Z level=INFO msg="Uploading 1 narinfos"6345lb # [ 134.518154] niks3-server[1081]: 2026/09/20 08:07:54 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6346lb # [ 134.528780] niks3-server[1081]: 2026/09/20 08:07:54 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6347worker1 # [ 134.507117] nix-grpc-daemon[1715]: time=2026-09-20T08:07:54.665Z level=INFO msg="Upload complete. (415ms)"6348lb # [ 134.534541] niks3-server[1081]: 2026/09/20 08:07:54 INFO Completed upload id=546349worker1 # [ 134.509347] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=0 paths=1 nar_bytes_in=6246350lb # [ 134.537756] niks3-server[1081]: 2026/09/20 08:07:54 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6351worker1 # [ 134.513932] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486352worker1 # [ 134.521052] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6353worker1 # [ 134.523294] nix-daemon[841]: reaped child process 1896, status = succeeded6354worker1 # [ 134.528585] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6355worker1 # [ 135.542948] nix-daemon[841]: reaped child process 1910, status = succeeded6356worker1 # [ 135.687344] nix-daemon[841]: accepted connection from pid 1925, user nix-grpc-daemon (trusted)6357worker1 # [ 135.699221] nix-daemon[841]: reaped child process 1928, status = succeeded6358lb # [ 135.743085] niks3-server[1081]: 2026/09/20 08:07:55 INFO Received uploads request method=POST path=/api/pending_closures6359worker1 # [ 135.770717] nix-grpc-daemon[1715]: time=2026-09-20T08:07:55.928Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6360worker1 # [ 135.774698] nix-grpc-daemon[1715]: time=2026-09-20T08:07:55.931Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6361lb # [ 135.823412] niks3-server[1081]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6362lb # [ 135.825980] niks3-server[1081]: 2026/09/20 08:07:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6363lb # [ 135.829166] niks3-server[1081]: 2026/09/20 08:07:55 INFO Signed narinfos id=55 count=16364worker1 # [ 135.802164] nix-grpc-daemon[1715]: time=2026-09-20T08:07:55.960Z level=INFO msg="Uploading 1 narinfos"6365lb # [ 135.831702] niks3-server[1081]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6366lb # [ 135.839242] niks3-server[1081]: 2026/09/20 08:07:55 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6367lb # [ 135.842716] niks3-server[1081]: 2026/09/20 08:07:55 INFO Completed upload id=556368worker1 # [ 135.815813] nix-grpc-daemon[1715]: time=2026-09-20T08:07:55.974Z level=INFO msg="Upload complete. (280ms)"6369lb # [ 135.844920] niks3-server[1081]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6370lb # [ 135.848652] niks3-server[1081]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6371worker2 # [ 135.863531] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:55Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16372worker2 # [ 135.868819] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:55Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06373worker1 # [ 135.823358] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=12 outputs=16374worker1 # [ 135.830949] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486375worker1 # [ 135.841550] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:431486376worker1 # [ 135.847455] nix-daemon[841]: reaped child process 1908, status = succeeded6377worker1 # [ 135.851484] nix-grpc-daemon[1715]: time=2026-09-20T08:07:56.009Z level=INFO msg="All 2 paths already cached"6378worker1 # [ 135.855474] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:431486379worker1 # [ 135.859277] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6380worker1 # [ 136.015522] nix-daemon[841]: accepted connection from pid 1932, user nix-grpc-daemon (trusted)6381worker1 # [ 136.027660] nix-daemon[841]: reaped child process 1935, status = succeeded6382worker1 # [ 136.187299] nix-daemon[841]: accepted connection from pid 1937, user nix-grpc-daemon (trusted)6383worker1 # [ 136.198875] nix-daemon[841]: reaped child process 1940, status = succeeded6384lb # [ 136.242157] niks3-server[1081]: 2026/09/20 08:07:55 INFO Received uploads request method=POST path=/api/pending_closures6385worker1 # [ 136.222939] nix-grpc-daemon[1715]: time=2026-09-20T08:07:56.381Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6386worker1 # [ 136.224346] nix-grpc-daemon[1715]: time=2026-09-20T08:07:56.381Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6387lb # [ 136.262359] niks3-server[1081]: 2026/09/20 08:07:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6388lb # [ 136.265360] niks3-server[1081]: 2026/09/20 08:07:55 INFO Signed narinfos id=56 count=16389worker1 # [ 136.238250] nix-grpc-daemon[1715]: time=2026-09-20T08:07:56.396Z level=INFO msg="Uploading 1 narinfos"6390lb # [ 136.270901] niks3-server[1081]: 2026/09/20 08:07:55 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6391lb # [ 136.273428] niks3-server[1081]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6392lb # [ 136.276297] niks3-server[1081]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6393lb # [ 136.278987] niks3-server[1081]: 2026/09/20 08:07:55 INFO Completed upload id=566394worker1 # [ 136.251658] nix-grpc-daemon[1715]: time=2026-09-20T08:07:56.409Z level=INFO msg="Upload complete. (386ms)"6395worker1 # [ 136.253599] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=0 paths=1 nar_bytes_in=7526396worker1 # [ 136.256430] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486397lb # [ 136.285025] niks3-server[1081]: 2026/09/20 08:07:55 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6398worker1 # [ 136.262813] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6399worker1 # [ 136.265988] nix-daemon[841]: reaped child process 1930, status = succeeded6400worker1 # [ 136.270961] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6401worker1 # [ 137.290740] nix-daemon[841]: reaped child process 1944, status = succeeded6402worker1 # [ 137.431173] nix-daemon[841]: accepted connection from pid 1959, user nix-grpc-daemon (trusted)6403worker1 # [ 137.443047] nix-daemon[841]: reaped child process 1962, status = succeeded6404lb # [ 137.481675] niks3-server[1081]: 2026/09/20 08:07:57 INFO Received uploads request method=POST path=/api/pending_closures6405worker1 # [ 137.463289] nix-grpc-daemon[1715]: time=2026-09-20T08:07:57.621Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6406worker1 # [ 137.464745] nix-grpc-daemon[1715]: time=2026-09-20T08:07:57.623Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6407lb # [ 137.512283] niks3-server[1081]: 2026/09/20 08:07:57 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6408lb # [ 137.516286] niks3-server[1081]: 2026/09/20 08:07:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6409lb # [ 137.518979] niks3-server[1081]: 2026/09/20 08:07:57 INFO Signed narinfos id=57 count=16410worker1 # [ 137.493148] nix-grpc-daemon[1715]: time=2026-09-20T08:07:57.651Z level=INFO msg="Uploading 1 narinfos"6411lb # [ 137.521639] niks3-server[1081]: 2026/09/20 08:07:57 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6412lb # [ 137.526315] niks3-server[1081]: 2026/09/20 08:07:57 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6413lb # [ 137.532046] niks3-server[1081]: 2026/09/20 08:07:57 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6414worker1 # [ 137.508421] nix-grpc-daemon[1715]: time=2026-09-20T08:07:57.666Z level=INFO msg="Upload complete. (230ms)"6415lb # [ 137.535920] niks3-server[1081]: 2026/09/20 08:07:57 INFO Completed upload id=576416lb # [ 137.538235] niks3-server[1081]: 2026/09/20 08:07:57 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6417worker1 # [ 137.512068] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=13 outputs=16418worker1 # [ 137.517784] nix-daemon[841]: reaped child process 1942, status = succeeded6419worker2 # [ 137.555979] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:57Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16420worker1 # [ 137.557638] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486421worker1 # [ 137.566911] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:431486422worker1 # [ 137.577520] nix-grpc-daemon[1715]: time=2026-09-20T08:07:57.735Z level=INFO msg="All 2 paths already cached"6423worker1 # [ 137.583876] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:431486424worker1 # [ 137.592127] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6425worker1 # [ 137.752410] nix-daemon[841]: accepted connection from pid 1966, user nix-grpc-daemon (trusted)6426worker1 # [ 137.767085] nix-daemon[841]: reaped child process 1969, status = succeeded6427worker1 # [ 137.918092] nix-daemon[841]: accepted connection from pid 1971, user nix-grpc-daemon (trusted)6428worker1 # [ 137.930210] nix-daemon[841]: reaped child process 1974, status = succeeded6429lb # [ 137.967530] niks3-server[1081]: 2026/09/20 08:07:57 INFO Received uploads request method=POST path=/api/pending_closures6430worker1 # [ 137.947773] nix-grpc-daemon[1715]: time=2026-09-20T08:07:58.105Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6431worker1 # [ 137.949199] nix-grpc-daemon[1715]: time=2026-09-20T08:07:58.105Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6432lb # [ 137.989952] niks3-server[1081]: 2026/09/20 08:07:57 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6433lb # [ 138.002777] niks3-server[1081]: 2026/09/20 08:07:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6434lb # [ 138.008101] niks3-server[1081]: 2026/09/20 08:07:57 INFO Signed narinfos id=58 count=16435worker1 # [ 137.983760] nix-grpc-daemon[1715]: time=2026-09-20T08:07:58.141Z level=INFO msg="Uploading 1 narinfos"6436lb # [ 138.015367] niks3-server[1081]: 2026/09/20 08:07:57 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6437lb # [ 138.025143] niks3-server[1081]: 2026/09/20 08:07:57 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6438worker1 # [ 138.002441] nix-grpc-daemon[1715]: time=2026-09-20T08:07:58.160Z level=INFO msg="Upload complete. (400ms)"6439lb # [ 138.029728] niks3-server[1081]: 2026/09/20 08:07:57 INFO Completed upload id=586440worker1 # [ 138.004300] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=0 paths=1 nar_bytes_in=7526441worker1 # [ 138.007920] nix-grpc-daemon[1659]: ts=2026-09-20T08:07:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486442lb # [ 138.034987] niks3-server[1081]: 2026/09/20 08:07:57 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6443worker1 # [ 138.015758] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6444worker1 # [ 138.018057] nix-daemon[841]: reaped child process 1964, status = succeeded6445worker1 # [ 138.023262] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6446worker1 # [ 139.450390] nix-daemon[841]: reaped child process 1978, status = succeeded6447worker1 # [ 139.590621] nix-daemon[841]: accepted connection from pid 1993, user nix-grpc-daemon (trusted)6448worker1 # [ 139.602125] nix-daemon[841]: reaped child process 1996, status = succeeded6449lb # [ 139.646228] niks3-server[1081]: 2026/09/20 08:07:59 INFO Received uploads request method=POST path=/api/pending_closures6450worker1 # [ 139.879627] nix-grpc-daemon[1715]: time=2026-09-20T08:08:00.036Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6451worker1 # [ 139.883740] nix-grpc-daemon[1715]: time=2026-09-20T08:08:00.036Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6452lb # [ 139.930365] niks3-server[1081]: 2026/09/20 08:07:59 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6453lb # [ 139.944779] niks3-server[1081]: 2026/09/20 08:07:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6454lb # [ 139.951372] niks3-server[1081]: 2026/09/20 08:07:59 INFO Signed narinfos id=59 count=16455worker1 # [ 139.927654] nix-grpc-daemon[1715]: time=2026-09-20T08:08:00.085Z level=INFO msg="Uploading 1 narinfos"6456lb # [ 139.959233] niks3-server[1081]: 2026/09/20 08:07:59 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6457lb # [ 139.968053] niks3-server[1081]: 2026/09/20 08:07:59 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6458lb # [ 139.972865] niks3-server[1081]: 2026/09/20 08:07:59 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6459lb # [ 139.978649] niks3-server[1081]: 2026/09/20 08:07:59 INFO Completed upload id=596460worker1 # [ 139.951404] nix-grpc-daemon[1715]: time=2026-09-20T08:08:00.109Z level=INFO msg="Upload complete. (520ms)"6461lb # [ 139.983487] niks3-server[1081]: 2026/09/20 08:07:59 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6462worker2 # [ 139.999189] nix-grpc-daemon[1410]: ts=2026-09-20T08:07:59Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16463worker1 # [ 139.958927] nix-grpc-daemon[1659]: ts=2026-09-20T08:08:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=14 outputs=16464worker1 # [ 139.971672] nix-daemon[841]: reaped child process 1976, status = succeeded6465worker1 # [ 140.002116] nix-grpc-daemon[1659]: ts=2026-09-20T08:08:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486466worker1 # [ 140.014113] nix-grpc-daemon[1659]: ts=2026-09-20T08:08:00Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:431486467worker1 # [ 140.026462] nix-grpc-daemon[1715]: time=2026-09-20T08:08:00.184Z level=INFO msg="All 2 paths already cached"6468worker1 # [ 140.033531] nix-grpc-daemon[1659]: ts=2026-09-20T08:08:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:431486469worker1 # [ 140.042159] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6470worker1 # [ 140.210681] nix-daemon[841]: accepted connection from pid 2000, user nix-grpc-daemon (trusted)6471worker1 # [ 140.222559] nix-daemon[841]: reaped child process 2003, status = succeeded6472worker1 # [ 140.379568] nix-daemon[841]: accepted connection from pid 2005, user nix-grpc-daemon (trusted)6473worker1 # [ 140.391055] nix-daemon[841]: reaped child process 2008, status = succeeded6474lb # [ 140.434602] niks3-server[1081]: 2026/09/20 08:08:00 INFO Received uploads request method=POST path=/api/pending_closures6475worker1 # [ 140.414811] nix-grpc-daemon[1715]: time=2026-09-20T08:08:00.573Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6476worker1 # [ 140.416314] nix-grpc-daemon[1715]: time=2026-09-20T08:08:00.574Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6477lb # [ 140.461674] niks3-server[1081]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6478lb # [ 140.475224] niks3-server[1081]: 2026/09/20 08:08:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6479worker1 # [ 140.454164] nix-grpc-daemon[1715]: time=2026-09-20T08:08:00.612Z level=INFO msg="Uploading 1 narinfos"6480lb # [ 140.481503] niks3-server[1081]: 2026/09/20 08:08:00 INFO Signed narinfos id=60 count=16481lb # [ 140.485715] niks3-server[1081]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6482lb # [ 140.499814] niks3-server[1081]: 2026/09/20 08:08:00 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6483lb # [ 140.504212] niks3-server[1081]: 2026/09/20 08:08:00 INFO Completed upload id=606484worker1 # [ 140.477047] nix-grpc-daemon[1715]: time=2026-09-20T08:08:00.635Z level=INFO msg="Upload complete. (421ms)"6485lb # [ 140.506765] niks3-server[1081]: 2026/09/20 08:08:00 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6486worker1 # [ 140.481133] nix-grpc-daemon[1659]: ts=2026-09-20T08:08:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=0 paths=1 nar_bytes_in=7526487worker1 # [ 140.486137] nix-grpc-daemon[1659]: ts=2026-09-20T08:08:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:431486488worker1 # [ 140.497067] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6489worker1 # [ 140.500216] nix-daemon[841]: reaped child process 1998, status = succeeded6490worker1 # [ 140.505353] nix-daemon[841]: accepted connection from pid 1659, user nix-grpc-daemon (trusted)6491worker1 # [ 141.317142] nix-daemon[841]: reaped child process 2012, status = succeeded6492worker1 # [ 141.455187] nix-daemon[841]: accepted connection from pid 2027, user nix-grpc-daemon (trusted)6493worker1 # [ 141.467710] nix-daemon[841]: reaped child process 2030, status = succeeded6494lb # [ 141.511747] niks3-server[1081]: 2026/09/20 08:08:01 INFO Received uploads request method=POST path=/api/pending_closures6495worker1 # [ 141.493278] nix-grpc-daemon[1715]: time=2026-09-20T08:08:01.650Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6496worker1 # [ 141.494784] nix-grpc-daemon[1715]: time=2026-09-20T08:08:01.650Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6497lb # [ 141.540142] niks3-server[1081]: 2026/09/20 08:08:01 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6498lb # [ 141.553897] niks3-server[1081]: 2026/09/20 08:08:01 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6499lb # [ 141.563883] niks3-server[1081]: 2026/09/20 08:08:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6500worker1 # [ 141.541530] nix-grpc-daemon[1715]: time=2026-09-20T08:08:01.699Z level=INFO msg="Uploading 1 narinfos"6501lb # [ 141.569362] niks3-server[1081]: 2026/09/20 08:08:01 INFO Signed narinfos id=61 count=16502lb # [ 141.573601] niks3-server[1081]: 2026/09/20 08:08:01 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6503lb # [ 141.582674] niks3-server[1081]: 2026/09/20 08:08:01 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6504lb # [ 141.585526] niks3-server[1081]: 2026/09/20 08:08:01 INFO Completed upload id=616505worker1 # [ 141.558206] nix-grpc-daemon[1715]: time=2026-09-20T08:08:01.716Z level=INFO msg="Upload complete. (247ms)"6506lb # [ 141.587218] niks3-server[1081]: 2026/09/20 08:08:01 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6507worker1 # [ 141.561393] nix-grpc-daemon[1659]: ts=2026-09-20T08:08:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43148 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=15 outputs=16508worker1 # [ 141.567770] nix-daemon[841]: reaped child process 2010, status = succeeded6509client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 18.69 seconds)6510worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6511worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.06 seconds)6512client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16513worker2 # [ 141.955914] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:390646514worker2 # [ 141.967990] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:01Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06515client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.27 seconds)6516(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 19.02 seconds)6517subtest: low disk drains a worker and builds go to the other6518worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6519worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.99 seconds)6520worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6521worker1 # [ 143.759725] nix-grpc-daemon[1659]: ts=2026-09-20T08:08:03Z level=info event=unhealthy reason=min_free6522worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.11 seconds)6523client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&26524client # don't know how to build these paths:6525worker2 # [ 144.298115] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:390646526client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6527worker2 # [ 144.306036] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:04Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06528worker2 # [ 144.308768] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:04Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16529worker2 # [ 144.350568] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:390646530worker2 # [ 144.359185] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:390646531client # copying 1 paths to 'lb:50051'...6532client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6533worker2 # [ 144.367318] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:390646534worker2 # [ 144.373558] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6535worker2 # [ 144.503529] nix-daemon[909]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6536worker2 # [ 144.516144] nix-daemon[909]: reaped child process 1697, status = succeeded6537worker2 # [ 144.652036] nix-daemon[909]: accepted connection from pid 1699, user nix-grpc-daemon (trusted)6538worker2 # [ 144.664316] nix-daemon[909]: reaped child process 1702, status = succeeded6539lb # [ 144.665364] niks3-server[1081]: 2026/09/20 08:08:04 INFO Received uploads request method=POST path=/api/pending_closures6540worker2 # [ 144.692994] nix-grpc-daemon[1486]: time=2026-09-20T08:08:04.618Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6541worker2 # [ 144.694440] nix-grpc-daemon[1486]: time=2026-09-20T08:08:04.618Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6542lb # [ 144.699885] niks3-server[1081]: 2026/09/20 08:08:04 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6543lb # [ 144.708534] niks3-server[1081]: 2026/09/20 08:08:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6544lb # [ 144.713956] niks3-server[1081]: 2026/09/20 08:08:04 INFO Signed narinfos id=62 count=16545worker2 # [ 144.731091] nix-grpc-daemon[1486]: time=2026-09-20T08:08:04.657Z level=INFO msg="Uploading 1 narinfos"6546lb # [ 144.726511] niks3-server[1081]: 2026/09/20 08:08:04 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6547lb # [ 144.734398] niks3-server[1081]: 2026/09/20 08:08:04 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6548worker2 # [ 144.754435] nix-grpc-daemon[1486]: time=2026-09-20T08:08:04.680Z level=INFO msg="Upload complete. (376ms)"6549lb # [ 144.740771] niks3-server[1081]: 2026/09/20 08:08:04 INFO Completed upload id=626550worker2 # [ 144.757074] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39064 duration_s=0 paths=1 nar_bytes_in=5126551lb # [ 144.743244] niks3-server[1081]: 2026/09/20 08:08:04 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6552worker2 # [ 144.762455] nix-daemon[909]: reaped child process 1692, status = succeeded6553worker2 # [ 144.763914] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:390646554worker2 # [ 144.767506] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6555client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6556worker2 # [ 144.774907] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6557client # farm-a> worker2: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6558client # farm-a> LOG-farm-a-drain6559worker2 # [ 145.587588] nix-daemon[909]: reaped child process 1706, status = succeeded6560worker2 # [ 145.735089] nix-daemon[909]: accepted connection from pid 1721, user nix-grpc-daemon (trusted)6561worker2 # [ 145.746901] nix-daemon[909]: reaped child process 1724, status = succeeded6562lb # [ 145.748596] niks3-server[1081]: 2026/09/20 08:08:05 INFO Received uploads request method=POST path=/api/pending_closures6563worker2 # [ 145.771600] nix-grpc-daemon[1486]: time=2026-09-20T08:08:05.697Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6564worker2 # [ 145.773132] nix-grpc-daemon[1486]: time=2026-09-20T08:08:05.699Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6565lb # [ 145.788217] niks3-server[1081]: 2026/09/20 08:08:05 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6566lb # [ 145.794689] niks3-server[1081]: 2026/09/20 08:08:05 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6567lb # [ 145.803620] niks3-server[1081]: 2026/09/20 08:08:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6568lb # [ 145.807393] niks3-server[1081]: 2026/09/20 08:08:05 INFO Signed narinfos id=63 count=16569worker2 # [ 145.823939] nix-grpc-daemon[1486]: time=2026-09-20T08:08:05.749Z level=INFO msg="Uploading 1 narinfos"6570lb # [ 145.813548] niks3-server[1081]: 2026/09/20 08:08:05 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6571lb # [ 145.819062] niks3-server[1081]: 2026/09/20 08:08:05 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6572lb # [ 145.822290] niks3-server[1081]: 2026/09/20 08:08:05 INFO Completed upload id=636573worker2 # [ 145.836494] nix-grpc-daemon[1486]: time=2026-09-20T08:08:05.762Z level=INFO msg="Upload complete. (256ms)"6574lb # [ 145.824705] niks3-server[1081]: 2026/09/20 08:08:05 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6575worker2 # [ 145.844584] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39064 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=16 outputs=16576worker2 # [ 145.852986] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:05Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06577worker2 # [ 145.856870] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:05Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16578worker2 # [ 145.864554] nix-daemon[909]: reaped child process 1704, status = succeeded6579worker2 # [ 145.896791] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:390646580worker2 # [ 145.908876] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:390646581worker2 # [ 145.920514] nix-grpc-daemon[1486]: time=2026-09-20T08:08:05.846Z level=INFO msg="All 1 paths already cached"6582client # copying 1 paths to 'lb:50051'...6583client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6584worker2 # [ 145.929697] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:390646585worker2 # [ 145.938260] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6586worker2 # [ 146.095135] nix-daemon[909]: accepted connection from pid 1730, user nix-grpc-daemon (trusted)6587worker2 # [ 146.109676] nix-daemon[909]: reaped child process 1733, status = succeeded6588worker2 # [ 146.251948] nix-daemon[909]: accepted connection from pid 1735, user nix-grpc-daemon (trusted)6589worker2 # [ 146.264170] nix-daemon[909]: reaped child process 1738, status = succeeded6590lb # [ 146.263788] niks3-server[1081]: 2026/09/20 08:08:05 INFO Received uploads request method=POST path=/api/pending_closures6591worker2 # [ 146.285536] nix-grpc-daemon[1486]: time=2026-09-20T08:08:06.211Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6592worker2 # [ 146.286894] nix-grpc-daemon[1486]: time=2026-09-20T08:08:06.211Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6593lb # [ 146.289230] niks3-server[1081]: 2026/09/20 08:08:05 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6594lb # [ 146.300985] niks3-server[1081]: 2026/09/20 08:08:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6595worker2 # [ 146.319313] nix-grpc-daemon[1486]: time=2026-09-20T08:08:06.245Z level=INFO msg="Uploading 1 narinfos"6596lb # [ 146.305141] niks3-server[1081]: 2026/09/20 08:08:05 INFO Signed narinfos id=64 count=16597lb # [ 146.311754] niks3-server[1081]: 2026/09/20 08:08:05 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6598lb # [ 146.322130] niks3-server[1081]: 2026/09/20 08:08:05 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6599worker2 # [ 146.342276] nix-grpc-daemon[1486]: time=2026-09-20T08:08:06.268Z level=INFO msg="Upload complete. (393ms)"6600lb # [ 146.328534] niks3-server[1081]: 2026/09/20 08:08:05 INFO Completed upload id=646601worker2 # [ 146.345078] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:06Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39064 duration_s=0 paths=1 nar_bytes_in=6246602lb # [ 146.332464] niks3-server[1081]: 2026/09/20 08:08:05 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6603worker2 # [ 146.350415] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:390646604worker2 # [ 146.354474] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6605worker2 # [ 146.356711] nix-daemon[909]: reaped child process 1728, status = succeeded6606worker2 # [ 146.361912] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6607client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6608client # farm-b> worker2: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6609worker2 # [ 147.574419] nix-daemon[909]: reaped child process 1742, status = succeeded6610client # farm-b> LOG-farm-b-drain6611worker2 # [ 147.710935] nix-daemon[909]: accepted connection from pid 1757, user nix-grpc-daemon (trusted)6612worker2 # [ 147.722733] nix-daemon[909]: reaped child process 1760, status = succeeded6613lb # [ 147.726780] niks3-server[1081]: 2026/09/20 08:08:07 INFO Received uploads request method=POST path=/api/pending_closures6614worker2 # [ 147.749502] nix-grpc-daemon[1486]: time=2026-09-20T08:08:07.675Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6615worker2 # [ 147.751270] nix-grpc-daemon[1486]: time=2026-09-20T08:08:07.677Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6616lb # [ 147.771208] niks3-server[1081]: 2026/09/20 08:08:07 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6617lb # [ 147.776505] niks3-server[1081]: 2026/09/20 08:08:07 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6618lb # [ 147.785369] niks3-server[1081]: 2026/09/20 08:08:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6619worker2 # [ 147.804097] nix-grpc-daemon[1486]: time=2026-09-20T08:08:07.730Z level=INFO msg="Uploading 1 narinfos"6620lb # [ 147.789955] niks3-server[1081]: 2026/09/20 08:08:07 INFO Signed narinfos id=65 count=16621lb # [ 147.796430] niks3-server[1081]: 2026/09/20 08:08:07 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6622lb # [ 147.806248] niks3-server[1081]: 2026/09/20 08:08:07 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6623lb # [ 147.813061] niks3-server[1081]: 2026/09/20 08:08:07 INFO Completed upload id=656624lb # [ 147.814380] niks3-server[1081]: 2026/09/20 08:08:07 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6625worker2 # [ 147.827361] nix-grpc-daemon[1486]: time=2026-09-20T08:08:07.753Z level=INFO msg="Upload complete. (257ms)"6626worker2 # [ 147.834235] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:07Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39064 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=17 outputs=16627worker2 # [ 147.843267] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:07Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06628worker2 # [ 147.846351] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:07Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16629worker2 # [ 147.854464] nix-daemon[909]: reaped child process 1740, status = succeeded6630worker2 # [ 147.887298] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:390646631worker2 # [ 147.900156] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:390646632worker2 # [ 147.924433] nix-grpc-daemon[1486]: time=2026-09-20T08:08:07.850Z level=INFO msg="All 2 paths already cached"6633client # copying 1 paths to 'lb:50051'...6634client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6635worker2 # [ 147.933075] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:390646636worker2 # [ 147.941635] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6637worker2 # [ 148.124745] nix-daemon[909]: accepted connection from pid 1766, user nix-grpc-daemon (trusted)6638worker2 # [ 148.138124] nix-daemon[909]: reaped child process 1769, status = succeeded6639worker2 # [ 148.308332] nix-daemon[909]: accepted connection from pid 1771, user nix-grpc-daemon (trusted)6640worker2 # [ 148.322057] nix-daemon[909]: reaped child process 1774, status = succeeded6641lb # [ 148.323588] niks3-server[1081]: 2026/09/20 08:08:07 INFO Received uploads request method=POST path=/api/pending_closures6642worker2 # [ 148.344725] nix-grpc-daemon[1486]: time=2026-09-20T08:08:08.270Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6643worker2 # [ 148.346547] nix-grpc-daemon[1486]: time=2026-09-20T08:08:08.272Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6644lb # [ 148.335546] envoy[979]: conn peer=[2001:db8:1::1]:42592 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26838 tx=10664 ms=184286645lb # [ 148.340453] envoy[979]: conn peer=[2001:db8:1::1]:52420 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=708 tx=438 ms=326646lb # [ 148.356979] niks3-server[1081]: 2026/09/20 08:08:08 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6647lb # [ 148.368264] niks3-server[1081]: 2026/09/20 08:08:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6648lb # [ 148.373858] niks3-server[1081]: 2026/09/20 08:08:08 INFO Signed narinfos id=66 count=16649worker2 # [ 148.390926] nix-grpc-daemon[1486]: time=2026-09-20T08:08:08.316Z level=INFO msg="Uploading 1 narinfos"6650lb # [ 148.379289] niks3-server[1081]: 2026/09/20 08:08:08 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6651lb # [ 148.388491] niks3-server[1081]: 2026/09/20 08:08:08 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6652lb # [ 148.392850] niks3-server[1081]: 2026/09/20 08:08:08 INFO Completed upload id=666653worker2 # [ 148.410058] nix-grpc-daemon[1486]: time=2026-09-20T08:08:08.336Z level=INFO msg="Upload complete. (453ms)"6654lb # [ 148.398228] niks3-server[1081]: 2026/09/20 08:08:08 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6655worker2 # [ 148.413866] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:39064 duration_s=0 paths=1 nar_bytes_in=7526656worker2 # [ 148.420165] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:390646657worker2 # [ 148.427169] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6658worker2 # [ 148.434367] nix-daemon[909]: reaped child process 1764, status = succeeded6659worker2 # [ 148.439510] nix-daemon[909]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)6660client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6661client # farm-top> worker2: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6662client # farm-top> LOG-farm-top-drain6663worker2 # [ 149.664791] nix-daemon[909]: reaped child process 1778, status = succeeded6664worker2 # [ 149.818707] nix-daemon[909]: accepted connection from pid 1793, user nix-grpc-daemon (trusted)6665worker2 # [ 149.830396] nix-daemon[909]: reaped child process 1796, status = succeeded6666lb # [ 149.831373] niks3-server[1081]: 2026/09/20 08:08:09 INFO Received uploads request method=POST path=/api/pending_closures6667worker2 # [ 149.854306] nix-grpc-daemon[1486]: time=2026-09-20T08:08:09.780Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6668worker2 # [ 149.856087] nix-grpc-daemon[1486]: time=2026-09-20T08:08:09.782Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6669lb # [ 149.855252] niks3-server[1081]: 2026/09/20 08:08:09 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6670lb # [ 149.858838] niks3-server[1081]: 2026/09/20 08:08:09 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6671lb # [ 149.864980] niks3-server[1081]: 2026/09/20 08:08:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6672lb # [ 149.869978] niks3-server[1081]: 2026/09/20 08:08:09 INFO Signed narinfos id=67 count=16673worker2 # [ 149.886966] nix-grpc-daemon[1486]: time=2026-09-20T08:08:09.812Z level=INFO msg="Uploading 1 narinfos"6674lb # [ 149.875990] niks3-server[1081]: 2026/09/20 08:08:09 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6675lb # [ 149.881054] niks3-server[1081]: 2026/09/20 08:08:09 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6676lb # [ 149.883520] niks3-server[1081]: 2026/09/20 08:08:09 INFO Completed upload id=676677worker2 # [ 149.897574] nix-grpc-daemon[1486]: time=2026-09-20T08:08:09.823Z level=INFO msg="Upload complete. (250ms)"6678lb # [ 149.886273] niks3-server[1081]: 2026/09/20 08:08:09 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6679worker2 # [ 149.900550] nix-grpc-daemon[1410]: ts=2026-09-20T08:08:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:39064 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=18 outputs=16680worker2 # [ 149.907914] nix-daemon[909]: reaped child process 1776, status = succeeded6681client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&2, in 5.83 seconds)6682client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath6683client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath, in 0.17 seconds)6684worker1: must succeed: rm /nix/.rw-store/fill6685worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.10 seconds)6686worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6687worker1 # [ 150.766981] nix-grpc-daemon[1659]: ts=2026-09-20T08:08:10Z level=info event=healthy reason=min_free6688worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.08 seconds)6689(finished: subtest: low disk drains a worker and builds go to the other, in 9.34 seconds)6690(finished: run the VM test script, in 152.29 seconds)6691test script finished in 152.51s6692cleanup6693kill QemuMachine (pid 49)6694client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6695kill QemuMachine (pid 50)6696lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6697kill QemuMachine (pid 51)6698worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6699kill QemuMachine (pid 52)6700worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6701(finished: cleanup, in 1.01 seconds)6702additionally exposed symbols:6703 client, lb, worker1, worker2,6704 vlan1,6705 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh