vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #315
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker1 # Disk image does not exist, creating the virtualisation disk image...13client # Disk image does not exist, creating the virtualisation disk image...14worker1: QEMU running (pid 51)15client: QEMU running (pid 49)16worker1 # Formatting '/build/vm-state-worker1/tmp.wfAKteEgBS', fmt=raw size=107374182417worker2 # Disk image does not exist, creating the virtualisation disk image...18client # Formatting '/build/vm-state-client/tmp.EM1qQ6dHS5', fmt=raw size=107374182419worker2: QEMU running (pid 52)20worker2 # Formatting '/build/vm-state-worker2/tmp.ALuG2Ae8Dn', fmt=raw size=107374182421worker1 # mke2fs 1.47.4 (6-Mar-2025)22lb # Disk image does not exist, creating the virtualisation disk image...23worker2 # mke2fs 1.47.4 (6-Mar-2025)24worker1 # Discarding device blocks: 0/262144 done25lb # Formatting '/build/vm-state-lb/tmp.3yC3AUK5dD', fmt=raw size=107374182426worker2 # Discarding device blocks: 0/262144 done27worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes28worker1 # Filesystem UUID: 8053a499-13e9-46b1-8fcc-2d31a282406029lb # mke2fs 1.47.4 (6-Mar-2025)30client # mke2fs 1.47.4 (6-Mar-2025)31lb: QEMU running (pid 50)32lb # Discarding device blocks: 0/262144 done33client # Discarding device blocks: 0/262144 done34lb # Creating filesystem with 262144 4k blocks and 65536 inodes35client # Creating filesystem with 262144 4k blocks and 65536 inodes36worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes37worker1 # Superblock backups stored on blocks:38lb # Filesystem UUID: b01a5895-3138-4b9d-ab98-486e7ceca90939client # Filesystem UUID: 78ce7364-ee6c-4ed6-9a44-114c2990aacc40worker2 # Filesystem UUID: 32c79e77-7850-4e69-b9f1-6b7a42eef54241worker1 # 32768, 98304, 163840, 22937642lb # Superblock backups stored on blocks:43client # Superblock backups stored on blocks:44(finished: start all VMs, in 0.23 seconds)45lb # 32768, 98304, 163840, 22937646client # 32768, 98304, 163840, 22937647client: waiting for unit network-addresses-eth1.service48lb # 49client # 50client: waiting for the VM to finish booting51lb # Allocating group tables: 0/8 done52client # Allocating group tables: 0/8 done53worker1 # 54worker2 # Superblock backups stored on blocks:55lb # Writing inode tables: 0/8 done56client # Writing inode tables: 0/8 done57worker1 # Allocating group tables: 0/8 done58worker2 # 32768, 98304, 163840, 22937659lb # Creating journal (8192 blocks): done60client # Creating journal (8192 blocks): done61worker1 # Writing inode tables: 0/8 done62worker2 # 63lb # Writing superblocks and filesystem accounting information: 0/8 done64client # Writing superblocks and filesystem accounting information: 0/8 done65worker1 # Creating journal (8192 blocks): done66worker2 # Allocating group tables: 0/8 done67lb # 68client # 69worker1 # Writing superblocks and filesystem accounting information: 0/8 done70worker2 # Writing inode tables: 0/8 done71lb # Virtualisation disk image created.72client # Virtualisation disk image created.73worker1 # 74worker2 # Creating journal (8192 blocks): done75worker1 # Virtualisation disk image created.76worker2 # Writing superblocks and filesystem accounting information: 0/8 done77worker2 # 78worker2 # Virtualisation disk image created.79worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker1 # 84worker1 # 85client # 86client # 87worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0088lb # 89lb # 90client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0091lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0092worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...93worker1 # 94worker1 # 95worker1 # 96worker1 # 97client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...98client # 99client # 100client # 101client # 102worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00103lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...104lb # 105lb # 106lb # 107lb # 108client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00109lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00110worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...111worker1 # 112worker1 # 113client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...114client # 115client # 116lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...117lb # 118lb # 119worker2 # 120worker2 # 121worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00122worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...123worker2 # 124worker2 # 125worker2 # 126worker2 # 127worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129worker2 # 130worker2 # 131worker1 # Booting from ROM...132client # Booting from ROM...133lb # Booting from ROM...134worker2 # Booting from ROM...135worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026137lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026138worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lsi4jlsq3hsv0m08jhhiky65kvydf0mq-nixos-system-worker1-test/init regInfo=/nix/store/bkbgzkbdqfi8lyfww18icml3yhcbhgip-closure-info/registration console=ttyS0,115200n8 console=tty0139worker1 # [ 0.000000] BIOS-provided physical RAM map:140client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/abf5y6lmj712ajsgxzvih1228b4c7xja-nixos-system-client-test/init regInfo=/nix/store/lxnzxhnbxr6wirjcj2yznnzr2dljc2zr-closure-info/registration console=ttyS0,115200n8 console=tty0141worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable142client # [ 0.000000] BIOS-provided physical RAM map:143worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved144client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable145worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved146lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zfkn25gwyly4vj1wrmysvx6pxf84cpx1-nixos-system-lb-test/init regInfo=/nix/store/4sxfzvml2hymd14mj9miafa9ing1xf50-closure-info/registration console=ttyS0,115200n8 console=tty0147client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved148lb # [ 0.000000] BIOS-provided physical RAM map:149worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable150client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved151lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable152worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved153client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable154lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved155worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved156client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved157lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved158worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved159client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved160lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable161worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved162client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved163lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved164worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved165client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved166lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved167worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved168client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved169lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved170worker1 # [ 0.000000] NX (Execute Disable) protection: active171client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved172worker1 # [ 0.000000] APIC: Static calls initialized173lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved174worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026175worker1 # [ 0.000000] SMBIOS 2.8 present.176client # [ 0.000000] NX (Execute Disable) protection: active177client # [ 0.000000] APIC: Static calls initialized178lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved179client # [ 0.000000] SMBIOS 2.8 present.180worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014181lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved182worker1 # [ 0.000000] DMI: Memory slots populated: 1/1183lb # [ 0.000000] NX (Execute Disable) protection: active184client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014185worker1 # [ 0.000000] Hypervisor detected: KVM186lb # [ 0.000000] APIC: Static calls initialized187client # [ 0.000000] DMI: Memory slots populated: 1/1188worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000189lb # [ 0.000000] SMBIOS 2.8 present.190client # [ 0.000000] Hypervisor detected: KVM191worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00192client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000193worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3ri1s6dnplxsmxjyiixxklps9krb0xjc-nixos-system-worker2-test/init regInfo=/nix/store/iwy8snd097rhja72kbczfz86qy1vbkfi-closure-info/registration console=ttyS0,115200n8 console=tty0194worker1 # [ 0.000001] kvm-clock: using sched offset of 471495501 cycles195lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014196worker2 # [ 0.000000] BIOS-provided physical RAM map:197client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00198lb # [ 0.000000] DMI: Memory slots populated: 1/1199worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable200client # [ 0.000001] kvm-clock: using sched offset of 471211124 cycles201lb # [ 0.000000] Hypervisor detected: KVM202worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns203lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000204worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved205worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor206client # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns207lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00208worker1 # [ 0.000824] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000209worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved210client # [ 0.000006] tsc: Detected 2400.012 MHz processor211lb # [ 0.000000] kvm-clock: using sched offset of 471434272 cycles212client # [ 0.000818] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000213worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable214worker1 # [ 0.000852] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs215worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved216lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns217worker1 # [ 0.000854] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT218client # [ 0.000847] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs219lb # [ 0.000005] tsc: Detected 2400.012 MHz processor220worker1 # [ 0.002760] found SMP MP-table at [mem 0x000f5450-0x000f545f]221client # [ 0.000850] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT222worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved223lb # [ 0.000811] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000224worker1 # [ 0.002771] Using GB pages for direct mapping225client # [ 0.002749] found SMP MP-table at [mem 0x000f5450-0x000f545f]226worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved227worker1 # [ 0.002875] RAMDISK: [mem 0x5e367000-0x5ffcffff]228client # [ 0.002762] Using GB pages for direct mapping229lb # [ 0.000838] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs230worker1 # [ 0.002884] ACPI: Early table checksum verification disabled231worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved232client # [ 0.002891] RAMDISK: [mem 0x5e366000-0x5ffcffff]233lb # [ 0.000841] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT234worker1 # [ 0.002887] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )235client # [ 0.002900] ACPI: Early table checksum verification disabled236worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved237lb # [ 0.002738] found SMP MP-table at [mem 0x000f5450-0x000f545f]238client # [ 0.002904] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )239lb # [ 0.002749] Using GB pages for direct mapping240worker1 # [ 0.002891] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)241worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved242lb # [ 0.002904] RAMDISK: [mem 0x5e367000-0x5ffcffff]243worker2 # [ 0.000000] NX (Execute Disable) protection: active244client # [ 0.002909] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)245worker1 # [ 0.002895] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)246lb # [ 0.002912] ACPI: Early table checksum verification disabled247worker2 # [ 0.000000] APIC: Static calls initialized248worker2 # [ 0.000000] SMBIOS 2.8 present.249client # [ 0.002913] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)250lb # [ 0.002916] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )251worker1 # [ 0.002903] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)252worker1 # [ 0.002905] ACPI: FACS 0x000000005FFE0000 000040253client # [ 0.002921] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)254lb # [ 0.002920] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)255worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014256client # [ 0.002923] ACPI: FACS 0x000000005FFE0000 000040257worker2 # [ 0.000000] DMI: Memory slots populated: 1/1258worker1 # [ 0.002906] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)259lb # [ 0.002925] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)260worker2 # [ 0.000000] Hypervisor detected: KVM261client # [ 0.002924] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)262worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000263worker1 # [ 0.002908] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)264lb # [ 0.002932] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)265worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00266client # [ 0.002926] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)267lb # [ 0.002934] ACPI: FACS 0x000000005FFE0000 000040268worker1 # [ 0.002909] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)269worker2 # [ 0.000001] kvm-clock: using sched offset of 487482113 cycles270lb # [ 0.002936] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)271client # [ 0.002927] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)272worker1 # [ 0.002911] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)273worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns274client # [ 0.002929] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)275lb # [ 0.002937] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)276worker1 # [ 0.002912] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]277worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor278client # [ 0.002930] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]279worker1 # [ 0.002913] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]280lb # [ 0.002939] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)281worker2 # [ 0.000812] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000282client # [ 0.002931] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]283worker1 # [ 0.002913] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]284lb # [ 0.002941] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)285worker2 # [ 0.000840] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs286client # [ 0.002932] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]287worker1 # [ 0.002914] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]288lb # [ 0.002942] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]289worker2 # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT290client # [ 0.002932] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]291worker1 # [ 0.002915] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]292lb # [ 0.002943] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]293worker2 # [ 0.002736] found SMP MP-table at [mem 0x000f5450-0x000f545f]294client # [ 0.002933] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]295worker1 # [ 0.002915] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]296worker2 # [ 0.002747] Using GB pages for direct mapping297lb # [ 0.002943] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]298worker2 # [ 0.002905] RAMDISK: [mem 0x5e367000-0x5ffcffff]299client # [ 0.002933] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]300worker1 # [ 0.002915] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]301lb # [ 0.002944] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]302worker2 # [ 0.002913] ACPI: Early table checksum verification disabled303worker1 # [ 0.003147] No NUMA configuration found304client # [ 0.002934] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]305lb # [ 0.002944] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]306worker2 # [ 0.002916] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )307client # [ 0.003197] No NUMA configuration found308worker1 # [ 0.003148] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]309lb # [ 0.002945] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]310client # [ 0.003198] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]311worker1 # [ 0.003151] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]312worker2 # [ 0.002920] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)313worker1 # [ 0.005577] Zone ranges:314client # [ 0.003200] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]315lb # [ 0.002945] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]316client # [ 0.005595] Zone ranges:317worker1 # [ 0.005578] DMA [mem 0x0000000000001000-0x0000000000ffffff]318worker2 # [ 0.002924] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)319lb # [ 0.003171] No NUMA configuration found320client # [ 0.005596] DMA [mem 0x0000000000001000-0x0000000000ffffff]321worker1 # [ 0.005580] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]322lb # [ 0.003172] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]323worker1 # [ 0.005581] Normal empty324worker2 # [ 0.002932] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)325client # [ 0.005598] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]326worker1 # [ 0.005582] Device empty327lb # [ 0.003175] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]328client # [ 0.005599] Normal empty329worker2 # [ 0.002934] ACPI: FACS 0x000000005FFE0000 000040330lb # [ 0.005561] Zone ranges:331worker1 # [ 0.005582] Movable zone start for each node332client # [ 0.005600] Device empty333worker1 # [ 0.005583] Early memory node ranges334client # [ 0.005600] Movable zone start for each node335lb # [ 0.005562] DMA [mem 0x0000000000001000-0x0000000000ffffff]336worker2 # [ 0.002935] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)337client # [ 0.005601] Early memory node ranges338worker1 # [ 0.005583] node 0: [mem 0x0000000000001000-0x000000000009efff]339lb # [ 0.005563] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]340lb # [ 0.005565] Normal empty341client # [ 0.005602] node 0: [mem 0x0000000000001000-0x000000000009efff]342worker1 # [ 0.005584] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]343worker2 # [ 0.002937] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)344lb # [ 0.005566] Device empty345client # [ 0.005603] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]346lb # [ 0.005566] Movable zone start for each node347worker1 # [ 0.005585] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]348worker2 # [ 0.002938] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)349lb # [ 0.005567] Early memory node ranges350client # [ 0.005604] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]351worker1 # [ 0.005606] On node 0, zone DMA: 1 pages in unavailable ranges352lb # [ 0.005568] node 0: [mem 0x0000000000001000-0x000000000009efff]353client # [ 0.005627] On node 0, zone DMA: 1 pages in unavailable ranges354worker2 # [ 0.002940] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)355worker1 # [ 0.005898] On node 0, zone DMA: 97 pages in unavailable ranges356lb # [ 0.005569] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]357worker2 # [ 0.002941] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]358worker1 # [ 0.034679] On node 0, zone DMA32: 40 pages in unavailable ranges359lb # [ 0.005570] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]360client # [ 0.005908] On node 0, zone DMA: 97 pages in unavailable ranges361worker1 # [ 0.035140] ACPI: PM-Timer IO Port: 0x608362client # [ 0.034246] On node 0, zone DMA32: 40 pages in unavailable ranges363worker2 # [ 0.002942] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]364lb # [ 0.005590] On node 0, zone DMA: 1 pages in unavailable ranges365worker1 # [ 0.035152] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])366client # [ 0.034712] ACPI: PM-Timer IO Port: 0x608367worker2 # [ 0.002943] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]368client # [ 0.034726] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])369lb # [ 0.005890] On node 0, zone DMA: 97 pages in unavailable ranges370worker1 # [ 0.035180] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23371worker2 # [ 0.002943] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]372client # [ 0.034755] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23373lb # [ 0.034295] On node 0, zone DMA32: 40 pages in unavailable ranges374worker1 # [ 0.035182] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)375lb # [ 0.034765] ACPI: PM-Timer IO Port: 0x608376client # [ 0.034758] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)377worker2 # [ 0.002944] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]378worker1 # [ 0.035184] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)379lb # [ 0.034778] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])380client # [ 0.034760] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)381worker2 # [ 0.002944] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]382worker1 # [ 0.035185] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)383lb # [ 0.034804] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23384client # [ 0.034761] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)385worker2 # [ 0.002945] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]386worker1 # [ 0.035186] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)387lb # [ 0.034807] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)388worker2 # [ 0.003190] No NUMA configuration found389client # [ 0.034763] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)390worker1 # [ 0.035187] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)391lb # [ 0.034809] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)392worker2 # [ 0.003190] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]393client # [ 0.034763] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)394worker1 # [ 0.035190] ACPI: Using ACPI (MADT) for SMP configuration information395worker2 # [ 0.003193] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]396lb # [ 0.034810] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)397worker2 # [ 0.005612] Zone ranges:398client # [ 0.034766] ACPI: Using ACPI (MADT) for SMP configuration information399worker1 # [ 0.035191] ACPI: HPET id: 0x8086a201 base: 0xfed00000400lb # [ 0.034811] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)401client # [ 0.034767] ACPI: HPET id: 0x8086a201 base: 0xfed00000402worker2 # [ 0.005613] DMA [mem 0x0000000000001000-0x0000000000ffffff]403worker1 # [ 0.035195] TSC deadline timer available404client # [ 0.034771] TSC deadline timer available405lb # [ 0.034812] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)406worker1 # [ 0.035210] CPU topo: Max. logical packages: 1407worker2 # [ 0.005615] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]408client # [ 0.034776] CPU topo: Max. logical packages: 1409worker1 # [ 0.035211] CPU topo: Max. logical dies: 1410worker2 # [ 0.005616] Normal empty411lb # [ 0.034814] ACPI: Using ACPI (MADT) for SMP configuration information412worker2 # [ 0.005617] Device empty413client # [ 0.034777] CPU topo: Max. logical dies: 1414worker1 # [ 0.035211] CPU topo: Max. dies per package: 1415lb # [ 0.034816] ACPI: HPET id: 0x8086a201 base: 0xfed00000416worker2 # [ 0.005617] Movable zone start for each node417client # [ 0.034777] CPU topo: Max. dies per package: 1418worker1 # [ 0.035215] CPU topo: Max. threads per core: 1419lb # [ 0.034820] TSC deadline timer available420worker2 # [ 0.005619] Early memory node ranges421client # [ 0.034782] CPU topo: Max. threads per core: 1422worker1 # [ 0.035215] CPU topo: Num. cores per package: 1423lb # [ 0.034824] CPU topo: Max. logical packages: 1424client # [ 0.034783] CPU topo: Num. cores per package: 1425worker2 # [ 0.005619] node 0: [mem 0x0000000000001000-0x000000000009efff]426worker1 # [ 0.035216] CPU topo: Num. threads per package: 1427lb # [ 0.034825] CPU topo: Max. logical dies: 1428client # [ 0.034784] CPU topo: Num. threads per package: 1429worker2 # [ 0.005620] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]430lb # [ 0.034826] CPU topo: Max. dies per package: 1431worker1 # [ 0.035216] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs432client # [ 0.034784] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs433lb # [ 0.034829] CPU topo: Max. threads per core: 1434worker2 # [ 0.005621] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]435worker1 # [ 0.035236] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()436lb # [ 0.034830] CPU topo: Num. cores per package: 1437worker2 # [ 0.005642] On node 0, zone DMA: 1 pages in unavailable ranges438client # [ 0.034808] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()439worker1 # [ 0.035271] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]440lb # [ 0.034830] CPU topo: Num. threads per package: 1441worker2 # [ 0.005921] On node 0, zone DMA: 97 pages in unavailable ranges442client # [ 0.034844] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]443lb # [ 0.034830] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs444worker1 # [ 0.035273] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]445worker2 # [ 0.034444] On node 0, zone DMA32: 40 pages in unavailable ranges446client # [ 0.034845] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]447lb # [ 0.034855] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()448worker2 # [ 0.034903] ACPI: PM-Timer IO Port: 0x608449worker1 # [ 0.035274] [mem 0x60000000-0xafffffff] available for PCI devices450client # [ 0.034847] [mem 0x60000000-0xafffffff] available for PCI devices451worker1 # [ 0.035276] Booting paravirtualized kernel on KVM452worker2 # [ 0.034914] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])453lb # [ 0.034892] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]454client # [ 0.034849] Booting paravirtualized kernel on KVM455worker2 # [ 0.034943] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23456lb # [ 0.034893] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]457worker1 # [ 0.035279] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns458worker2 # [ 0.034946] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)459client # [ 0.034853] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns460lb # [ 0.034895] [mem 0x60000000-0xafffffff] available for PCI devices461worker1 # [ 0.039783] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1462worker2 # [ 0.034948] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)463lb # [ 0.034897] Booting paravirtualized kernel on KVM464client # [ 0.039349] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1465worker1 # [ 0.042402] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152466worker2 # [ 0.034949] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)467client # [ 0.041941] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152468worker1 # [ 0.042446] kvm-guest: PV spinlocks disabled, single CPU469lb # [ 0.034901] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns470worker2 # [ 0.034950] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)471client # [ 0.041987] kvm-guest: PV spinlocks disabled, single CPU472lb # [ 0.039367] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1473worker2 # [ 0.034951] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)474lb # [ 0.041678] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152475worker2 # [ 0.034953] ACPI: Using ACPI (MADT) for SMP configuration information476lb # [ 0.041725] kvm-guest: PV spinlocks disabled, single CPU477worker2 # [ 0.034954] ACPI: HPET id: 0x8086a201 base: 0xfed00000478worker2 # [ 0.034958] TSC deadline timer available479worker2 # [ 0.034962] CPU topo: Max. logical packages: 1480worker1 # [ 0.042447] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/lsi4jlsq3hsv0m08jhhiky65kvydf0mq-nixos-system-worker1-test/init regInfo=/nix/store/bkbgzkbdqfi8lyfww18icml3yhcbhgip-closure-info/registration console=ttyS0,115200n8 console=tty0481worker2 # [ 0.034963] CPU topo: Max. logical dies: 1482client # [ 0.041988] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/abf5y6lmj712ajsgxzvih1228b4c7xja-nixos-system-client-test/init regInfo=/nix/store/lxnzxhnbxr6wirjcj2yznnzr2dljc2zr-closure-info/registration console=ttyS0,115200n8 console=tty0483worker2 # [ 0.034963] CPU topo: Max. dies per package: 1484worker2 # [ 0.034966] CPU topo: Max. threads per core: 1485worker1 # [ 0.042544] Unknown kernel command line parameters "regInfo=/nix/store/bkbgzkbdqfi8lyfww18icml3yhcbhgip-closure-info/registration", will be passed to user space.486client # [ 0.042088] Unknown kernel command line parameters "regInfo=/nix/store/lxnzxhnbxr6wirjcj2yznnzr2dljc2zr-closure-info/registration", will be passed to user space.487worker2 # [ 0.034967] CPU topo: Num. cores per package: 1488worker1 # [ 0.042556] random: crng init done489lb # [ 0.041727] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zfkn25gwyly4vj1wrmysvx6pxf84cpx1-nixos-system-lb-test/init regInfo=/nix/store/4sxfzvml2hymd14mj9miafa9ing1xf50-closure-info/registration console=ttyS0,115200n8 console=tty0490client # [ 0.042101] random: crng init done491worker2 # [ 0.034967] CPU topo: Num. threads per package: 1492worker1 # [ 0.042557] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes493worker2 # [ 0.034968] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs494client # [ 0.042102] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes495worker1 # [ 0.044821] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)496lb # [ 0.041828] Unknown kernel command line parameters "regInfo=/nix/store/4sxfzvml2hymd14mj9miafa9ing1xf50-closure-info/registration", will be passed to user space.497worker2 # [ 0.034987] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()498client # [ 0.044360] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)499lb # [ 0.041842] random: crng init done500worker1 # [ 0.045958] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)501worker2 # [ 0.035023] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]502client # [ 0.045501] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)503lb # [ 0.041843] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes504worker1 # [ 0.045989] Fallback order for Node 0: 0505client # [ 0.045535] Fallback order for Node 0: 0506worker2 # [ 0.035025] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]507worker1 # [ 0.045992] Built 1 zonelists, mobility grouping on. Total pages: 393078508lb # [ 0.044138] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)509client # [ 0.045538] Built 1 zonelists, mobility grouping on. Total pages: 393078510worker1 # [ 0.045993] Policy zone: DMA32511worker2 # [ 0.035026] [mem 0x60000000-0xafffffff] available for PCI devices512client # [ 0.045539] Policy zone: DMA32513lb # [ 0.045562] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)514worker2 # [ 0.035028] Booting paravirtualized kernel on KVM515worker1 # [ 0.048656] mem auto-init: stack:all(zero), heap alloc:on, heap free:off516lb # [ 0.045596] Fallback order for Node 0: 0517client # [ 0.048198] mem auto-init: stack:all(zero), heap alloc:on, heap free:off518worker1 # [ 0.052164] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1519lb # [ 0.045599] Built 1 zonelists, mobility grouping on. Total pages: 393078520client # [ 0.051772] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1521worker2 # [ 0.035031] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns522worker1 # [ 0.056057] allocated 3145728 bytes of page_ext523lb # [ 0.045600] Policy zone: DMA32524client # [ 0.055714] allocated 3145728 bytes of page_ext525worker1 # [ 0.066555] ftrace: allocating 48731 entries in 192 pages526worker2 # [ 0.039512] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1527lb # [ 0.048704] mem auto-init: stack:all(zero), heap alloc:on, heap free:off528client # [ 0.066357] ftrace: allocating 48731 entries in 192 pages529worker1 # [ 0.066557] ftrace: allocated 192 pages with 2 groups530client # [ 0.066359] ftrace: allocated 192 pages with 2 groups531worker1 # [ 0.067457] Dynamic Preempt: lazy532worker2 # [ 0.041827] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152533lb # [ 0.052315] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1534client # [ 0.067285] Dynamic Preempt: lazy535worker2 # [ 0.041871] kvm-guest: PV spinlocks disabled, single CPU536lb # [ 0.055897] allocated 3145728 bytes of page_ext537worker1 # [ 0.067628] rcu: Preemptible hierarchical RCU implementation.538client # [ 0.067438] rcu: Preemptible hierarchical RCU implementation.539worker1 # [ 0.067628] rcu: RCU event tracing is enabled.540lb # [ 0.066508] ftrace: allocating 48731 entries in 192 pages541client # [ 0.067438] rcu: RCU event tracing is enabled.542lb # [ 0.066510] ftrace: allocated 192 pages with 2 groups543worker1 # [ 0.067629] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.544lb # [ 0.067426] Dynamic Preempt: lazy545client # [ 0.067439] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.546worker1 # [ 0.067631] Trampoline variant of Tasks RCU enabled.547client # [ 0.067441] Trampoline variant of Tasks RCU enabled.548lb # [ 0.067571] rcu: Preemptible hierarchical RCU implementation.549worker1 # [ 0.067631] Rude variant of Tasks RCU enabled.550lb # [ 0.067572] rcu: RCU event tracing is enabled.551client # [ 0.067441] Rude variant of Tasks RCU enabled.552worker1 # [ 0.067631] Tracing variant of Tasks RCU enabled.553client # [ 0.067442] Tracing variant of Tasks RCU enabled.554worker2 # [ 0.041872] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3ri1s6dnplxsmxjyiixxklps9krb0xjc-nixos-system-worker2-test/init regInfo=/nix/store/iwy8snd097rhja72kbczfz86qy1vbkfi-closure-info/registration console=ttyS0,115200n8 console=tty0555lb # [ 0.067573] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.556worker1 # [ 0.067632] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.557lb # [ 0.067574] Trampoline variant of Tasks RCU enabled.558client # [ 0.067443] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.559lb # [ 0.067575] Rude variant of Tasks RCU enabled.560worker1 # [ 0.067633] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1561client # [ 0.067443] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1562lb # [ 0.067575] Tracing variant of Tasks RCU enabled.563worker2 # [ 0.041969] Unknown kernel command line parameters "regInfo=/nix/store/iwy8snd097rhja72kbczfz86qy1vbkfi-closure-info/registration", will be passed to user space.564worker2 # [ 0.041981] random: crng init done565worker1 # [ 0.067655] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.566client # [ 0.067506] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.567lb # [ 0.067576] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.568worker2 # [ 0.041982] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes569worker1 # [ 0.067657] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.570lb # [ 0.067576] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1571client # [ 0.067508] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.572worker2 # [ 0.044240] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)573worker1 # [ 0.067658] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.574lb # [ 0.067636] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.575client # [ 0.067509] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.576worker2 # [ 0.045650] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)577worker1 # [ 0.072173] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16578worker2 # [ 0.045682] Fallback order for Node 0: 0579client # [ 0.072027] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16580lb # [ 0.067638] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.581worker1 # [ 0.072493] rcu: srcu_init: Setting srcu_struct sizes based on contention.582worker2 # [ 0.045686] Built 1 zonelists, mobility grouping on. Total pages: 393078583client # [ 0.072312] rcu: srcu_init: Setting srcu_struct sizes based on contention.584worker2 # [ 0.045687] Policy zone: DMA32585lb # [ 0.067639] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.586worker1 # [ 0.072500] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns587worker2 # [ 0.048315] mem auto-init: stack:all(zero), heap alloc:on, heap free:off588lb # [ 0.072489] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16589client # [ 0.072319] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns590worker2 # [ 0.051549] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1591lb # [ 0.072775] rcu: srcu_init: Setting srcu_struct sizes based on contention.592worker1 # [ 0.072610] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)593worker2 # [ 0.055134] allocated 3145728 bytes of page_ext594client # [ 0.072434] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)595worker1 # [ 0.076234] Console: colour VGA+ 80x25596worker2 # [ 0.065547] ftrace: allocating 48731 entries in 192 pages597client # [ 0.076029] Console: colour VGA+ 80x25598worker1 # [ 0.076237] printk: legacy console [tty0] enabled599lb # [ 0.072781] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns600client # [ 0.076033] printk: legacy console [tty0] enabled601worker2 # [ 0.065549] ftrace: allocated 192 pages with 2 groups602worker1 # [ 0.105857] printk: legacy console [ttyS0] enabled603client # [ 0.106013] printk: legacy console [ttyS0] enabled604worker2 # [ 0.066475] Dynamic Preempt: lazy605lb # [ 0.072895] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)606worker1 # [ 0.203329] ACPI: Core revision 20250807607worker2 # [ 0.066637] rcu: Preemptible hierarchical RCU implementation.608lb # [ 0.076468] Console: colour VGA+ 80x25609client # [ 0.202629] ACPI: Core revision 20250807610worker2 # [ 0.066637] rcu: RCU event tracing is enabled.611lb # [ 0.076471] printk: legacy console [tty0] enabled612lb # [ 0.105873] printk: legacy console [ttyS0] enabled613worker2 # [ 0.066638] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.614worker1 # [ 0.204179] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns615client # [ 0.203554] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns616lb # [ 0.201985] ACPI: Core revision 20250807617worker2 # [ 0.066640] Trampoline variant of Tasks RCU enabled.618worker1 # [ 0.205752] APIC: Switch to symmetric I/O mode setup619worker2 # [ 0.066640] Rude variant of Tasks RCU enabled.620client # [ 0.205149] APIC: Switch to symmetric I/O mode setup621worker1 # [ 0.206702] x2apic enabled622worker2 # [ 0.066640] Tracing variant of Tasks RCU enabled.623client # [ 0.206105] x2apic enabled624lb # [ 0.202852] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns625worker2 # [ 0.066641] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.626worker1 # [ 0.207461] APIC: Switched APIC routing to: physical x2apic627lb # [ 0.204371] APIC: Switch to symmetric I/O mode setup628client # [ 0.206871] APIC: Switched APIC routing to: physical x2apic629worker2 # [ 0.066642] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1630lb # [ 0.205314] x2apic enabled631worker2 # [ 0.066658] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.632worker1 # [ 0.209313] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1633lb # [ 0.206065] APIC: Switched APIC routing to: physical x2apic634client # [ 0.208665] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1635worker2 # [ 0.066660] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.636worker1 # [ 0.210320] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns637worker2 # [ 0.066661] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.638client # [ 0.209614] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns639lb # [ 0.207836] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1640worker2 # [ 0.071527] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16641worker1 # [ 0.212016] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)642client # [ 0.211238] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)643worker2 # [ 0.071806] rcu: srcu_init: Setting srcu_struct sizes based on contention.644lb # [ 0.208816] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns645worker1 # [ 0.213103] x86/cpu: User Mode Instruction Prevention (UMIP) activated646client # [ 0.212325] x86/cpu: User Mode Instruction Prevention (UMIP) activated647worker2 # [ 0.071813] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns648lb # [ 0.210457] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)649worker1 # [ 0.214138] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127650client # [ 0.213365] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127651worker2 # [ 0.071926] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)652worker2 # [ 0.075524] Console: colour VGA+ 80x25653lb # [ 0.211540] x86/cpu: User Mode Instruction Prevention (UMIP) activated654worker1 # [ 0.215700] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0655client # [ 0.214235] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0656worker2 # [ 0.075527] printk: legacy console [tty0] enabled657worker2 # [ 0.105348] printk: legacy console [ttyS0] enabled658lb # [ 0.212642] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127659worker1 # [ 0.216769] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto660worker2 # [ 0.202871] ACPI: Core revision 20250807661client # [ 0.215249] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto662lb # [ 0.214131] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0663worker1 # [ 0.218013] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl664client # [ 0.216235] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl665worker2 # [ 0.203755] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns666lb # [ 0.214458] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto667worker1 # [ 0.219013] Transient Scheduler Attacks: Vulnerable: No microcode668client # [ 0.217235] Transient Scheduler Attacks: Vulnerable: No microcode669worker2 # [ 0.205288] APIC: Switch to symmetric I/O mode setup670worker1 # [ 0.220743] Spectre V2 : Mitigation: Enhanced / Automatic IBRS671worker2 # [ 0.206226] x2apic enabled672client # [ 0.218235] Spectre V2 : Mitigation: Enhanced / Automatic IBRS673lb # [ 0.216455] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl674client # [ 0.219235] Speculative Return Stack Overflow: Mitigation: Safe RET675worker1 # [ 0.221694] Speculative Return Stack Overflow: Mitigation: Safe RET676worker2 # [ 0.206968] APIC: Switched APIC routing to: physical x2apic677lb # [ 0.217455] Transient Scheduler Attacks: Vulnerable: No microcode678lb # [ 0.218454] Spectre V2 : Mitigation: Enhanced / Automatic IBRS679worker2 # [ 0.208776] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1680lb # [ 0.219454] Speculative Return Stack Overflow: Mitigation: Safe RET681client # [ 0.220235] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization682worker2 # [ 0.209784] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns683worker1 # [ 0.222013] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization684client # [ 0.222243] Spectre V2 : Enabling IBPB for BPF685worker1 # [ 0.224021] Spectre V2 : Enabling IBPB for BPF686worker2 # [ 0.211439] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)687client # [ 0.222955] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier688lb # [ 0.220454] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization689worker1 # [ 0.225014] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier690worker2 # [ 0.212518] x86/cpu: User Mode Instruction Prevention (UMIP) activated691client # [ 0.224236] active return thunk: srso_alias_return_thunk692lb # [ 0.222462] Spectre V2 : Enabling IBPB for BPF693worker1 # [ 0.226014] active return thunk: srso_alias_return_thunk694worker2 # [ 0.213546] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127695client # [ 0.225264] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'696lb # [ 0.223455] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier697worker1 # [ 0.227687] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'698worker2 # [ 0.214427] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0699client # [ 0.226235] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'700lb # [ 0.224455] active return thunk: srso_alias_return_thunk701worker1 # [ 0.228898] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'702client # [ 0.227235] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'703worker2 # [ 0.215431] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto704worker1 # [ 0.229764] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'705lb # [ 0.226107] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'706client # [ 0.228235] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'707worker1 # [ 0.230759] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'708worker2 # [ 0.217427] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl709lb # [ 0.226455] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'710client # [ 0.229235] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'711worker1 # [ 0.231769] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'712worker2 # [ 0.218427] Transient Scheduler Attacks: Vulnerable: No microcode713lb # [ 0.228187] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'714client # [ 0.230235] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'715worker1 # [ 0.232740] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'716worker2 # [ 0.219426] Spectre V2 : Mitigation: Enhanced / Automatic IBRS717lb # [ 0.229184] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'718client # [ 0.231235] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'719lb # [ 0.230195] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'720worker2 # [ 0.220427] Speculative Return Stack Overflow: Mitigation: Safe RET721worker1 # [ 0.233817] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'722client # [ 0.232235] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256723lb # [ 0.230454] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'724worker1 # [ 0.235013] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256725client # [ 0.233235] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64726worker1 # [ 0.236013] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64727lb # [ 0.231454] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'728client # [ 0.234235] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512729worker1 # [ 0.237012] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512730lb # [ 0.233455] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256731client # [ 0.235235] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024732worker2 # [ 0.221426] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization733worker1 # [ 0.238012] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024734lb # [ 0.234454] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64735client # [ 0.236235] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8736worker2 # [ 0.223434] Spectre V2 : Enabling IBPB for BPF737worker1 # [ 0.239013] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8738lb # [ 0.235373] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512739client # [ 0.237235] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.740worker2 # [ 0.224427] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier741lb # [ 0.236183] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024742worker1 # [ 0.240013] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.743worker2 # [ 0.225427] active return thunk: srso_alias_return_thunk744lb # [ 0.237162] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8745worker2 # [ 0.226448] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'746lb # [ 0.238186] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.747worker2 # [ 0.227426] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'748worker2 # [ 0.229191] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'749worker2 # [ 0.230198] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'750worker2 # [ 0.231205] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'751worker2 # [ 0.232182] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'752worker2 # [ 0.233230] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'753worker2 # [ 0.234427] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256754worker2 # [ 0.235427] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64755worker2 # [ 0.236426] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512756worker2 # [ 0.237426] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024757worker2 # [ 0.238427] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8758worker2 # [ 0.239426] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.759client # [ 0.272432] Freeing SMP alternatives memory: 44K760worker1 # [ 0.275268] Freeing SMP alternatives memory: 44K761client # [ 0.273222] pid_max: default: 32768 minimum: 301762worker1 # [ 0.276016] pid_max: default: 32768 minimum: 301763client # [ 0.273888] LSM: initializing lsm=capability,landlock,yama,bpf,ima764worker1 # [ 0.276874] LSM: initializing lsm=capability,landlock,yama,bpf,ima765client # [ 0.275089] landlock: Up and running.766lb # [ 0.273710] Freeing SMP alternatives memory: 44K767client # [ 0.275671] Yama: becoming mindful.768worker1 # [ 0.278043] landlock: Up and running.769lb # [ 0.274458] pid_max: default: 32768 minimum: 301770worker1 # [ 0.278691] Yama: becoming mindful.771client # [ 0.276452] LSM support for eBPF active772lb # [ 0.275292] LSM: initializing lsm=capability,landlock,yama,bpf,ima773worker1 # [ 0.279239] LSM support for eBPF active774lb # [ 0.276298] landlock: Up and running.775client # [ 0.277343] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)776lb # [ 0.276901] Yama: becoming mindful.777worker1 # [ 0.280134] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)778client # [ 0.278275] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)779lb # [ 0.277678] LSM support for eBPF active780worker1 # [ 0.281055] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)781lb # [ 0.278584] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)782client # [ 0.280907] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)783lb # [ 0.279497] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)784worker1 # [ 0.284073] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)785client # [ 0.281840] Performance Events: Fam17h+ core perfctr, AMD PMU driver.786client # [ 0.282240] ... version: 2787worker1 # [ 0.285586] Performance Events: Fam17h+ core perfctr, AMD PMU driver.788lb # [ 0.282276] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)789client # [ 0.282947] ... bit width: 48790worker1 # [ 0.286023] ... version: 2791client # [ 0.283238] ... generic counters: 6792worker1 # [ 0.286763] ... bit width: 48793lb # [ 0.283036] Performance Events: Fam17h+ core perfctr, AMD PMU driver.794client # [ 0.283934] ... generic bitmap: 000000000000003f795worker1 # [ 0.287016] ... generic counters: 6796lb # [ 0.283459] ... version: 2797worker2 # [ 0.274191] Freeing SMP alternatives memory: 44K798client # [ 0.284285] ... fixed-purpose counters: 0799lb # [ 0.284139] ... bit width: 48800worker1 # [ 0.287743] ... generic bitmap: 000000000000003f801worker2 # [ 0.274968] pid_max: default: 32768 minimum: 301802client # [ 0.284970] ... fixed-purpose bitmap: 0000000000000000803lb # [ 0.284457] ... generic counters: 6804worker1 # [ 0.288015] ... fixed-purpose counters: 0805client # [ 0.285238] ... value mask: 0000ffffffffffff806worker2 # [ 0.275524] LSM: initializing lsm=capability,landlock,yama,bpf,ima807lb # [ 0.285136] ... generic bitmap: 000000000000003f808worker1 # [ 0.288724] ... fixed-purpose bitmap: 0000000000000000809worker2 # [ 0.276550] landlock: Up and running.810client # [ 0.286100] ... max period: 00007fffffffffff811lb # [ 0.285467] ... fixed-purpose counters: 0812worker1 # [ 0.289016] ... value mask: 0000ffffffffffff813worker2 # [ 0.277427] Yama: becoming mindful.814client # [ 0.286897] ... global_ctrl mask: 000000000000003f815lb # [ 0.286145] ... fixed-purpose bitmap: 0000000000000000816worker1 # [ 0.289866] ... max period: 00007fffffffffff817worker2 # [ 0.278215] LSM support for eBPF active818client # [ 0.287373] signal: max sigframe size: 3376819lb # [ 0.286456] ... value mask: 0000ffffffffffff820worker1 # [ 0.290666] ... global_ctrl mask: 000000000000003f821client # [ 0.288145] rcu: Hierarchical SRCU implementation.822worker2 # [ 0.278987] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)823lb # [ 0.287331] ... max period: 00007fffffffffff824worker1 # [ 0.291143] signal: max sigframe size: 3376825client # [ 0.288787] rcu: Max phase no-delay instances is 400.826lb # [ 0.288122] ... global_ctrl mask: 000000000000003f827worker1 # [ 0.291970] rcu: Hierarchical SRCU implementation.828worker2 # [ 0.279468] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)829lb # [ 0.288580] signal: max sigframe size: 3376830worker1 # [ 0.292598] rcu: Max phase no-delay instances is 400.831lb # [ 0.289400] rcu: Hierarchical SRCU implementation.832lb # [ 0.290039] rcu: Max phase no-delay instances is 400.833worker2 # [ 0.282591] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)834worker2 # [ 0.284054] Performance Events: Fam17h+ core perfctr, AMD PMU driver.835worker2 # [ 0.284435] ... version: 2836client # [ 0.293823] smp: Bringing up secondary CPUs ...837worker2 # [ 0.285106] ... bit width: 48838client # [ 0.294251] smp: Brought up 1 node, 1 CPU839worker2 # [ 0.285429] ... generic counters: 6840worker1 # [ 0.297626] smp: Bringing up secondary CPUs ...841client # [ 0.294916] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)842worker1 # [ 0.298028] smp: Brought up 1 node, 1 CPU843worker2 # [ 0.286121] ... generic bitmap: 000000000000003f844worker2 # [ 0.286429] ... fixed-purpose counters: 0845lb # [ 0.295105] smp: Bringing up secondary CPUs ...846worker1 # [ 0.298699] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)847lb # [ 0.295472] smp: Brought up 1 node, 1 CPU848worker2 # [ 0.287086] ... fixed-purpose bitmap: 0000000000000000849client # [ 0.295456] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)850worker2 # [ 0.287430] ... value mask: 0000ffffffffffff851lb # [ 0.296123] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)852client # [ 0.296525] devtmpfs: initialized853worker2 # [ 0.288296] ... max period: 00007fffffffffff854worker1 # [ 0.299228] Memory: 1454580K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)855client # [ 0.297295] x86/mm: Memory block size: 128MB856worker1 # [ 0.300294] devtmpfs: initialized857worker2 # [ 0.289091] ... global_ctrl mask: 000000000000003f858lb # [ 0.296626] Memory: 1454544K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)859worker2 # [ 0.289542] signal: max sigframe size: 3376860worker1 # [ 0.301095] x86/mm: Memory block size: 128MB861lb # [ 0.297784] devtmpfs: initialized862worker2 # [ 0.290324] rcu: Hierarchical SRCU implementation.863client # [ 0.299051] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)864lb # [ 0.298595] x86/mm: Memory block size: 128MB865worker2 # [ 0.290977] rcu: Max phase no-delay instances is 400.866client # [ 0.300161] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).867worker1 # [ 0.302945] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)868client # [ 0.301337] pinctrl core: initialized pinctrl subsystem869lb # [ 0.300302] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)870worker1 # [ 0.303937] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).871client # [ 0.302490] PM: RTC time: 12:22:01, date: 2026-09-20872worker1 # [ 0.305107] pinctrl core: initialized pinctrl subsystem873lb # [ 0.301376] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).874worker1 # [ 0.306244] PM: RTC time: 12:22:01, date: 2026-09-20875lb # [ 0.302542] pinctrl core: initialized pinctrl subsystem876worker2 # [ 0.295999] smp: Bringing up secondary CPUs ...877lb # [ 0.303692] PM: RTC time: 12:22:01, date: 2026-09-20878worker2 # [ 0.296444] smp: Brought up 1 node, 1 CPU879client # [ 0.306474] NET: Registered PF_NETLINK/PF_ROUTE protocol family880worker2 # [ 0.297122] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)881client # [ 0.307781] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations882worker1 # [ 0.310257] NET: Registered PF_NETLINK/PF_ROUTE protocol family883worker2 # [ 0.297613] Memory: 1454568K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)884lb # [ 0.307390] NET: Registered PF_NETLINK/PF_ROUTE protocol family885client # [ 0.308263] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations886worker1 # [ 0.311534] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations887worker2 # [ 0.298705] devtmpfs: initialized888worker2 # [ 0.299532] x86/mm: Memory block size: 128MB889lb # [ 0.308690] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations890client # [ 0.309533] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations891worker1 # [ 0.312040] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations892client # [ 0.310255] audit: initializing netlink subsys (disabled)893lb # [ 0.309481] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations894worker1 # [ 0.313303] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations895worker2 # [ 0.301251] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)896client # [ 0.311239] audit: type=2000 audit(1789906922.316:1): state=initialized audit_enabled=0 res=1897worker1 # [ 0.314024] audit: initializing netlink subsys (disabled)898lb # [ 0.310750] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations899worker2 # [ 0.302332] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).900client # [ 0.312348] thermal_sys: Registered thermal governor 'fair_share'901lb # [ 0.311468] audit: initializing netlink subsys (disabled)902worker1 # [ 0.315088] thermal_sys: Registered thermal governor 'fair_share'903worker2 # [ 0.303530] pinctrl core: initialized pinctrl subsystem904client # [ 0.312351] thermal_sys: Registered thermal governor 'bang_bang'905worker1 # [ 0.315091] thermal_sys: Registered thermal governor 'bang_bang'906lb # [ 0.312588] thermal_sys: Registered thermal governor 'fair_share'907client # [ 0.313239] thermal_sys: Registered thermal governor 'step_wise'908worker2 # [ 0.304632] PM: RTC time: 12:22:01, date: 2026-09-20909worker1 # [ 0.316016] thermal_sys: Registered thermal governor 'step_wise'910lb # [ 0.312591] thermal_sys: Registered thermal governor 'bang_bang'911client # [ 0.314199] thermal_sys: Registered thermal governor 'user_space'912worker1 # [ 0.316948] thermal_sys: Registered thermal governor 'user_space'913lb # [ 0.313458] thermal_sys: Registered thermal governor 'step_wise'914client # [ 0.314987] thermal_sys: Registered thermal governor 'power_allocator'915lb # [ 0.314395] thermal_sys: Registered thermal governor 'user_space'916worker1 # [ 0.317705] audit: type=2000 audit(1789906922.318:1): state=initialized audit_enabled=0 res=1917client # [ 0.315250] cpuidle: using governor menu918worker1 # [ 0.319018] thermal_sys: Registered thermal governor 'power_allocator'919lb # [ 0.315161] audit: type=2000 audit(1789906922.321:1): state=initialized audit_enabled=0 res=1920worker2 # [ 0.308415] NET: Registered PF_NETLINK/PF_ROUTE protocol family921worker1 # [ 0.319033] cpuidle: using governor menu922client # [ 0.317486] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5923lb # [ 0.316460] thermal_sys: Registered thermal governor 'power_allocator'924lb # [ 0.316473] cpuidle: using governor menu925worker2 # [ 0.309639] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations926worker1 # [ 0.321233] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5927client # [ 0.318520] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]928worker2 # [ 0.310461] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations929lb # [ 0.318671] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5930client # [ 0.319241] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry931worker1 # [ 0.322231] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]932client # [ 0.320249] PCI: Using configuration type 1 for base access933worker2 # [ 0.311720] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations934worker1 # [ 0.323018] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry935lb # [ 0.319691] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]936worker2 # [ 0.312440] audit: initializing netlink subsys (disabled)937worker1 # [ 0.324027] PCI: Using configuration type 1 for base access938lb # [ 0.320461] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry939client # [ 0.321377] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.940lb # [ 0.321469] PCI: Using configuration type 1 for base access941worker2 # [ 0.313585] thermal_sys: Registered thermal governor 'fair_share'942worker1 # [ 0.325089] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.943worker2 # [ 0.313588] thermal_sys: Registered thermal governor 'bang_bang'944lb # [ 0.322538] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.945worker2 # [ 0.314430] thermal_sys: Registered thermal governor 'step_wise'946worker2 # [ 0.315351] thermal_sys: Registered thermal governor 'user_space'947worker2 # [ 0.316135] audit: type=2000 audit(1789906922.331:1): state=initialized audit_enabled=0 res=1948worker2 # [ 0.317439] thermal_sys: Registered thermal governor 'power_allocator'949worker1 # [ 0.330283] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages950worker2 # [ 0.317466] cpuidle: using governor menu951client # [ 0.328264] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages952worker1 # [ 0.331016] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page953worker2 # [ 0.319625] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5954client # [ 0.329239] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page955lb # [ 0.329715] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages956worker2 # [ 0.320665] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]957lb # [ 0.330458] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page958worker2 # [ 0.321432] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry959worker2 # [ 0.322442] PCI: Using configuration type 1 for base access960worker1 # [ 0.336016] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages961worker2 # [ 0.323496] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.962client # [ 0.334239] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages963worker1 # [ 0.337015] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page964client # [ 0.335238] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page965lb # [ 0.335458] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages966lb # [ 0.336457] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page967worker2 # [ 0.328703] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages968worker2 # [ 0.329431] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page969worker1 # [ 0.347414] ACPI: Added _OSI(Module Device)970worker2 # [ 0.334430] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages971worker1 # [ 0.348025] ACPI: Added _OSI(Processor Device)972lb # [ 0.345118] ACPI: Added _OSI(Module Device)973client # [ 0.346516] ACPI: Added _OSI(Module Device)974worker1 # [ 0.348768] ACPI: Added _OSI(Processor Aggregator Device)975worker2 # [ 0.335430] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page976lb # [ 0.345458] ACPI: Added _OSI(Processor Device)977client # [ 0.347231] ACPI: Added _OSI(Processor Device)978lb # [ 0.346199] ACPI: Added _OSI(Processor Aggregator Device)979client # [ 0.348032] ACPI: Added _OSI(Processor Aggregator Device)980lb # [ 0.352995] ACPI: 1 ACPI AML tables successfully acquired and loaded981worker1 # [ 0.357584] ACPI: 1 ACPI AML tables successfully acquired and loaded982worker2 # [ 0.345845] ACPI: Added _OSI(Module Device)983client # [ 0.356794] ACPI: 1 ACPI AML tables successfully acquired and loaded984worker2 # [ 0.346431] ACPI: Added _OSI(Processor Device)985worker2 # [ 0.347135] ACPI: Added _OSI(Processor Aggregator Device)986client # [ 0.358172] ACPI: Interpreter enabled987lb # [ 0.356426] ACPI: Interpreter enabled988client # [ 0.358706] ACPI: PM: (supports S0 S3 S4 S5)989lb # [ 0.356927] ACPI: PM: (supports S0 S3 S4 S5)990worker1 # [ 0.361424] ACPI: Interpreter enabled991client # [ 0.359238] ACPI: Using IOAPIC for interrupt routing992lb # [ 0.357457] ACPI: Using IOAPIC for interrupt routing993worker1 # [ 0.362048] ACPI: PM: (supports S0 S3 S4 S5)994client # [ 0.360115] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug995worker1 # [ 0.362792] ACPI: Using IOAPIC for interrupt routing996lb # [ 0.358376] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug997worker1 # [ 0.363089] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug998worker1 # [ 0.364016] PCI: Using E820 reservations for host bridge windows999client # [ 0.365239] PCI: Using E820 reservations for host bridge windows1000lb # [ 0.363457] PCI: Using E820 reservations for host bridge windows1001worker1 # [ 0.367186] ACPI: Enabled 2 GPEs in block 00 to 3F1002client # [ 0.366366] ACPI: Enabled 2 GPEs in block 00 to 3F1003worker2 # [ 0.356010] ACPI: 1 ACPI AML tables successfully acquired and loaded1004lb # [ 0.364563] ACPI: Enabled 2 GPEs in block 00 to 3F1005worker2 # [ 0.359837] ACPI: Interpreter enabled1006worker2 # [ 0.360446] ACPI: PM: (supports S0 S3 S4 S5)1007worker2 # [ 0.361143] ACPI: Using IOAPIC for interrupt routing1008worker2 # [ 0.361507] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1009client # [ 0.374110] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1010worker2 # [ 0.362430] PCI: Using E820 reservations for host bridge windows1011worker1 # [ 0.376030] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1012lb # [ 0.373163] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1013client # [ 0.375028] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1014client # [ 0.376314] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1015worker1 # [ 0.377731] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1016lb # [ 0.373996] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1017worker2 # [ 0.365503] ACPI: Enabled 2 GPEs in block 00 to 3F1018client # [ 0.377363] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1019worker1 # [ 0.379093] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1020lb # [ 0.374541] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1021client # [ 0.378615] PCI host bridge to bus 0000:001022worker1 # [ 0.380138] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1023lb # [ 0.375580] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1024client # [ 0.379242] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1025worker1 # [ 0.381395] PCI host bridge to bus 0000:001026lb # [ 0.376834] PCI host bridge to bus 0000:001027client # [ 0.380238] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1028worker1 # [ 0.382020] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1029lb # [ 0.377462] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1030client # [ 0.381237] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1031worker1 # [ 0.383015] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1032lb # [ 0.378457] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1033client # [ 0.382237] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1034worker1 # [ 0.384015] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1035lb # [ 0.379457] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1036client # [ 0.383238] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1037worker1 # [ 0.385015] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1038lb # [ 0.380457] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1039worker2 # [ 0.374165] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1040client # [ 0.384238] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1041worker1 # [ 0.386015] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1042lb # [ 0.381457] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1043client # [ 0.385239] pci_bus 0000:00: root bus resource [bus 00-ff]1044worker1 # [ 0.387015] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1045worker2 # [ 0.374436] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1046lb # [ 0.382457] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1047worker1 # [ 0.388026] pci_bus 0000:00: root bus resource [bus 00-ff]1048lb # [ 0.383457] pci_bus 0000:00: root bus resource [bus 00-ff]1049client # [ 0.386211] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1050worker2 # [ 0.376074] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1051worker1 # [ 0.389017] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1052lb # [ 0.384459] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1053client # [ 0.387647] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1054worker2 # [ 0.376552] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1055worker2 # [ 0.377786] PCI host bridge to bus 0000:001056worker1 # [ 0.390471] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1057lb # [ 0.385919] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1058worker2 # [ 0.378434] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1059worker2 # [ 0.379429] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1060worker2 # [ 0.380429] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1061worker2 # [ 0.381429] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1062worker2 # [ 0.382430] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1063worker2 # [ 0.383430] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1064client # [ 0.390310] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1065worker2 # [ 0.384430] pci_bus 0000:00: root bus resource [bus 00-ff]1066client # [ 0.391375] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1067lb # [ 0.388551] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1068worker1 # [ 0.393175] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1069worker2 # [ 0.385419] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1070worker1 # [ 0.394027] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1071lb # [ 0.389469] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1072client # [ 0.392260] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1073worker2 # [ 0.386831] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1074worker1 # [ 0.394990] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1075lb # [ 0.390423] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1076client # [ 0.393627] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1077worker1 # [ 0.396319] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1078lb # [ 0.391830] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1079client # [ 0.394982] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1080worker1 # [ 0.397744] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1081lb # [ 0.393212] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1082client # [ 0.398255] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1083worker1 # [ 0.400049] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1084client # [ 0.399153] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1085lb # [ 0.396489] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1086worker1 # [ 0.400908] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1087client # [ 0.399972] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1088lb # [ 0.397336] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1089worker2 # [ 0.389509] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1090worker1 # [ 0.401738] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1091lb # [ 0.398203] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1092client # [ 0.400243] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1093worker2 # [ 0.390442] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1094worker1 # [ 0.402021] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1095lb # [ 0.398463] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1096worker2 # [ 0.391379] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1097client # [ 0.401785] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1098worker1 # [ 0.403565] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1099lb # [ 0.400046] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1100worker2 # [ 0.392803] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1101client # [ 0.403245] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1102worker1 # [ 0.405023] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1103worker2 # [ 0.394177] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1104client # [ 0.404165] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1105worker1 # [ 0.405851] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1106lb # [ 0.402489] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1107client # [ 0.404957] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1108lb # [ 0.403346] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1109worker1 # [ 0.406761] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1110lb # [ 0.404229] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1111client # [ 0.405807] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1112worker2 # [ 0.396455] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1113worker1 # [ 0.407593] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1114worker2 # [ 0.397265] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1115lb # [ 0.405901] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1116worker2 # [ 0.398135] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1117worker2 # [ 0.398435] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1118client # [ 0.408245] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1119client # [ 0.409113] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1120worker1 # [ 0.410354] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1121worker2 # [ 0.400008] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1122lb # [ 0.408493] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1123worker1 # [ 0.411022] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1124client # [ 0.409981] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1125lb # [ 0.409348] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1126worker1 # [ 0.411931] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1127client # [ 0.410778] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1128worker2 # [ 0.401453] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1129lb # [ 0.410239] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1130worker2 # [ 0.402288] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1131worker1 # [ 0.413414] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1132lb # [ 0.411873] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1133worker2 # [ 0.403157] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1134client # [ 0.413158] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1135worker1 # [ 0.415033] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1136client # [ 0.413863] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1137worker2 # [ 0.403989] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1138worker1 # [ 0.415863] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1139lb # [ 0.414345] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1140worker1 # [ 0.416749] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1141client # [ 0.414268] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1142lb # [ 0.415095] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1143worker2 # [ 0.406437] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1144worker1 # [ 0.417582] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1145client # [ 0.415820] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1146lb # [ 0.415478] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1147worker2 # [ 0.407244] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1148worker2 # [ 0.408166] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1149lb # [ 0.417008] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1150worker1 # [ 0.419035] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1151client # [ 0.417254] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1152worker1 # [ 0.419916] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1153client # [ 0.418131] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1154worker2 # [ 0.409004] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1155worker1 # [ 0.420760] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1156client # [ 0.418989] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1157lb # [ 0.419261] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1158lb # [ 0.420129] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1159worker2 # [ 0.410467] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1160worker1 # [ 0.421589] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1161client # [ 0.419840] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1162worker2 # [ 0.411260] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1163lb # [ 0.420479] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1164worker2 # [ 0.412126] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1165lb # [ 0.422043] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1166worker1 # [ 0.424039] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1167worker2 # [ 0.413412] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1168worker1 # [ 0.425403] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1169client # [ 0.422595] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1170client # [ 0.423872] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1171worker1 # [ 0.426050] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1172worker2 # [ 0.415455] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1173lb # [ 0.424464] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1174client # [ 0.424260] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1175worker2 # [ 0.416294] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1176lb # [ 0.425303] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1177worker1 # [ 0.427625] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1178worker2 # [ 0.417150] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1179lb # [ 0.426166] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1180client # [ 0.425814] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1181worker1 # [ 0.429043] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1182worker2 # [ 0.418047] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1183lb # [ 0.427070] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1184worker1 # [ 0.429926] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1185client # [ 0.427246] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1186client # [ 0.428087] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1187worker1 # [ 0.430760] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1188lb # [ 0.428486] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1189worker1 # [ 0.431021] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1190client # [ 0.429001] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1191lb # [ 0.429350] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1192client # [ 0.430064] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1193worker2 # [ 0.420661] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1194worker1 # [ 0.432585] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1195worker2 # [ 0.421436] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1196lb # [ 0.430232] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1197worker2 # [ 0.422374] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1198client # [ 0.431784] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1199lb # [ 0.431487] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1200worker1 # [ 0.434890] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1201worker1 # [ 0.435755] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1202worker2 # [ 0.423847] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1203client # [ 0.433251] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1204lb # [ 0.433007] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1205client # [ 0.434193] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1206worker1 # [ 0.436563] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1207worker2 # [ 0.425437] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1208lb # [ 0.434491] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1209worker2 # [ 0.426285] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1210client # [ 0.435645] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1211lb # [ 0.435479] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1212worker2 # [ 0.427152] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1213worker1 # [ 0.438032] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1214worker2 # [ 0.427435] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1215worker1 # [ 0.438893] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1216lb # [ 0.436994] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1217client # [ 0.438088] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1218worker1 # [ 0.439748] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1219worker2 # [ 0.429430] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1220client # [ 0.438879] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1221worker1 # [ 0.440565] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1222client # [ 0.439260] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1223lb # [ 0.438509] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1224worker2 # [ 0.431177] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1225lb # [ 0.440108] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1226worker2 # [ 0.431452] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1227worker1 # [ 0.442033] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1228client # [ 0.440799] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1229lb # [ 0.440479] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1230worker1 # [ 0.442870] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1231worker2 # [ 0.432958] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1232worker1 # [ 0.443751] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1233client # [ 0.442246] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1234lb # [ 0.442007] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1235client # [ 0.443112] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1236worker2 # [ 0.434437] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1237worker1 # [ 0.444574] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1238client # [ 0.444016] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1239worker2 # [ 0.435284] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1240lb # [ 0.443465] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1241worker1 # [ 0.445653] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1242lb # [ 0.444308] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1243worker2 # [ 0.436160] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1244client # [ 0.445631] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1245lb # [ 0.445175] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1246worker1 # [ 0.446222] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1247worker2 # [ 0.436990] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1248client # [ 0.447254] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1249worker1 # [ 0.447564] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1250lb # [ 0.446043] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1251worker2 # [ 0.438453] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1252client # [ 0.448339] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1253worker2 # [ 0.439269] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1254lb # [ 0.447158] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1255client # [ 0.449926] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1256worker2 # [ 0.440137] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1257lb # [ 0.447669] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1258worker2 # [ 0.441009] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1259lb # [ 0.449161] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1260worker2 # [ 0.442054] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1261worker2 # [ 0.442628] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1262worker2 # [ 0.443950] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1263worker1 # [ 0.448208] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1264worker1 # [ 0.450532] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1265worker1 # [ 0.451246] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1266client # [ 0.450463] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1267worker1 # [ 0.452554] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1268client # [ 0.452894] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1269lb # [ 0.449650] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1270client # [ 0.453512] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1271worker1 # [ 0.453293] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1272lb # [ 0.452121] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1273worker1 # [ 0.454314] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1274client # [ 0.454987] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1275lb # [ 0.452692] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1276worker1 # [ 0.455286] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1277client # [ 0.456217] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1278worker2 # [ 0.444636] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1279lb # [ 0.454091] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1280worker1 # [ 0.456849] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1281worker2 # [ 0.446936] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1282client # [ 0.457514] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1283worker1 # [ 0.457648] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1284lb # [ 0.454720] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1285worker2 # [ 0.447705] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1286client # [ 0.458482] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1287worker1 # [ 0.458328] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1288lb # [ 0.455751] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1289worker2 # [ 0.448987] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1290client # [ 0.460254] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1291worker1 # [ 0.459564] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1292lb # [ 0.456724] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1293client # [ 0.461090] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1294worker2 # [ 0.449652] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1295lb # [ 0.458458] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1296client # [ 0.462284] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1297worker2 # [ 0.450717] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1298lb # [ 0.459310] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1299worker1 # [ 0.463200] ACPI: PCI: Interrupt link LNKA configured for IRQ 101300worker2 # [ 0.451701] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1301client # [ 0.463946] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1302worker1 # [ 0.464121] ACPI: PCI: Interrupt link LNKB configured for IRQ 101303lb # [ 0.460775] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1304worker2 # [ 0.453244] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1305worker1 # [ 0.465122] ACPI: PCI: Interrupt link LNKC configured for IRQ 111306worker2 # [ 0.454065] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1307lb # [ 0.462152] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1308worker1 # [ 0.466124] ACPI: PCI: Interrupt link LNKD configured for IRQ 111309client # [ 0.467214] ACPI: PCI: Interrupt link LNKA configured for IRQ 101310worker2 # [ 0.454748] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1311worker1 # [ 0.467112] ACPI: PCI: Interrupt link LNKE configured for IRQ 101312client # [ 0.468088] ACPI: PCI: Interrupt link LNKB configured for IRQ 101313worker1 # [ 0.468112] ACPI: PCI: Interrupt link LNKF configured for IRQ 101314worker2 # [ 0.455988] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1315client # [ 0.469087] ACPI: PCI: Interrupt link LNKC configured for IRQ 111316worker1 # [ 0.469116] ACPI: PCI: Interrupt link LNKG configured for IRQ 111317lb # [ 0.465398] ACPI: PCI: Interrupt link LNKA configured for IRQ 101318client # [ 0.470100] ACPI: PCI: Interrupt link LNKD configured for IRQ 111319worker1 # [ 0.470114] ACPI: PCI: Interrupt link LNKH configured for IRQ 111320lb # [ 0.466318] ACPI: PCI: Interrupt link LNKB configured for IRQ 101321client # [ 0.471101] ACPI: PCI: Interrupt link LNKE configured for IRQ 101322worker1 # [ 0.471052] ACPI: PCI: Interrupt link GSIA configured for IRQ 161323lb # [ 0.467291] ACPI: PCI: Interrupt link LNKC configured for IRQ 111324worker1 # [ 0.472032] ACPI: PCI: Interrupt link GSIB configured for IRQ 171325client # [ 0.472067] ACPI: PCI: Interrupt link LNKF configured for IRQ 101326worker2 # [ 0.459687] ACPI: PCI: Interrupt link LNKA configured for IRQ 101327lb # [ 0.468282] ACPI: PCI: Interrupt link LNKD configured for IRQ 111328worker1 # [ 0.472985] ACPI: PCI: Interrupt link GSIC configured for IRQ 181329client # [ 0.473042] ACPI: PCI: Interrupt link LNKG configured for IRQ 111330worker2 # [ 0.460534] ACPI: PCI: Interrupt link LNKB configured for IRQ 101331lb # [ 0.469502] ACPI: PCI: Interrupt link LNKE configured for IRQ 101332worker1 # [ 0.473753] ACPI: PCI: Interrupt link GSID configured for IRQ 191333client # [ 0.474054] ACPI: PCI: Interrupt link LNKH configured for IRQ 111334worker2 # [ 0.461529] ACPI: PCI: Interrupt link LNKC configured for IRQ 111335lb # [ 0.470509] ACPI: PCI: Interrupt link LNKF configured for IRQ 101336worker1 # [ 0.474034] ACPI: PCI: Interrupt link GSIE configured for IRQ 201337client # [ 0.474995] ACPI: PCI: Interrupt link GSIA configured for IRQ 161338worker2 # [ 0.462528] ACPI: PCI: Interrupt link LNKD configured for IRQ 111339lb # [ 0.471513] ACPI: PCI: Interrupt link LNKG configured for IRQ 111340worker1 # [ 0.474957] ACPI: PCI: Interrupt link GSIF configured for IRQ 211341client # [ 0.475253] ACPI: PCI: Interrupt link GSIB configured for IRQ 171342worker2 # [ 0.463525] ACPI: PCI: Interrupt link LNKE configured for IRQ 101343lb # [ 0.472530] ACPI: PCI: Interrupt link LNKH configured for IRQ 111344worker1 # [ 0.475741] ACPI: PCI: Interrupt link GSIG configured for IRQ 221345client # [ 0.476192] ACPI: PCI: Interrupt link GSIC configured for IRQ 181346worker2 # [ 0.464525] ACPI: PCI: Interrupt link LNKF configured for IRQ 101347lb # [ 0.473470] ACPI: PCI: Interrupt link GSIA configured for IRQ 161348worker1 # [ 0.476030] ACPI: PCI: Interrupt link GSIH configured for IRQ 231349client # [ 0.476943] ACPI: PCI: Interrupt link GSID configured for IRQ 191350worker2 # [ 0.465528] ACPI: PCI: Interrupt link LNKG configured for IRQ 111351lb # [ 0.474388] ACPI: PCI: Interrupt link GSIB configured for IRQ 171352client # [ 0.477251] ACPI: PCI: Interrupt link GSIE configured for IRQ 201353lb # [ 0.475186] ACPI: PCI: Interrupt link GSIC configured for IRQ 181354worker2 # [ 0.466528] ACPI: PCI: Interrupt link LNKH configured for IRQ 111355worker1 # [ 0.478028] iommu: Default domain type: Translated1356client # [ 0.478224] ACPI: PCI: Interrupt link GSIF configured for IRQ 211357lb # [ 0.475471] ACPI: PCI: Interrupt link GSID configured for IRQ 191358worker1 # [ 0.478779] iommu: DMA domain TLB invalidation policy: lazy mode1359worker2 # [ 0.467467] ACPI: PCI: Interrupt link GSIA configured for IRQ 161360client # [ 0.478983] ACPI: PCI: Interrupt link GSIG configured for IRQ 221361lb # [ 0.476394] ACPI: PCI: Interrupt link GSIE configured for IRQ 201362worker1 # [ 0.479284] ACPI: bus type USB registered1363worker2 # [ 0.468444] ACPI: PCI: Interrupt link GSIB configured for IRQ 171364client # [ 0.479252] ACPI: PCI: Interrupt link GSIH configured for IRQ 231365lb # [ 0.477194] ACPI: PCI: Interrupt link GSIF configured for IRQ 211366worker1 # [ 0.479997] usbcore: registered new interface driver usbfs1367worker2 # [ 0.469414] ACPI: PCI: Interrupt link GSIC configured for IRQ 181368worker1 # [ 0.480680] usbcore: registered new interface driver hub1369lb # [ 0.477472] ACPI: PCI: Interrupt link GSIG configured for IRQ 221370worker2 # [ 0.470174] ACPI: PCI: Interrupt link GSID configured for IRQ 191371client # [ 0.481323] iommu: Default domain type: Translated1372worker1 # [ 0.481026] usbcore: registered new device driver usb1373lb # [ 0.478469] ACPI: PCI: Interrupt link GSIH configured for IRQ 231374worker2 # [ 0.470442] ACPI: PCI: Interrupt link GSIE configured for IRQ 201375client # [ 0.482082] iommu: DMA domain TLB invalidation policy: lazy mode1376worker2 # [ 0.471375] ACPI: PCI: Interrupt link GSIF configured for IRQ 211377worker1 # [ 0.482774] NetLabel: Initializing1378client # [ 0.483285] ACPI: bus type USB registered1379lb # [ 0.480444] iommu: Default domain type: Translated1380worker1 # [ 0.483016] NetLabel: domain hash size = 1281381worker2 # [ 0.472165] ACPI: PCI: Interrupt link GSIG configured for IRQ 221382client # [ 0.484018] usbcore: registered new interface driver usbfs1383lb # [ 0.481054] iommu: DMA domain TLB invalidation policy: lazy mode1384worker1 # [ 0.483710] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1385worker2 # [ 0.472445] ACPI: PCI: Interrupt link GSIH configured for IRQ 231386client # [ 0.484253] usbcore: registered new interface driver hub1387worker1 # [ 0.484052] NetLabel: unlabeled traffic allowed by default1388lb # [ 0.481740] ACPI: bus type USB registered1389client # [ 0.485137] usbcore: registered new device driver usb1390worker1 # [ 0.484946] PCI: Using ACPI for IRQ routing1391worker2 # [ 0.474370] iommu: Default domain type: Translated1392lb # [ 0.482506] usbcore: registered new interface driver usbfs1393worker2 # [ 0.475007] iommu: DMA domain TLB invalidation policy: lazy mode1394lb # [ 0.483414] usbcore: registered new interface driver hub1395client # [ 0.487112] NetLabel: Initializing1396lb # [ 0.484142] usbcore: registered new device driver usb1397worker2 # [ 0.475699] ACPI: bus type USB registered1398client # [ 0.487695] NetLabel: domain hash size = 1281399client # [ 0.488238] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1400lb # [ 0.485387] NetLabel: Initializing1401client # [ 0.489296] NetLabel: unlabeled traffic allowed by default1402worker2 # [ 0.476407] usbcore: registered new interface driver usbfs1403lb # [ 0.485900] NetLabel: domain hash size = 1281404client # [ 0.490216] PCI: Using ACPI for IRQ routing1405worker2 # [ 0.477129] usbcore: registered new interface driver hub1406lb # [ 0.486457] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1407worker2 # [ 0.477442] usbcore: registered new device driver usb1408lb # [ 0.487499] NetLabel: unlabeled traffic allowed by default1409lb # [ 0.488470] PCI: Using ACPI for IRQ routing1410worker2 # [ 0.479152] NetLabel: Initializing1411worker2 # [ 0.479431] NetLabel: domain hash size = 1281412worker2 # [ 0.480122] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413worker2 # [ 0.480460] NetLabel: unlabeled traffic allowed by default1414worker2 # [ 0.481331] PCI: Using ACPI for IRQ routing1415worker1 # [ 0.528063] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416worker1 # [ 0.529011] pci 0000:00:01.0: vgaarb: bridge control possible1417worker1 # [ 0.529011] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418worker1 # [ 0.529018] vgaarb: loaded1419worker1 # [ 0.529744] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420worker1 # [ 0.530016] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421client # [ 0.534091] pci 0000:00:01.0: vgaarb: setting as boot VGA device1422client # [ 0.534234] pci 0000:00:01.0: vgaarb: bridge control possible1423lb # [ 0.532546] pci 0000:00:01.0: vgaarb: setting as boot VGA device1424client # [ 0.534234] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1425lb # [ 0.533453] pci 0000:00:01.0: vgaarb: bridge control possible1426client # [ 0.534245] vgaarb: loaded1427worker1 # [ 0.534103] clocksource: Switched to clocksource kvm-clock1428worker2 # [ 0.525030] pci 0000:00:01.0: vgaarb: setting as boot VGA device1429lb # [ 0.533453] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1430client # [ 0.535047] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01431lb # [ 0.533461] vgaarb: loaded1432worker2 # [ 0.525425] pci 0000:00:01.0: vgaarb: bridge control possible1433client # [ 0.535886] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1434lb # [ 0.534195] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01435worker2 # [ 0.525425] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1436worker2 # [ 0.525434] vgaarb: loaded1437lb # [ 0.534458] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1438worker1 # [ 0.537624] VFS: Disk quotas dquot_6.6.01439worker2 # [ 0.526148] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01440worker1 # [ 0.538333] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1441worker2 # [ 0.526431] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1442worker1 # [ 0.539698] pnp: PnP ACPI init1443worker1 # [ 0.540579] ACPI: IRQ 4 override to edge(!), high(!)1444client # [ 0.540354] clocksource: Switched to clocksource kvm-clock1445lb # [ 0.537548] clocksource: Switched to clocksource kvm-clock1446worker1 # [ 0.541557] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1447worker1 # [ 0.543089] pnp: PnP ACPI: found 6 devices1448worker2 # [ 0.530522] clocksource: Switched to clocksource kvm-clock1449client # [ 0.544143] VFS: Disk quotas dquot_6.6.01450lb # [ 0.541391] VFS: Disk quotas dquot_6.6.01451client # [ 0.544925] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1452lb # [ 0.542156] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1453client # [ 0.546413] pnp: PnP ACPI init1454lb # [ 0.543596] pnp: PnP ACPI init1455worker2 # [ 0.534119] VFS: Disk quotas dquot_6.6.01456client # [ 0.547313] ACPI: IRQ 4 override to edge(!), high(!)1457lb # [ 0.544427] ACPI: IRQ 4 override to edge(!), high(!)1458worker2 # [ 0.534831] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1459client # [ 0.548390] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1460lb # [ 0.545424] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1461worker2 # [ 0.536263] pnp: PnP ACPI init1462lb # [ 0.546978] pnp: PnP ACPI: found 6 devices1463client # [ 0.550056] pnp: PnP ACPI: found 6 devices1464worker2 # [ 0.537273] ACPI: IRQ 4 override to edge(!), high(!)1465worker1 # [ 0.550734] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1466worker1 # [ 0.552189] clocksource: Switched to clocksource acpi_pm1467worker2 # [ 0.538505] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1468worker1 # [ 0.553150] NET: Registered PF_INET protocol family1469worker2 # [ 0.540143] pnp: PnP ACPI: found 6 devices1470worker1 # [ 0.554316] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1471lb # [ 0.554652] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1472client # [ 0.557865] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1473lb # [ 0.556199] clocksource: Switched to clocksource acpi_pm1474client # [ 0.559488] clocksource: Switched to clocksource acpi_pm1475lb # [ 0.557267] NET: Registered PF_INET protocol family1476client # [ 0.560590] NET: Registered PF_INET protocol family1477worker2 # [ 0.547991] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1478lb # [ 0.558499] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1479client # [ 0.561875] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1480worker2 # [ 0.549460] clocksource: Switched to clocksource acpi_pm1481worker2 # [ 0.550512] NET: Registered PF_INET protocol family1482worker2 # [ 0.551758] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1483worker1 # [ 0.571227] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1484worker1 # [ 0.572756] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1485worker1 # [ 0.574090] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1486worker1 # [ 0.575460] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1487worker1 # [ 0.576775] TCP: Hash tables configured (established 16384 bind 16384)1488worker1 # [ 0.577905] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1489worker1 # [ 0.579187] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1490lb # [ 0.575315] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1491client # [ 0.578894] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1492worker1 # [ 0.580254] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1493lb # [ 0.576869] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1494worker1 # [ 0.581449] NET: Registered PF_UNIX/PF_LOCAL protocol family1495client # [ 0.580627] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1496lb # [ 0.578193] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1497worker1 # [ 0.582384] NET: Registered PF_XDP protocol family1498client # [ 0.582062] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1499worker2 # [ 0.569125] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1500worker1 # [ 0.583212] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1501lb # [ 0.579515] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1502worker1 # [ 0.584162] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1503client # [ 0.583541] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1504lb # [ 0.580740] TCP: Hash tables configured (established 16384 bind 16384)1505worker2 # [ 0.570694] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1506worker1 # [ 0.585114] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1507client # [ 0.584894] TCP: Hash tables configured (established 16384 bind 16384)1508lb # [ 0.581825] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1509worker2 # [ 0.571957] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1510worker1 # [ 0.586194] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1511lb # [ 0.583030] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1512client # [ 0.586160] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1513worker2 # [ 0.573247] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1514worker1 # [ 0.587257] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1515lb # [ 0.584066] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1516worker2 # [ 0.574438] TCP: Hash tables configured (established 16384 bind 16384)1517client # [ 0.587523] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1518worker1 # [ 0.588299] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1519lb # [ 0.585224] NET: Registered PF_UNIX/PF_LOCAL protocol family1520worker2 # [ 0.575517] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1521client # [ 0.588701] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1522lb # [ 0.586160] NET: Registered PF_XDP protocol family1523worker1 # [ 0.589953] ACPI: \_SB_.GSIA: Enabled at IRQ 161524worker2 # [ 0.576751] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1525lb # [ 0.586954] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1526client # [ 0.590073] NET: Registered PF_UNIX/PF_LOCAL protocol family1527worker2 # [ 0.577769] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1528client # [ 0.591183] NET: Registered PF_XDP protocol family1529lb # [ 0.587919] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1530worker1 # [ 0.592145] ACPI: \_SB_.GSIB: Enabled at IRQ 171531worker2 # [ 0.578924] NET: Registered PF_UNIX/PF_LOCAL protocol family1532lb # [ 0.588880] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1533client # [ 0.592100] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1534worker2 # [ 0.579884] NET: Registered PF_XDP protocol family1535lb # [ 0.589922] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1536client # [ 0.593232] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1537worker1 # [ 0.594403] ACPI: \_SB_.GSIC: Enabled at IRQ 181538worker2 # [ 0.580718] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1539lb # [ 0.591014] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1540client # [ 0.594325] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1541worker2 # [ 0.581678] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1542lb # [ 0.592067] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1543worker1 # [ 0.596333] ACPI: \_SB_.GSID: Enabled at IRQ 191544client # [ 0.595543] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1545worker2 # [ 0.582712] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1546lb # [ 0.593740] ACPI: \_SB_.GSIA: Enabled at IRQ 161547worker2 # [ 0.583787] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1548client # [ 0.596752] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1549worker1 # [ 0.598052] PCI: CLS 0 bytes, default 641550worker2 # [ 0.584887] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1551client # [ 0.598028] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1552worker1 # [ 0.598935] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1553lb # [ 0.595971] ACPI: \_SB_.GSIB: Enabled at IRQ 171554worker2 # [ 0.585997] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1555client # [ 0.599903] ACPI: \_SB_.GSIA: Enabled at IRQ 161556worker1 # [ 0.600617] Trying to unpack rootfs image as initramfs...1557worker2 # [ 0.587836] ACPI: \_SB_.GSIA: Enabled at IRQ 161558lb # [ 0.598288] ACPI: \_SB_.GSIC: Enabled at IRQ 181559client # [ 0.602564] ACPI: \_SB_.GSIB: Enabled at IRQ 171560lb # [ 0.600421] ACPI: \_SB_.GSID: Enabled at IRQ 191561worker2 # [ 0.590718] ACPI: \_SB_.GSIB: Enabled at IRQ 171562client # [ 0.604828] ACPI: \_SB_.GSIC: Enabled at IRQ 181563lb # [ 0.602193] PCI: CLS 0 bytes, default 641564worker2 # [ 0.592601] ACPI: \_SB_.GSIC: Enabled at IRQ 181565client # [ 0.606982] ACPI: \_SB_.GSID: Enabled at IRQ 191566lb # [ 0.603172] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1567worker2 # [ 0.594521] ACPI: \_SB_.GSID: Enabled at IRQ 191568lb # [ 0.605014] Trying to unpack rootfs image as initramfs...1569client # [ 0.608812] PCI: CLS 0 bytes, default 641570worker2 # [ 0.596185] PCI: CLS 0 bytes, default 641571client # [ 0.609889] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1572worker2 # [ 0.597102] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1573client # [ 0.611816] Trying to unpack rootfs image as initramfs...1574worker2 # [ 0.598895] Trying to unpack rootfs image as initramfs...1575worker1 # [ 0.644764] Initialise system trusted keyrings1576worker1 # [ 0.647587] workingset: timestamp_bits=40 max_order=19 bucket_order=01577lb # [ 0.650543] Initialise system trusted keyrings1578lb # [ 0.651548] workingset: timestamp_bits=40 max_order=19 bucket_order=01579client # [ 0.657721] Initialise system trusted keyrings1580worker2 # [ 0.645146] Initialise system trusted keyrings1581worker2 # [ 0.646162] workingset: timestamp_bits=40 max_order=19 bucket_order=01582client # [ 0.660999] workingset: timestamp_bits=40 max_order=19 bucket_order=01583worker1 # [ 0.669000] Key type asymmetric registered1584worker1 # [ 0.669762] Asymmetric key parser 'x509' registered1585worker1 # [ 0.672595] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1586worker1 # [ 0.675599] io scheduler mq-deadline registered1587worker1 # [ 0.676401] io scheduler kyber registered1588lb # [ 0.674836] Key type asymmetric registered1589lb # [ 0.675880] Asymmetric key parser 'x509' registered1590worker1 # [ 0.680573] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1591worker1 # [ 0.681883] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1592worker2 # [ 0.668860] Key type asymmetric registered1593lb # [ 0.678771] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1594worker2 # [ 0.669564] Asymmetric key parser 'x509' registered1595client # [ 0.683067] Key type asymmetric registered1596lb # [ 0.680130] io scheduler mq-deadline registered1597client # [ 0.683843] Asymmetric key parser 'x509' registered1598worker2 # [ 0.670439] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1599client # [ 0.684858] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1600lb # [ 0.682724] io scheduler kyber registered1601worker1 # [ 0.687380] Linux agpgart interface v0.1031602worker1 # [ 0.688193] ACPI: bus type drm_connector registered1603lb # [ 0.684727] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1604worker2 # [ 0.675830] io scheduler mq-deadline registered1605lb # [ 0.686057] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1606worker2 # [ 0.676653] io scheduler kyber registered1607worker1 # [ 0.691017] usbcore: registered new interface driver usbserial_generic1608client # [ 0.691080] io scheduler mq-deadline registered1609worker1 # [ 0.692109] usbserial: USB Serial support registered for generic1610client # [ 0.691963] io scheduler kyber registered1611worker2 # [ 0.680317] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1612lb # [ 0.692540] Linux agpgart interface v0.1031613worker1 # [ 0.695547] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1614client # [ 0.695540] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1615lb # [ 0.693311] ACPI: bus type drm_connector registered1616worker1 # [ 0.695547] Please enable it if your BIOS has the CPPC option.1617worker2 # [ 0.683641] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1618worker1 # [ 0.697829] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1619client # [ 0.698975] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1620lb # [ 0.696186] usbcore: registered new interface driver usbserial_generic1621worker2 # [ 0.687503] Linux agpgart interface v0.1031622lb # [ 0.697372] usbserial: USB Serial support registered for generic1623worker1 # [ 0.701702] drop_monitor: Initializing network drop monitor service1624worker2 # [ 0.688303] ACPI: bus type drm_connector registered1625worker1 # [ 0.702855] NET: Registered PF_INET6 protocol family1626client # [ 0.702622] Linux agpgart interface v0.1031627client # [ 0.703508] ACPI: bus type drm_connector registered1628lb # [ 0.699754] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1629lb # [ 0.699754] Please enable it if your BIOS has the CPPC option.1630worker1 # [ 0.706147] Segment Routing with IPv61631lb # [ 0.702081] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1632worker2 # [ 0.693147] usbcore: registered new interface driver usbserial_generic1633client # [ 0.706409] usbcore: registered new interface driver usbserial_generic1634worker2 # [ 0.694264] usbserial: USB Serial support registered for generic1635client # [ 0.707624] usbserial: USB Serial support registered for generic1636worker1 # [ 0.708560] In-situ OAM (IOAM) with IPv61637worker1 # [ 0.709636] IPI shorthand broadcast: enabled1638lb # [ 0.707824] drop_monitor: Initializing network drop monitor service1639worker2 # [ 0.697649] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1640client # [ 0.710950] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1641lb # [ 0.709002] NET: Registered PF_INET6 protocol family1642worker2 # [ 0.697649] Please enable it if your BIOS has the CPPC option.1643client # [ 0.710950] Please enable it if your BIOS has the CPPC option.1644worker2 # [ 0.699784] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1645client # [ 0.713394] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1646lb # [ 0.712199] Segment Routing with IPv61647worker2 # [ 0.703808] drop_monitor: Initializing network drop monitor service1648worker1 # [ 0.718108] sched_clock: Marking stable (582015085, 135512202)->(794121040, -76593753)1649worker2 # [ 0.705057] NET: Registered PF_INET6 protocol family1650lb # [ 0.715720] In-situ OAM (IOAM) with IPv61651worker2 # [ 0.706379] Segment Routing with IPv61652client # [ 0.719083] drop_monitor: Initializing network drop monitor service1653lb # [ 0.716802] IPI shorthand broadcast: enabled1654client # [ 0.720464] NET: Registered PF_INET6 protocol family1655worker2 # [ 0.708657] In-situ OAM (IOAM) with IPv61656worker1 # [ 0.723677] registered taskstats version 11657worker2 # [ 0.710948] IPI shorthand broadcast: enabled1658worker1 # [ 0.724672] Loading compiled-in X.509 certificates1659client # [ 0.724489] Segment Routing with IPv61660client # [ 0.725253] In-situ OAM (IOAM) with IPv61661client # [ 0.728334] IPI shorthand broadcast: enabled1662lb # [ 0.725112] sched_clock: Marking stable (591015390, 133673281)->(801371603, -76682932)1663worker2 # [ 0.719198] sched_clock: Marking stable (583014576, 135613052)->(794051740, -75424112)1664lb # [ 0.729957] registered taskstats version 11665lb # [ 0.730903] Loading compiled-in X.509 certificates1666worker2 # [ 0.722792] registered taskstats version 11667worker2 # [ 0.723794] Loading compiled-in X.509 certificates1668client # [ 0.736786] sched_clock: Marking stable (601014762, 134915716)->(811961640, -76031162)1669client # [ 0.740160] registered taskstats version 11670worker1 # [ 0.741249] Demotion targets for Node 0: null1671client # [ 0.741215] Loading compiled-in X.509 certificates1672worker1 # [ 0.744582] Key type .fscrypt registered1673worker1 # [ 0.745303] Key type fscrypt-provisioning registered1674worker1 # [ 0.746246] ima: No TPM chip found, activating TPM-bypass!1675worker1 # [ 0.748544] ima: Allocated hash algorithm: sha11676worker1 # [ 0.749362] ima: No architecture policies found1677lb # [ 0.748707] Demotion targets for Node 0: null1678worker1 # [ 0.753554] PM: Magic number: 10:616:3801679lb # [ 0.750747] Key type .fscrypt registered1680lb # [ 0.751427] Key type fscrypt-provisioning registered1681worker1 # [ 0.755294] RAS: Correctable Errors collector initialized.1682lb # [ 0.752413] ima: No TPM chip found, activating TPM-bypass!1683worker2 # [ 0.742650] Demotion targets for Node 0: null1684worker2 # [ 0.744703] Key type .fscrypt registered1685worker2 # [ 0.745384] Key type fscrypt-provisioning registered1686worker2 # [ 0.746349] ima: No TPM chip found, activating TPM-bypass!1687lb # [ 0.756706] ima: Allocated hash algorithm: sha11688lb # [ 0.757569] ima: No architecture policies found1689client # [ 0.760944] Demotion targets for Node 0: null1690client # [ 0.761988] Key type .fscrypt registered1691lb # [ 0.759706] PM: Magic number: 10:616:3801692client # [ 0.762743] Key type fscrypt-provisioning registered1693worker1 # [ 0.764260] clk: Disabling unused clocks1694worker2 # [ 0.750647] ima: Allocated hash algorithm: sha11695client # [ 0.763799] ima: No TPM chip found, activating TPM-bypass!1696worker2 # [ 0.751450] ima: No architecture policies found1697lb # [ 0.761413] RAS: Correctable Errors collector initialized.1698worker1 # [ 0.766551] PM: genpd: Disabling unused power domains1699worker2 # [ 0.753642] PM: Magic number: 10:616:3801700client # [ 0.767955] ima: Allocated hash algorithm: sha11701worker2 # [ 0.755397] RAS: Correctable Errors collector initialized.1702client # [ 0.768825] ima: No architecture policies found1703client # [ 0.771956] PM: Magic number: 10:616:3801704lb # [ 0.770431] clk: Disabling unused clocks1705client # [ 0.773720] RAS: Correctable Errors collector initialized.1706lb # [ 0.774713] PM: genpd: Disabling unused power domains1707worker2 # [ 0.765399] clk: Disabling unused clocks1708worker2 # [ 0.767652] PM: genpd: Disabling unused power domains1709client # [ 0.783664] clk: Disabling unused clocks1710client # [ 0.785946] PM: genpd: Disabling unused power domains1711worker1 # [ 0.938495] Freeing initrd memory: 29092K1712worker1 # [ 0.941743] Freeing unused decrypted memory: 2028K1713worker1 # [ 0.944421] Freeing unused kernel image (initmem) memory: 3644K1714worker1 # [ 0.945657] Write protecting the kernel read-only data: 32768k1715worker1 # [ 0.947612] Freeing unused kernel image (text/rodata gap) memory: 1208K1716worker2 # [ 0.934792] Freeing initrd memory: 29092K1717lb # [ 0.945832] Freeing initrd memory: 29092K1718worker1 # [ 0.949232] Freeing unused kernel image (rodata/data gap) memory: 752K1719worker2 # [ 0.938251] Freeing unused decrypted memory: 2028K1720lb # [ 0.949067] Freeing unused decrypted memory: 2028K1721worker2 # [ 0.941294] Freeing unused kernel image (initmem) memory: 3644K1722lb # [ 0.951828] Freeing unused kernel image (initmem) memory: 3644K1723worker2 # [ 0.942442] Write protecting the kernel read-only data: 32768k1724lb # [ 0.952925] Write protecting the kernel read-only data: 32768k1725worker2 # [ 0.944452] Freeing unused kernel image (text/rodata gap) memory: 1208K1726lb # [ 0.954862] Freeing unused kernel image (text/rodata gap) memory: 1208K1727worker2 # [ 0.946132] Freeing unused kernel image (rodata/data gap) memory: 752K1728lb # [ 0.956403] Freeing unused kernel image (rodata/data gap) memory: 752K1729client # [ 0.961545] Freeing initrd memory: 29096K1730client # [ 0.964863] Freeing unused decrypted memory: 2028K1731client # [ 0.967708] Freeing unused kernel image (initmem) memory: 3644K1732client # [ 0.968907] Write protecting the kernel read-only data: 32768k1733client # [ 0.970885] Freeing unused kernel image (text/rodata gap) memory: 1208K1734client # [ 0.972547] Freeing unused kernel image (rodata/data gap) memory: 752K1735worker1 # [ 1.000527] x86/mm: Checked W+X mappings: passed, no W+X pages found.1736worker1 # [ 1.001672] Run /init as init process1737lb # [ 1.007535] x86/mm: Checked W+X mappings: passed, no W+X pages found.1738worker2 # [ 0.997972] x86/mm: Checked W+X mappings: passed, no W+X pages found.1739lb # [ 1.008611] Run /init as init process1740worker1 # [ 1.012364] systemd[1]: Inserted module 'autofs4'1741worker2 # [ 0.999089] Run /init as init process1742lb # [ 1.019633] systemd[1]: Inserted module 'autofs4'1743worker2 # [ 1.010260] systemd[1]: Inserted module 'autofs4'1744client # [ 1.023671] x86/mm: Checked W+X mappings: passed, no W+X pages found.1745client # [ 1.024907] Run /init as init process1746worker1 # [ 1.028725] fuse: init (API version 7.45)1747worker1 # [ 1.034650] ACPI: \_SB_.GSIG: Enabled at IRQ 221748client # [ 1.035802] systemd[1]: Inserted module 'autofs4'1749worker1 # [ 1.037087] ACPI: \_SB_.GSIH: Enabled at IRQ 231750lb # [ 1.036424] fuse: init (API version 7.45)1751worker1 # [ 1.040117] ACPI: \_SB_.GSIE: Enabled at IRQ 201752worker2 # [ 1.027458] fuse: init (API version 7.45)1753worker1 # [ 1.042374] ACPI: \_SB_.GSIF: Enabled at IRQ 211754lb # [ 1.042568] ACPI: \_SB_.GSIG: Enabled at IRQ 221755worker2 # [ 1.033578] ACPI: \_SB_.GSIG: Enabled at IRQ 221756lb # [ 1.045153] ACPI: \_SB_.GSIH: Enabled at IRQ 231757worker2 # [ 1.036392] ACPI: \_SB_.GSIH: Enabled at IRQ 231758lb # [ 1.048312] ACPI: \_SB_.GSIE: Enabled at IRQ 201759client # [ 1.052315] fuse: init (API version 7.45)1760worker2 # [ 1.039921] ACPI: \_SB_.GSIE: Enabled at IRQ 201761lb # [ 1.050700] ACPI: \_SB_.GSIF: Enabled at IRQ 211762worker2 # [ 1.042452] ACPI: \_SB_.GSIF: Enabled at IRQ 211763client # [ 1.058394] ACPI: \_SB_.GSIG: Enabled at IRQ 221764client # [ 1.061092] ACPI: \_SB_.GSIH: Enabled at IRQ 231765client # [ 1.064193] ACPI: \_SB_.GSIE: Enabled at IRQ 201766client # [ 1.066527] ACPI: \_SB_.GSIF: Enabled at IRQ 211767worker1 # [ 1.074411] systemd[1]: Successfully made /usr/ read-only.1768lb # [ 1.080848] systemd[1]: Successfully made /usr/ read-only.1769worker2 # [ 1.074736] systemd[1]: Successfully made /usr/ read-only.1770client # [ 1.096070] systemd[1]: Successfully made /usr/ read-only.1771worker1 # [ 1.411123] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772worker1 # [ 1.423697] systemd[1]: Detected virtualization kvm.1773worker1 # [ 1.426178] systemd[1]: Detected architecture x86-64.1774worker2 # [ 1.410305] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1775worker2 # [ 1.415178] systemd[1]: Detected virtualization kvm.1776worker1 # [ 1.428595] systemd[1]: Running in initrd.1777worker2 # [ 1.416066] systemd[1]: Detected architecture x86-64.1778worker2 # [ 1.416939] systemd[1]: Running in initrd.1779worker2 # [ 1.418090] systemd[1]: Initializing machine ID from random generator.1780lb # [ 1.417632] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1781worker2 # [ 1.419313] systemd[1]: Hostname set to <worker2>.1782worker1 # [ 1.431284] systemd[1]: Initializing machine ID from random generator.1783lb # [ 1.429717] systemd[1]: Detected virtualization kvm.1784worker1 # [ 1.434419] systemd[1]: Hostname set to <worker1>.1785lb # [ 1.431869] systemd[1]: Detected architecture x86-64.1786lb # [ 1.434032] systemd[1]: Running in initrd.1787lb # [ 1.436932] systemd[1]: Initializing machine ID from random generator.1788client # [ 1.432839] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1789lb # [ 1.439890] systemd[1]: Hostname set to <lb>.1790client # [ 1.444986] systemd[1]: Detected virtualization kvm.1791client # [ 1.447089] systemd[1]: Detected architecture x86-64.1792client # [ 1.449227] systemd[1]: Running in initrd.1793client # [ 1.451766] systemd[1]: Initializing machine ID from random generator.1794client # [ 1.454647] systemd[1]: Hostname set to <client>.1795worker2 # [ 1.623947] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796worker1 # [ 1.656931] systemd[1]: bpf-restrict-fs: LSM BPF program attached1797lb # [ 1.662842] systemd[1]: bpf-restrict-fs: LSM BPF program attached1798client # [ 1.680370] systemd[1]: bpf-restrict-fs: LSM BPF program attached1799worker2 # [ 1.676906] systemd[1]: Queued start job for default target Initrd Default Target.1800worker2 # [ 1.681029] systemd[1]: Created slice Slice /system/modprobe.1801worker2 # [ 1.682262] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1802worker2 # [ 1.683753] systemd[1]: Expecting device /dev/disk/by-label/nixos...1803worker2 # [ 1.684849] systemd[1]: Reached target Path Units.1804worker2 # [ 1.685747] systemd[1]: Reached target Slice Units.1805worker2 # [ 1.686874] systemd[1]: Reached target Swaps.1806worker2 # [ 1.687684] systemd[1]: Reached target Timer Units.1807worker2 # [ 1.688704] systemd[1]: Listening on D-Bus System Message Bus Socket.1808worker2 # [ 1.689915] systemd[1]: Listening on Journal Socket (/dev/log).1809worker2 # [ 1.691210] systemd[1]: Listening on Journal Sockets.1810worker2 # [ 1.692304] systemd[1]: Listening on udev Control Socket.1811worker2 # [ 1.693396] systemd[1]: Listening on udev Kernel Socket.1812worker2 # [ 1.694362] systemd[1]: Reached target Socket Units.1813worker2 # [ 1.696206] systemd[1]: Starting Create List of Static Device Nodes...1814worker1 # [ 1.710978] systemd[1]: Queued start job for default target Initrd Default Target.1815worker2 # [ 1.700739] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1816worker1 # [ 1.714882] systemd[1]: Created slice Slice /system/modprobe.1817worker1 # [ 1.716073] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1818worker1 # [ 1.717609] systemd[1]: Expecting device /dev/disk/by-label/nixos...1819worker1 # [ 1.718762] systemd[1]: Reached target Path Units.1820worker1 # [ 1.719687] systemd[1]: Reached target Slice Units.1821worker1 # [ 1.720608] systemd[1]: Reached target Swaps.1822worker1 # [ 1.721422] systemd[1]: Reached target Timer Units.1823lb # [ 1.717803] systemd[1]: Queued start job for default target Initrd Default Target.1824worker2 # [ 1.708704] systemd[1]: Starting Load Kernel Module configfs...1825worker1 # [ 1.722402] systemd[1]: Listening on D-Bus System Message Bus Socket.1826worker1 # [ 1.723640] systemd[1]: Listening on Journal Socket (/dev/log).1827worker1 # [ 1.724836] systemd[1]: Listening on Journal Sockets.1828lb # [ 1.721123] systemd[1]: Created slice Slice /system/modprobe.1829worker1 # [ 1.725861] systemd[1]: Listening on udev Control Socket.1830lb # [ 1.722324] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1831worker1 # [ 1.726910] systemd[1]: Listening on udev Kernel Socket.1832lb # [ 1.723785] systemd[1]: Expecting device /dev/disk/by-label/nixos...1833worker1 # [ 1.727877] systemd[1]: Reached target Socket Units.1834lb # [ 1.724897] systemd[1]: Reached target Path Units.1835lb # [ 1.725858] systemd[1]: Reached target Slice Units.1836lb # [ 1.726781] systemd[1]: Reached target Swaps.1837worker1 # [ 1.730617] systemd[1]: Starting Create List of Static Device Nodes...1838lb # [ 1.727566] systemd[1]: Reached target Timer Units.1839lb # [ 1.728568] systemd[1]: Listening on D-Bus System Message Bus Socket.1840lb # [ 1.729825] systemd[1]: Listening on Journal Socket (/dev/log).1841worker1 # [ 1.733615] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1842lb # [ 1.730985] systemd[1]: Listening on Journal Sockets.1843lb # [ 1.732028] systemd[1]: Listening on udev Control Socket.1844worker2 # [ 1.722752] systemd[1]: Starting Journal Service...1845lb # [ 1.733083] systemd[1]: Listening on udev Kernel Socket.1846lb # [ 1.734058] systemd[1]: Reached target Socket Units.1847client # [ 1.737003] systemd[1]: Queued start job for default target Initrd Default Target.1848lb # [ 1.735960] systemd[1]: Starting Create List of Static Device Nodes...1849worker1 # [ 1.740611] systemd[1]: Starting Load Kernel Module configfs...1850client # [ 1.740407] systemd[1]: Created slice Slice /system/modprobe.1851client # [ 1.741563] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1852client # [ 1.742982] systemd[1]: Expecting device /dev/disk/by-label/nixos...1853client # [ 1.744075] systemd[1]: Reached target Path Units.1854lb # [ 1.740757] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1855client # [ 1.744935] systemd[1]: Reached target Slice Units.1856client # [ 1.745755] systemd[1]: Reached target Swaps.1857client # [ 1.746531] systemd[1]: Reached target Timer Units.1858client # [ 1.747526] systemd[1]: Listening on D-Bus System Message Bus Socket.1859client # [ 1.748687] systemd[1]: Listening on Journal Socket (/dev/log).1860worker2 # [ 1.735705] systemd[1]: Starting Load Kernel Modules...1861client # [ 1.749896] systemd[1]: Listening on Journal Sockets.1862client # [ 1.750966] systemd[1]: Listening on udev Control Socket.1863client # [ 1.751999] systemd[1]: Listening on udev Kernel Socket.1864lb # [ 1.748758] systemd[1]: Starting Load Kernel Module configfs...1865client # [ 1.752881] systemd[1]: Reached target Socket Units.1866client # [ 1.754776] systemd[1]: Starting Create List of Static Device Nodes...1867worker1 # [ 1.755834] systemd[1]: Starting Journal Service...1868client # [ 1.760014] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1869client # [ 1.765003] systemd[1]: Starting Load Kernel Module configfs...1870lb # [ 1.762811] systemd[1]: Starting Journal Service...1871worker1 # [ 1.769412] systemd[1]: Starting Load Kernel Modules...1872worker2 # [ 1.745744] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1873lb # [ 1.776019] systemd[1]: Starting Load Kernel Modules...1874client # [ 1.779689] systemd[1]: Starting Journal Service...1875worker2 # [ 1.769403] netfs: FS-Cache loaded1876worker1 # [ 1.777062] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1877client # [ 1.792011] systemd[1]: Starting Load Kernel Modules...1878worker1 # [ 1.793692] netfs: FS-Cache loaded1879worker2 # [ 1.782779] 9pnet: Installing 9P2000 support1880lb # [ 1.782775] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1881worker1 # [ 1.801851] 9pnet: Installing 9P2000 support1882worker2 # [ 1.788792] systemd-journald[67]: Collecting audit messages is disabled.1883lb # [ 1.799926] netfs: FS-Cache loaded1884worker2 # [ 1.794330] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1885lb # [ 1.806302] 9pnet: Installing 9P2000 support1886client # [ 1.799024] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1887worker1 # [ 1.815796] systemd[1]: Starting Coldplug All udev Devices...1888worker2 # [ 1.804013] systemd[1]: Starting Coldplug All udev Devices...1889client # [ 1.818079] netfs: FS-Cache loaded1890worker1 # [ 1.818291] systemd-journald[67]: Collecting audit messages is disabled.1891worker2 # [ 1.806666] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1892lb # [ 1.818764] systemd[1]: Starting Coldplug All udev Devices...1893client # [ 1.822861] 9pnet: Installing 9P2000 support1894client # [ 1.827560] systemd[1]: Starting Coldplug All udev Devices...1895worker1 # [ 1.830642] systemd[1]: Finished Create List of Static Device Nodes.1896worker2 # [ 1.818697] systemd[1]: Finished Create List of Static Device Nodes.1897lb # [ 1.831300] systemd-journald[67]: Collecting audit messages is disabled.1898worker1 # [ 1.836149] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1899lb # [ 1.834774] systemd[1]: Finished Create List of Static Device Nodes.1900worker2 # [ 1.826311] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1901lb # [ 1.839541] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1902worker1 # [ 1.843942] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1903client # [ 1.844805] systemd[1]: Finished Create List of Static Device Nodes.1904worker2 # [ 1.831824] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1905worker2 # [ 1.834125] systemd[1]: modprobe@configfs.service: Deactivated successfully.1906worker1 # [ 1.848975] systemd[1]: modprobe@configfs.service: Deactivated successfully.1907client # [ 1.850596] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1908lb # [ 1.848163] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1909worker2 # [ 1.840702] systemd[1]: Finished Load Kernel Module configfs.1910worker1 # [ 1.856902] systemd[1]: Finished Load Kernel Module configfs.1911lb # [ 1.854104] systemd[1]: modprobe@configfs.service: Deactivated successfully.1912worker2 # [ 1.845242] systemd[1]: Finished Load Kernel Modules.1913client # [ 1.859426] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1914worker1 # [ 1.860952] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1915worker2 # [ 1.849121] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1916client # [ 1.864409] systemd[1]: modprobe@configfs.service: Deactivated successfully.1917lb # [ 1.862062] systemd[1]: Finished Load Kernel Module configfs.1918worker1 # [ 1.866175] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1919lb # [ 1.866133] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1920client # [ 1.870334] systemd-journald[67]: Collecting audit messages is disabled.1921worker2 # [ 1.858716] systemd[1]: Starting Apply Kernel Variables...1922lb # [ 1.868601] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1923worker1 # [ 1.873620] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1924client # [ 1.874330] systemd[1]: Finished Load Kernel Module configfs.1925worker1 # [ 1.875166] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1926client # [ 1.879441] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1927lb # [ 1.877044] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1928worker2 # [ 1.869708] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1929lb # [ 1.879795] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1930client # [ 1.884592] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1931client # [ 1.892022] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1932client # [ 1.896104] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1933worker2 # [ 1.754230] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.891097] systemd[1]: Started Journal Service.1934worker2 # 1935worker2 # [ 1.756468] systemd-modules-load[68]: Inserted module 'virtio_balloon'1936worker1 # [ 1.906091] systemd[1]: Finished Load Kernel Modules.1937worker2 # [ 1.759403] systemd-modules-load[68]: Inserted module 'virtio_gpu'1938lb # [ 1.906908] systemd[1]: Finished Load Kernel Modules.1939worker1 # [ 1.913734] systemd[1]: Starting Apply Kernel Variables...1940lb # [ 1.915074] systemd[1]: Starting Apply Kernel Variables...1941worker2 # [ 1.774193] systemd[1]: Finished Apply Kernel Variables.1942worker1 # [ 1.925702] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1943client # [ 1.926478] systemd[1]: Finished Load Kernel Modules.1944worker2 # [ 1.778662] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1945worker2 # [ 1.782154] systemd[1]: Starting Create Static Device Nodes in /dev...1946lb # [ 1.929865] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1947client # [ 1.934011] systemd[1]: Starting Apply Kernel Variables...1948worker1 # [ 1.938755] systemd[1]: Starting Create Static Device Nodes in /dev...1949lb # [ 1.939897] systemd[1]: Starting Create Static Device Nodes in /dev...1950client # [ 1.945080] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1951worker1 # [ 1.810178] systemd-modules-load[68]: Inserted module 'dm_mod'1952worker1 # [ 1.812277] systemd-modules-load[68]: Inserted module 'virtio_balloon'1953worker1 # [ 1.814309] systemd-modules-load[68]: Inserted module 'virtio_gpu'1954worker2 # [ 1.804120] systemd[1]: Finished Create Static Device Nodes in /dev.1955worker2 # [ 1.805069] systemd[1]: Reached target Preparation for Local File Systems.1956worker1 # [ 1.954876] systemd[1]: Started Journal Service.1957worker2 # [ 1.805989] systemd[1]: Reached target Local File Systems.1958lb # [ 1.952790] systemd[1]: Finished Apply Kernel Variables.1959client # [ 1.957160] systemd[1]: Starting Create Static Device Nodes in /dev...1960worker2 # [ 1.809068] systemd[1]: Starting Create System Files and Directories...1961lb # [ 1.820232] systemd-modules-load[68]: Inserted module 'dm_mod'1962lb # [ 1.823306] systemd-modules-load[68]: Inserted module 'virtio_balloon'1963worker1 # [ 1.826064] systemd[1]: Finished Apply Kernel Variables.1964lb # [ 1.824379] systemd-modules-load[68]: Inserted module 'virtio_gpu'1965lb # [ 1.960039] systemd[1]: Started Journal Service.1966worker2 # [ 1.815076] systemd[1]: Starting Rule-based Manager for Device Events and Files...1967worker1 # [ 1.840466] systemd[1]: Finished Create Static Device Nodes in /dev.1968client # [ 1.976299] systemd[1]: Finished Apply Kernel Variables.1969worker1 # [ 1.842277] systemd[1]: Reached target Preparation for Local File Systems.1970worker1 # [ 1.843302] systemd[1]: Reached target Local File Systems.1971lb # [ 1.844115] systemd[1]: Finished Create Static Device Nodes in /dev.1972lb # [ 1.845601] systemd[1]: Reached target Preparation for Local File Systems.1973worker1 # [ 1.848130] systemd[1]: Starting Create System Files and Directories...1974lb # [ 1.848957] systemd[1]: Reached target Local File Systems.1975lb # [ 1.852070] systemd[1]: Starting Create System Files and Directories...1976worker1 # [ 1.854071] systemd[1]: Starting Rule-based Manager for Device Events and Files...1977worker2 # [ 1.842108] systemd[1]: Finished Create System Files and Directories.1978client # [ 1.992443] systemd[1]: Finished Create Static Device Nodes in /dev.1979lb # [ 1.857201] systemd[1]: Starting Rule-based Manager for Device Events and Files...1980client # [ 1.859250] systemd-modules-load[68]: Inserted module 'dm_mod'1981client # [ 1.862428] systemd-modules-load[68]: Inserted module 'virtio_balloon'1982client # [ 1.863483] systemd-modules-load[68]: Inserted module 'virtio_gpu'1983client # [ 1.999375] systemd[1]: Started Journal Service.1984client # [ 1.873793] systemd[1]: Reached target Preparation for Local File Systems.1985client # [ 1.876833] systemd[1]: Reached target Local File Systems.1986worker2 # [ 1.864241] systemd-udevd[84]: Using default interface naming scheme 'v261'.1987worker1 # [ 1.878041] systemd[1]: Finished Create System Files and Directories.1988client # [ 1.880067] systemd[1]: Starting Create System Files and Directories...1989client # [ 1.885419] systemd[1]: Starting Rule-based Manager for Device Events and Files...1990lb # [ 1.884133] systemd[1]: Finished Create System Files and Directories.1991worker1 # [ 1.900798] systemd-udevd[83]: Using default interface naming scheme 'v261'.1992worker2 # [ 1.890370] systemd[1]: Started Rule-based Manager for Device Events and Files.1993lb # [ 1.906268] systemd-udevd[83]: Using default interface naming scheme 'v261'.1994client # [ 1.913200] systemd[1]: Finished Create System Files and Directories.1995worker1 # [ 1.925602] systemd[1]: Started Rule-based Manager for Device Events and Files.1996lb # [ 1.933086] systemd[1]: Started Rule-based Manager for Device Events and Files.1997client # [ 1.938309] systemd-udevd[83]: Using default interface naming scheme 'v261'.1998client # [ 1.962976] systemd[1]: Started Rule-based Manager for Device Events and Files.1999worker2 # [ 1.955769] systemd[1]: Finished Coldplug All udev Devices.2000worker2 # [ 1.956755] systemd[1]: Reached target System Initialization.
loading 1,640 hidden lines…
3641client # [ 9.676286] systemd[1]: Finished resolvconf update.3642worker1 # [ 9.676248] systemd[1]: Started Reset console on configuration changes.3643client # [ 9.683156] systemd[1]: Starting DHCP Client...3644worker1 # [ 9.684254] systemd[1]: Starting resolvconf update...3645client # [ 9.685952] nsncd[529]: Sep 20 12:22:10.971 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3646client # [ 9.688971] systemd[1]: Started Name Service Cache Daemon (nsncd).3647worker1 # [ 9.690119] systemd[1]: Starting D-Bus System Message Bus...3648client # [ 9.690254] systemd[1]: Reached target Host and Network Name Lookups.3649client # [ 9.691964] systemd[1]: Reached target User and Group Name Lookups.3650worker2 # [ 9.702689] systemd[1]: Finished Post-Boot Actions.3651worker2 # connecting to host...3652worker2 # [ 9.742544] systemd[1]: Started Name Service Cache Daemon (nsncd).3653worker2 # [ 9.744351] systemd[1]: Reached target Host and Network Name Lookups.3654worker1 # [ 9.759903] systemd[1]: Finished Post-Boot Actions.3655lb # [ 9.655212] ppdev: user-space parallel port driver3656lb # [ 9.770009] 8021q: 802.1Q VLAN Support v1.83657lb # [ 9.770026] 8021q: adding VLAN 0 to HW filter on device eth13658worker2 # [ 9.748402] nsncd[531]: Sep 20 12:22:11.577 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3659worker2 # [ 9.753509] systemd[1]: Reached target User and Group Name Lookups.3660worker2 # [ 9.755460] systemd[1]: Starting User Login Management...3661worker2 # [ 9.762382] systemd[1]: Finished Import lastlog data into lastlog2 database.3662worker1 # [ 9.789418] nsncd[532]: Sep 20 12:22:11.602 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3663worker1 # [ 9.794266] systemd[1]: Started Name Service Cache Daemon (nsncd).3664worker1 # [ 9.797555] systemd[1]: Reached target Host and Network Name Lookups.3665worker1 # [ 9.800259] systemd[1]: Reached target User and Group Name Lookups.3666worker1 # connecting to host...3667worker1 # [ 9.803674] systemd[1]: Starting User Login Management...3668worker1 # [ 9.804802] systemd[1]: Finished Import lastlog data into lastlog2 database.3669lb # [ 9.817331] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)3670lb # [ 9.848109] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0)3671client # [ 9.807311] dhcpcd[557]: dhcpcd-10.3.2 starting3672client # [ 9.815680] dhcpcd[566]: dev: loaded udev3673worker2 # [ 9.808664] dbus-broker-launch[535]: Looking up NSS user entry for 'systemd-timesync'...3674lb # [ 9.853205] Console: switching to colour frame buffer device 160x503675lb # [ 9.964345] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device3676client # [ 9.970185] 8021q: 802.1Q VLAN Support v1.83677lb # [ 9.583117] systemd[1]: Finished Extra networking commands..3678worker2 # [ 9.825653] dbus-broker-launch[535]: NSS returned no entry for 'systemd-timesync'3679lb # [ 9.838614] dhcpcd[654]: dhcpcd-10.3.2 starting3680worker2 # [ 9.826834] dbus-broker-launch[535]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3681lb # [ 9.843528] systemd[1]: Reached target Network.3682lb # [ 9.847424] dhcpcd[711]: dev: loaded udev3683lb # [ 9.848370] systemd[1]: Starting PostgreSQL Server...3684lb # [ 9.849461] systemd[1]: Starting Permit User Sessions...3685worker2 # [ 9.844859] systemd[1]: Stopped target Host and Network Name Lookups.3686worker1 # [ 9.859406] dbus-broker-launch[536]: Looking up NSS user entry for 'systemd-timesync'...3687lb # [ 9.858184] systemd[1]: Finished Permit User Sessions.3688worker2 # [ 9.847453] systemd[1]: Stopping Host and Network Name Lookups...3689worker2 # [ 9.849519] systemd[1]: Stopped target User and Group Name Lookups.3690lb # [ 9.861640] systemd-logind[552]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3691client # [ 9.864332] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3692lb # [ 9.863162] systemd[1]: Started Getty on tty1.3693lb # [ 9.863787] systemd[1]: Reached target Login Prompts.3694worker2 # [ 9.852196] systemd[1]: Stopping User and Group Name Lookups...3695lb # [ 9.864500] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3696worker2 # [ 9.854231] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3697lb # [ 9.867543] systemd[1]: Stopped Virtual Console Setup.3698worker2 # [ 9.855829] systemd[1]: nscd.service: Deactivated successfully.3699worker2 # [ 9.856885] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3700worker1 # [ 9.874948] dbus-broker-launch[536]: NSS returned no entry for 'systemd-timesync'3701worker1 # [ 9.876352] dbus-broker-launch[536]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3702worker2 # [ 9.865944] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3703worker2 # [ 9.876352] systemd[1]: Started D-Bus System Message Bus.3704lb # [ 9.892514] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3705worker1 # [ 9.896373] systemd[1]: Stopped target Host and Network Name Lookups.3706client # [ 9.898083] systemd[1]: Finished nftables firewall.3707worker1 # [ 9.898940] systemd[1]: Stopping Host and Network Name Lookups...3708worker2 # [ 9.886341] systemd-logind[556]: New seat seat0.3709worker1 # [ 9.900818] systemd[1]: Stopped target User and Group Name Lookups.3710client # [ 9.902073] systemd[1]: Reached target Preparation for Network.3711lb # [ 10.033818] cfg80211: Loading compiled-in X.509 certificates for regulatory database3712worker1 # [ 9.903904] systemd[1]: Stopping User and Group Name Lookups...3713lb # [ 9.902727] systemd[1]: Starting Virtual Console Setup...3714worker1 # [ 9.905263] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3715worker1 # [ 9.907052] systemd[1]: nscd.service: Deactivated successfully.3716client # [ 9.908106] systemd[1]: Starting Address configuration of eth1...3717worker2 # [ 9.894168] systemd-logind[556]: Watching system buttons on /dev/input/event2 (Power Button)3718worker1 # [ 9.909891] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3719worker2 # [ 9.895834] systemd-logind[556]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3720worker2 # [ 9.898155] systemd-logind[556]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3721client # [ 9.913759] systemd[1]: Starting Extra networking commands....3722worker2 # [ 9.901152] systemd[1]: Started User Login Management.3723worker1 # [ 9.915860] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3724worker2 # [ 9.905916] systemd[1]: Starting linger-users.service...3725worker1 # [ 9.928495] systemd-logind[555]: New seat seat0.3726worker1 # [ 9.930282] systemd[1]: Started D-Bus System Message Bus.3727lb # [ 9.930377] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3728worker1 # [ 9.936251] systemd-logind[555]: Watching system buttons on /dev/input/event2 (Power Button)3729lb # [ 9.935717] systemd[1]: Stopped Virtual Console Setup.3730worker1 # [ 9.938331] systemd-logind[555]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3731client # [ 10.075678] cfg80211: Loading compiled-in X.509 certificates for regulatory database3732worker1 # [ 9.940546] systemd-logind[555]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3733lb # [ 9.942237] systemd[1]: Starting Virtual Console Setup...3734worker1 # [ 9.944149] systemd[1]: Started User Login Management.3735worker1 # [ 9.948285] systemd[1]: Starting linger-users.service...3736worker2 # [ 9.936117] dbus-broker-launch[535]: Ready3737lb # [ 10.084172] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3738lb # [ 10.086870] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3739lb # [ 10.089849] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23740lb # [ 10.090742] cfg80211: failed to load regulatory.db3741worker2 # [ 9.953368] systemd[1]: Started Name Service Cache Daemon (nsncd).3742worker2 # [ 9.955810] systemd[1]: Reached target Host and Network Name Lookups.3743worker2 # [ 9.957369] nsncd[601]: Sep 20 12:22:11.790 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3744worker2 # [ 9.960353] systemd[1]: Reached target User and Group Name Lookups.3745client # [ 10.112445] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3746client # [ 10.113543] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3747client # [ 10.117668] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23748client # [ 10.118630] cfg80211: failed to load regulatory.db3749worker2 # [ 9.973686] systemd[1]: linger-users.service: Deactivated successfully.3750worker2 # [ 9.974728] systemd[1]: Finished linger-users.service.3751worker1 # [ 9.992415] dbus-broker-launch[536]: Ready3752worker2 # [ 9.980076] systemd[1]: Finished resolvconf update.3753worker2 # [ 9.981449] systemd[1]: Reached target Preparation for Network.3754worker2 # [ 9.986532] systemd[1]: Starting DHCP Client...3755worker1 # [ 10.001994] systemd[1]: Started Name Service Cache Daemon (nsncd).3756worker2 # [ 9.989350] systemd[1]: Starting Address configuration of eth1...3757worker1 # [ 10.003345] systemd[1]: Reached target Host and Network Name Lookups.3758worker1 # [ 10.005183] nsncd[602]: Sep 20 12:22:11.817 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3759worker2 # [ 9.992967] systemd[1]: Starting Extra networking commands....3760worker1 # [ 10.007448] systemd[1]: Reached target User and Group Name Lookups.3761client # [ 10.143481] 8021q: adding VLAN 0 to HW filter on device eth13762worker1 # [ 10.017085] systemd[1]: linger-users.service: Deactivated successfully.3763worker1 # [ 10.018613] systemd[1]: Finished linger-users.service.3764client # [ 10.027606] network-addresses-eth1-start[576]: adding address 192.168.1.1/24... done3765lb # [ 10.028495] postgresql-pre-start[723]: The files belonging to this database system will be owned by user "postgres".3766lb # [ 10.030736] postgresql-pre-start[723]: This user must also own the server process.3767worker1 # [ 10.033379] systemd[1]: Finished resolvconf update.3768worker1 # [ 10.034213] systemd[1]: Reached target Preparation for Network.3769worker1 # [ 10.038411] systemd[1]: Starting DHCP Client...3770client # [ 10.040591] dhcpcd[594]: /nix/store/gz6c2i5x5b1lmdy71d4h3i8kd7nwnnl7-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (581) - Operation not permitted3771worker1 # [ 10.041423] systemd[1]: Starting Address configuration of eth1...3772client # [ 10.042626] dhcpcd[594]: .resolvconf-wrapped: clearing stale lock pid 5813773lb # [ 10.042284] postgresql-pre-start[723]: The database cluster will be initialized with locale "en_US.UTF-8".3774worker1 # [ 10.045104] systemd[1]: Starting Extra networking commands....3775lb # [ 10.043607] postgresql-pre-start[723]: The default database encoding has accordingly been set to "UTF8".3776client # [ 10.045753] network-addresses-eth1-start[576]: adding address 2001:db8:1::1/64... done3777lb # [ 10.044742] postgresql-pre-start[723]: The default text search configuration will be set to "english".3778lb # [ 10.046284] postgresql-pre-start[723]: Data page checksums are enabled.3779lb # [ 10.047549] postgresql-pre-start[723]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3780lb # [ 10.051396] postgresql-pre-start[723]: creating subdirectories ... ok3781lb # [ 10.055088] postgresql-pre-start[723]: selecting dynamic shared memory implementation ... posix3782client # [ 10.064297] systemd[1]: Finished Address configuration of eth1.3783client # [ 10.212192] 8021q: adding VLAN 0 to HW filter on device eth03784client # [ 10.078393] dhcpcd[566]: eth0: waiting for carrier3785client # [ 10.080068] dhcpcd[566]: eth0: carrier acquired3786client # [ 10.090950] dhcpcd[566]: DUID 00:01:00:01:32:42:8c:73:52:54:00:12:34:563787lb # [ 10.223052] 8021q: adding VLAN 0 to HW filter on device eth03788client # [ 10.092049] dhcpcd[566]: eth0: IAID 00:12:34:563789client # [ 10.092952] dhcpcd[566]: eth0: adding address fe80::5054:ff:fe12:34563790lb # [ 10.092578] dhcpcd[711]: eth0: waiting for carrier3791lb # [ 10.093809] dhcpcd[711]: eth0: carrier acquired3792lb # [ 10.231109] kvm_amd: TSC scaling supported3793lb # [ 10.231501] kvm_amd: Nested Virtualization enabled3794lb # [ 10.232434] kvm_amd: Nested Paging enabled3795lb # [ 10.233273] kvm_amd: LBR virtualization supported3796lb # [ 10.234492] kvm_amd: Virtual VMLOAD VMSAVE supported3797lb # [ 10.235231] kvm_amd: Virtual GIF supported3798client # [ 10.103741] systemd[1]: Finished Extra networking commands..3799lb # [ 10.236228] kvm_amd: Virtual NMI enabled3800client # [ 10.105477] systemd[1]: Reached target Network.3801client # [ 10.108640] systemd[1]: Starting Permit User Sessions...3802lb # [ 10.112136] dhcpcd[711]: DUID 00:01:00:01:32:42:8c:74:52:54:00:12:34:563803lb # [ 10.113422] dhcpcd[711]: eth0: IAID 00:12:34:563804worker2 # [ 10.101217] network-addresses-eth1-start[631]: adding address 192.168.1.4/24... done3805lb # [ 10.114432] dhcpcd[711]: eth0: adding address fe80::5054:ff:fe12:34563806worker2 # [ 10.118426] network-addresses-eth1-start[631]: adding address 2001:db8:1::4/64... done3807client # [ 10.136599] systemd[1]: Finished Permit User Sessions.3808client # [ 10.140526] systemd[1]: Started Getty on tty1.3809client # [ 10.141679] systemd[1]: Reached target Login Prompts.3810worker1 # [ 10.145973] network-addresses-eth1-start[632]: adding address 192.168.1.3/24... done3811worker2 # [ 10.139675] systemd[1]: Finished Address configuration of eth1.3812worker1 # [ 10.161942] network-addresses-eth1-start[632]: adding address 2001:db8:1::3/64... done3813worker2 # [ 10.166374] dhcpcd[639]: dhcpcd-10.3.2 starting3814worker1 # [ 10.183142] systemd[1]: Finished Address configuration of eth1.3815worker2 # [ 10.175883] dhcpcd[694]: dev: loaded udev3816lb # [ 10.326457] EDAC MC: Ver: 3.0.03817worker2 # [ 10.182192] systemd[1]: Finished Extra networking commands..3818worker2 # [ 10.185132] systemd[1]: Reached target Network.3819worker2 # [ 10.188379] systemd[1]: Starting Permit User Sessions...3820worker1 # [ 10.204861] dhcpcd[639]: dhcpcd-10.3.2 starting3821worker1 # [ 10.212827] dhcpcd[692]: dev: loaded udev3822worker2 # [ 10.341155] 8021q: 802.1Q VLAN Support v1.83823worker2 # [ 10.341723] 8021q: adding VLAN 0 to HW filter on device eth13824lb # [ 10.219693] postgresql-pre-start[723]: selecting default "max_connections" ... 1003825worker1 # [ 10.222747] systemd[1]: Finished Extra networking commands..3826worker1 # [ 10.224940] systemd[1]: Reached target Network.3827worker1 # [ 10.228643] systemd[1]: Starting Permit User Sessions...3828worker1 # [ 10.372019] 8021q: 802.1Q VLAN Support v1.83829worker2 # [ 10.222541] systemd[1]: Finished Permit User Sessions.3830worker1 # [ 10.373269] 8021q: adding VLAN 0 to HW filter on device eth13831worker2 # [ 10.225195] systemd[1]: Started Getty on tty1.3832worker2 # [ 10.226667] systemd[1]: Reached target Login Prompts.3833worker2 # [ 10.243902] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3834worker1 # [ 10.259612] systemd[1]: Finished Permit User Sessions.3835worker1 # [ 10.264916] systemd[1]: Started Getty on tty1.3836worker1 # [ 10.266143] systemd[1]: Reached target Login Prompts.3837worker1 # [ 10.275887] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3838lb # [ 10.310265] postgresql-pre-start[723]: selecting default "shared_buffers" ... 128MB3839worker2 # [ 10.436127] cfg80211: Loading compiled-in X.509 certificates for regulatory database3840worker1 # [ 10.465029] cfg80211: Loading compiled-in X.509 certificates for regulatory database3841worker2 # [ 10.461551] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3842worker2 # [ 10.462345] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3843worker2 # [ 10.465754] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23844worker2 # [ 10.466637] cfg80211: failed to load regulatory.db3845worker1 # [ 10.490881] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3846worker1 # [ 10.491751] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3847worker1 # [ 10.495365] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23848worker1 # [ 10.496292] cfg80211: failed to load regulatory.db3849worker2 # [ 10.512768] 8021q: adding VLAN 0 to HW filter on device eth03850worker2 # [ 10.378526] dhcpcd[694]: eth0: waiting for carrier3851worker2 # [ 10.379297] dhcpcd[694]: eth0: carrier acquired3852worker2 # [ 10.387436] dhcpcd[694]: DUID 00:01:00:01:32:42:8c:74:52:54:00:12:34:563853worker2 # [ 10.388656] dhcpcd[694]: eth0: IAID 00:12:34:563854worker2 # [ 10.389352] dhcpcd[694]: eth0: adding address fe80::5054:ff:fe12:34563855lb # [ 10.405394] systemd-vconsole-setup[734]: Configuration of first virtual console was skipped, ignoring remaining ones.3856worker1 # [ 10.545611] 8021q: adding VLAN 0 to HW filter on device eth03857lb # [ 10.408423] systemd[1]: Finished Virtual Console Setup.3858worker1 # [ 10.411382] dhcpcd[692]: eth0: waiting for carrier3859worker1 # [ 10.412254] dhcpcd[692]: eth0: carrier acquired3860worker1 # [ 10.421540] dhcpcd[692]: DUID 00:01:00:01:32:42:8c:74:52:54:00:12:34:563861worker1 # [ 10.422619] dhcpcd[692]: eth0: IAID 00:12:34:563862worker1 # [ 10.423429] dhcpcd[692]: eth0: adding address fe80::5054:ff:fe12:34563863client: (finished: waiting for unit network-addresses-eth1.service, in 11.40 seconds)3864client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3865client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3866lb: waiting for unit network-addresses-eth1.service3867lb: waiting for the VM to finish booting3868lb: Guest shell says: b'Spawning backdoor root shell...\n'3869lb: connected to guest root shell3870lb: (connecting took 0.00 seconds)3871lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3872lb: (finished: waiting for unit network-addresses-eth1.service, in 0.06 seconds)3873lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3874lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3875worker1: waiting for unit network-addresses-eth1.service3876worker1: waiting for the VM to finish booting3877worker1: Guest shell says: b'Spawning backdoor root shell...\n'3878worker1: connected to guest root shell3879worker1: (connecting took 0.00 seconds)3880worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3881client # [ 10.854234] dhcpcd[566]: eth0: soliciting a DHCP lease3882client # [ 11.014683] NET: Registered PF_PACKET protocol family3883client # [ 10.885951] dhcpcd[566]: eth0: offered 10.0.2.15 from 10.0.2.23884client # [ 10.891148] dhcpcd[566]: eth0: probing address 10.0.2.15/243885lb # [ 10.913835] dhcpcd[711]: eth0: soliciting a DHCP lease3886lb # [ 11.062981] NET: Registered PF_PACKET protocol family3887worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.09 seconds)3888worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3889lb # [ 10.933583] dhcpcd[711]: eth0: offered 10.0.2.15 from 10.0.2.23890lb # [ 10.935127] dhcpcd[711]: eth0: probing address 10.0.2.15/243891worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3892worker2: waiting for unit network-addresses-eth1.service3893worker2: waiting for the VM to finish booting3894worker2: Guest shell says: b'Spawning backdoor root shell...\n'3895worker2: connected to guest root shell3896worker2: (connecting took 0.00 seconds)3897worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3898worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds)3899worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3900worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3901lb: waiting for unit niks3.service3902worker1 # [ 11.183429] dhcpcd[692]: eth0: soliciting a DHCP lease3903worker1 # [ 11.345232] NET: Registered PF_PACKET protocol family3904worker1 # [ 11.216520] dhcpcd[692]: eth0: offered 10.0.2.15 from 10.0.2.23905worker1 # [ 11.220384] dhcpcd[692]: eth0: probing address 10.0.2.15/243906client # [ 11.500632] dhcpcd[566]: eth0: soliciting an IPv6 router3907client # [ 11.502990] dhcpcd[566]: eth0: Router Advertisement from fe80::23908client # [ 11.505638] dhcpcd[566]: eth0: adding address fec0::5054:ff:fe12:3456/643909client # [ 11.507877] dhcpcd[566]: eth0: adding route to fec0::/643910client # [ 11.509754] dhcpcd[566]: eth0: adding default route via fe80::23911worker2 # [ 11.906311] dhcpcd[694]: eth0: soliciting a DHCP lease3912worker2 # [ 12.067100] NET: Registered PF_PACKET protocol family3913worker2 # [ 11.937770] dhcpcd[694]: eth0: offered 10.0.2.15 from 10.0.2.23914worker2 # [ 11.943342] dhcpcd[694]: eth0: probing address 10.0.2.15/243915lb # [ 12.043744] dhcpcd[711]: eth0: soliciting an IPv6 router3916lb # [ 12.045146] dhcpcd[711]: eth0: Router Advertisement from fe80::23917lb # [ 12.045922] dhcpcd[711]: eth0: adding address fec0::5054:ff:fe12:3456/643918lb # [ 12.047116] dhcpcd[711]: eth0: adding route to fec0::/643919lb # [ 12.047879] dhcpcd[711]: eth0: adding default route via fe80::23920worker1 # [ 12.189479] dhcpcd[692]: eth0: soliciting an IPv6 router3921lb # [ 12.191533] postgresql-pre-start[723]: selecting default time zone ... UTC3922worker1 # [ 12.192461] dhcpcd[692]: eth0: Router Advertisement from fe80::23923worker1 # [ 12.194693] dhcpcd[692]: eth0: adding address fec0::5054:ff:fe12:3456/643924worker1 # [ 12.196849] dhcpcd[692]: eth0: adding route to fec0::/643925lb # [ 12.195763] postgresql-pre-start[723]: creating configuration files ... ok3926worker1 # [ 12.198741] dhcpcd[692]: eth0: adding default route via fe80::23927worker2 # [ 12.245278] dhcpcd[694]: eth0: soliciting an IPv6 router3928worker2 # [ 12.248822] dhcpcd[694]: eth0: Router Advertisement from fe80::23929worker2 # [ 12.250892] dhcpcd[694]: eth0: adding address fec0::5054:ff:fe12:3456/643930worker2 # [ 12.253173] dhcpcd[694]: eth0: adding route to fec0::/643931worker2 # [ 12.255161] dhcpcd[694]: eth0: adding default route via fe80::23932lb # [ 12.430665] postgresql-pre-start[723]: running bootstrap script ... ok3933lb # [ 12.992138] postgresql-pre-start[723]: performing post-bootstrap initialization ... ok3934lb # [ 13.123264] postgresql-pre-start[723]: syncing data to disk ... ok3935lb # [ 13.124214] postgresql-pre-start[723]: initdb: warning: enabling "trust" authentication for local connections3936lb # [ 13.125386] postgresql-pre-start[723]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3937lb # [ 13.127215] postgresql-pre-start[723]: Success. You can now start the database server using:3938lb # [ 13.128212] postgresql-pre-start[723]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3939lb # [ 13.246494] postgres[790]: [790] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3940lb # [ 13.250236] postgres[790]: [790] LOG: listening on IPv6 address "::1", port 54323941lb # [ 13.251275] postgres[790]: [790] LOG: listening on IPv4 address "127.0.0.1", port 54323942lb # [ 13.254177] postgres[790]: [790] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3943lb # [ 13.270951] postgres[805]: [805] LOG: database system was shut down at 2026-09-20 12:22:14 GMT3944lb # [ 13.276484] postgres[790]: [790] LOG: database system is ready to accept connections3945lb # [ 13.283667] systemd[1]: Started PostgreSQL Server.3946lb # [ 13.290700] systemd[1]: Starting PostgreSQL Setup Scripts...3947lb # [ 13.491911] postgresql-setup-start[824]: CREATE DATABASE3948lb # [ 13.539231] postgresql-setup-start[829]: CREATE ROLE3949lb # [ 13.561278] postgresql-setup-start[831]: ALTER DATABASE3950lb # [ 13.566095] systemd[1]: Finished PostgreSQL Setup Scripts.3951lb # [ 13.567769] systemd[1]: Reached target PostgreSQL.3952lb # [ 16.127074] dhcpcd[711]: eth0: leased 10.0.2.15 for 86400 seconds3953lb # [ 16.129726] dhcpcd[711]: eth0: adding route to 10.0.2.0/243954lb # [ 16.132165] dhcpcd[711]: eth0: adding default route via 10.0.2.23955lb # [ 16.255809] systemd[1]: Started DHCP Client.3956lb # [ 16.257807] systemd[1]: Reached target Network is Online.3957lb # [ 16.261976] systemd[1]: Started Envoy reverse proxy.3958lb # [ 16.265612] systemd[1]: Started mock-oidc.service.3959lb # [ 16.363628] mock-oidc-server[908]: Mock OIDC Server running3960lb # [ 16.365542] mock-oidc-server[908]: OIDC Address: 192.168.1.2:80803961lb # [ 16.366614] mock-oidc-server[908]: Issue Address: 0.0.0.0:80813962lb # [ 16.367983] mock-oidc-server[908]: Issuer: http://192.168.1.2:8080/oidc3963lb # [ 16.368858] mock-oidc-server[908]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3964lb # [ 16.369890] mock-oidc-server[908]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3965lb # [ 16.371080] mock-oidc-server[908]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3966worker1 # [ 16.411992] dhcpcd[692]: eth0: leased 10.0.2.15 for 86400 seconds3967worker1 # [ 16.413310] dhcpcd[692]: eth0: adding route to 10.0.2.0/243968worker1 # [ 16.414358] dhcpcd[692]: eth0: adding default route via 10.0.2.23969client # [ 16.447844] dhcpcd[566]: eth0: leased 10.0.2.15 for 86400 seconds3970client # [ 16.448745] dhcpcd[566]: eth0: adding route to 10.0.2.0/243971client # [ 16.449496] dhcpcd[566]: eth0: adding default route via 10.0.2.23972worker1 # [ 16.526622] systemd[1]: Started DHCP Client.3973worker1 # [ 16.528337] systemd[1]: Reached target Multi-User System.3974worker1 # [ 16.529650] systemd[1]: Startup finished in 869ms (kernel) + 4.204s (initrd) + 11.455s (userspace) = 16.529s.3975client # [ 16.538456] systemd[1]: Started DHCP Client.3976client # [ 16.539862] systemd[1]: Reached target Multi-User System.3977client # [ 16.541364] systemd[1]: Startup finished in 893ms (kernel) + 4.098s (initrd) + 11.548s (userspace) = 16.541s.3978lb # [ 16.767466] envoy[907]: [2026-09-20 12:22:18.737][907][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3979lb # [ 16.769534] envoy[907]: [2026-09-20 12:22:18.737][907][info][main] [source/server/server.cc:469] statically linked extensions:3980lb # [ 16.770989] envoy[907]: [2026-09-20 12:22:18.737][907][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3981lb # [ 16.773238] envoy[907]: [2026-09-20 12:22:18.737][907][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http13982lb # [ 16.775292] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality3983lb # [ 16.790368] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3984lb # [ 16.792174] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor3985lb # [ 16.794819] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options3986lb # [ 16.799156] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap3987lb # [ 16.803317] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default3988lb # [ 16.804936] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default3989lb # [ 16.806648] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3990lb # [ 16.809092] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3991lb # [ 16.810688] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche3992lb # [ 16.812448] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts3993lb # [ 16.815035] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator3994lb # [ 16.817329] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3995lb # [ 16.821268] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain3996lb # [ 16.823952] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed3997lb # [ 16.827081] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3998lb # [ 16.828761] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json3999lb # [ 16.830358] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4000lb # [ 16.834273] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4001lb # [ 16.837854] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4002lb # [ 16.839951] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4003lb # [ 16.843960] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4004lb # [ 16.845749] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4005lb # [ 16.848909] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4006lb # [ 16.851214] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4007lb # [ 16.853406] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4008lb # [ 16.854905] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4009lb # [ 16.856536] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4010lb # [ 16.861143] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4011lb # [ 16.863936] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4012lb # [ 16.868431] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4013lb # [ 16.870191] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4014lb # [ 16.872212] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4015lb # [ 16.874771] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4016lb # [ 16.880537] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4017lb # [ 16.882212] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4018worker2 # [ 16.871339] dhcpcd[694]: eth0: leased 10.0.2.15 for 86400 seconds4019lb # [ 16.885062] envoy[907]: [2026-09-20 12:22:18.738][907][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4020worker2 # [ 16.874371] dhcpcd[694]: eth0: adding route to 10.0.2.0/244021lb # [ 16.887571] envoy[907]: [2026-09-20 12:22:18.740][907][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4022worker2 # [ 16.876296] dhcpcd[694]: eth0: adding default route via 10.0.2.24023lb # [ 16.889921] envoy[907]: [2026-09-20 12:22:18.740][907][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4024lb # [ 16.915314] envoy[907]: [2026-09-20 12:22:18.740][907][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4025lb # [ 16.917052] envoy[907]: [2026-09-20 12:22:18.740][907][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4026lb # [ 16.919073] envoy[907]: [2026-09-20 12:22:18.740][907][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4027lb # [ 16.921545] envoy[907]: [2026-09-20 12:22:18.740][907][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4028lb # [ 16.932685] envoy[907]: [2026-09-20 12:22:18.740][907][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4029lb # [ 16.934671] envoy[907]: [2026-09-20 12:22:18.740][907][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4030lb # [ 16.937642] envoy[907]: [2026-09-20 12:22:18.740][907][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4031lb # [ 16.941661] envoy[907]: [2026-09-20 12:22:18.740][907][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4032lb # [ 16.943380] envoy[907]: [2026-09-20 12:22:18.740][907][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24033lb # [ 16.945552] envoy[907]: [2026-09-20 12:22:18.740][907][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4034lb # [ 16.947471] envoy[907]: [2026-09-20 12:22:18.740][907][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4035lb # [ 16.949244] envoy[907]: [2026-09-20 12:22:18.741][907][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4036lb # [ 16.951966] envoy[907]: [2026-09-20 12:22:18.742][907][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4037lb # [ 16.954163] envoy[907]: [2026-09-20 12:22:18.742][907][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4038lb # [ 16.956574] envoy[907]: [2026-09-20 12:22:18.742][907][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4039lb # [ 16.958191] envoy[907]: [2026-09-20 12:22:18.742][907][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4040lb # [ 16.961078] envoy[907]: [2026-09-20 12:22:18.742][907][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4041lb # [ 16.962805] envoy[907]: [2026-09-20 12:22:18.742][907][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24042lb # [ 16.964358] envoy[907]: [2026-09-20 12:22:18.742][907][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4043lb # [ 16.965847] envoy[907]: [2026-09-20 12:22:18.742][907][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4044lb # [ 16.968148] envoy[907]: [2026-09-20 12:22:18.742][907][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4045lb # [ 16.970443] envoy[907]: [2026-09-20 12:22:18.742][907][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24046lb # [ 16.971890] envoy[907]: [2026-09-20 12:22:18.742][907][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4047lb # [ 16.973954] envoy[907]: [2026-09-20 12:22:18.742][907][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84048lb # [ 16.975690] envoy[907]: [2026-09-20 12:22:18.744][907][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4049lb # [ 16.979108] envoy[907]: [2026-09-20 12:22:18.744][907][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4050lb # [ 16.981516] envoy[907]: [2026-09-20 12:22:18.744][907][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4051lb # [ 16.987783] envoy[907]: [2026-09-20 12:22:18.744][907][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4052lb # [ 16.991386] envoy[907]: [2026-09-20 12:22:18.746][907][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4053worker2 # [ 16.982915] systemd[1]: Started DHCP Client.4054lb # [ 16.993212] envoy[907]: [2026-09-20 12:22:18.746][907][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4055worker2 # [ 16.984402] systemd[1]: Reached target Multi-User System.4056worker2 # [ 16.985248] systemd[1]: Startup finished in 867ms (kernel) + 4.086s (initrd) + 12.030s (userspace) = 16.984s.4057lb # [ 16.996234] envoy[907]: [2026-09-20 12:22:18.752][907][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4058lb # [ 17.003655] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4059lb # [ 17.006251] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4060lb # [ 17.008499] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4061lb # [ 17.011469] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4062lb # [ 17.013673] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4063lb # [ 17.020297] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4064lb # [ 17.027501] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4065lb # [ 17.029754] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4066lb # [ 17.032240] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4067lb # [ 17.034837] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4068lb # [ 17.037229] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4069lb # [ 17.040978] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4070lb # [ 17.051127] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4071lb # [ 17.053436] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4072lb # [ 17.055557] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4073lb # [ 17.057153] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4074lb # [ 17.059385] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4075lb # [ 17.061773] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4076lb # [ 17.064121] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4077lb # [ 17.068525] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4078lb # [ 17.069962] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4079lb # [ 17.071613] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4080lb # [ 17.074324] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4081lb # [ 17.081128] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4082lb # [ 17.084042] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4083lb # [ 17.085958] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4084lb # [ 17.088266] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4085lb # [ 17.091258] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4086lb # [ 17.093107] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4087lb # [ 17.095717] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4088lb # [ 17.097406] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4089lb # [ 17.099134] envoy[907]: [2026-09-20 12:22:18.753][907][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4090lb # [ 17.100922] envoy[907]: [2026-09-20 12:22:18.853][907][info][main] [source/server/server.cc:531] HTTP header map info:4091lb # [ 17.102190] envoy[907]: [2026-09-20 12:22:18.925][907][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4092lb # [ 17.114789] envoy[907]: [2026-09-20 12:22:18.925][907][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4093lb # [ 17.116189] envoy[907]: [2026-09-20 12:22:18.925][907][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4094lb # [ 17.123526] envoy[907]: [2026-09-20 12:22:18.925][907][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4095lb # [ 17.155591] envoy[907]: [2026-09-20 12:22:19.126][907][info][main] [source/server/server.cc:968] runtime: {}4096lb # [ 17.161500] envoy[907]: [2026-09-20 12:22:19.132][907][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4097lb # [ 17.163631] envoy[907]: [2026-09-20 12:22:19.134][907][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014098lb # [ 17.166328] envoy[907]: [2026-09-20 12:22:19.137][907][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014099lb # [ 17.169077] envoy[907]: [2026-09-20 12:22:19.140][907][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4100lb # [ 17.170838] envoy[907]: [2026-09-20 12:22:19.141][907][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4101lb # [ 17.172435] envoy[907]: [2026-09-20 12:22:19.141][907][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4102lb # [ 17.222094] envoy[907]: [2026-09-20 12:22:19.193][907][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4103worker1 # [ 17.227322] systemd[1]: Starting Nix worker-protocol over gRPC...4104worker2 # [ 17.215370] systemd[1]: Reached target Network is Online.4105worker2 # [ 17.224323] systemd[1]: Starting scheduler-token.service...4106lb # [ 17.246422] envoy[907]: [2026-09-20 12:22:19.217][907][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4107lb # [ 17.248799] envoy[907]: [2026-09-20 12:22:19.219][907][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4108lb # [ 17.251803] envoy[907]: [2026-09-20 12:22:19.219][907][info][main] [source/server/server.cc:1077] starting main dispatch loop4109worker2 # [ 17.321576] systemd[1]: scheduler-token.service: Deactivated successfully.4110worker2 # [ 17.323462] systemd[1]: Finished scheduler-token.service.4111worker2 # [ 17.324658] systemd[1]: scheduler-token.service: Consumed 32ms CPU time over 99ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4112worker2 # [ 17.330710] systemd[1]: Starting Nix worker-protocol over gRPC...4113worker1 # [ 17.425974] nix-grpc-daemon[786]: ts=2026-09-20T12:22:19Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4114worker1 # [ 17.435721] nix-grpc-daemon[786]: ts=2026-09-20T12:22:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4115worker1 # [ 17.438730] nix-grpc-daemon[786]: ts=2026-09-20T12:22:19Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14116worker1 # [ 17.480895] nix-grpc-daemon[786]: ts=2026-09-20T12:22:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4117worker1 # [ 17.485648] systemd[1]: Started Nix worker-protocol over gRPC.4118worker1 # [ 17.515193] nix-grpc-daemon[786]: ts=2026-09-20T12:22:19Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4119lb # [ 17.533659] envoy[907]: [2026-09-20 12:22:19.504][907][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4120lb # [ 17.538741] envoy[907]: [2026-09-20 12:22:19.509][907][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4121worker2 # [ 17.529377] nix-grpc-daemon[788]: ts=2026-09-20T12:22:19Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4122lb # [ 17.542879] envoy[907]: [2026-09-20 12:22:19.509][907][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4123lb # [ 17.547478] envoy[907]: [2026-09-20 12:22:19.513][907][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4124worker2 # [ 17.539157] nix-grpc-daemon[788]: ts=2026-09-20T12:22:19Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4125worker2 # [ 17.542237] nix-grpc-daemon[788]: ts=2026-09-20T12:22:19Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14126worker2 # [ 17.589721] nix-grpc-daemon[788]: ts=2026-09-20T12:22:19Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4127worker2 # [ 17.592486] systemd[1]: Started Nix worker-protocol over gRPC.4128worker2 # [ 17.638967] nix-grpc-daemon[788]: ts=2026-09-20T12:22:19Z level=info event=scheduler_connected addr=lb:500514129worker1 # [ 17.689870] nix-grpc-daemon[786]: ts=2026-09-20T12:22:19Z level=info event=oidc_jwks provider=mock keys=14130worker1 # [ 17.695335] nix-grpc-daemon[786]: ts=2026-09-20T12:22:19Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:571944131worker1 # [ 17.699238] nix-grpc-daemon[786]: ts=2026-09-20T12:22:19Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04132worker1 # [ 17.715947] nix-grpc-daemon[786]: ts=2026-09-20T12:22:19Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4133worker1 # [ 18.116654] nix-grpc-daemon[786]: ts=2026-09-20T12:22:19Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4134worker1 # [ 18.920874] nix-grpc-daemon[786]: ts=2026-09-20T12:22:20Z level=info event=scheduler_connected addr=lb:500514135worker1 # [ 18.925918] nix-grpc-daemon[786]: ts=2026-09-20T12:22:20Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:571944136worker1 # [ 18.929479] nix-grpc-daemon[786]: ts=2026-09-20T12:22:20Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04137lb # [ 23.930622] rustfs-bucket-start[989]: mb s3://farm4138lb # [ 23.935752] systemd[1]: Finished rustfs-bucket.service.4139lb # [ 23.941987] systemd[1]: Starting niks3 server...4140lb # [ 24.197948] postgres[1009]: [1009] ERROR: relation "goose_db_version" does not exist at character 364141lb # [ 24.199157] postgres[1009]: [1009] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4142lb # [ 24.241313] niks3-server[999]: 2026/09/20 12:22:26 OK 20241026095416_initial_model.sql (22.27ms)4143lb # [ 24.244330] niks3-server[999]: 2026/09/20 12:22:26 OK 20251210153512_drop_unused_gin_index.sql (3.61ms)4144lb # [ 24.249685] niks3-server[999]: 2026/09/20 12:22:26 OK 20251218171726_add_pins.sql (3.93ms)4145lb # [ 24.255306] niks3-server[999]: 2026/09/20 12:22:26 OK 20260628120000_add_object_size_and_stats.sql (5.67ms)4146lb # [ 24.259659] niks3-server[999]: 2026/09/20 12:22:26 OK 20260905000000_add_claims.sql (2.98ms)4147lb # [ 24.260950] niks3-server[999]: 2026/09/20 12:22:26 goose: successfully migrated database to version: 202609050000004148lb # [ 24.267447] niks3-server[999]: 2026/09/20 12:22:26 OK 1_commit_pending_closure.sql (6.52ms)4149lb # [ 24.270077] niks3-server[999]: 2026/09/20 12:22:26 OK 2_object_stats_trigger.sql (1.39ms)4150lb # [ 24.271251] niks3-server[999]: 2026/09/20 12:22:26 goose: up to current file version: 24151lb # [ 24.278054] niks3-server[999]: 2026/09/20 12:22:26 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4152lb # [ 24.362119] niks3-server[999]: 2026/09/20 12:22:26 INFO Read proxy enabled — serving cache objects from S34153lb # [ 24.365481] niks3-server[999]: 2026/09/20 12:22:26 INFO Using socket-activated listener address=0.0.0.0:57514154lb # [ 24.367705] niks3-server[999]: 2026/09/20 12:22:26 INFO systemd watchdog enabled interval=15s4155lb # [ 24.369291] systemd[1]: Started niks3 server.4156lb # [ 24.370774] systemd[1]: Reached target Multi-User System.4157lb # [ 24.372332] niks3-server[999]: 2026/09/20 12:22:26 INFO Starting HTTP server address=0.0.0.0:57514158lb # [ 24.375775] systemd[1]: Startup finished in 878ms (kernel) + 4.056s (initrd) + 19.440s (userspace) = 24.375s.4159lb: (finished: waiting for unit niks3.service, in 14.12 seconds)4160lb: waiting for TCP port 5751 on localhost4161lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4162lb: (finished: waiting for TCP port 5751 on localhost, in 0.07 seconds)4163lb: waiting for unit envoy.service4164lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4165lb: waiting for TCP port 50051 on localhost4166lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4167lb # [ 25.352804] envoy[907]: conn peer=[::1]:58784 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=34168lb: (finished: waiting for TCP port 50051 on localhost, in 0.04 seconds)4169worker2 # [ 25.469876] systemd[1]: Starting scheduler-token.service...4170worker2 # [ 25.534361] systemd[1]: scheduler-token.service: Deactivated successfully.4171worker2 # [ 25.536219] systemd[1]: Finished scheduler-token.service.4172worker2 # [ 25.537616] systemd[1]: scheduler-token.service: Consumed 21ms CPU time over 67ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4173lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4174??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4175 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284176lb: must succeed: curl -sf localhost:9901/clusters4177lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4178lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds)4179lb: waiting until exactly no endpoints of sched are unhealthy4180lb: must succeed: curl -sf localhost:9901/clusters4181lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4182lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 0.04 seconds)4183subtest: both builders hold a WorkerSession on the scheduler, worker2 by OIDC token4184worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4185worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.08 seconds)4186worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'4187worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.03 seconds)4188(finished: subtest: both builders hold a WorkerSession on the scheduler, worker2 by OIDC token, in 0.10 seconds)4189subtest: balancer auth: client cert, bearer token, nothing, unknown CN4190worker1 # [ 26.129672] nix-grpc-daemon[786]: ts=2026-09-20T12:22:27Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:584104191worker1 # [ 26.142532] systemd[1]: Started Nix Daemon.4192worker1 # [ 26.354136] nix-daemon[847]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4193worker1 # [ 26.409475] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5)4194worker1 # [ 26.470657] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 139 ms (attempt 2/5)4195worker1 # [ 26.612541] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 380 ms (attempt 3/5)4196worker1 # [ 26.998473] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 330 ms (attempt 4/5)4197worker1 # [ 27.340801] nix-grpc-daemon[786]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4198worker1 # [ 27.368735] nix-grpc-daemon[786]: ts=2026-09-20T12:22:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:584104199worker1 # [ 27.385594] nix-grpc-daemon[786]: ts=2026-09-20T12:22:29Z level=debug event=path_info_miss path=abf5y6lmj712ajsgxzvih1228b4c7xja-nixos-system-client-test error="error: path '/nix/store/abf5y6lmj712ajsgxzvih1228b4c7xja-nixos-system-client-test' is required, but there is no substituter that can build it"4200worker2 # [ 27.388597] nix-grpc-daemon[788]: ts=2026-09-20T12:22:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:430684201worker2 # [ 27.401421] systemd[1]: Started Nix Daemon.4202worker2 # [ 27.623150] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4203worker2 # [ 27.653755] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 1/5)4204worker2 # [ 27.687271] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 193 ms (attempt 2/5)4205worker2 # [ 27.882995] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 113 ms (attempt 3/5)4206worker2 # [ 27.999070] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 766 ms (attempt 4/5)4207worker2 # [ 28.775699] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4208worker2 # [ 28.796181] nix-grpc-daemon[788]: ts=2026-09-20T12:22:30Z level=debug event=path_info_miss path=abf5y6lmj712ajsgxzvih1228b4c7xja-nixos-system-client-test error="error: path '/nix/store/abf5y6lmj712ajsgxzvih1228b4c7xja-nixos-system-client-test' is required, but there is no substituter that can build it"4209client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4210client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.08 seconds)4211client: must succeed: install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4212client: (finished: must succeed: install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds)4213worker2 # [ 29.178812] nix-grpc-daemon[788]: ts=2026-09-20T12:22:31Z level=info event=oidc_jwks provider=mock keys=14214worker2 # [ 29.184180] nix-grpc-daemon[788]: ts=2026-09-20T12:22:31Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:430684215worker1 # [ 29.226393] nix-grpc-daemon[786]: ts=2026-09-20T12:22:31Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:584104216worker1 # [ 29.235951] nix-grpc-daemon[786]: ts=2026-09-20T12:22:31Z level=debug event=path_info_miss path=abf5y6lmj712ajsgxzvih1228b4c7xja-nixos-system-client-test error="error: path '/nix/store/abf5y6lmj712ajsgxzvih1228b4c7xja-nixos-system-client-test' is required, but there is no substituter that can build it"4217worker2 # [ 29.226082] nix-grpc-daemon[788]: ts=2026-09-20T12:22:31Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:430684218worker2 # [ 29.235498] nix-grpc-daemon[788]: ts=2026-09-20T12:22:31Z level=debug event=path_info_miss path=abf5y6lmj712ajsgxzvih1228b4c7xja-nixos-system-client-test error="error: path '/nix/store/abf5y6lmj712ajsgxzvih1228b4c7xja-nixos-system-client-test' is required, but there is no substituter that can build it"4219client: must succeed: rm -r /var/lib/nix-grpc-store4220client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.04 seconds)4221worker2 # [ 31.491282] nix-grpc-daemon[788]: ts=2026-09-20T12:22:33Z level=info event=denied method=QueryMissing cn=- role=none4222worker2 # [ 31.697523] nix-grpc-daemon[788]: ts=2026-09-20T12:22:33Z level=info event=denied method=QueryMissing cn=stranger role=none4223(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 5.95 seconds)4224subtest: DAG build is scheduled across workers and lands in the cache4225client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24226worker2 # [ 31.925699] nix-grpc-daemon[788]: ts=2026-09-20T12:22:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:430684227client # don't know how to build these paths:4228client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4229worker1 # [ 31.955254] nix-grpc-daemon[786]: ts=2026-09-20T12:22:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:584104230worker1 # [ 31.987754] nix-grpc-daemon[786]: ts=2026-09-20T12:22:33Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04231worker1 # [ 31.992157] nix-grpc-daemon[786]: ts=2026-09-20T12:22:33Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14232worker2 # [ 32.030167] nix-grpc-daemon[788]: ts=2026-09-20T12:22:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684233worker2 # [ 32.053343] nix-grpc-daemon[788]: ts=2026-09-20T12:22:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430684234client # copying 1 paths to 'lb:50051'...4235worker2 # [ 32.067432] nix-grpc-daemon[788]: ts=2026-09-20T12:22:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430684236client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4237worker2 # [ 32.099701] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4238worker2 # [ 32.128774] nix-grpc-daemon[788]: ts=2026-09-20T12:22:33Z level=info event=niks3_push_started pid=8234239worker2 # [ 32.410385] nix-grpc-daemon[823]: time=2026-09-20T12:22:34.242Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""4240worker2 # [ 32.592817] nix-daemon[813]: accepted connection from pid 835, user nix-grpc-daemon (trusted)4241worker2 # [ 32.608050] nix-daemon[813]: reaped child process 838, status = succeeded4242worker2 # [ 32.780641] nix-daemon[813]: accepted connection from pid 841, user nix-grpc-daemon (trusted)4243worker2 # [ 32.795684] nix-daemon[813]: reaped child process 845, status = succeeded4244lb # [ 32.823252] niks3-server[999]: 2026/09/20 12:22:34 INFO Received uploads request method=POST path=/api/pending_closures4245worker2 # [ 32.958266] nix-grpc-daemon[823]: time=2026-09-20T12:22:34.793Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4246worker2 # [ 32.963682] nix-grpc-daemon[823]: time=2026-09-20T12:22:34.798Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4247lb # [ 33.035703] niks3-server[999]: 2026/09/20 12:22:35 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4248lb # [ 33.042847] niks3-server[999]: 2026/09/20 12:22:35 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4249lb # [ 33.052203] niks3-server[999]: 2026/09/20 12:22:35 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4250lb # [ 33.064566] niks3-server[999]: 2026/09/20 12:22:35 INFO Signed narinfos id=1 count=14251worker2 # [ 33.055605] nix-grpc-daemon[823]: time=2026-09-20T12:22:34.890Z level=INFO msg="Uploading 1 narinfos"4252lb # [ 33.078396] niks3-server[999]: 2026/09/20 12:22:35 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4253lb # [ 33.087092] niks3-server[999]: 2026/09/20 12:22:35 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4254lb # [ 33.092571] niks3-server[999]: 2026/09/20 12:22:35 INFO Completed upload id=14255worker2 # [ 33.081177] nix-grpc-daemon[823]: time=2026-09-20T12:22:34.916Z level=INFO msg="Upload complete. (654ms)"4256worker2 # [ 33.087494] nix-grpc-daemon[788]: ts=2026-09-20T12:22:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=1 paths=1 nar_bytes_in=5044257worker2 # [ 33.093823] nix-grpc-daemon[788]: ts=2026-09-20T12:22:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684258worker2 # [ 33.108598] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4259worker2 # [ 33.119233] nix-daemon[813]: reaped child process 821, status = succeeded4260client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4261client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4262worker2 # [ 33.126186] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4263client # farm-a> LOG-farm-a-t14264worker2 # [ 34.756171] nix-daemon[813]: reaped child process 849, status = succeeded4265worker2 # [ 34.915591] nix-daemon[813]: accepted connection from pid 864, user nix-grpc-daemon (trusted)4266worker2 # [ 34.928641] nix-daemon[813]: reaped child process 867, status = succeeded4267lb # [ 34.955725] niks3-server[999]: 2026/09/20 12:22:36 INFO Received uploads request method=POST path=/api/pending_closures4268worker2 # [ 34.954509] nix-grpc-daemon[823]: time=2026-09-20T12:22:36.789Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4269worker2 # [ 34.956158] nix-grpc-daemon[823]: time=2026-09-20T12:22:36.791Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4270lb # [ 35.000772] niks3-server[999]: 2026/09/20 12:22:36 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4271lb # [ 35.008282] niks3-server[999]: 2026/09/20 12:22:36 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4272lb # [ 35.022122] niks3-server[999]: 2026/09/20 12:22:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4273lb # [ 35.026604] niks3-server[999]: 2026/09/20 12:22:36 INFO Signed narinfos id=2 count=14274worker2 # [ 35.018183] nix-grpc-daemon[823]: time=2026-09-20T12:22:36.853Z level=INFO msg="Uploading 1 narinfos"4275lb # [ 35.031475] niks3-server[999]: 2026/09/20 12:22:37 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4276lb # [ 35.042441] niks3-server[999]: 2026/09/20 12:22:37 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4277lb # [ 35.048662] niks3-server[999]: 2026/09/20 12:22:37 INFO Completed upload id=24278worker2 # [ 35.036649] nix-grpc-daemon[823]: time=2026-09-20T12:22:36.872Z level=INFO msg="Upload complete. (293ms)"4279lb # [ 35.050437] niks3-server[999]: 2026/09/20 12:22:37 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4280worker2 # [ 35.042902] nix-grpc-daemon[788]: ts=2026-09-20T12:22:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14281worker2 # [ 35.056216] nix-daemon[813]: reaped child process 847, status = succeeded4282worker1 # [ 35.076884] nix-grpc-daemon[786]: ts=2026-09-20T12:22:36Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04283worker1 # [ 35.081296] nix-grpc-daemon[786]: ts=2026-09-20T12:22:36Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14284worker2 # [ 35.113636] nix-grpc-daemon[788]: ts=2026-09-20T12:22:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684285worker2 # [ 35.123902] nix-grpc-daemon[788]: ts=2026-09-20T12:22:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430684286worker2 # [ 35.134289] nix-grpc-daemon[823]: time=2026-09-20T12:22:36.969Z level=INFO msg="All 1 paths already cached"4287client # copying 1 paths to 'lb:50051'...4288worker2 # [ 35.141547] nix-grpc-daemon[788]: ts=2026-09-20T12:22:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430684289client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4290worker2 # [ 35.159829] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4291worker2 # [ 35.326959] nix-daemon[813]: accepted connection from pid 871, user nix-grpc-daemon (trusted)4292worker2 # [ 35.341676] nix-daemon[813]: reaped child process 874, status = succeeded4293worker2 # [ 35.508969] nix-daemon[813]: accepted connection from pid 876, user nix-grpc-daemon (trusted)4294worker2 # [ 35.522620] nix-daemon[813]: reaped child process 879, status = succeeded4295lb # [ 35.548545] niks3-server[999]: 2026/09/20 12:22:37 INFO Received uploads request method=POST path=/api/pending_closures4296worker2 # [ 35.652838] nix-grpc-daemon[823]: time=2026-09-20T12:22:37.488Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4297worker2 # [ 35.658571] nix-grpc-daemon[823]: time=2026-09-20T12:22:37.492Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4298lb # [ 35.679887] niks3-server[999]: 2026/09/20 12:22:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4299lb # [ 35.682059] niks3-server[999]: 2026/09/20 12:22:37 INFO Signed narinfos id=3 count=14300worker2 # [ 35.671600] nix-grpc-daemon[823]: time=2026-09-20T12:22:37.506Z level=INFO msg="Uploading 1 narinfos"4301lb # [ 35.684991] niks3-server[999]: 2026/09/20 12:22:37 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4302lb # [ 35.694670] niks3-server[999]: 2026/09/20 12:22:37 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4303lb # [ 35.700675] niks3-server[999]: 2026/09/20 12:22:37 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4304lb # [ 35.708797] niks3-server[999]: 2026/09/20 12:22:37 INFO Completed upload id=34305worker2 # [ 35.697310] nix-grpc-daemon[823]: time=2026-09-20T12:22:37.532Z level=INFO msg="Upload complete. (522ms)"4306worker2 # [ 35.702139] nix-grpc-daemon[788]: ts=2026-09-20T12:22:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=0 paths=1 nar_bytes_in=6244307lb # [ 35.720918] niks3-server[999]: 2026/09/20 12:22:37 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4308worker2 # [ 35.708327] nix-grpc-daemon[788]: ts=2026-09-20T12:22:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684309worker2 # [ 35.719427] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4310worker2 # [ 35.729797] nix-daemon[813]: reaped child process 869, status = succeeded4311client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4312worker2 # [ 35.739152] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4313client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4314client # farm-b> LOG-farm-b-t14315worker2 # [ 37.158278] nix-daemon[813]: reaped child process 883, status = succeeded4316lb # [ 37.233239] envoy[907]: conn peer=[2001:db8:1::1]:41292 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=27374317lb # [ 37.236911] envoy[907]: conn peer=[2001:db8:1::1]:41298 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=387 ms=854318lb # [ 37.240390] envoy[907]: conn peer=[2001:db8:1::1]:41306 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=94319lb # [ 37.243666] envoy[907]: conn peer=[2001:db8:1::1]:41308 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=84320worker2 # [ 37.299384] nix-daemon[813]: accepted connection from pid 899, user nix-grpc-daemon (trusted)4321worker2 # [ 37.311283] nix-daemon[813]: reaped child process 902, status = succeeded4322lb # [ 37.334293] niks3-server[999]: 2026/09/20 12:22:39 INFO Received uploads request method=POST path=/api/pending_closures4323worker2 # [ 37.403863] nix-grpc-daemon[823]: time=2026-09-20T12:22:39.239Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4324worker2 # [ 37.407705] nix-grpc-daemon[823]: time=2026-09-20T12:22:39.241Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4325lb # [ 37.442449] niks3-server[999]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4326lb # [ 37.457528] niks3-server[999]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4327lb # [ 37.465914] niks3-server[999]: 2026/09/20 12:22:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4328lb # [ 37.472215] niks3-server[999]: 2026/09/20 12:22:39 INFO Signed narinfos id=4 count=14329worker2 # [ 37.460994] nix-grpc-daemon[823]: time=2026-09-20T12:22:39.296Z level=INFO msg="Uploading 1 narinfos"4330lb # [ 37.475975] niks3-server[999]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4331lb # [ 37.485328] niks3-server[999]: 2026/09/20 12:22:39 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4332lb # [ 37.494600] niks3-server[999]: 2026/09/20 12:22:39 INFO Completed upload id=44333lb # [ 37.496429] niks3-server[999]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4334worker2 # [ 37.483129] nix-grpc-daemon[823]: time=2026-09-20T12:22:39.318Z level=INFO msg="Upload complete. (332ms)"4335worker1 # [ 37.506763] nix-grpc-daemon[786]: ts=2026-09-20T12:22:39Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04336worker2 # [ 37.488984] nix-grpc-daemon[788]: ts=2026-09-20T12:22:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14337worker1 # [ 37.508562] nix-grpc-daemon[786]: ts=2026-09-20T12:22:39Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14338worker2 # [ 37.504687] nix-daemon[813]: reaped child process 881, status = succeeded4339worker2 # [ 37.537719] nix-grpc-daemon[788]: ts=2026-09-20T12:22:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684340worker2 # [ 37.550663] nix-grpc-daemon[788]: ts=2026-09-20T12:22:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430684341worker2 # [ 37.565263] nix-grpc-daemon[823]: time=2026-09-20T12:22:39.400Z level=INFO msg="All 2 paths already cached"4342client # copying 1 paths to 'lb:50051'...4343worker2 # [ 37.574574] nix-grpc-daemon[788]: ts=2026-09-20T12:22:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430684344client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4345worker2 # [ 37.594161] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4346worker2 # [ 37.765471] nix-daemon[813]: accepted connection from pid 906, user nix-grpc-daemon (trusted)4347worker2 # [ 37.778471] nix-daemon[813]: reaped child process 909, status = succeeded4348worker2 # [ 37.910526] nix-daemon[813]: accepted connection from pid 911, user nix-grpc-daemon (trusted)4349worker2 # [ 37.924920] nix-daemon[813]: reaped child process 914, status = succeeded4350lb # [ 37.947281] niks3-server[999]: 2026/09/20 12:22:39 INFO Received uploads request method=POST path=/api/pending_closures4351worker2 # [ 37.945624] nix-grpc-daemon[823]: time=2026-09-20T12:22:39.781Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4352worker2 # [ 37.947021] nix-grpc-daemon[823]: time=2026-09-20T12:22:39.781Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4353lb # [ 37.977545] niks3-server[999]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4354lb # [ 37.989816] niks3-server[999]: 2026/09/20 12:22:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4355lb # [ 37.992208] niks3-server[999]: 2026/09/20 12:22:39 INFO Signed narinfos id=5 count=14356worker2 # [ 37.981954] nix-grpc-daemon[823]: time=2026-09-20T12:22:39.817Z level=INFO msg="Uploading 1 narinfos"4357lb # [ 37.999610] niks3-server[999]: 2026/09/20 12:22:39 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4358lb # [ 38.003634] niks3-server[999]: 2026/09/20 12:22:39 INFO Completed upload id=54359worker2 # [ 37.991430] nix-grpc-daemon[823]: time=2026-09-20T12:22:39.827Z level=WARN msg="Failed to register uploaded object" key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo error="server returned 404: object is not pending upload\n"4360lb # [ 38.005067] niks3-server[999]: 2026/09/20 12:22:39 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4361worker2 # [ 37.994648] nix-grpc-daemon[823]: time=2026-09-20T12:22:39.829Z level=INFO msg="Upload complete. (385ms)"4362worker2 # [ 37.996318] nix-grpc-daemon[788]: ts=2026-09-20T12:22:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=0 paths=1 nar_bytes_in=7524363worker2 # [ 37.999195] nix-grpc-daemon[788]: ts=2026-09-20T12:22:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684364worker2 # [ 38.005062] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4365worker2 # [ 38.010119] nix-daemon[813]: reaped child process 904, status = succeeded4366worker2 # [ 38.014174] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4367client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4368client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4369client # farm-top> LOG-farm-top-t14370worker2 # [ 39.229849] nix-daemon[813]: reaped child process 918, status = succeeded4371worker2 # [ 39.374257] nix-daemon[813]: accepted connection from pid 934, user nix-grpc-daemon (trusted)4372worker2 # [ 39.388610] nix-daemon[813]: reaped child process 937, status = succeeded4373lb # [ 39.416833] niks3-server[999]: 2026/09/20 12:22:41 INFO Received uploads request method=POST path=/api/pending_closures4374worker2 # [ 39.425110] nix-grpc-daemon[823]: time=2026-09-20T12:22:41.260Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4375worker2 # [ 39.427754] nix-grpc-daemon[823]: time=2026-09-20T12:22:41.262Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4376lb # [ 39.474613] niks3-server[999]: 2026/09/20 12:22:41 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4377lb # [ 39.486544] niks3-server[999]: 2026/09/20 12:22:41 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4378lb # [ 39.494084] niks3-server[999]: 2026/09/20 12:22:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4379worker2 # [ 39.488074] nix-grpc-daemon[823]: time=2026-09-20T12:22:41.323Z level=INFO msg="Uploading 1 narinfos"4380lb # [ 39.499494] niks3-server[999]: 2026/09/20 12:22:41 INFO Signed narinfos id=6 count=14381lb # [ 39.505056] niks3-server[999]: 2026/09/20 12:22:41 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4382lb # [ 39.511259] niks3-server[999]: 2026/09/20 12:22:41 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4383lb # [ 39.515145] niks3-server[999]: 2026/09/20 12:22:41 INFO Completed upload id=64384worker2 # [ 39.503410] nix-grpc-daemon[823]: time=2026-09-20T12:22:41.339Z level=INFO msg="Upload complete. (282ms)"4385lb # [ 39.516939] niks3-server[999]: 2026/09/20 12:22:41 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4386worker2 # [ 39.506573] nix-grpc-daemon[788]: ts=2026-09-20T12:22:41Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14387worker2 # [ 39.514959] nix-daemon[813]: reaped child process 916, status = succeeded4388client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 7.83 seconds)4389client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4390client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.20 seconds)4391client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4392client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds)4393client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4394client # copying 3 paths...4395client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4396client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4397client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4398client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds)4399(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 8.38 seconds)4400subtest: repeat is answered Cached by the scheduler without building4401worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4402worker1 # finding garbage collector roots...4403worker1 # deleting specified paths...4404worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4405worker1 # deleting unused links...4406worker1 # note: hard linking is currently saving 0.0 KiB4407worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.26 seconds)4408worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4409worker2 # finding garbage collector roots...4410worker2 # deleting specified paths...4411worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4412worker2 # deleting unused links...4413worker2 # note: hard linking is currently saving 0.0 KiB4414worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.26 seconds)4415client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24416worker2 # [ 40.837711] nix-grpc-daemon[788]: ts=2026-09-20T12:22:42Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:430684417client # this path will be fetched (0.0 KiB download, 0.2 KiB unpacked):4418client # /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4419worker2 # [ 40.856157] nix-grpc-daemon[788]: ts=2026-09-20T12:22:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430684420worker2 # [ 40.866332] nix-grpc-daemon[823]: time=2026-09-20T12:22:42.701Z level=INFO msg="All 2 paths already cached"4421worker1 # [ 40.925634] nix-grpc-daemon[786]: ts=2026-09-20T12:22:42Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14422client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.33 seconds)4423client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4424client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.18 seconds)4425worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4426worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4427(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.17 seconds)4428subtest: inputs already in the cache are not sent to the scheduler4429worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4430worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds)4431client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24432client # don't know how to build these paths:4433client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4434worker2 # [ 41.505910] nix-grpc-daemon[788]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:430684435worker2 # [ 41.512764] nix-grpc-daemon[788]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430684436worker2 # [ 41.517943] nix-grpc-daemon[823]: time=2026-09-20T12:22:43.352Z level=INFO msg="All 2 paths already cached"4437worker1 # [ 41.540358] nix-grpc-daemon[786]: ts=2026-09-20T12:22:43Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04438worker1 # [ 41.544737] nix-grpc-daemon[786]: ts=2026-09-20T12:22:43Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=14439worker2 # [ 41.570620] nix-grpc-daemon[788]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684440worker2 # [ 41.583879] nix-grpc-daemon[788]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430684441worker2 # [ 41.597780] nix-grpc-daemon[823]: time=2026-09-20T12:22:43.433Z level=INFO msg="All 2 paths already cached"4442client # copying 1 paths to 'lb:50051'...4443client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4444worker2 # [ 41.606594] nix-grpc-daemon[788]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430684445worker2 # [ 41.615936] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4446worker2 # [ 41.790566] nix-daemon[813]: accepted connection from pid 954, user nix-grpc-daemon (trusted)4447worker2 # [ 41.804049] nix-daemon[813]: reaped child process 957, status = succeeded4448worker2 # [ 41.959870] nix-daemon[813]: accepted connection from pid 959, user nix-grpc-daemon (trusted)4449worker2 # [ 41.972944] nix-daemon[813]: reaped child process 962, status = succeeded4450lb # [ 42.001570] niks3-server[999]: 2026/09/20 12:22:43 INFO Received uploads request method=POST path=/api/pending_closures4451worker2 # [ 41.996545] nix-grpc-daemon[823]: time=2026-09-20T12:22:43.832Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4452worker2 # [ 41.998536] nix-grpc-daemon[823]: time=2026-09-20T12:22:43.833Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4453lb # [ 42.029176] niks3-server[999]: 2026/09/20 12:22:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4454lb # [ 42.032074] niks3-server[999]: 2026/09/20 12:22:44 INFO Signed narinfos id=7 count=14455worker2 # [ 42.021897] nix-grpc-daemon[823]: time=2026-09-20T12:22:43.857Z level=INFO msg="Uploading 1 narinfos"4456lb # [ 42.036782] niks3-server[999]: 2026/09/20 12:22:44 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4457lb # [ 42.039850] niks3-server[999]: 2026/09/20 12:22:44 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4458lb # [ 42.045311] niks3-server[999]: 2026/09/20 12:22:44 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4459lb # [ 42.049864] niks3-server[999]: 2026/09/20 12:22:44 INFO Completed upload id=74460worker2 # [ 42.038145] nix-grpc-daemon[823]: time=2026-09-20T12:22:43.873Z level=INFO msg="Upload complete. (407ms)"4461lb # [ 42.051635] niks3-server[999]: 2026/09/20 12:22:44 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4462worker2 # [ 42.040509] nix-grpc-daemon[788]: ts=2026-09-20T12:22:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=0 paths=1 nar_bytes_in=7524463worker2 # [ 42.043684] nix-grpc-daemon[788]: ts=2026-09-20T12:22:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684464worker2 # [ 42.049797] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4465worker2 # [ 42.053366] nix-daemon[813]: reaped child process 952, status = succeeded4466client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4467client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4468worker2 # [ 42.058184] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4469worker2 # [ 43.071523] nix-daemon[813]: reaped child process 966, status = succeeded4470client # farm-top> LOG-farm-top-t1b4471worker2 # [ 43.218544] nix-daemon[813]: accepted connection from pid 982, user nix-grpc-daemon (trusted)4472worker2 # [ 43.231700] nix-daemon[813]: reaped child process 985, status = succeeded4473lb # [ 43.261859] niks3-server[999]: 2026/09/20 12:22:45 INFO Received uploads request method=POST path=/api/pending_closures4474worker2 # [ 43.259932] nix-grpc-daemon[823]: time=2026-09-20T12:22:45.095Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4475worker2 # [ 43.261896] nix-grpc-daemon[823]: time=2026-09-20T12:22:45.097Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4476lb # [ 43.300214] niks3-server[999]: 2026/09/20 12:22:45 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4477lb # [ 43.311245] niks3-server[999]: 2026/09/20 12:22:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4478worker2 # [ 43.305146] nix-grpc-daemon[823]: time=2026-09-20T12:22:45.140Z level=INFO msg="Uploading 1 narinfos"4479lb # [ 43.317281] niks3-server[999]: 2026/09/20 12:22:45 INFO Signed narinfos id=8 count=14480lb # [ 43.325854] niks3-server[999]: 2026/09/20 12:22:45 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4481lb # [ 43.329701] niks3-server[999]: 2026/09/20 12:22:45 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4482lb # [ 43.334651] niks3-server[999]: 2026/09/20 12:22:45 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4483lb # [ 43.337851] niks3-server[999]: 2026/09/20 12:22:45 INFO Completed upload id=84484lb # [ 43.339653] niks3-server[999]: 2026/09/20 12:22:45 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4485worker2 # [ 43.327665] nix-grpc-daemon[823]: time=2026-09-20T12:22:45.163Z level=INFO msg="Upload complete. (263ms)"4486worker2 # [ 43.333323] nix-grpc-daemon[788]: ts=2026-09-20T12:22:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14487worker2 # [ 43.343973] nix-daemon[813]: reaped child process 964, status = succeeded4488client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 2.06 seconds)4489client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4490client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.15 seconds)4491worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4492worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.05 seconds)4493(finished: subtest: inputs already in the cache are not sent to the scheduler, in 2.29 seconds)4494subtest: two clients wanting the same drv build it once4495client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4496client # [ 43.601353] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4497client # Running as unit: dedup1.service; invocation ID: dcacfca2ad1a4c1c897d4c0bb147b5104498client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.04 seconds)4499client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4500worker1 # [ 43.767272] nix-grpc-daemon[786]: ts=2026-09-20T12:22:45Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:584104501client # [ 43.773703] nix[891]: don't know how to build these paths:4502client # [ 43.775174] nix[891]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4503worker1 # [ 43.782379] nix-grpc-daemon[786]: ts=2026-09-20T12:22:45Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04504worker1 # [ 43.787929] nix-grpc-daemon[786]: ts=2026-09-20T12:22:45Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14505worker1 # [ 43.793248] nix-grpc-daemon[786]: ts=2026-09-20T12:22:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:584104506worker1 # [ 43.808748] nix-grpc-daemon[786]: ts=2026-09-20T12:22:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:584104507client # [ 43.818734] nix[891]: copying 1 paths to 'lb:50051'...4508client # [ 43.819585] nix[891]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4509worker1 # [ 43.819374] nix-grpc-daemon[786]: ts=2026-09-20T12:22:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:584104510worker1 # [ 43.832563] nix-daemon[847]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4511worker1 # [ 43.854472] nix-grpc-daemon[786]: ts=2026-09-20T12:22:45Z level=info event=niks3_push_started pid=9004512worker1 # [ 44.115604] nix-grpc-daemon[900]: time=2026-09-20T12:22:45.926Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""4513worker1 # [ 44.315716] nix-daemon[847]: accepted connection from pid 912, user nix-grpc-daemon (trusted)4514worker1 # [ 44.331862] nix-daemon[847]: reaped child process 915, status = succeeded4515worker1 # [ 44.501210] nix-daemon[847]: accepted connection from pid 918, user nix-grpc-daemon (trusted)4516worker1 # [ 44.514153] nix-daemon[847]: reaped child process 921, status = succeeded4517lb # [ 44.529455] niks3-server[999]: 2026/09/20 12:22:46 INFO Received uploads request method=POST path=/api/pending_closures4518worker1 # [ 44.539435] nix-grpc-daemon[900]: time=2026-09-20T12:22:46.353Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4519worker1 # [ 44.541760] nix-grpc-daemon[900]: time=2026-09-20T12:22:46.356Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4520lb # [ 44.567547] niks3-server[999]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4521lb # [ 44.574647] niks3-server[999]: 2026/09/20 12:22:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4522lb # [ 44.579382] niks3-server[999]: 2026/09/20 12:22:46 INFO Signed narinfos id=9 count=14523worker1 # [ 44.584213] nix-grpc-daemon[900]: time=2026-09-20T12:22:46.398Z level=INFO msg="Uploading 1 narinfos"4524lb # [ 44.591764] niks3-server[999]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4525lb # [ 44.601495] niks3-server[999]: 2026/09/20 12:22:46 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4526worker1 # [ 44.609695] nix-grpc-daemon[900]: time=2026-09-20T12:22:46.423Z level=INFO msg="Upload complete. (476ms)"4527lb # [ 44.608061] niks3-server[999]: 2026/09/20 12:22:46 INFO Completed upload id=94528worker1 # [ 44.611602] nix-grpc-daemon[786]: ts=2026-09-20T12:22:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58410 duration_s=0 paths=1 nar_bytes_in=4324529lb # [ 44.611618] niks3-server[999]: 2026/09/20 12:22:46 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4530worker1 # [ 44.618371] nix-grpc-daemon[786]: ts=2026-09-20T12:22:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:584104531worker1 # [ 44.622141] nix-daemon[847]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4532worker1 # [ 44.624399] nix-daemon[847]: reaped child process 898, status = succeeded4533worker1 # [ 44.629941] nix-daemon[847]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4534client # [ 44.629546] nix[891]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4535client # [ 44.667471] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4536client # Running as unit: dedup2.service; invocation ID: 2b18e262320b4ff39854bd70b1cf3d794537client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds)4538client # [ 44.923945] nix[906]: don't know how to build these paths:4539client # [ 44.924925] nix[906]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4540worker2 # [ 44.909583] nix-grpc-daemon[788]: ts=2026-09-20T12:22:46Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:430684541worker1 # [ 44.932304] nix-grpc-daemon[786]: ts=2026-09-20T12:22:46Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04542client # [ 44.938311] nix[906]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4543worker1 # [ 44.937849] nix-grpc-daemon[786]: ts=2026-09-20T12:22:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:584104544client: must succeed: sleep 24545lb # [ 47.233419] envoy[907]: conn peer=[2001:db8:1::1]:41322 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9537 tx=3844 ms=76234546lb # [ 47.237233] envoy[907]: conn peer=[2001:db8:1::1]:36596 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=476 ms=894547lb # [ 47.240652] envoy[907]: conn peer=[2001:db8:1::1]:36610 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4152 tx=1688 ms=18384548client: (finished: must succeed: sleep 2, in 2.05 seconds)4549??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4550 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394551client: waiting for success: ! systemctl is-active dedup1 dedup24552??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4553 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394554worker1 # [ 48.260864] nix-daemon[847]: reaped child process 925, status = succeeded4555worker1 # [ 48.432657] nix-daemon[847]: accepted connection from pid 956, user nix-grpc-daemon (trusted)4556worker1 # [ 48.444606] nix-daemon[847]: reaped child process 959, status = succeeded4557lb # [ 48.458773] niks3-server[999]: 2026/09/20 12:22:50 INFO Received uploads request method=POST path=/api/pending_closures4558worker1 # [ 48.468753] nix-grpc-daemon[900]: time=2026-09-20T12:22:50.282Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4559worker1 # [ 48.470226] nix-grpc-daemon[900]: time=2026-09-20T12:22:50.284Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4560lb # [ 48.502173] niks3-server[999]: 2026/09/20 12:22:50 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4561lb # [ 48.509465] niks3-server[999]: 2026/09/20 12:22:50 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4562lb # [ 48.522959] niks3-server[999]: 2026/09/20 12:22:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4563lb # [ 48.529180] niks3-server[999]: 2026/09/20 12:22:50 INFO Signed narinfos id=10 count=14564worker1 # [ 48.534117] nix-grpc-daemon[900]: time=2026-09-20T12:22:50.347Z level=INFO msg="Uploading 1 narinfos"4565lb # [ 48.533529] niks3-server[999]: 2026/09/20 12:22:50 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4566lb # [ 48.544092] niks3-server[999]: 2026/09/20 12:22:50 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4567lb # [ 48.547915] niks3-server[999]: 2026/09/20 12:22:50 INFO Completed upload id=104568worker1 # [ 48.550080] nix-grpc-daemon[900]: time=2026-09-20T12:22:50.364Z level=INFO msg="Upload complete. (305ms)"4569lb # [ 48.550145] niks3-server[999]: 2026/09/20 12:22:50 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4570worker1 # [ 48.557749] nix-grpc-daemon[786]: ts=2026-09-20T12:22:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58410 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14571worker1 # [ 48.563926] nix-grpc-daemon[786]: ts=2026-09-20T12:22:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58410 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14572worker1 # [ 48.574268] nix-daemon[847]: reaped child process 923, status = succeeded4573client # [ 48.601490] systemd[1]: dedup1.service: Deactivated successfully.4574client # [ 48.608169] systemd[1]: dedup1.service: Consumed 103ms CPU time over 5.002s wall clock time, 39.3M memory peak, 8.7K incoming IP traffic, 9.1K outgoing IP traffic.4575client # [ 48.639382] systemd[1]: dedup2.service: Deactivated successfully.4576client # [ 48.640778] systemd[1]: dedup2.service: Consumed 126ms CPU time over 3.973s wall clock time, 33.2M memory peak, 7.6K incoming IP traffic, 6.4K outgoing IP traffic.4577client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.07 seconds)4578client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4579client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.03 seconds)4580worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4581worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4582worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4583worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.04 seconds)4584worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4585worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)4586worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4587worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)4588(finished: subtest: two clients wanting the same drv build it once, in 5.81 seconds)4589subtest: build hook: nix-daemon with builders = grpc://lb4590client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4591client # [ 49.565742] systemd[1]: Started Nix Daemon.4592client # [ 49.721457] nix-daemon[947]: accepted connection from pid 944, user root (trusted)4593worker2 # [ 49.880617] nix-grpc-daemon[788]: ts=2026-09-20T12:22:51Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:430684594worker1 # [ 49.900675] nix-grpc-daemon[786]: ts=2026-09-20T12:22:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:584104595worker1 # [ 49.916929] nix-grpc-daemon[786]: ts=2026-09-20T12:22:51Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04596worker1 # [ 49.921168] nix-grpc-daemon[786]: ts=2026-09-20T12:22:51Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14597worker2 # [ 49.947458] nix-grpc-daemon[788]: ts=2026-09-20T12:22:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684598worker2 # [ 49.955998] nix-grpc-daemon[788]: ts=2026-09-20T12:22:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430684599worker2 # [ 49.963803] nix-grpc-daemon[788]: ts=2026-09-20T12:22:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430684600worker2 # [ 49.969480] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4601worker2 # [ 50.136692] nix-daemon[813]: accepted connection from pid 1010, user nix-grpc-daemon (trusted)4602worker2 # [ 50.151322] nix-daemon[813]: reaped child process 1013, status = succeeded4603worker2 # [ 50.309678] nix-daemon[813]: accepted connection from pid 1015, user nix-grpc-daemon (trusted)4604worker2 # [ 50.322493] nix-daemon[813]: reaped child process 1018, status = succeeded4605lb # [ 50.351298] niks3-server[999]: 2026/09/20 12:22:52 INFO Received uploads request method=POST path=/api/pending_closures4606worker2 # [ 50.347691] nix-grpc-daemon[823]: time=2026-09-20T12:22:52.183Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4607worker2 # [ 50.349523] nix-grpc-daemon[823]: time=2026-09-20T12:22:52.184Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4608lb # [ 50.384512] niks3-server[999]: 2026/09/20 12:22:52 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4609lb # [ 50.395760] niks3-server[999]: 2026/09/20 12:22:52 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4610worker2 # [ 50.388984] nix-grpc-daemon[823]: time=2026-09-20T12:22:52.224Z level=INFO msg="Uploading 1 narinfos"4611lb # [ 50.401992] niks3-server[999]: 2026/09/20 12:22:52 INFO Signed narinfos id=11 count=14612lb # [ 50.406665] niks3-server[999]: 2026/09/20 12:22:52 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4613lb # [ 50.417128] niks3-server[999]: 2026/09/20 12:22:52 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4614lb # [ 50.423634] niks3-server[999]: 2026/09/20 12:22:52 INFO Completed upload id=114615worker2 # [ 50.411775] nix-grpc-daemon[823]: time=2026-09-20T12:22:52.247Z level=INFO msg="Upload complete. (436ms)"4616lb # [ 50.425944] niks3-server[999]: 2026/09/20 12:22:52 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4617worker2 # [ 50.415605] nix-grpc-daemon[788]: ts=2026-09-20T12:22:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=0 paths=1 nar_bytes_in=5124618worker2 # [ 50.422305] nix-grpc-daemon[788]: ts=2026-09-20T12:22:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684619worker2 # [ 50.430248] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4620worker2 # [ 50.438426] nix-daemon[813]: reaped child process 1008, status = succeeded4621worker2 # [ 50.443825] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4622worker2 # [ 51.257634] nix-daemon[813]: reaped child process 1022, status = succeeded4623worker2 # [ 51.406080] nix-daemon[813]: accepted connection from pid 1037, user nix-grpc-daemon (trusted)4624worker2 # [ 51.418686] nix-daemon[813]: reaped child process 1040, status = succeeded4625lb # [ 51.446567] niks3-server[999]: 2026/09/20 12:22:53 INFO Received uploads request method=POST path=/api/pending_closures4626worker2 # [ 51.443616] nix-grpc-daemon[823]: time=2026-09-20T12:22:53.279Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4627worker2 # [ 51.447637] nix-grpc-daemon[823]: time=2026-09-20T12:22:53.280Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4628lb # [ 51.497088] niks3-server[999]: 2026/09/20 12:22:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4629lb # [ 51.502092] niks3-server[999]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4630lb # [ 51.507861] niks3-server[999]: 2026/09/20 12:22:53 INFO Signed narinfos id=12 count=14631worker2 # [ 51.499299] nix-grpc-daemon[823]: time=2026-09-20T12:22:53.334Z level=INFO msg="Uploading 1 narinfos"4632lb # [ 51.512958] niks3-server[999]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4633lb # [ 51.517544] niks3-server[999]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4634lb # [ 51.527640] niks3-server[999]: 2026/09/20 12:22:53 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4635lb # [ 51.532794] niks3-server[999]: 2026/09/20 12:22:53 INFO Completed upload id=124636worker2 # [ 51.521122] nix-grpc-daemon[823]: time=2026-09-20T12:22:53.356Z level=INFO msg="Upload complete. (270ms)"4637lb # [ 51.534345] niks3-server[999]: 2026/09/20 12:22:53 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4638worker2 # [ 51.526643] nix-grpc-daemon[788]: ts=2026-09-20T12:22:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14639worker1 # [ 51.544078] nix-grpc-daemon[786]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:584104640worker2 # [ 51.538673] nix-daemon[813]: reaped child process 1020, status = succeeded4641worker1 # [ 51.551346] nix-grpc-daemon[786]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4642worker2 # [ 51.567590] nix-grpc-daemon[788]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:430684643worker2 # [ 51.573961] nix-grpc-daemon[788]: ts=2026-09-20T12:22:53Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=0 paths=1 nar_bytes_out=1284644worker1 # [ 51.780801] nix-grpc-daemon[786]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:584104645worker1 # [ 51.787967] nix-grpc-daemon[786]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:584104646worker1 # [ 51.797365] nix-grpc-daemon[900]: time=2026-09-20T12:22:53.610Z level=INFO msg="All 1 paths already cached"4647worker1 # [ 51.812214] nix-grpc-daemon[786]: ts=2026-09-20T12:22:53Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04648worker2 # [ 51.805202] nix-grpc-daemon[788]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684649worker1 # [ 51.816659] nix-grpc-daemon[786]: ts=2026-09-20T12:22:53Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=14650worker2 # [ 51.813751] nix-grpc-daemon[788]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430684651worker2 # [ 51.822255] nix-grpc-daemon[823]: time=2026-09-20T12:22:53.658Z level=INFO msg="All 1 paths already cached"4652worker2 # [ 51.826288] nix-grpc-daemon[788]: ts=2026-09-20T12:22:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430684653worker2 # [ 51.831073] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4654worker2 # [ 51.988677] nix-daemon[813]: accepted connection from pid 1044, user nix-grpc-daemon (trusted)4655worker2 # [ 52.003081] nix-daemon[813]: reaped child process 1047, status = succeeded4656worker2 # [ 52.161627] nix-daemon[813]: accepted connection from pid 1049, user nix-grpc-daemon (trusted)4657worker2 # [ 52.174469] nix-daemon[813]: reaped child process 1052, status = succeeded4658lb # [ 52.200752] niks3-server[999]: 2026/09/20 12:22:54 INFO Received uploads request method=POST path=/api/pending_closures4659worker2 # [ 52.193819] nix-grpc-daemon[823]: time=2026-09-20T12:22:54.029Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4660worker2 # [ 52.195165] nix-grpc-daemon[823]: time=2026-09-20T12:22:54.029Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4661lb # [ 52.214816] niks3-server[999]: 2026/09/20 12:22:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4662lb # [ 52.216616] niks3-server[999]: 2026/09/20 12:22:54 INFO Signed narinfos id=13 count=14663worker2 # [ 52.206307] nix-grpc-daemon[823]: time=2026-09-20T12:22:54.041Z level=INFO msg="Uploading 1 narinfos"4664lb # [ 52.221058] niks3-server[999]: 2026/09/20 12:22:54 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4665lb # [ 52.225567] niks3-server[999]: 2026/09/20 12:22:54 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4666lb # [ 52.228967] niks3-server[999]: 2026/09/20 12:22:54 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4667lb # [ 52.232097] niks3-server[999]: 2026/09/20 12:22:54 INFO Completed upload id=134668worker2 # [ 52.220290] nix-grpc-daemon[823]: time=2026-09-20T12:22:54.056Z level=INFO msg="Upload complete. (384ms)"4669lb # [ 52.233621] niks3-server[999]: 2026/09/20 12:22:54 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4670worker2 # [ 52.222314] nix-grpc-daemon[788]: ts=2026-09-20T12:22:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=0 paths=1 nar_bytes_in=6244671worker2 # [ 52.226701] nix-grpc-daemon[788]: ts=2026-09-20T12:22:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684672worker2 # [ 52.232312] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4673worker2 # [ 52.234497] nix-daemon[813]: reaped child process 1042, status = succeeded4674worker2 # [ 52.239675] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4675worker2 # [ 53.266716] nix-daemon[813]: reaped child process 1056, status = succeeded4676worker2 # [ 53.422345] nix-daemon[813]: accepted connection from pid 1071, user nix-grpc-daemon (trusted)4677worker2 # [ 53.435187] nix-daemon[813]: reaped child process 1074, status = succeeded4678lb # [ 53.463705] niks3-server[999]: 2026/09/20 12:22:55 INFO Received uploads request method=POST path=/api/pending_closures4679worker2 # [ 53.460177] nix-grpc-daemon[823]: time=2026-09-20T12:22:55.295Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4680worker2 # [ 53.462164] nix-grpc-daemon[823]: time=2026-09-20T12:22:55.297Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4681lb # [ 53.502893] niks3-server[999]: 2026/09/20 12:22:55 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4682lb # [ 53.515332] niks3-server[999]: 2026/09/20 12:22:55 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4683lb # [ 53.519428] niks3-server[999]: 2026/09/20 12:22:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4684worker2 # [ 53.515440] nix-grpc-daemon[823]: time=2026-09-20T12:22:55.350Z level=INFO msg="Uploading 1 narinfos"4685lb # [ 53.527491] niks3-server[999]: 2026/09/20 12:22:55 INFO Signed narinfos id=14 count=14686lb # [ 53.532962] niks3-server[999]: 2026/09/20 12:22:55 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4687lb # [ 53.542220] niks3-server[999]: 2026/09/20 12:22:55 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4688lb # [ 53.545278] niks3-server[999]: 2026/09/20 12:22:55 INFO Completed upload id=144689lb # [ 53.547182] niks3-server[999]: 2026/09/20 12:22:55 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4690worker2 # [ 53.534948] nix-grpc-daemon[823]: time=2026-09-20T12:22:55.370Z level=INFO msg="Upload complete. (287ms)"4691worker2 # [ 53.540644] nix-grpc-daemon[788]: ts=2026-09-20T12:22:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14692worker2 # [ 53.553266] nix-daemon[813]: reaped child process 1054, status = succeeded4693worker1 # [ 53.601260] nix-grpc-daemon[786]: ts=2026-09-20T12:22:55Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:584104694worker1 # [ 53.608171] nix-grpc-daemon[786]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4695worker1 # [ 53.635933] nix-grpc-daemon[786]: ts=2026-09-20T12:22:55Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:584104696worker1 # [ 53.641940] nix-grpc-daemon[786]: ts=2026-09-20T12:22:55Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58410 duration_s=0 paths=1 nar_bytes_out=1764697worker2 # [ 53.883376] nix-grpc-daemon[788]: ts=2026-09-20T12:22:55Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:430684698worker2 # [ 53.889666] nix-grpc-daemon[788]: ts=2026-09-20T12:22:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430684699worker2 # [ 53.894737] nix-grpc-daemon[823]: time=2026-09-20T12:22:55.729Z level=INFO msg="All 2 paths already cached"4700worker1 # [ 53.917384] nix-grpc-daemon[786]: ts=2026-09-20T12:22:55Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04701worker1 # [ 53.919390] nix-grpc-daemon[786]: ts=2026-09-20T12:22:55Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=14702worker2 # [ 53.908071] nix-grpc-daemon[788]: ts=2026-09-20T12:22:55Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684703worker2 # [ 53.921240] nix-grpc-daemon[788]: ts=2026-09-20T12:22:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430684704worker2 # [ 53.934157] nix-grpc-daemon[823]: time=2026-09-20T12:22:55.769Z level=INFO msg="All 2 paths already cached"4705worker2 # [ 53.940873] nix-grpc-daemon[788]: ts=2026-09-20T12:22:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430684706worker2 # [ 53.949330] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4707worker2 # [ 54.125600] nix-daemon[813]: accepted connection from pid 1079, user nix-grpc-daemon (trusted)4708worker2 # [ 54.138721] nix-daemon[813]: reaped child process 1082, status = succeeded4709worker2 # [ 54.299862] nix-daemon[813]: accepted connection from pid 1084, user nix-grpc-daemon (trusted)4710worker2 # [ 54.312868] nix-daemon[813]: reaped child process 1087, status = succeeded4711lb # [ 54.339739] niks3-server[999]: 2026/09/20 12:22:56 INFO Received uploads request method=POST path=/api/pending_closures4712worker2 # [ 54.335970] nix-grpc-daemon[823]: time=2026-09-20T12:22:56.171Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4713worker2 # [ 54.337541] nix-grpc-daemon[823]: time=2026-09-20T12:22:56.173Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4714lb # [ 54.375321] niks3-server[999]: 2026/09/20 12:22:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4715lb # [ 54.380611] niks3-server[999]: 2026/09/20 12:22:56 INFO Signed narinfos id=15 count=14716worker2 # [ 54.372514] nix-grpc-daemon[823]: time=2026-09-20T12:22:56.208Z level=INFO msg="Uploading 1 narinfos"4717lb # [ 54.390634] niks3-server[999]: 2026/09/20 12:22:56 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4718lb # [ 54.398143] niks3-server[999]: 2026/09/20 12:22:56 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4719lb # [ 54.407360] niks3-server[999]: 2026/09/20 12:22:56 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4720lb # [ 54.413451] niks3-server[999]: 2026/09/20 12:22:56 INFO Completed upload id=154721worker2 # [ 54.401601] nix-grpc-daemon[823]: time=2026-09-20T12:22:56.237Z level=INFO msg="Upload complete. (438ms)"4722lb # [ 54.416483] niks3-server[999]: 2026/09/20 12:22:56 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4723worker2 # [ 54.405350] nix-grpc-daemon[788]: ts=2026-09-20T12:22:56Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=0 paths=1 nar_bytes_in=7524724worker2 # [ 54.411226] nix-grpc-daemon[788]: ts=2026-09-20T12:22:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684725worker2 # [ 54.419647] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4726worker2 # [ 54.424080] nix-daemon[813]: reaped child process 1077, status = succeeded4727worker2 # [ 54.429270] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4728worker2 # [ 55.457202] nix-daemon[813]: reaped child process 1091, status = succeeded4729worker2 # [ 55.615954] nix-daemon[813]: accepted connection from pid 1106, user nix-grpc-daemon (trusted)4730worker2 # [ 55.627721] nix-daemon[813]: reaped child process 1109, status = succeeded4731lb # [ 55.656908] niks3-server[999]: 2026/09/20 12:22:57 INFO Received uploads request method=POST path=/api/pending_closures4732worker2 # [ 55.657164] nix-grpc-daemon[823]: time=2026-09-20T12:22:57.492Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4733worker2 # [ 55.660065] nix-grpc-daemon[823]: time=2026-09-20T12:22:57.494Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4734lb # [ 55.700380] niks3-server[999]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4735lb # [ 55.712058] niks3-server[999]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4736lb # [ 55.717269] niks3-server[999]: 2026/09/20 12:22:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4737worker2 # [ 55.710355] nix-grpc-daemon[823]: time=2026-09-20T12:22:57.545Z level=INFO msg="Uploading 1 narinfos"4738lb # [ 55.722353] niks3-server[999]: 2026/09/20 12:22:57 INFO Signed narinfos id=16 count=14739lb # [ 55.729614] niks3-server[999]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4740lb # [ 55.736693] niks3-server[999]: 2026/09/20 12:22:57 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4741lb # [ 55.744528] niks3-server[999]: 2026/09/20 12:22:57 INFO Completed upload id=164742worker2 # [ 55.733229] nix-grpc-daemon[823]: time=2026-09-20T12:22:57.568Z level=INFO msg="Upload complete. (295ms)"4743lb # [ 55.748718] niks3-server[999]: 2026/09/20 12:22:57 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4744worker2 # [ 55.740439] nix-grpc-daemon[788]: ts=2026-09-20T12:22:57Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14745worker2 # [ 55.748102] nix-grpc-daemon[788]: ts=2026-09-20T12:22:57Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:430684746worker2 # [ 55.759113] nix-daemon[813]: reaped child process 1089, status = succeeded4747worker1 # [ 55.771875] nix-grpc-daemon[786]: ts=2026-09-20T12:22:57Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:584104748worker1 # [ 55.783316] nix-grpc-daemon[786]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4749worker1 # [ 55.796885] nix-grpc-daemon[786]: ts=2026-09-20T12:22:57Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58410 duration_s=0 paths=1 nar_bytes_out=2324750client # [ 55.890849] nix-daemon[947]: reaped child process 949, status = succeeded4751client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.52 seconds)4752client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4753client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.02 seconds)4754client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4755client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4756client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4757client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4758(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.61 seconds)4759subtest: an input only one worker has still reaches the builder4760client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4761client # this derivation will be built:4762client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4763client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4764client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.40 seconds)4765client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4766client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.17 seconds)4767worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4768worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.21 seconds)4769worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4770worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4771client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24772client # [ 56.978737] nix-daemon[947]: accepted connection from pid 1027, user root (trusted)4773client # this derivation will be built:4774lb # [ 57.233746] envoy[907]: conn peer=[2001:db8:1::1]:35830 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2972 tx=1370 ms=48064775client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4776lb # [ 57.237500] envoy[907]: conn peer=[2001:db8:1::1]:35842 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1427 tx=1082 ms=37044777lb # [ 57.241124] envoy[907]: conn peer=[2001:db8:1::1]:35856 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3383 tx=1754 ms=17124778lb # [ 57.244604] envoy[907]: conn peer=[2001:db8:1::1]:35870 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=333 ms=234779lb # [ 57.248294] envoy[907]: conn peer=[2001:db8:1::1]:35876 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3880 tx=1968 ms=19134780lb # [ 57.252122] envoy[907]: conn peer=[2001:db8:1::1]:37772 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=594781lb # [ 57.256680] envoy[907]: conn peer=[2001:db8:1::1]:37782 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4328 tx=2107 ms=19514782lb # [ 57.260561] envoy[907]: conn peer=[2001:db8:1::1]:37794 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=744783worker1 # [ 57.427474] nix-grpc-daemon[786]: ts=2026-09-20T12:22:59Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:584104784client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...4785worker2 # [ 57.421361] nix-grpc-daemon[788]: ts=2026-09-20T12:22:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430684786client # copying 1 paths...4787client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...4788worker2 # [ 57.434151] nix-grpc-daemon[788]: ts=2026-09-20T12:22:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430684789worker2 # [ 57.445711] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4790worker2 # [ 57.625832] nix-daemon[813]: accepted connection from pid 1116, user nix-grpc-daemon (trusted)4791worker2 # [ 57.641508] nix-daemon[813]: reaped child process 1119, status = succeeded4792lb # [ 57.667468] niks3-server[999]: 2026/09/20 12:22:59 INFO Received uploads request method=POST path=/api/pending_closures4793worker2 # [ 57.659725] nix-grpc-daemon[823]: time=2026-09-20T12:22:59.495Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4794worker2 # [ 57.661239] nix-grpc-daemon[823]: time=2026-09-20T12:22:59.496Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4795lb # [ 57.683747] niks3-server[999]: 2026/09/20 12:22:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4796lb # [ 57.686206] niks3-server[999]: 2026/09/20 12:22:59 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4797worker2 # [ 57.681688] nix-grpc-daemon[823]: time=2026-09-20T12:22:59.517Z level=INFO msg="Uploading 1 narinfos"4798lb # [ 57.693377] niks3-server[999]: 2026/09/20 12:22:59 INFO Signed narinfos id=17 count=14799lb # [ 57.698718] niks3-server[999]: 2026/09/20 12:22:59 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4800lb # [ 57.708230] niks3-server[999]: 2026/09/20 12:22:59 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4801lb # [ 57.712697] niks3-server[999]: 2026/09/20 12:22:59 INFO Completed upload id=174802worker2 # [ 57.702039] nix-grpc-daemon[823]: time=2026-09-20T12:22:59.537Z level=INFO msg="Upload complete. (244ms)"4803lb # [ 57.715116] niks3-server[999]: 2026/09/20 12:22:59 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4804worker2 # [ 57.704435] nix-grpc-daemon[788]: ts=2026-09-20T12:22:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=0 paths=1 nar_bytes_in=1204805worker2 # [ 57.710719] nix-daemon[813]: reaped child process 1114, status = succeeded4806worker1 # [ 57.733304] nix-grpc-daemon[786]: ts=2026-09-20T12:22:59Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04807worker1 # [ 57.737522] nix-grpc-daemon[786]: ts=2026-09-20T12:22:59Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14808worker1 # [ 57.775835] nix-grpc-daemon[786]: ts=2026-09-20T12:22:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:584104809worker1 # [ 57.788129] nix-grpc-daemon[786]: ts=2026-09-20T12:22:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:584104810client # copying 2 paths to 'lb:50051'...4811client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4812worker1 # [ 57.803240] nix-grpc-daemon[786]: ts=2026-09-20T12:22:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:584104813client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4814worker1 # [ 57.818596] nix-daemon[847]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4815worker1 # [ 57.970364] nix-daemon[847]: accepted connection from pid 988, user nix-grpc-daemon (trusted)4816worker1 # [ 57.983458] nix-daemon[847]: reaped child process 991, status = succeeded4817worker1 # [ 58.134278] nix-daemon[847]: accepted connection from pid 993, user nix-grpc-daemon (trusted)4818worker1 # [ 58.146643] nix-daemon[847]: reaped child process 996, status = succeeded4819lb # [ 58.153976] niks3-server[999]: 2026/09/20 12:23:00 INFO Received uploads request method=POST path=/api/pending_closures4820lb # [ 58.212442] niks3-server[999]: 2026/09/20 12:23:00 INFO Received uploads request method=POST path=/api/pending_closures4821worker1 # [ 58.228518] nix-grpc-daemon[900]: time=2026-09-20T12:23:00.041Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4822worker1 # [ 58.230032] nix-grpc-daemon[900]: time=2026-09-20T12:23:00.041Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4823worker1 # [ 58.231604] nix-grpc-daemon[900]: time=2026-09-20T12:23:00.041Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4824lb # [ 58.253845] niks3-server[999]: 2026/09/20 12:23:00 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4825lb # [ 58.261929] niks3-server[999]: 2026/09/20 12:23:00 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4826lb # [ 58.279126] niks3-server[999]: 2026/09/20 12:23:00 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4827lb # [ 58.283216] niks3-server[999]: 2026/09/20 12:23:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4828lb # [ 58.287074] niks3-server[999]: 2026/09/20 12:23:00 INFO Signed narinfos id=18 count=14829lb # [ 58.292354] niks3-server[999]: 2026/09/20 12:23:00 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4830lb # [ 58.294865] niks3-server[999]: 2026/09/20 12:23:00 INFO Signed narinfos id=19 count=24831lb # [ 58.297309] niks3-server[999]: 2026/09/20 12:23:00 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4832worker1 # [ 58.299332] nix-grpc-daemon[900]: time=2026-09-20T12:23:00.112Z level=INFO msg="Uploading 3 narinfos"4833lb # [ 58.309547] niks3-server[999]: 2026/09/20 12:23:00 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4834lb # [ 58.311820] niks3-server[999]: 2026/09/20 12:23:00 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4835lb # [ 58.316059] niks3-server[999]: 2026/09/20 12:23:00 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4836lb # [ 58.319675] niks3-server[999]: 2026/09/20 12:23:00 INFO Completed upload id=184837lb # [ 58.321029] niks3-server[999]: 2026/09/20 12:23:00 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4838lb # [ 58.322927] niks3-server[999]: 2026/09/20 12:23:00 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4839lb # [ 58.325306] niks3-server[999]: 2026/09/20 12:23:00 INFO Completed upload id=194840worker1 # [ 58.328605] nix-grpc-daemon[900]: time=2026-09-20T12:23:00.142Z level=INFO msg="Upload complete. (500ms)"4841worker1 # [ 58.334188] nix-grpc-daemon[786]: ts=2026-09-20T12:23:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58410 duration_s=0 paths=2 nar_bytes_in=9764842worker1 # [ 58.339841] nix-grpc-daemon[786]: ts=2026-09-20T12:23:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:584104843worker1 # [ 58.351679] nix-daemon[847]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4844worker1 # [ 58.361278] nix-daemon[847]: reaped child process 986, status = succeeded4845client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4846worker1 # [ 58.372895] nix-daemon[847]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4847client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4848worker1 # [ 58.989552] nix-daemon[847]: reaped child process 1000, status = succeeded4849worker1 # [ 59.123843] nix-daemon[847]: accepted connection from pid 1015, user nix-grpc-daemon (trusted)4850worker1 # [ 59.135912] nix-daemon[847]: reaped child process 1018, status = succeeded4851lb # [ 59.147705] niks3-server[999]: 2026/09/20 12:23:01 INFO Received uploads request method=POST path=/api/pending_closures4852worker1 # [ 59.153801] nix-grpc-daemon[900]: time=2026-09-20T12:23:00.968Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4853lb # [ 59.162273] niks3-server[999]: 2026/09/20 12:23:01 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4854lb # [ 59.164786] niks3-server[999]: 2026/09/20 12:23:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4855lb # [ 59.166727] niks3-server[999]: 2026/09/20 12:23:01 INFO Signed narinfos id=20 count=14856worker1 # [ 59.170253] nix-grpc-daemon[900]: time=2026-09-20T12:23:00.984Z level=INFO msg="Uploading 1 narinfos"4857lb # [ 59.170948] niks3-server[999]: 2026/09/20 12:23:01 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4858lb # [ 59.175205] niks3-server[999]: 2026/09/20 12:23:01 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4859lb # [ 59.177798] niks3-server[999]: 2026/09/20 12:23:01 INFO Completed upload id=204860worker1 # [ 59.180837] nix-grpc-daemon[900]: time=2026-09-20T12:23:00.995Z level=INFO msg="Upload complete. (199ms)"4861lb # [ 59.180171] niks3-server[999]: 2026/09/20 12:23:01 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4862worker1 # [ 59.183335] nix-grpc-daemon[786]: ts=2026-09-20T12:23:00Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58410 duration_s=0 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=14863worker1 # [ 59.190334] nix-daemon[847]: reaped child process 998, status = succeeded4864client # copying 1 paths...4865worker2 # [ 59.214422] nix-grpc-daemon[788]: ts=2026-09-20T12:23:01Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:430684866worker2 # [ 59.222202] nix-grpc-daemon[788]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...4867client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4868worker2 # [ 59.245174] nix-grpc-daemon[788]: ts=2026-09-20T12:23:01Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:430684869worker2 # [ 59.249310] nix-grpc-daemon[788]: ts=2026-09-20T12:23:01Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=0 paths=1 nar_bytes_out=1204870client # [ 59.344406] nix-daemon[947]: reaped child process 1030, status = succeeded4871client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.56 seconds)4872client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24873client # [ 59.513287] nix-daemon[947]: accepted connection from pid 1047, user root (trusted)4874client # this derivation will be built:4875client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4876worker2 # [ 59.940745] nix-grpc-daemon[788]: ts=2026-09-20T12:23:01Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:430684877client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...4878worker1 # [ 59.957824] nix-grpc-daemon[786]: ts=2026-09-20T12:23:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:584104879worker1 # [ 59.968257] nix-grpc-daemon[900]: time=2026-09-20T12:23:01.781Z level=INFO msg="All 1 paths already cached"4880worker1 # [ 59.983143] nix-grpc-daemon[786]: ts=2026-09-20T12:23:01Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=04881worker1 # [ 59.987704] nix-grpc-daemon[786]: ts=2026-09-20T12:23:01Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14882worker2 # [ 60.013812] nix-grpc-daemon[788]: ts=2026-09-20T12:23:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684883worker2 # [ 60.027276] nix-grpc-daemon[788]: ts=2026-09-20T12:23:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:430684884client # copying 1 paths to 'lb:50051'...4885worker2 # [ 60.044557] nix-grpc-daemon[788]: ts=2026-09-20T12:23:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:430684886client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...4887worker2 # [ 60.057691] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4888worker2 # [ 60.074103] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 67 ms (attempt 1/5)4889worker2 # [ 60.147149] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 63 ms (attempt 2/5)4890worker2 # [ 60.217290] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 215 ms (attempt 3/5)4891worker2 # [ 60.431658] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 192 ms (attempt 4/5)4892worker2 # [ 60.627468] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4893worker2 # [ 60.633645] nix-grpc-daemon[788]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...4894worker2 # [ 60.812173] nix-daemon[813]: accepted connection from pid 1128, user nix-grpc-daemon (trusted)4895worker2 # [ 60.826786] nix-daemon[813]: reaped child process 1131, status = succeeded4896worker2 # [ 60.961548] nix-daemon[813]: accepted connection from pid 1133, user nix-grpc-daemon (trusted)4897worker2 # [ 60.974519] nix-daemon[813]: reaped child process 1136, status = succeeded4898lb # [ 61.001097] niks3-server[999]: 2026/09/20 12:23:02 INFO Received uploads request method=POST path=/api/pending_closures4899worker2 # [ 60.994505] nix-grpc-daemon[823]: time=2026-09-20T12:23:02.829Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4900worker2 # [ 60.996233] nix-grpc-daemon[823]: time=2026-09-20T12:23:02.831Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"4901lb # [ 61.020160] niks3-server[999]: 2026/09/20 12:23:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4902lb # [ 61.021959] niks3-server[999]: 2026/09/20 12:23:02 INFO Signed narinfos id=21 count=14903worker2 # [ 61.011655] nix-grpc-daemon[823]: time=2026-09-20T12:23:02.847Z level=INFO msg="Uploading 1 narinfos"4904lb # [ 61.030596] niks3-server[999]: 2026/09/20 12:23:03 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4905lb # [ 61.034068] niks3-server[999]: 2026/09/20 12:23:03 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst4906lb # [ 61.038141] niks3-server[999]: 2026/09/20 12:23:03 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls4907lb # [ 61.041123] niks3-server[999]: 2026/09/20 12:23:03 INFO Completed upload id=214908worker2 # [ 61.030477] nix-grpc-daemon[823]: time=2026-09-20T12:23:02.866Z level=INFO msg="Upload complete. (376ms)"4909lb # [ 61.042705] niks3-server[999]: 2026/09/20 12:23:03 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo4910worker2 # [ 61.033043] nix-grpc-daemon[788]: ts=2026-09-20T12:23:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=0 paths=1 nar_bytes_in=5604911worker2 # [ 61.035512] nix-grpc-daemon[788]: ts=2026-09-20T12:23:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:430684912worker2 # [ 61.042061] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4913worker2 # [ 61.048242] nix-daemon[813]: reaped child process 1122, status = succeeded4914client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...4915worker2 # [ 61.051526] nix-daemon[813]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4916client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4917worker2 # [ 61.665612] nix-daemon[813]: reaped child process 1140, status = succeeded4918worker2 # [ 61.805545] nix-daemon[813]: accepted connection from pid 1155, user nix-grpc-daemon (trusted)4919worker2 # [ 61.818470] nix-daemon[813]: reaped child process 1158, status = succeeded4920lb # [ 61.843738] niks3-server[999]: 2026/09/20 12:23:03 INFO Received uploads request method=POST path=/api/pending_closures4921worker2 # [ 62.204930] nix-grpc-daemon[823]: time=2026-09-20T12:23:04.039Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4922lb # [ 62.241882] niks3-server[999]: 2026/09/20 12:23:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4923lb # [ 62.248612] niks3-server[999]: 2026/09/20 12:23:04 INFO Signed narinfos id=22 count=14924worker2 # [ 62.240345] nix-grpc-daemon[823]: time=2026-09-20T12:23:04.075Z level=INFO msg="Uploading 1 narinfos"4925lb # [ 62.264454] niks3-server[999]: 2026/09/20 12:23:04 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4926lb # [ 62.269653] niks3-server[999]: 2026/09/20 12:23:04 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls4927lb # [ 62.284066] niks3-server[999]: 2026/09/20 12:23:04 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4928lb # [ 62.299238] niks3-server[999]: 2026/09/20 12:23:04 INFO Completed upload id=224929worker2 # [ 62.287704] nix-grpc-daemon[823]: time=2026-09-20T12:23:04.123Z level=INFO msg="Upload complete. (630ms)"4930client # copying 1 paths...4931worker2 # [ 62.295614] nix-grpc-daemon[788]: ts=2026-09-20T12:23:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=14932lb # [ 62.312134] niks3-server[999]: 2026/09/20 12:23:04 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo4933worker2 # [ 62.306274] nix-grpc-daemon[788]: ts=2026-09-20T12:23:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:430684934client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...4935worker2 # [ 62.318225] nix-daemon[813]: reaped child process 1138, status = succeeded4936worker2 # [ 62.324156] nix-grpc-daemon[788]: ts=2026-09-20T12:23:04Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:430684937worker2 # [ 62.328526] nix-grpc-daemon[788]: ts=2026-09-20T12:23:04Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43068 duration_s=0 paths=1 nar_bytes_out=1204938client # [ 62.445784] nix-daemon[947]: reaped child process 1050, status = succeeded4939client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.10 seconds)4940client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&24941client # [ 62.629799] nix-daemon[947]: accepted connection from pid 1068, user root (trusted)4942client # this derivation will be built:4943client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4944worker1 # [ 62.803372] nix-grpc-daemon[786]: ts=2026-09-20T12:23:04Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:584104945client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...4946worker1 # [ 62.809814] nix-grpc-daemon[786]: ts=2026-09-20T12:23:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:584104947worker1 # [ 62.818723] nix-grpc-daemon[900]: time=2026-09-20T12:23:04.632Z level=INFO msg="All 1 paths already cached"4948worker1 # [ 62.832823] nix-grpc-daemon[786]: ts=2026-09-20T12:23:04Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=04949worker1 # [ 62.839303] nix-grpc-daemon[786]: ts=2026-09-20T12:23:04Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14950worker1 # [ 62.844394] nix-grpc-daemon[786]: ts=2026-09-20T12:23:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:584104951worker1 # [ 62.855674] nix-grpc-daemon[786]: ts=2026-09-20T12:23:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:584104952worker1 # [ 62.868137] nix-grpc-daemon[900]: time=2026-09-20T12:23:04.682Z level=INFO msg="All 1 paths already cached"4953client # copying 1 paths to 'lb:50051'...4954client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...4955worker1 # [ 62.875982] nix-grpc-daemon[786]: ts=2026-09-20T12:23:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:584104956worker1 # [ 62.884889] nix-daemon[847]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4957worker1 # [ 63.058302] nix-daemon[847]: accepted connection from pid 1026, user nix-grpc-daemon (trusted)4958worker1 # [ 63.070445] nix-daemon[847]: reaped child process 1029, status = succeeded4959worker1 # [ 63.233673] nix-daemon[847]: accepted connection from pid 1031, user nix-grpc-daemon (trusted)4960worker1 # [ 63.245843] nix-daemon[847]: reaped child process 1034, status = succeeded4961lb # [ 63.259301] niks3-server[999]: 2026/09/20 12:23:05 INFO Received uploads request method=POST path=/api/pending_closures4962worker1 # [ 63.270585] nix-grpc-daemon[900]: time=2026-09-20T12:23:05.084Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4963worker1 # [ 63.272171] nix-grpc-daemon[900]: time=2026-09-20T12:23:05.086Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"4964lb # [ 63.284959] niks3-server[999]: 2026/09/20 12:23:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4965lb # [ 63.287294] niks3-server[999]: 2026/09/20 12:23:05 INFO Signed narinfos id=23 count=14966worker1 # [ 63.289239] nix-grpc-daemon[900]: time=2026-09-20T12:23:05.103Z level=INFO msg="Uploading 1 narinfos"4967lb # [ 63.294250] niks3-server[999]: 2026/09/20 12:23:05 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4968lb # [ 63.384655] niks3-server[999]: 2026/09/20 12:23:05 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst4969lb # [ 63.396388] niks3-server[999]: 2026/09/20 12:23:05 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls4970lb # [ 63.404876] niks3-server[999]: 2026/09/20 12:23:05 INFO Completed upload id=234971worker1 # [ 63.407334] nix-grpc-daemon[900]: time=2026-09-20T12:23:05.221Z level=INFO msg="Upload complete. (508ms)"4972lb # [ 63.411196] niks3-server[999]: 2026/09/20 12:23:05 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo4973worker1 # [ 63.413443] nix-grpc-daemon[786]: ts=2026-09-20T12:23:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58410 duration_s=0 paths=1 nar_bytes_in=5604974worker1 # [ 63.420261] nix-grpc-daemon[786]: ts=2026-09-20T12:23:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:584104975worker1 # [ 63.433158] nix-daemon[847]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4976worker1 # [ 63.444320] nix-daemon[847]: reaped child process 1024, status = succeeded4977client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...4978worker1 # [ 63.455649] nix-daemon[847]: accepted connection from pid 786, user nix-grpc-daemon (trusted)4979client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4980worker1 # [ 64.890794] nix-daemon[847]: reaped child process 1038, status = succeeded4981worker1 # [ 65.039374] nix-daemon[847]: accepted connection from pid 1053, user nix-grpc-daemon (trusted)4982worker1 # [ 65.053820] nix-daemon[847]: reaped child process 1056, status = succeeded4983lb # [ 65.065307] niks3-server[999]: 2026/09/20 12:23:07 INFO Received uploads request method=POST path=/api/pending_closures4984worker1 # [ 65.073109] nix-grpc-daemon[900]: time=2026-09-20T12:23:06.887Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4985lb # [ 65.081822] niks3-server[999]: 2026/09/20 12:23:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4986worker1 # [ 65.085783] nix-grpc-daemon[900]: time=2026-09-20T12:23:06.900Z level=INFO msg="Uploading 1 narinfos"4987lb # [ 65.084460] niks3-server[999]: 2026/09/20 12:23:07 INFO Signed narinfos id=24 count=14988lb # [ 65.088196] niks3-server[999]: 2026/09/20 12:23:07 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls4989lb # [ 65.091927] niks3-server[999]: 2026/09/20 12:23:07 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4990lb # [ 65.096251] niks3-server[999]: 2026/09/20 12:23:07 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4991lb # [ 65.099396] niks3-server[999]: 2026/09/20 12:23:07 INFO Completed upload id=244992worker1 # [ 65.101333] nix-grpc-daemon[900]: time=2026-09-20T12:23:06.915Z level=INFO msg="Upload complete. (231ms)"4993lb # [ 65.102043] niks3-server[999]: 2026/09/20 12:23:07 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo4994worker1 # [ 65.104829] nix-grpc-daemon[786]: ts=2026-09-20T12:23:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58410 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=14995worker1 # [ 65.112481] nix-daemon[847]: reaped child process 1036, status = succeeded4996client # copying 1 paths...4997worker2 # [ 65.136962] nix-grpc-daemon[788]: ts=2026-09-20T12:23:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:430684998worker2 # [ 65.146482] nix-grpc-daemon[788]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...4999client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5000worker1 # [ 65.188217] nix-grpc-daemon[786]: ts=2026-09-20T12:23:07Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:584105001worker1 # [ 65.192715] nix-grpc-daemon[786]: ts=2026-09-20T12:23:07Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58410 duration_s=0 paths=1 nar_bytes_out=1205002client # [ 65.255970] nix-daemon[947]: reaped child process 1071, status = succeeded5003client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.81 seconds)5004(finished: subtest: an input only one worker has still reaches the builder, in 9.28 seconds)5005subtest: upload whose reference the worker lacks is completed from the cache5006client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5007client # this derivation will be built:5008client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5009client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5010client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.40 seconds)5011client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5012client # this derivation will be built:5013client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5014client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5015client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.55 seconds)5016client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5017client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.18 seconds)5018worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5019worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.23 seconds)5020worker2 # [ 66.676868] systemd[1]: Stopping Nix worker-protocol over gRPC...5021lb # [ 67.235424] envoy[907]: conn peer=[2001:db8:1::1]:37796 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4176 tx=1824 ms=18825022lb # [ 67.239218] envoy[907]: conn peer=[2001:db8:1::1]:37812 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=328 ms=485023lb # [ 67.243213] envoy[907]: conn peer=[2001:db8:1::1]:37824 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3686 tx=1800 ms=24365024lb # [ 67.246679] envoy[907]: conn peer=[2001:db8:1::1]:37826 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=535025lb # [ 67.250064] envoy[907]: conn peer=[2001:db8:1::1]:33444 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3714 tx=1917 ms=24005026lb # [ 67.253493] envoy[907]: conn peer=[2001:db8:1::1]:33460 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=473 tx=328 ms=155027worker2 # [ 67.615772] nix-grpc-daemon[788]: ts=2026-09-20T12:23:09Z level=info event=signal_exit5028worker1 # [ 67.637708] nix-grpc-daemon[786]: ts=2026-09-20T12:23:09Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:571945029worker1 # [ 67.641557] nix-grpc-daemon[786]: ts=2026-09-20T12:23:09Z level=info event=worker_gone addr=192.168.1.4:500515030worker2 # [ 67.631540] nix-grpc-daemon[788]: ts=2026-09-20T12:23:09Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5031worker2 # [ 67.650611] nix-daemon[813]: reaped child process 815, status = succeeded5032worker2 # [ 67.738761] nix-grpc-daemon[788]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5033worker2 # [ 67.742174] nix-grpc-daemon[788]: E0000 00:00:1789906989.573987 799 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true5034worker2 # [ 69.414476] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5035worker2 # [ 69.417644] systemd[1]: Stopped Nix worker-protocol over gRPC.5036worker2 # [ 69.421872] systemd[1]: nix-grpc-daemon.service: Consumed 2.557s CPU time over 52.082s wall clock time, 55.6M memory peak, 80K incoming IP traffic, 141.7K outgoing IP traffic.5037worker2 # [ 69.432112] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5038worker2 # [ 69.435520] systemd[1]: Closed Nix worker-protocol over gRPC.5039worker2 # [ 69.438207] systemd[1]: nix-grpc-daemon.socket: Consumed 314us CPU time over 59.838s wall clock time, 256K memory peak, 56.4K incoming IP traffic, 44K outgoing IP traffic.5040lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5041lb: must succeed: curl -sf localhost:9901/clusters5042lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)5043lb: must succeed: curl -sf localhost:9901/clusters5044lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5045lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 1.13 seconds)5046client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25047worker1 # [ 70.796908] nix-grpc-daemon[786]: ts=2026-09-20T12:23:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:584105048client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5049worker1 # [ 70.802402] nix-grpc-daemon[786]: ts=2026-09-20T12:23:12Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:584105050client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.24 seconds)5051worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5052worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds)5053worker2 # [ 70.898126] systemd[1]: Listening on Nix worker-protocol over gRPC.5054worker1 # [ 70.952613] systemd[1]: Stopping Nix worker-protocol over gRPC...5055worker2 # [ 71.406167] systemd[1]: Starting scheduler-token.service...5056worker1 # [ 71.506536] nix-grpc-daemon[786]: ts=2026-09-20T12:23:13Z level=info event=signal_exit5057worker2 # [ 71.497639] systemd[1]: scheduler-token.service: Deactivated successfully.5058worker2 # [ 71.499305] systemd[1]: Finished scheduler-token.service.5059worker2 # [ 71.500464] systemd[1]: scheduler-token.service: Consumed 41ms CPU time over 93ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5060worker1 # [ 71.514222] nix-grpc-daemon[786]: ts=2026-09-20T12:23:13Z level=info event=scheduler_restarting5061worker2 # [ 71.506091] systemd[1]: Starting Nix worker-protocol over gRPC...5062worker1 # [ 71.518909] nix-grpc-daemon[786]: ts=2026-09-20T12:23:13Z level=info event=scheduler_restarting addr=lb:500515063worker1 # [ 71.521966] nix-grpc-daemon[786]: ts=2026-09-20T12:23:13Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:571945064worker1 # [ 71.526423] nix-grpc-daemon[786]: ts=2026-09-20T12:23:13Z level=info event=worker_gone addr=192.168.1.3:500515065worker1 # [ 71.547207] nix-daemon[847]: reaped child process 849, status = succeeded5066worker1 # [ 71.633894] nix-grpc-daemon[786]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5067worker1 # [ 71.637366] nix-grpc-daemon[786]: E0000 00:00:1789906993.447064 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true5068worker1 # [ 71.641975] nix-grpc-daemon[786]: E0000 00:00:1789906993.448061 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5069worker2 # [ 71.654381] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:13Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5070worker2 # [ 71.656751] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:13Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5071worker2 # [ 71.658551] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:13Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15072worker2 # [ 71.664599] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:13Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5073worker2 # [ 71.668944] systemd[1]: Started Nix worker-protocol over gRPC.5074worker2 # [ 71.679936] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:13Z level=info event=scheduler_connected addr=lb:500515075worker1 # [ 71.695542] nix-grpc-daemon[786]: E0000 00:00:1789906993.509621 829 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5076worker1 # [ 71.724974] nix-grpc-daemon[786]: ts=2026-09-20T12:23:13Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5077worker2 # [ 73.351379] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5078worker1 # [ 73.378953] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5079worker1 # [ 73.384402] systemd[1]: Stopped Nix worker-protocol over gRPC.5080worker1 # [ 73.386544] systemd[1]: nix-grpc-daemon.service: Consumed 1.373s CPU time over 56.151s wall clock time, 49.8M memory peak, 44K incoming IP traffic, 79.2K outgoing IP traffic.5081worker1 # [ 73.400184] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5082worker1 # [ 73.404160] systemd[1]: Closed Nix worker-protocol over gRPC.5083worker1 # [ 73.406557] systemd[1]: nix-grpc-daemon.socket: Consumed 296us CPU time over 1min 3.756s wall clock time, 256K memory peak, 74.6K incoming IP traffic, 62.1K outgoing IP traffic.5084lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5085lb: must succeed: curl -sf localhost:9901/clusters5086lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5087worker2 # [ 73.552973] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:15Z level=info event=scheduler_connected addr=lb:500515088worker2 # [ 73.557242] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5089worker2 # [ 73.758101] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:15Z level=info event=scheduler_connected addr=lb:500515090worker2 # [ 73.762099] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5091worker2 # [ 73.962585] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:15Z level=info event=scheduler_connected addr=lb:500515092worker2 # [ 73.964887] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:15Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5093worker2 # [ 74.165839] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:16Z level=info event=scheduler_connected addr=lb:500515094worker2 # [ 74.167928] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5095worker2 # [ 74.369242] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:16Z level=info event=scheduler_connected addr=lb:500515096worker2 # [ 74.370980] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5097lb: must succeed: curl -sf localhost:9901/clusters5098lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5099lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 1.10 seconds)5100client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25101worker2 # [ 74.572149] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:16Z level=info event=scheduler_connected addr=lb:500515102worker2 # [ 74.576252] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5103worker2 # [ 74.717128] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:544045104worker2 # [ 74.729253] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5105worker2 # [ 74.745446] nix-grpc-daemon[1183]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 94 ms (attempt 1/5)5106worker2 # [ 74.777337] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:16Z level=info event=scheduler_connected addr=lb:500515107worker2 # [ 74.781938] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5108worker2 # [ 74.845453] nix-grpc-daemon[1183]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 109 ms (attempt 2/5)5109worker2 # [ 74.960473] nix-grpc-daemon[1183]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 233 ms (attempt 3/5)5110worker2 # [ 74.982892] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:16Z level=info event=scheduler_connected addr=lb:500515111worker2 # [ 74.986928] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:16Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5112worker2 # [ 75.187720] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:17Z level=info event=scheduler_connected addr=lb:500515113worker2 # [ 75.190519] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5114worker2 # [ 75.199072] nix-grpc-daemon[1183]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 39 ms (attempt 4/5)5115worker2 # [ 75.240663] nix-grpc-daemon[1183]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5116client # copying 2 paths...5117worker2 # [ 75.258323] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:544045118client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5119client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5120worker2 # [ 75.266805] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5121worker2 # [ 75.286895] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:17Z level=info event=niks3_push_started pid=12045122worker2 # [ 75.391981] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:17Z level=info event=scheduler_connected addr=lb:500515123worker2 # [ 75.394312] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5124worker2 # [ 75.471140] nix-grpc-daemon[1204]: time=2026-09-20T12:23:17.306Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""5125worker2 # [ 75.595280] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:17Z level=info event=scheduler_connected addr=lb:500515126worker2 # [ 75.598107] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5127worker2 # [ 75.634026] nix-daemon[813]: accepted connection from pid 1217, user nix-grpc-daemon (trusted)5128worker2 # [ 75.646533] nix-daemon[813]: reaped child process 1220, status = succeeded5129lb # [ 75.676290] niks3-server[999]: 2026/09/20 12:23:17 INFO Received uploads request method=POST path=/api/pending_closures5130lb # [ 75.684402] niks3-server[999]: 2026/09/20 12:23:17 INFO Received uploads request method=POST path=/api/pending_closures5131worker2 # [ 75.679880] nix-grpc-daemon[1204]: time=2026-09-20T12:23:17.515Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5132worker2 # [ 75.681884] nix-grpc-daemon[1204]: time=2026-09-20T12:23:17.517Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5133worker2 # [ 75.684129] nix-grpc-daemon[1204]: time=2026-09-20T12:23:17.519Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5134lb # [ 75.732807] niks3-server[999]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5135lb # [ 75.749529] niks3-server[999]: 2026/09/20 12:23:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5136lb # [ 75.753096] niks3-server[999]: 2026/09/20 12:23:17 INFO Signed narinfos id=26 count=25137lb # [ 75.757876] niks3-server[999]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5138lb # [ 75.759980] niks3-server[999]: 2026/09/20 12:23:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5139lb # [ 75.761939] niks3-server[999]: 2026/09/20 12:23:17 INFO Signed narinfos id=25 count=15140worker2 # [ 75.751247] nix-grpc-daemon[1204]: time=2026-09-20T12:23:17.586Z level=INFO msg="Uploading 3 narinfos"5141lb # [ 75.764027] niks3-server[999]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5142lb # [ 75.767095] niks3-server[999]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5143lb # [ 75.778630] niks3-server[999]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5144lb # [ 75.781204] niks3-server[999]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5145lb # [ 75.785264] niks3-server[999]: 2026/09/20 12:23:17 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5146lb # [ 75.788140] niks3-server[999]: 2026/09/20 12:23:17 INFO Completed upload id=255147lb # [ 75.790053] niks3-server[999]: 2026/09/20 12:23:17 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5148lb # [ 75.792579] niks3-server[999]: 2026/09/20 12:23:17 INFO Completed upload id=265149lb # [ 75.793863] niks3-server[999]: 2026/09/20 12:23:17 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5150worker2 # [ 75.781066] nix-grpc-daemon[1204]: time=2026-09-20T12:23:17.616Z level=INFO msg="Upload complete. (305ms)"5151worker2 # [ 75.786196] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54404 duration_s=0 paths=2 nar_bytes_in=3125152worker2 # [ 75.799364] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:17Z level=info event=scheduler_connected addr=lb:500515153worker2 # [ 75.802575] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:17Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5154worker2 # [ 75.807695] nix-daemon[813]: reaped child process 1202, status = succeeded5155client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.32 seconds)5156worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5157worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5158worker1 # [ 75.924584] systemd[1]: Listening on Nix worker-protocol over gRPC.5159worker1 # [ 75.928813] systemd[1]: Starting Nix worker-protocol over gRPC...5160worker2 # [ 76.003859] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:17Z level=info event=scheduler_connected addr=lb:500515161worker1 # [ 76.074856] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:17Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5162worker1 # [ 76.076613] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:17Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5163worker1 # [ 76.079760] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:17Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15164worker1 # [ 76.086490] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:17Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5165worker1 # [ 76.091066] systemd[1]: Started Nix worker-protocol over gRPC.5166lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5167lb: must succeed: curl -sf localhost:9901/clusters5168worker1 # [ 76.102089] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:17Z level=info event=oidc_jwks provider=mock keys=15169worker1 # [ 76.103871] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:17Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:385465170worker1 # [ 76.105811] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:17Z level=info event=scheduler_connected addr=lb:500515171worker1 # [ 76.107053] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:17Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05172worker1 # [ 76.109333] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:17Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:385465173worker1 # [ 76.110797] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:17Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05174lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5175lb: must succeed: curl -sf localhost:9901/clusters5176lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5177lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.11 seconds)5178(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 11.94 seconds)5179subtest: scheduler down: builds wait, then resume when it is back5180worker1 # [ 77.235850] systemd[1]: Stopping Nix worker-protocol over gRPC...5181lb # [ 77.235629] envoy[907]: conn peer=[2001:db8:1::4]:43142 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=2647 tx=816 ms=499985182lb # [ 77.240110] envoy[907]: conn peer=[2001:db8:1::1]:33464 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=165183lb # [ 77.243974] envoy[907]: conn peer=192.168.1.3:54700 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1223 tx=468 ms=532115184lb # [ 77.247559] envoy[907]: conn peer=[2001:db8:1::1]:42742 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1008 tx=304 ms=10835185worker1 # [ 78.092661] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:19Z level=info event=signal_exit5186worker2 # [ 78.080885] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:19Z level=info event=scheduler_restarting addr=lb:500515187worker1 # [ 78.096574] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:19Z level=info event=scheduler_restarting5188worker1 # [ 78.099440] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:19Z level=info event=scheduler_restarting addr=lb:500515189worker1 # [ 78.102393] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:385465190worker1 # [ 78.105678] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:19Z level=info event=worker_gone addr=192.168.1.3:500515191worker1 # [ 78.108587] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:19Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:385465192worker1 # [ 78.111950] nix-grpc-daemon[1079]: ts=2026-09-20T12:23:19Z level=info event=worker_gone addr=192.168.1.4:500515193worker2 # [ 78.281227] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:20Z level=info event=scheduler_connected addr=lb:500515194worker1 # [ 78.296453] nix-grpc-daemon[1079]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5195worker1 # [ 78.300176] nix-grpc-daemon[1079]: E0000 00:00:1789907000.110584 1122 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 13, started true, shutdown true5196worker1 # [ 78.370081] nix-grpc-daemon[1079]: E0000 00:00:1789907000.184046 1122 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5197worker1 # [ 78.375340] nix-grpc-daemon[1079]: E0000 00:00:1789907000.189243 1122 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 8, started true, shutdown true5198worker2 # [ 80.071971] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:21Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5199worker1 # [ 80.096479] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5200worker1 # [ 80.097588] systemd[1]: Stopped Nix worker-protocol over gRPC.5201worker1 # [ 80.099125] systemd[1]: nix-grpc-daemon.service: Consumed 108ms CPU time over 4.166s wall clock time, 10.1M memory peak, 8.2K incoming IP traffic, 5.7K outgoing IP traffic.5202worker1 # [ 80.102468] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5203worker1 # [ 80.104209] systemd[1]: Closed Nix worker-protocol over gRPC.5204worker1 # [ 80.105925] systemd[1]: nix-grpc-daemon.socket: Consumed 515us CPU time over 4.185s wall clock time, 256K memory peak, 14.3K incoming IP traffic, 10.1K outgoing IP traffic.5205lb: waiting until exactly ['worker1'] endpoints of sched are unhealthy5206lb: must succeed: curl -sf localhost:9901/clusters5207lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5208worker2 # [ 80.272550] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:22Z level=info event=scheduler_connected addr=lb:500515209worker2 # [ 80.276887] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5210worker2 # [ 80.477904] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:22Z level=info event=scheduler_connected addr=lb:500515211worker2 # [ 80.481980] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5212worker2 # [ 80.682674] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:22Z level=info event=scheduler_connected addr=lb:500515213worker2 # [ 80.686658] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5214worker2 # [ 80.887925] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:22Z level=info event=scheduler_connected addr=lb:500515215worker2 # [ 80.891919] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5216worker2 # [ 81.093822] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:22Z level=info event=scheduler_connected addr=lb:500515217worker2 # [ 81.097951] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:22Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5218lb: must succeed: curl -sf localhost:9901/clusters5219lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5220lb: (finished: waiting until exactly ['worker1'] endpoints of sched are unhealthy, in 1.08 seconds)5221client: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag schedback5222client # [ 81.245186] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag schedback.5223client # Running as unit: waits.service; invocation ID: ed95b1aca1994fc89b89d012269214fb5224client: (finished: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag schedback, in 0.07 seconds)5225??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5226 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735227client: must succeed: sleep 3.05228worker2 # [ 81.299090] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:23Z level=info event=scheduler_connected addr=lb:500515229worker2 # [ 81.303297] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5230worker2 # [ 81.429482] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:544045231client # [ 81.449502] nix[1148]: don't know how to build these paths:5232client # [ 81.450855] nix[1148]: /nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv5233worker2 # [ 81.438473] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:544045234client # [ 81.470623] nix[1148]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5235worker2 # [ 81.504085] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:23Z level=info event=scheduler_connected addr=lb:500515236worker2 # [ 81.508157] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5237worker2 # [ 81.708564] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:23Z level=info event=scheduler_connected addr=lb:500515238worker2 # [ 81.712365] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5239worker2 # [ 81.912890] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:23Z level=info event=scheduler_connected addr=lb:500515240worker2 # [ 81.915227] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5241client # [ 81.974262] nix[1148]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5242worker2 # [ 82.117613] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:23Z level=info event=scheduler_connected addr=lb:500515243worker2 # [ 82.121490] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:23Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5244worker2 # [ 82.322668] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:24Z level=info event=scheduler_connected addr=lb:500515245worker2 # [ 82.326856] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5246worker2 # [ 82.527946] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:24Z level=info event=scheduler_connected addr=lb:500515247worker2 # [ 82.531977] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5248worker2 # [ 82.732817] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:24Z level=info event=scheduler_connected addr=lb:500515249worker2 # [ 82.736790] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5250worker2 # [ 82.937925] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:24Z level=info event=scheduler_connected addr=lb:500515251worker2 # [ 82.942168] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5252client # [ 82.978134] nix[1148]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5253worker2 # [ 83.144245] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:24Z level=info event=scheduler_connected addr=lb:500515254worker2 # [ 83.148144] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:24Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5255worker2 # [ 83.349137] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:25Z level=info event=scheduler_connected addr=lb:500515256worker2 # [ 83.353363] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5257worker2 # [ 83.554292] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:25Z level=info event=scheduler_connected addr=lb:500515258worker2 # [ 83.558281] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5259worker2 # [ 83.759163] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:25Z level=info event=scheduler_connected addr=lb:500515260worker2 # [ 83.763259] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5261worker2 # [ 83.964377] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:25Z level=info event=scheduler_connected addr=lb:500515262worker2 # [ 83.968427] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5263worker2 # [ 84.170621] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:26Z level=info event=scheduler_connected addr=lb:500515264worker2 # [ 84.174424] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5265client: (finished: must succeed: sleep 3.0, in 3.04 seconds)5266client: must succeed: systemctl is-active waits5267client: (finished: must succeed: systemctl is-active waits, in 0.04 seconds)5268worker2 # [ 84.375547] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:26Z level=info event=scheduler_connected addr=lb:500515269worker2 # [ 84.379547] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5270worker1 # [ 84.404683] systemd[1]: Listening on Nix worker-protocol over gRPC.5271worker1 # [ 84.412781] systemd[1]: Starting Nix worker-protocol over gRPC...5272worker1 # [ 84.578374] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:26Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5273worker1 # [ 84.580948] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5274worker1 # [ 84.584572] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15275worker1 # [ 84.591056] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5276worker1 # [ 84.593256] systemd[1]: Started Nix worker-protocol over gRPC.5277worker2 # [ 84.580562] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:26Z level=info event=scheduler_connected addr=lb:500515278lb: waiting until exactly no endpoints of sched are unhealthy5279lb: must succeed: curl -sf localhost:9901/clusters5280worker1 # [ 84.608109] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:26Z level=info event=oidc_jwks provider=mock keys=15281worker1 # [ 84.611057] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:26Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:419065282worker1 # [ 84.612798] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:26Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05283worker1 # [ 84.616742] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:26Z level=info event=scheduler_connected addr=lb:500515284worker1 # [ 84.618369] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:26Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:419065285worker1 # [ 84.619807] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:26Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05286lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5287worker1 # [ 84.986756] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:26Z level=debug event=want client=1 drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv cached=05288worker1 # [ 84.990732] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:26Z level=debug event=assigned drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv worker=192.168.1.4:50051 clients=15289worker2 # [ 85.017694] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544045290worker2 # [ 85.030423] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:544045291client # [ 85.054429] nix[1148]: copying 1 paths to 'lb:50051'...5292client # [ 85.055212] nix[1148]: copying path '/nix/store/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv' to 'lb:50051'...5293worker2 # [ 85.041135] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:544045294worker2 # [ 85.052252] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5295worker2 # [ 85.243683] nix-daemon[813]: accepted connection from pid 1227, user nix-grpc-daemon (trusted)5296worker2 # [ 85.256975] nix-daemon[813]: reaped child process 1230, status = succeeded5297worker2 # [ 85.405786] nix-daemon[813]: accepted connection from pid 1232, user nix-grpc-daemon (trusted)5298worker2 # [ 85.418610] nix-daemon[813]: reaped child process 1235, status = succeeded5299lb # [ 85.442497] niks3-server[999]: 2026/09/20 12:23:27 INFO Received uploads request method=POST path=/api/pending_closures5300worker2 # [ 85.438355] nix-grpc-daemon[1204]: time=2026-09-20T12:23:27.273Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5301worker2 # [ 85.440256] nix-grpc-daemon[1204]: time=2026-09-20T12:23:27.275Z level=INFO msg="Uploading 78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv (520B)"5302lb # [ 85.468806] niks3-server[999]: 2026/09/20 12:23:27 INFO Registered completed upload object_key=nar/06bjks304hxld0mwhch6kvcfiix46iimcpysvzrdsfv41vfc14ny.nar.zst5303lb # [ 85.482114] niks3-server[999]: 2026/09/20 12:23:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5304worker2 # [ 85.477170] nix-grpc-daemon[1204]: time=2026-09-20T12:23:27.312Z level=INFO msg="Uploading 1 narinfos"5305lb # [ 85.488679] niks3-server[999]: 2026/09/20 12:23:27 INFO Signed narinfos id=27 count=15306lb # [ 85.495522] niks3-server[999]: 2026/09/20 12:23:27 INFO Registered completed upload object_key=78ilcmmhxh1nxads92k8m9r0j1mgl1vw.ls5307lb # [ 85.504442] niks3-server[999]: 2026/09/20 12:23:27 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5308lb # [ 85.508967] niks3-server[999]: 2026/09/20 12:23:27 INFO Completed upload id=275309worker2 # [ 85.499281] nix-grpc-daemon[1204]: time=2026-09-20T12:23:27.335Z level=INFO msg="Upload complete. (435ms)"5310worker2 # [ 85.501765] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54404 duration_s=0 paths=1 nar_bytes_in=5205311worker2 # [ 85.505159] nix-grpc-daemon[1204]: time=2026-09-20T12:23:27.336Z level=WARN msg="Failed to register uploaded object" key=78ilcmmhxh1nxads92k8m9r0j1mgl1vw.narinfo error="server returned 404: object is not pending upload\n"5312worker2 # [ 85.507374] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544045313worker2 # [ 85.513570] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5314worker2 # [ 85.517489] nix-daemon[813]: reaped child process 1225, status = succeeded5315client # [ 85.535626] nix[1148]: building '/nix/store/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv' on lb:50051...5316worker2 # [ 85.523492] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5317lb: must succeed: curl -sf localhost:9901/clusters5318lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5319lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 1.13 seconds)5320client: waiting for success: ! systemctl is-active waits5321worker2 # [ 86.545274] nix-daemon[813]: reaped child process 1239, status = succeeded5322worker2 # [ 86.702169] nix-daemon[813]: accepted connection from pid 1254, user nix-grpc-daemon (trusted)5323worker2 # [ 86.716387] nix-daemon[813]: reaped child process 1257, status = succeeded5324lb # [ 86.746580] niks3-server[999]: 2026/09/20 12:23:28 INFO Received uploads request method=POST path=/api/pending_closures5325worker2 # [ 86.742529] nix-grpc-daemon[1204]: time=2026-09-20T12:23:28.578Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5326worker2 # [ 86.744192] nix-grpc-daemon[1204]: time=2026-09-20T12:23:28.579Z level=INFO msg="Uploading wxl98jgbbzfq9nz6nhndwvzybqml1mdg-farm-a (136B)"5327lb # [ 86.776724] niks3-server[999]: 2026/09/20 12:23:28 INFO Registered completed upload object_key=log/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv5328lb # [ 86.790144] niks3-server[999]: 2026/09/20 12:23:28 INFO Registered completed upload object_key=nar/0857pwr5xvcgvis5zd1wyn7l7dm0a00lpfjkz94axr76vhy2l88g.nar.zst5329lb # [ 86.802320] niks3-server[999]: 2026/09/20 12:23:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5330lb # [ 86.807503] niks3-server[999]: 2026/09/20 12:23:28 INFO Signed narinfos id=28 count=15331worker2 # [ 86.798864] nix-grpc-daemon[1204]: time=2026-09-20T12:23:28.634Z level=INFO msg="Uploading 1 narinfos"5332lb # [ 86.812870] niks3-server[999]: 2026/09/20 12:23:28 INFO Registered completed upload object_key=wxl98jgbbzfq9nz6nhndwvzybqml1mdg.ls5333lb # [ 86.822713] niks3-server[999]: 2026/09/20 12:23:28 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5334lb # [ 86.828619] niks3-server[999]: 2026/09/20 12:23:28 INFO Completed upload id=285335worker2 # [ 86.817060] nix-grpc-daemon[1204]: time=2026-09-20T12:23:28.652Z level=INFO msg="Upload complete. (287ms)"5336lb # [ 86.830186] niks3-server[999]: 2026/09/20 12:23:28 INFO Registered completed upload object_key=wxl98jgbbzfq9nz6nhndwvzybqml1mdg.narinfo5337worker2 # [ 86.823468] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54404 duration_s=1 drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv assign_id=1 outputs=15338worker1 # [ 86.843678] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:28Z level=debug event=want client=1 drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv cached=05339worker1 # [ 86.847733] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:28Z level=debug event=assigned drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv worker=192.168.1.4:50051 clients=15340worker2 # [ 86.837231] nix-daemon[813]: reaped child process 1237, status = succeeded5341worker2 # [ 86.873521] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544045342worker2 # [ 86.885670] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:544045343worker2 # [ 86.898139] nix-grpc-daemon[1204]: time=2026-09-20T12:23:28.733Z level=INFO msg="All 1 paths already cached"5344client # [ 86.917757] nix[1148]: copying 1 paths to 'lb:50051'...5345client # [ 86.921173] nix[1148]: copying path '/nix/store/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv' to 'lb:50051'...5346worker2 # [ 86.907587] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:544045347worker2 # [ 86.918160] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5348worker2 # [ 87.086510] nix-daemon[813]: accepted connection from pid 1261, user nix-grpc-daemon (trusted)5349worker2 # [ 87.100026] nix-daemon[813]: reaped child process 1264, status = succeeded5350lb # [ 87.236161] envoy[907]: conn peer=[2001:db8:1::3]:45806 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=552 tx=177 ms=21955351worker2 # [ 87.278276] nix-daemon[813]: accepted connection from pid 1266, user nix-grpc-daemon (trusted)5352worker2 # [ 87.291680] nix-daemon[813]: reaped child process 1269, status = succeeded5353lb # [ 87.320483] niks3-server[999]: 2026/09/20 12:23:29 INFO Received uploads request method=POST path=/api/pending_closures5354worker2 # [ 87.316262] nix-grpc-daemon[1204]: time=2026-09-20T12:23:29.152Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5355worker2 # [ 87.318253] nix-grpc-daemon[1204]: time=2026-09-20T12:23:29.153Z level=INFO msg="Uploading jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv (632B)"5356lb # [ 87.346085] niks3-server[999]: 2026/09/20 12:23:29 INFO Registered completed upload object_key=nar/06r703613wasx30c56zihv19sk7v1y1xsivlzw3jax3csnwjf02v.nar.zst5357lb # [ 87.357928] niks3-server[999]: 2026/09/20 12:23:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5358worker2 # [ 87.351370] nix-grpc-daemon[1204]: time=2026-09-20T12:23:29.186Z level=INFO msg="Uploading 1 narinfos"5359lb # [ 87.362946] niks3-server[999]: 2026/09/20 12:23:29 INFO Signed narinfos id=29 count=15360lb # [ 87.368562] niks3-server[999]: 2026/09/20 12:23:29 INFO Registered completed upload object_key=jv6y5kiw0k6gp891vxyi80vs9q23zzaj.ls5361lb # [ 87.380278] niks3-server[999]: 2026/09/20 12:23:29 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5362worker2 # [ 87.374697] nix-grpc-daemon[1204]: time=2026-09-20T12:23:29.210Z level=INFO msg="Upload complete. (444ms)"5363lb # [ 87.386741] niks3-server[999]: 2026/09/20 12:23:29 INFO Completed upload id=295364lb # [ 87.390258] niks3-server[999]: 2026/09/20 12:23:29 INFO Registered completed upload object_key=jv6y5kiw0k6gp891vxyi80vs9q23zzaj.narinfo5365worker2 # [ 87.377885] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54404 duration_s=0 paths=1 nar_bytes_in=6325366worker2 # [ 87.383386] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544045367worker2 # [ 87.393111] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5368worker2 # [ 87.398357] nix-daemon[813]: reaped child process 1259, status = succeeded5369worker2 # [ 87.403414] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5370client # [ 87.416916] nix[1148]: building '/nix/store/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv' on lb:50051...5371worker2 # [ 88.631216] nix-daemon[813]: reaped child process 1273, status = succeeded5372worker2 # [ 88.786594] nix-daemon[813]: accepted connection from pid 1288, user nix-grpc-daemon (trusted)5373worker2 # [ 88.799882] nix-daemon[813]: reaped child process 1291, status = succeeded5374lb # [ 88.824928] niks3-server[999]: 2026/09/20 12:23:30 INFO Received uploads request method=POST path=/api/pending_closures5375worker2 # [ 88.821425] nix-grpc-daemon[1204]: time=2026-09-20T12:23:30.656Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5376worker2 # [ 88.822852] nix-grpc-daemon[1204]: time=2026-09-20T12:23:30.658Z level=INFO msg="Uploading ahy8cs7r52ad4fklig5k1khmrwzp7bkc-farm-b (184B)"5377lb # [ 88.856836] niks3-server[999]: 2026/09/20 12:23:30 INFO Registered completed upload object_key=log/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv5378lb # [ 88.869141] niks3-server[999]: 2026/09/20 12:23:30 INFO Registered completed upload object_key=nar/1bxjgkmwyii071c3ahwryw7md5gl9qidg8bm2rb2v2idzf8bvmpb.nar.zst5379lb # [ 88.880573] niks3-server[999]: 2026/09/20 12:23:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5380lb # [ 88.885608] niks3-server[999]: 2026/09/20 12:23:30 INFO Signed narinfos id=30 count=15381worker2 # [ 88.874478] nix-grpc-daemon[1204]: time=2026-09-20T12:23:30.709Z level=INFO msg="Uploading 1 narinfos"5382lb # [ 88.891242] niks3-server[999]: 2026/09/20 12:23:30 INFO Registered completed upload object_key=ahy8cs7r52ad4fklig5k1khmrwzp7bkc.ls5383lb # [ 88.899599] niks3-server[999]: 2026/09/20 12:23:30 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5384lb # [ 88.905972] niks3-server[999]: 2026/09/20 12:23:30 INFO Completed upload id=305385worker2 # [ 88.894368] nix-grpc-daemon[1204]: time=2026-09-20T12:23:30.729Z level=INFO msg="Upload complete. (283ms)"5386lb # [ 88.908358] niks3-server[999]: 2026/09/20 12:23:30 INFO Registered completed upload object_key=ahy8cs7r52ad4fklig5k1khmrwzp7bkc.narinfo5387worker2 # [ 88.900637] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54404 duration_s=1 drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv assign_id=2 outputs=15388worker1 # [ 88.919795] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:30Z level=debug event=want client=1 drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv cached=05389worker1 # [ 88.924211] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:30Z level=debug event=assigned drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv worker=192.168.1.4:50051 clients=15390worker2 # [ 88.915109] nix-daemon[813]: reaped child process 1271, status = succeeded5391worker2 # [ 88.950162] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544045392worker2 # [ 88.963241] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:544045393worker2 # [ 88.975755] nix-grpc-daemon[1204]: time=2026-09-20T12:23:30.811Z level=INFO msg="All 2 paths already cached"5394client # [ 88.996470] nix[1148]: copying 1 paths to 'lb:50051'...5395client # [ 88.997430] nix[1148]: copying path '/nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv' to 'lb:50051'...5396worker2 # [ 88.982695] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:544045397worker2 # [ 88.992162] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5398worker2 # [ 89.168845] nix-daemon[813]: accepted connection from pid 1295, user nix-grpc-daemon (trusted)5399worker2 # [ 89.181663] nix-daemon[813]: reaped child process 1298, status = succeeded5400worker2 # [ 89.344364] nix-daemon[813]: accepted connection from pid 1300, user nix-grpc-daemon (trusted)5401worker2 # [ 89.356814] nix-daemon[813]: reaped child process 1303, status = succeeded5402lb # [ 89.381449] niks3-server[999]: 2026/09/20 12:23:31 INFO Received uploads request method=POST path=/api/pending_closures5403worker2 # [ 89.378153] nix-grpc-daemon[1204]: time=2026-09-20T12:23:31.213Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5404worker2 # [ 89.379549] nix-grpc-daemon[1204]: time=2026-09-20T12:23:31.213Z level=INFO msg="Uploading 4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv (760B)"5405lb # [ 89.408612] niks3-server[999]: 2026/09/20 12:23:31 INFO Registered completed upload object_key=nar/1dx1l3qanf0yqmk397nzvl6w8vm5z1klsskxak9mqzzqlm7rj9id.nar.zst5406lb # [ 89.415536] niks3-server[999]: 2026/09/20 12:23:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5407lb # [ 89.417536] niks3-server[999]: 2026/09/20 12:23:31 INFO Signed narinfos id=31 count=15408worker2 # [ 89.407353] nix-grpc-daemon[1204]: time=2026-09-20T12:23:31.242Z level=INFO msg="Uploading 1 narinfos"5409lb # [ 89.420987] niks3-server[999]: 2026/09/20 12:23:31 INFO Registered completed upload object_key=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym.ls5410lb # [ 89.425150] niks3-server[999]: 2026/09/20 12:23:31 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5411lb # [ 89.428044] niks3-server[999]: 2026/09/20 12:23:31 INFO Completed upload id=315412worker2 # [ 89.416296] nix-grpc-daemon[1204]: time=2026-09-20T12:23:31.252Z level=INFO msg="Upload complete. (411ms)"5413worker2 # [ 89.418261] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54404 duration_s=0 paths=1 nar_bytes_in=7605414lb # [ 89.430672] niks3-server[999]: 2026/09/20 12:23:31 INFO Registered completed upload object_key=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym.narinfo5415worker2 # [ 89.421175] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544045416worker2 # [ 89.428360] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5417worker2 # [ 89.430869] nix-daemon[813]: reaped child process 1293, status = succeeded5418worker2 # [ 89.435971] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5419client # [ 89.448920] nix[1148]: building '/nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv' on lb:50051...5420worker2 # [ 90.249162] nix-daemon[813]: reaped child process 1307, status = succeeded5421worker2 # [ 90.412284] nix-daemon[813]: accepted connection from pid 1322, user nix-grpc-daemon (trusted)5422worker2 # [ 90.426206] nix-daemon[813]: reaped child process 1325, status = succeeded5423lb # [ 90.456380] niks3-server[999]: 2026/09/20 12:23:32 INFO Received uploads request method=POST path=/api/pending_closures5424worker2 # [ 90.453061] nix-grpc-daemon[1204]: time=2026-09-20T12:23:32.288Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5425worker2 # [ 90.454835] nix-grpc-daemon[1204]: time=2026-09-20T12:23:32.290Z level=INFO msg="Uploading 2kzynzc2x7d9fjl737krjzzjbsp5p77k-farm-top (240B)"5426lb # [ 90.494823] niks3-server[999]: 2026/09/20 12:23:32 INFO Registered completed upload object_key=log/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv5427lb # [ 90.502804] niks3-server[999]: 2026/09/20 12:23:32 INFO Registered completed upload object_key=nar/1x5xsygwz4a6bpv0g402i3p0nk63j2j9qkxs1rdnp6s20644kc3j.nar.zst5428lb # [ 90.511354] niks3-server[999]: 2026/09/20 12:23:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5429worker2 # [ 90.506171] nix-grpc-daemon[1204]: time=2026-09-20T12:23:32.341Z level=INFO msg="Uploading 1 narinfos"5430lb # [ 90.517547] niks3-server[999]: 2026/09/20 12:23:32 INFO Signed narinfos id=32 count=15431lb # [ 90.521534] niks3-server[999]: 2026/09/20 12:23:32 INFO Registered completed upload object_key=2kzynzc2x7d9fjl737krjzzjbsp5p77k.ls5432lb # [ 90.531160] niks3-server[999]: 2026/09/20 12:23:32 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5433lb # [ 90.535996] niks3-server[999]: 2026/09/20 12:23:32 INFO Completed upload id=325434worker2 # [ 90.524369] nix-grpc-daemon[1204]: time=2026-09-20T12:23:32.360Z level=INFO msg="Upload complete. (280ms)"5435lb # [ 90.541138] niks3-server[999]: 2026/09/20 12:23:32 INFO Registered completed upload object_key=2kzynzc2x7d9fjl737krjzzjbsp5p77k.narinfo5436worker2 # [ 90.529706] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54404 duration_s=1 drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv assign_id=3 outputs=15437worker2 # [ 90.543598] nix-daemon[813]: reaped child process 1305, status = succeeded5438client # [ 90.584731] systemd[1]: waits.service: Deactivated successfully.5439client # [ 90.588363] systemd[1]: waits.service: Consumed 143ms CPU time over 9.342s wall clock time, 49.5M memory peak, 14.5K incoming IP traffic, 20K outgoing IP traffic.5440client: (finished: waiting for success: ! systemctl is-active waits, in 5.28 seconds)5441client: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }5442client: (finished: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }, in 0.04 seconds)5443worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5444worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)5445(finished: subtest: scheduler down: builds wait, then resume when it is back, in 13.92 seconds)5446subtest: clean scheduler restart: peers are told, reconnect without error or backoff5447client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5448client # [ 91.168258] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5449client # Running as unit: rs.service; invocation ID: 57f33d8ec4ed4a7d948a8279af2814d15450client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.06 seconds)5451client # [ 91.351281] nix[1208]: don't know how to build these paths:5452client # [ 91.352707] nix[1208]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5453worker2 # [ 91.335607] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:544045454worker1 # [ 91.361934] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:33Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05455worker1 # [ 91.366077] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:33Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15456worker1 # [ 91.409169] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:33Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:419345457worker1 # [ 91.420983] nix-daemon[847]: accepted connection from pid 1140, user nix-grpc-daemon (trusted)5458worker1 # [ 91.438338] nix-grpc-daemon[1140]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 17 ms (attempt 1/5)5459worker1 # [ 91.461246] nix-grpc-daemon[1140]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 2/5)5460worker1 # [ 91.518782] nix-grpc-daemon[1140]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 261 ms (attempt 3/5)5461worker1 # [ 91.785766] nix-grpc-daemon[1140]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 474 ms (attempt 4/5)5462worker1 # [ 92.266090] nix-grpc-daemon[1140]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5463worker1 # [ 92.276429] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:419345464client # [ 92.281627] nix[1208]: copying 1 paths to 'lb:50051'...5465client # [ 92.285968] nix[1208]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5466worker1 # [ 92.286366] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:419345467worker1 # [ 92.296144] nix-daemon[847]: accepted connection from pid 1140, user nix-grpc-daemon (trusted)5468worker1 # [ 92.314843] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:34Z level=info event=niks3_push_started pid=12085469worker1 # [ 92.511598] nix-grpc-daemon[1208]: time=2026-09-20T12:23:34.325Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""5470worker1 # [ 92.692824] nix-daemon[847]: accepted connection from pid 1225, user nix-grpc-daemon (trusted)5471worker1 # [ 92.703545] nix-daemon[847]: reaped child process 1228, status = succeeded5472worker1 # [ 92.881178] nix-daemon[847]: accepted connection from pid 1230, user nix-grpc-daemon (trusted)5473worker1 # [ 92.893071] nix-daemon[847]: reaped child process 1233, status = succeeded5474lb # [ 92.911253] niks3-server[999]: 2026/09/20 12:23:34 INFO Received uploads request method=POST path=/api/pending_closures5475worker1 # [ 92.920258] nix-grpc-daemon[1208]: time=2026-09-20T12:23:34.734Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5476worker1 # [ 92.923439] nix-grpc-daemon[1208]: time=2026-09-20T12:23:34.735Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5477lb # [ 92.943088] niks3-server[999]: 2026/09/20 12:23:34 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5478lb # [ 92.955631] niks3-server[999]: 2026/09/20 12:23:34 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5479lb # [ 92.961127] niks3-server[999]: 2026/09/20 12:23:34 INFO Signed narinfos id=33 count=15480worker1 # [ 92.966452] nix-grpc-daemon[1208]: time=2026-09-20T12:23:34.780Z level=INFO msg="Uploading 1 narinfos"5481lb # [ 92.972806] niks3-server[999]: 2026/09/20 12:23:34 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5482lb # [ 92.982499] niks3-server[999]: 2026/09/20 12:23:34 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5483lb # [ 92.988726] niks3-server[999]: 2026/09/20 12:23:34 INFO Completed upload id=335484worker1 # [ 92.990617] nix-grpc-daemon[1208]: time=2026-09-20T12:23:34.804Z level=INFO msg="Upload complete. (474ms)"5485lb # [ 92.992121] niks3-server[999]: 2026/09/20 12:23:34 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5486worker1 # [ 92.995243] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:34Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41934 duration_s=0 paths=1 nar_bytes_in=4165487worker1 # [ 93.001296] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:419345488worker1 # [ 93.011122] nix-daemon[847]: accepted connection from pid 1140, user nix-grpc-daemon (trusted)5489worker1 # [ 93.014902] nix-daemon[847]: reaped child process 1206, status = succeeded5490worker1 # [ 93.020057] nix-daemon[847]: accepted connection from pid 1140, user nix-grpc-daemon (trusted)5491client # [ 93.020668] nix[1208]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5492worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5493worker2 # [ 94.845685] systemd-journald[288]: Received client request to rotate journal, rotating.5494worker2 # [ 94.855689] systemd-journald[288]: Vacuuming done, freed 0B of archived journals from /var/log/journal/2f302625d1a64a4aae5f043175ad45ee.5495worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.05 seconds)5496worker1: must succeed: systemctl restart nix-grpc-daemon.service5497worker1 # [ 94.835331] nix-daemon[847]: reaped child process 1237, status = succeeded5498worker1 # [ 94.842575] systemd[1]: Stopping Nix worker-protocol over gRPC...5499worker1 # [ 95.000390] nix-daemon[847]: accepted connection from pid 1268, user nix-grpc-daemon (trusted)5500worker1 # [ 95.012567] nix-daemon[847]: reaped child process 1272, status = succeeded5501lb # [ 95.030417] niks3-server[999]: 2026/09/20 12:23:36 INFO Received uploads request method=POST path=/api/pending_closures5502worker1 # [ 95.040620] nix-grpc-daemon[1208]: time=2026-09-20T12:23:36.854Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5503worker1 # [ 95.042180] nix-grpc-daemon[1208]: time=2026-09-20T12:23:36.856Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5504lb # [ 95.068927] niks3-server[999]: 2026/09/20 12:23:37 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5505lb # [ 95.078844] niks3-server[999]: 2026/09/20 12:23:37 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5506lb # [ 95.087222] niks3-server[999]: 2026/09/20 12:23:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5507worker1 # [ 95.094479] nix-grpc-daemon[1208]: time=2026-09-20T12:23:36.908Z level=INFO msg="Uploading 1 narinfos"5508lb # [ 95.092398] niks3-server[999]: 2026/09/20 12:23:37 INFO Signed narinfos id=34 count=15509lb # [ 95.097055] niks3-server[999]: 2026/09/20 12:23:37 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5510lb # [ 95.107167] niks3-server[999]: 2026/09/20 12:23:37 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5511lb # [ 95.116198] niks3-server[999]: 2026/09/20 12:23:37 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5512lb # [ 95.118063] niks3-server[999]: 2026/09/20 12:23:37 INFO Completed upload id=345513worker1 # [ 95.120275] nix-grpc-daemon[1208]: time=2026-09-20T12:23:36.934Z level=INFO msg="Upload complete. (292ms)"5514worker1 # [ 95.127563] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41934 duration_s=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15515worker1 # [ 95.140187] nix-daemon[847]: reaped child process 1235, status = succeeded5516client # [ 95.163983] systemd[1]: rs.service: Deactivated successfully.5517client # [ 95.167695] systemd[1]: rs.service: Consumed 108ms CPU time over 3.996s wall clock time, 39.1M memory peak, 8.7K incoming IP traffic, 9K outgoing IP traffic.5518worker1 # [ 95.595525] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:37Z level=info event=signal_exit5519worker1 # [ 95.597885] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:37Z level=info event=scheduler_restarting5520worker1 # [ 95.601430] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:37Z level=info event=scheduler_restarting addr=lb:500515521worker2 # [ 95.587708] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:37Z level=info event=scheduler_restarting addr=lb:500515522worker1 # [ 95.603558] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:419065523worker1 # [ 95.605694] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:37Z level=info event=worker_gone addr=192.168.1.3:500515524worker1 # [ 95.607572] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:37Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:419065525worker1 # [ 95.609301] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:37Z level=info event=worker_gone addr=192.168.1.4:500515526worker1 # [ 95.619902] nix-daemon[847]: reaped child process 1201, status = succeeded5527worker2 # [ 95.788759] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:37Z level=info event=scheduler_connected addr=lb:500515528worker1 # [ 95.805672] nix-grpc-daemon[1140]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5529worker1 # [ 95.812907] nix-grpc-daemon[1140]: E0000 00:00:1789907017.619775 1183 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true5530worker1 # [ 95.820181] nix-grpc-daemon[1140]: ts=2026-09-20T12:23:37Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5531worker1 # [ 96.116740] nix-grpc-daemon[1140]: E0000 00:00:1789907017.930673 1183 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5532worker1 # [ 96.121600] nix-grpc-daemon[1140]: E0000 00:00:1789907017.930906 1183 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5533worker2 # [ 97.129688] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:38Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5534worker1 # [ 97.161145] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5535worker1 # [ 97.164144] systemd[1]: Stopped Nix worker-protocol over gRPC.5536worker1 # [ 97.167351] systemd[1]: nix-grpc-daemon.service: Consumed 486ms CPU time over 12.748s wall clock time, 31.3M memory peak, 19K incoming IP traffic, 23.9K outgoing IP traffic.5537worker1 # [ 97.183314] systemd[1]: Starting Nix worker-protocol over gRPC...5538lb # [ 97.238471] envoy[907]: conn peer=[2001:db8:1::1]:42744 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=10116 tx=4073 ms=91165539lb # [ 97.242407] envoy[907]: conn peer=[2001:db8:1::1]:39556 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2947 tx=1349 ms=37865540lb # [ 97.245865] envoy[907]: conn peer=[2001:db8:1::3]:56634 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=744 tx=260 ms=112005541worker1 # [ 97.342312] nix-grpc-daemon[1279]: ts=2026-09-20T12:23:39Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5542worker1 # [ 97.344223] nix-grpc-daemon[1279]: ts=2026-09-20T12:23:39Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5543worker2 # [ 97.329888] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:39Z level=info event=scheduler_connected addr=lb:500515544worker1 # [ 97.347871] nix-grpc-daemon[1279]: ts=2026-09-20T12:23:39Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15545worker1 # [ 97.354056] nix-grpc-daemon[1279]: ts=2026-09-20T12:23:39Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5546worker1 # [ 97.358113] systemd[1]: Started Nix worker-protocol over gRPC.5547worker1: (finished: must succeed: systemctl restart nix-grpc-daemon.service, in 2.56 seconds)5548worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting5549worker1 # [ 97.369529] nix-grpc-daemon[1279]: ts=2026-09-20T12:23:39Z level=info event=oidc_jwks provider=mock keys=15550worker1 # [ 97.372124] nix-grpc-daemon[1279]: ts=2026-09-20T12:23:39Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:407005551worker1 # [ 97.373771] nix-grpc-daemon[1279]: ts=2026-09-20T12:23:39Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05552worker1 # [ 97.377263] nix-grpc-daemon[1279]: ts=2026-09-20T12:23:39Z level=info event=scheduler_connected addr=lb:500515553worker1 # [ 97.378772] nix-grpc-daemon[1279]: ts=2026-09-20T12:23:39Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:407005554worker1 # [ 97.380265] nix-grpc-daemon[1279]: ts=2026-09-20T12:23:39Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05555worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting, in 0.06 seconds)5556worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5557worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5558client: waiting for success: ! systemctl is-active rs5559client: (finished: waiting for success: ! systemctl is-active rs, in 0.05 seconds)5560client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5561client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)5562client: must fail: journalctl -u rs | grep -q 'reconnecting'5563client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5564(finished: subtest: clean scheduler restart: peers are told, reconnect without error or backoff, in 6.56 seconds)5565subtest: scheduler restart mid-build: build finishes, no double build5566client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5567client # [ 97.705385] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5568client # Running as unit: mid.service; invocation ID: 7194ed95ddb04addb55b1560d8b079515569client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.03 seconds)5570worker2 # [ 97.866472] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:544045571client # [ 97.887276] nix[1240]: don't know how to build these paths:5572client # [ 97.888278] nix[1240]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5573worker1 # [ 97.896944] nix-grpc-daemon[1279]: ts=2026-09-20T12:23:39Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05574worker1 # [ 97.901456] nix-grpc-daemon[1279]: ts=2026-09-20T12:23:39Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15575worker2 # [ 97.928061] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544045576worker2 # [ 97.942285] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:544045577client # [ 97.966449] nix[1240]: copying 1 paths to 'lb:50051'...5578worker2 # [ 97.953673] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:544045579client # [ 97.969143] nix[1240]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5580worker2 # [ 97.965764] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5581worker2 # [ 98.148720] nix-daemon[813]: accepted connection from pid 1364, user nix-grpc-daemon (trusted)5582worker2 # [ 98.163118] nix-daemon[813]: reaped child process 1367, status = succeeded5583worker2 # [ 98.317578] nix-daemon[813]: accepted connection from pid 1369, user nix-grpc-daemon (trusted)5584worker2 # [ 98.330144] nix-daemon[813]: reaped child process 1372, status = succeeded5585lb # [ 98.358757] niks3-server[999]: 2026/09/20 12:23:40 INFO Received uploads request method=POST path=/api/pending_closures5586worker2 # [ 98.351858] nix-grpc-daemon[1204]: time=2026-09-20T12:23:40.187Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5587worker2 # [ 98.353342] nix-grpc-daemon[1204]: time=2026-09-20T12:23:40.189Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5588lb # [ 98.376069] niks3-server[999]: 2026/09/20 12:23:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5589lb # [ 98.379156] niks3-server[999]: 2026/09/20 12:23:40 INFO Signed narinfos id=35 count=15590worker2 # [ 98.368803] nix-grpc-daemon[1204]: time=2026-09-20T12:23:40.204Z level=INFO msg="Uploading 1 narinfos"5591lb # [ 98.383809] niks3-server[999]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5592lb # [ 98.386746] niks3-server[999]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5593lb # [ 98.391180] niks3-server[999]: 2026/09/20 12:23:40 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5594lb # [ 98.394228] niks3-server[999]: 2026/09/20 12:23:40 INFO Completed upload id=355595worker2 # [ 98.382477] nix-grpc-daemon[1204]: time=2026-09-20T12:23:40.218Z level=INFO msg="Upload complete. (400ms)"5596worker2 # [ 98.384636] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54404 duration_s=0 paths=1 nar_bytes_in=4245597lb # [ 98.397215] niks3-server[999]: 2026/09/20 12:23:40 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5598worker2 # [ 98.388105] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544045599worker2 # [ 98.394805] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5600worker2 # [ 98.397152] nix-daemon[813]: reaped child process 1362, status = succeeded5601worker2 # [ 98.402442] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5602client # [ 98.415525] nix[1240]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5603worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5604worker1 # [ 99.121582] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1279 (nix-grpc-daemon) on client request.5605worker2 # [ 99.115341] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:40Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5606worker1 # [ 99.129304] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5607client # [ 99.130782] nix[1240]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5608worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.07 seconds)5609client: must succeed: sleep 5.05610worker1 # [ 99.154856] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5611worker1 # [ 99.156416] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5612worker1 # [ 99.158203] systemd[1]: nix-grpc-daemon.service: Consumed 103ms CPU time over 1.971s wall clock time, 10.3M memory peak, 8.6K incoming IP traffic, 7.9K outgoing IP traffic.5613worker2 # [ 99.316065] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:41Z level=info event=scheduler_connected addr=lb:500515614worker1 # [ 99.409423] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5615worker1 # [ 99.414261] systemd[1]: Starting Nix worker-protocol over gRPC...5616worker1 # [ 99.583386] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:41Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5617worker1 # [ 99.585813] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:41Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5618worker1 # [ 99.589443] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:41Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15619worker1 # [ 99.595922] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:41Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5620worker1 # [ 99.598904] systemd[1]: Started Nix worker-protocol over gRPC.5621worker1 # [ 99.613470] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:41Z level=info event=oidc_jwks provider=mock keys=15622worker1 # [ 99.616455] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:41Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:407525623worker1 # [ 99.618727] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:41Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=15624worker1 # [ 99.621788] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:41Z level=info event=scheduler_connected addr=lb:500515625worker1 # [ 99.623318] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:41Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:407525626worker1 # [ 99.624751] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:41Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05627client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5628client: waiting for success: ! systemctl is-active mid5629worker2 # [ 104.421274] nix-daemon[813]: reaped child process 1376, status = succeeded5630worker2 # [ 104.552916] nix-daemon[813]: accepted connection from pid 1408, user nix-grpc-daemon (trusted)5631worker2 # [ 104.564091] nix-daemon[813]: reaped child process 1411, status = succeeded5632lb # [ 104.594456] niks3-server[999]: 2026/09/20 12:23:46 INFO Received uploads request method=POST path=/api/pending_closures5633worker2 # [ 104.591225] nix-grpc-daemon[1204]: time=2026-09-20T12:23:46.426Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5634worker2 # [ 104.592700] nix-grpc-daemon[1204]: time=2026-09-20T12:23:46.428Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5635lb # [ 104.636916] niks3-server[999]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5636lb # [ 104.650198] niks3-server[999]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5637lb # [ 104.658136] niks3-server[999]: 2026/09/20 12:23:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5638lb # [ 104.662566] niks3-server[999]: 2026/09/20 12:23:46 INFO Signed narinfos id=36 count=15639worker2 # [ 104.651360] nix-grpc-daemon[1204]: time=2026-09-20T12:23:46.486Z level=INFO msg="Uploading 1 narinfos"5640lb # [ 104.673085] niks3-server[999]: 2026/09/20 12:23:46 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5641lb # [ 104.677872] niks3-server[999]: 2026/09/20 12:23:46 INFO Completed upload id=365642worker2 # [ 104.665813] nix-grpc-daemon[1204]: time=2026-09-20T12:23:46.501Z level=INFO msg="Upload complete. (252ms)"5643lb # [ 104.679260] niks3-server[999]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5644worker2 # [ 104.668320] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54404 duration_s=6 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15645lb # [ 104.681928] niks3-server[999]: 2026/09/20 12:23:46 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5646worker2 # [ 104.675608] nix-daemon[813]: reaped child process 1374, status = succeeded5647client # [ 104.708853] systemd[1]: mid.service: Deactivated successfully.5648client # [ 104.710164] systemd[1]: mid.service: Consumed 100ms CPU time over 7.003s wall clock time, 39.3M memory peak, 8.9K incoming IP traffic, 9.2K outgoing IP traffic.5649client: (finished: waiting for success: ! systemctl is-active mid, in 1.09 seconds)5650client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5651client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)5652(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 7.83 seconds)5653subtest: interrupting the client stops the build on the worker5654client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5655client # [ 105.537994] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5656client # Running as unit: intr.service; invocation ID: 65f7660e50b84b5291d41bf0269fbf315657client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.03 seconds)5658client # [ 105.705781] nix[1274]: don't know how to build these paths:5659client # [ 105.706663] nix[1274]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5660worker2 # [ 105.690716] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:544045661worker1 # [ 105.712530] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:47Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05662worker1 # [ 105.714979] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:47Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15663worker1 # [ 105.758067] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429445664worker1 # [ 105.763741] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5665worker1 # [ 105.771871] nix-grpc-daemon[1353]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 60 ms (attempt 1/5)5666worker1 # [ 105.834471] nix-grpc-daemon[1353]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 62 ms (attempt 2/5)5667worker1 # [ 105.896640] nix-grpc-daemon[1353]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 268 ms (attempt 3/5)5668worker1 # [ 106.167239] nix-grpc-daemon[1353]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 255 ms (attempt 4/5)5669worker1 # [ 106.425255] nix-grpc-daemon[1353]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5670worker1 # [ 106.437873] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429445671client # [ 106.444547] nix[1274]: copying 1 paths to 'lb:50051'...5672worker1 # [ 106.447969] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429445673client # [ 106.448145] nix[1274]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5674worker1 # [ 106.455455] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5675worker1 # [ 106.464394] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:48Z level=info event=niks3_push_started pid=14205676worker1 # [ 106.642871] nix-grpc-daemon[1420]: time=2026-09-20T12:23:48.456Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""5677worker1 # [ 106.803911] nix-daemon[847]: accepted connection from pid 1436, user nix-grpc-daemon (trusted)5678worker1 # [ 106.816319] nix-daemon[847]: reaped child process 1440, status = succeeded5679worker1 # [ 106.967175] nix-daemon[847]: accepted connection from pid 1442, user nix-grpc-daemon (trusted)5680worker1 # [ 106.979218] nix-daemon[847]: reaped child process 1445, status = succeeded5681lb # [ 106.994674] niks3-server[999]: 2026/09/20 12:23:48 INFO Received uploads request method=POST path=/api/pending_closures5682worker1 # [ 107.005728] nix-grpc-daemon[1420]: time=2026-09-20T12:23:48.819Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5683worker1 # [ 107.008817] nix-grpc-daemon[1420]: time=2026-09-20T12:23:48.821Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5684lb # [ 107.027729] niks3-server[999]: 2026/09/20 12:23:48 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5685lb # [ 107.036447] niks3-server[999]: 2026/09/20 12:23:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5686lb # [ 107.041390] niks3-server[999]: 2026/09/20 12:23:49 INFO Signed narinfos id=37 count=15687worker1 # [ 107.046393] nix-grpc-daemon[1420]: time=2026-09-20T12:23:48.860Z level=INFO msg="Uploading 1 narinfos"5688lb # [ 107.054043] niks3-server[999]: 2026/09/20 12:23:49 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5689lb # [ 107.062199] niks3-server[999]: 2026/09/20 12:23:49 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5690worker1 # [ 107.070778] nix-grpc-daemon[1420]: time=2026-09-20T12:23:48.884Z level=INFO msg="Upload complete. (423ms)"5691lb # [ 107.068961] niks3-server[999]: 2026/09/20 12:23:49 INFO Completed upload id=375692lb # [ 107.071617] niks3-server[999]: 2026/09/20 12:23:49 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5693worker1 # [ 107.075226] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=0 paths=1 nar_bytes_in=4245694worker1 # [ 107.080619] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429445695worker1 # [ 107.089060] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5696worker1 # [ 107.092850] nix-daemon[847]: reaped child process 1418, status = succeeded5697worker1 # [ 107.097848] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5698client # [ 107.098267] nix[1274]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5699lb # [ 107.238135] envoy[907]: conn peer=[2001:db8:1::3]:47422 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=496 tx=55 ms=17615700lb # [ 107.241789] envoy[907]: conn peer=[2001:db8:1::1]:42424 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3001 tx=1378 ms=68155701client: must succeed: systemctl kill -s INT intr5702client # [ 107.934266] systemd[1]: intr.service: Sent signal SIGINT to main process 1274 (nix) on client request.5703client # [ 107.938375] nix[1274]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5704client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)5705client # [ 107.945391] nix[1274]: error: interrupted by the user5706client # [ 107.975505] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5707client # [ 107.977117] systemd[1]: intr.service: Failed with result 'exit-code'.5708client # [ 107.979077] systemd[1]: intr.service: Consumed 104ms CPU time over 2.439s wall clock time, 39.1M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5709worker1 # [ 108.115393] nix-daemon[847]: reaped child process 1447, status = succeeded5710worker1 # [ 108.121275] nix-daemon[1449]: unexpected Nix daemon error: error: interrupted by the user5711worker1 # [ 108.124378] nix-daemon[847]: reaped child process 1449, status = failed with exit code 15712(finished: subtest: interrupting the client stops the build on the worker, in 3.68 seconds)5713subtest: a deploy mid-build drains: the build finishes, the new generation takes over5714client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5715client # [ 109.247318] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5716client # Running as unit: sw.service; invocation ID: e08267f4ac3744519cf50cb3da30ae985717client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds)5718worker1 # [ 109.429542] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:429445719client # [ 109.435946] nix[1294]: don't know how to build these paths:5720client # [ 109.436827] nix[1294]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5721worker1 # [ 109.443789] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:51Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05722worker1 # [ 109.447860] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:51Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15723worker2 # [ 109.475709] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544045724worker2 # [ 109.491574] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:544045725client # [ 109.516426] nix[1294]: copying 1 paths to 'lb:50051'...5726worker2 # [ 109.503493] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:544045727client # [ 109.519150] nix[1294]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5728worker2 # [ 109.513694] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5729worker2 # [ 109.707623] nix-daemon[813]: accepted connection from pid 1439, user nix-grpc-daemon (trusted)5730worker2 # [ 109.722661] nix-daemon[813]: reaped child process 1442, status = succeeded5731worker2 # [ 109.890346] nix-daemon[813]: accepted connection from pid 1444, user nix-grpc-daemon (trusted)5732worker2 # [ 109.903453] nix-daemon[813]: reaped child process 1447, status = succeeded5733lb # [ 109.930757] niks3-server[999]: 2026/09/20 12:23:51 INFO Received uploads request method=POST path=/api/pending_closures5734worker2 # [ 109.928796] nix-grpc-daemon[1204]: time=2026-09-20T12:23:51.763Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5735worker2 # [ 109.930426] nix-grpc-daemon[1204]: time=2026-09-20T12:23:51.766Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5736lb # [ 109.961774] niks3-server[999]: 2026/09/20 12:23:51 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5737lb # [ 109.973444] niks3-server[999]: 2026/09/20 12:23:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5738worker2 # [ 109.967068] nix-grpc-daemon[1204]: time=2026-09-20T12:23:51.802Z level=INFO msg="Uploading 1 narinfos"5739lb # [ 109.978627] niks3-server[999]: 2026/09/20 12:23:51 INFO Signed narinfos id=38 count=15740lb # [ 109.985120] niks3-server[999]: 2026/09/20 12:23:51 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5741lb # [ 109.994629] niks3-server[999]: 2026/09/20 12:23:51 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5742lb # [ 110.003664] niks3-server[999]: 2026/09/20 12:23:51 INFO Completed upload id=385743worker2 # [ 109.991814] nix-grpc-daemon[1204]: time=2026-09-20T12:23:51.827Z level=INFO msg="Upload complete. (461ms)"5744lb # [ 110.006417] niks3-server[999]: 2026/09/20 12:23:51 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo5745worker2 # [ 109.995623] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:51Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:54404 duration_s=0 paths=1 nar_bytes_in=4165746worker2 # [ 110.000740] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:544045747worker2 # [ 110.010112] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5748worker2 # [ 110.017446] nix-daemon[813]: reaped child process 1437, status = succeeded5749client # [ 110.035975] nix[1294]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5750worker2 # [ 110.024105] nix-daemon[813]: accepted connection from pid 1183, user nix-grpc-daemon (trusted)5751worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25752worker2 # Checking switch inhibitors... done5753worker2 # [ 112.470295] nixos[1482]: switching to system configuration /nix/store/i07yb21x3xcm88hqadr2lslw50gmm1lm-nixos-system-worker2-test5754worker2 # [ 112.473413] systemd[1]: Stopped target Local File Systems.5755worker2 # activating the configuration...5756worker2 # [ 112.476482] systemd[1]: Stopped target Remote File Systems.5757worker2 # setting up /etc...5758worker2 # [ 113.156668] systemd[1]: Reload requested from client PID 1482 ('.switch-to-conf') (unit backdoor.service)...5759worker2 # [ 113.158286] systemd[1]: Reloading...5760worker2 # [ 113.895328] systemd[1]: Reloading finished in 734 ms.5761worker2 # restarting sysinit-reactivation.target5762worker2 # [ 113.953596] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5763worker2 # [ 114.090405] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5764worker2 # [ 114.093754] systemd[1]: Reached target Reactivate sysinit units.5765worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5766worker2 # [ 114.098270] dbus-broker-launch[535]: Caught SIGHUP, trigger reload.5767worker2 # [ 114.100506] systemd[1]: Reloading D-Bus System Message Bus...5768worker2 # [ 114.103829] systemd[1]: Reloading Nix worker-protocol over gRPC...5769worker2 # [ 114.133534] dbus-broker-launch[535]: Looking up NSS user entry for 'systemd-timesync'...5770worker2 # [ 114.137263] dbus-broker-launch[535]: NSS returned no entry for 'systemd-timesync'5771worker2 # [ 114.138833] dbus-broker-launch[535]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5772worker2 # [ 114.152748] systemd[1]: Reloaded Nix worker-protocol over gRPC.5773worker2 # [ 114.174535] systemd[1]: Reloaded D-Bus System Message Bus.5774worker2 # [ 114.177834] systemd[1]: Reached target Remote File Systems.5775worker2 # [ 114.185070] systemd[1]: Reached target Local File Systems.5776worker2 # [ 114.185893] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5777worker2 # [ 114.191588] systemd[1]: Starting Create SUID/SGID Wrappers...5778worker2 # [ 114.192620] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5779worker2 # [ 114.194640] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675780worker2 # [ 114.196606] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5781worker2 # [ 114.198053] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5782worker2 # [ 114.199235] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5783worker2 # [ 114.211300] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5784worker2 # [ 114.212536] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5785worker2 # [ 114.634218] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5786worker2 # [ 114.636226] systemd[1]: Finished Create SUID/SGID Wrappers.5787worker2 # [ 114.639168] systemd[1]: Starting linger-users.service...5788worker2 # [ 114.683797] nix-grpc-daemon[1183]: ts=2026-09-20T12:23:56Z level=info event=draining5789worker2 # [ 114.688269] systemd[1]: linger-users.service: Deactivated successfully.5790worker2 # [ 114.689511] systemd[1]: Finished linger-users.service.5791worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5792worker2 # [ 114.946381] nixos[1482]: finished switching to system configuration /nix/store/i07yb21x3xcm88hqadr2lslw50gmm1lm-nixos-system-worker2-test5793worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.19 seconds)5794worker2: must succeed: pgrep -f 'read -t [9]0 x'5795worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5796client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&25797worker1 # [ 115.247400] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:429445798client # don't know how to build these paths:5799client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5800worker1 # [ 115.255370] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429445801worker1 # [ 115.277198] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:57Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05802worker1 # [ 115.282355] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:57Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=15803worker1 # [ 115.327573] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429445804worker1 # [ 115.339114] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429445805client # copying 1 paths to 'lb:50051'...5806client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5807worker1 # [ 115.349725] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429445808worker1 # [ 115.362531] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5809worker1 # [ 115.537660] nix-daemon[847]: accepted connection from pid 1499, user nix-grpc-daemon (trusted)5810worker1 # [ 115.549772] nix-daemon[847]: reaped child process 1502, status = succeeded5811worker1 # [ 115.717437] nix-daemon[847]: accepted connection from pid 1504, user nix-grpc-daemon (trusted)5812worker1 # [ 115.729919] nix-daemon[847]: reaped child process 1507, status = succeeded5813lb # [ 115.740588] niks3-server[999]: 2026/09/20 12:23:57 INFO Received uploads request method=POST path=/api/pending_closures5814worker1 # [ 115.750861] nix-grpc-daemon[1420]: time=2026-09-20T12:23:57.564Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5815worker1 # [ 115.752283] nix-grpc-daemon[1420]: time=2026-09-20T12:23:57.564Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5816lb # [ 115.771937] niks3-server[999]: 2026/09/20 12:23:57 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5817lb # [ 115.784243] niks3-server[999]: 2026/09/20 12:23:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5818lb # [ 115.788118] niks3-server[999]: 2026/09/20 12:23:57 INFO Signed narinfos id=39 count=15819worker1 # [ 115.793201] nix-grpc-daemon[1420]: time=2026-09-20T12:23:57.607Z level=INFO msg="Uploading 1 narinfos"5820lb # [ 115.794274] niks3-server[999]: 2026/09/20 12:23:57 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5821lb # [ 115.805604] niks3-server[999]: 2026/09/20 12:23:57 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5822lb # [ 115.811229] niks3-server[999]: 2026/09/20 12:23:57 INFO Completed upload id=395823worker1 # [ 115.812996] nix-grpc-daemon[1420]: time=2026-09-20T12:23:57.627Z level=INFO msg="Upload complete. (439ms)"5824lb # [ 115.815583] niks3-server[999]: 2026/09/20 12:23:57 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5825worker1 # [ 115.816853] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=0 paths=1 nar_bytes_in=5285826worker1 # [ 115.822473] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429445827worker1 # [ 115.831088] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5828worker1 # [ 115.838346] nix-daemon[847]: reaped child process 1497, status = succeeded5829worker1 # [ 115.843364] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5830client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...5831client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5832client # farm-a> LOG-farm-a-during-drain5833lb # [ 117.238654] envoy[907]: conn peer=[2001:db8:1::1]:49886 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=730 ms=22505834worker1 # [ 117.268198] nix-daemon[847]: reaped child process 1511, status = succeeded5835worker1 # [ 117.443814] nix-daemon[847]: accepted connection from pid 1526, user nix-grpc-daemon (trusted)5836worker1 # [ 117.454681] nix-daemon[847]: reaped child process 1529, status = succeeded5837lb # [ 117.471781] niks3-server[999]: 2026/09/20 12:23:59 INFO Received uploads request method=POST path=/api/pending_closures5838worker1 # [ 117.477994] nix-grpc-daemon[1420]: time=2026-09-20T12:23:59.292Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5839worker1 # [ 117.479501] nix-grpc-daemon[1420]: time=2026-09-20T12:23:59.293Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"5840lb # [ 117.490560] niks3-server[999]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5841lb # [ 117.496143] niks3-server[999]: 2026/09/20 12:23:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5842lb # [ 117.499902] niks3-server[999]: 2026/09/20 12:23:59 INFO Signed narinfos id=40 count=15843worker1 # [ 117.503900] nix-grpc-daemon[1420]: time=2026-09-20T12:23:59.317Z level=INFO msg="Uploading 1 narinfos"5844lb # [ 117.502523] niks3-server[999]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5845lb # [ 117.504427] niks3-server[999]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls5846lb # [ 117.509907] niks3-server[999]: 2026/09/20 12:23:59 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5847lb # [ 117.513327] niks3-server[999]: 2026/09/20 12:23:59 INFO Completed upload id=405848worker1 # [ 117.515132] nix-grpc-daemon[1420]: time=2026-09-20T12:23:59.329Z level=INFO msg="Upload complete. (264ms)"5849lb # [ 117.514955] niks3-server[999]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo5850worker1 # [ 117.517532] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=15851worker1 # [ 117.524665] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:59Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=05852worker1 # [ 117.526994] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:59Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=15853worker1 # [ 117.530661] nix-daemon[847]: reaped child process 1509, status = succeeded5854worker1 # [ 117.567641] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429445855worker1 # [ 117.574057] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429445856worker1 # [ 117.583169] nix-grpc-daemon[1420]: time=2026-09-20T12:23:59.397Z level=INFO msg="All 1 paths already cached"5857client # copying 1 paths to 'lb:50051'...5858worker1 # [ 117.589554] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429445859client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...5860worker1 # [ 117.609146] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5861worker1 # [ 117.761064] nix-daemon[847]: accepted connection from pid 1535, user nix-grpc-daemon (trusted)5862worker1 # [ 117.773582] nix-daemon[847]: reaped child process 1538, status = succeeded5863worker1 # [ 117.943607] nix-daemon[847]: accepted connection from pid 1540, user nix-grpc-daemon (trusted)5864worker1 # [ 117.955972] nix-daemon[847]: reaped child process 1543, status = succeeded5865lb # [ 117.964275] niks3-server[999]: 2026/09/20 12:23:59 INFO Received uploads request method=POST path=/api/pending_closures5866worker1 # [ 117.975124] nix-grpc-daemon[1420]: time=2026-09-20T12:23:59.788Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5867worker1 # [ 117.976516] nix-grpc-daemon[1420]: time=2026-09-20T12:23:59.789Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"5868lb # [ 117.991261] niks3-server[999]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst5869lb # [ 118.001235] niks3-server[999]: 2026/09/20 12:23:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5870lb # [ 118.006117] niks3-server[999]: 2026/09/20 12:23:59 INFO Signed narinfos id=41 count=15871worker1 # [ 118.011338] nix-grpc-daemon[1420]: time=2026-09-20T12:23:59.825Z level=INFO msg="Uploading 1 narinfos"5872lb # [ 118.013381] niks3-server[999]: 2026/09/20 12:23:59 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls5873lb # [ 118.022900] niks3-server[999]: 2026/09/20 12:23:59 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5874lb # [ 118.029289] niks3-server[999]: 2026/09/20 12:24:00 INFO Completed upload id=415875worker1 # [ 118.031194] nix-grpc-daemon[1420]: time=2026-09-20T12:23:59.845Z level=INFO msg="Upload complete. (412ms)"5876lb # [ 118.031528] niks3-server[999]: 2026/09/20 12:24:00 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo5877worker1 # [ 118.034497] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:59Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=0 paths=1 nar_bytes_in=6405878worker1 # [ 118.039462] nix-grpc-daemon[1353]: ts=2026-09-20T12:23:59Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429445879worker1 # [ 118.048274] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5880worker1 # [ 118.053071] nix-daemon[847]: reaped child process 1533, status = succeeded5881worker1 # [ 118.058144] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5882client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...5883client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5884client # farm-b> LOG-farm-b-during-drain5885worker1 # [ 119.483658] nix-daemon[847]: reaped child process 1547, status = succeeded5886worker1 # [ 119.651080] nix-daemon[847]: accepted connection from pid 1562, user nix-grpc-daemon (trusted)5887worker1 # [ 119.664135] nix-daemon[847]: reaped child process 1565, status = succeeded5888lb # [ 119.678423] niks3-server[999]: 2026/09/20 12:24:01 INFO Received uploads request method=POST path=/api/pending_closures5889worker1 # [ 119.684891] nix-grpc-daemon[1420]: time=2026-09-20T12:24:01.498Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5890worker1 # [ 119.686409] nix-grpc-daemon[1420]: time=2026-09-20T12:24:01.500Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"5891lb # [ 119.695451] niks3-server[999]: 2026/09/20 12:24:01 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5892lb # [ 119.701300] niks3-server[999]: 2026/09/20 12:24:01 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst5893lb # [ 119.703546] niks3-server[999]: 2026/09/20 12:24:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5894lb # [ 119.705954] niks3-server[999]: 2026/09/20 12:24:01 INFO Signed narinfos id=42 count=15895worker1 # [ 119.709291] nix-grpc-daemon[1420]: time=2026-09-20T12:24:01.523Z level=INFO msg="Uploading 1 narinfos"5896lb # [ 119.710371] niks3-server[999]: 2026/09/20 12:24:01 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls5897lb # [ 119.715242] niks3-server[999]: 2026/09/20 12:24:01 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5898lb # [ 119.718586] niks3-server[999]: 2026/09/20 12:24:01 INFO Completed upload id=425899worker1 # [ 119.720444] nix-grpc-daemon[1420]: time=2026-09-20T12:24:01.534Z level=INFO msg="Upload complete. (254ms)"5900lb # [ 119.720141] niks3-server[999]: 2026/09/20 12:24:01 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo5901worker1 # [ 119.722772] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=15902worker1 # [ 119.729893] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:01Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=05903worker1 # [ 119.731897] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:01Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=15904worker1 # [ 119.735941] nix-daemon[847]: reaped child process 1545, status = succeeded5905worker1 # [ 119.773765] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429445906worker1 # [ 119.783053] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429445907worker1 # [ 119.792463] nix-grpc-daemon[1420]: time=2026-09-20T12:24:01.606Z level=INFO msg="All 2 paths already cached"5908client # copying 1 paths to 'lb:50051'...5909client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...5910worker1 # [ 119.799265] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429445911worker1 # [ 119.812164] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5912worker1 # [ 119.974710] nix-daemon[847]: accepted connection from pid 1571, user nix-grpc-daemon (trusted)5913worker1 # [ 119.986974] nix-daemon[847]: reaped child process 1574, status = succeeded5914worker1 # [ 120.148732] nix-daemon[847]: accepted connection from pid 1576, user nix-grpc-daemon (trusted)5915worker1 # [ 120.160660] nix-daemon[847]: reaped child process 1579, status = succeeded5916lb # [ 120.173894] niks3-server[999]: 2026/09/20 12:24:02 INFO Received uploads request method=POST path=/api/pending_closures5917worker1 # [ 120.183881] nix-grpc-daemon[1420]: time=2026-09-20T12:24:01.997Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5918worker1 # [ 120.185242] nix-grpc-daemon[1420]: time=2026-09-20T12:24:01.997Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"5919lb # [ 120.199952] niks3-server[999]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst5920lb # [ 120.210918] niks3-server[999]: 2026/09/20 12:24:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5921lb # [ 120.217947] niks3-server[999]: 2026/09/20 12:24:02 INFO Signed narinfos id=43 count=15922worker1 # [ 120.222992] nix-grpc-daemon[1420]: time=2026-09-20T12:24:02.037Z level=INFO msg="Uploading 1 narinfos"5923lb # [ 120.223116] niks3-server[999]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls5924lb # [ 120.233188] niks3-server[999]: 2026/09/20 12:24:02 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5925lb # [ 120.239555] niks3-server[999]: 2026/09/20 12:24:02 INFO Completed upload id=435926worker1 # [ 120.241238] nix-grpc-daemon[1420]: time=2026-09-20T12:24:02.055Z level=INFO msg="Upload complete. (418ms)"5927lb # [ 120.242913] niks3-server[999]: 2026/09/20 12:24:02 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo5928worker1 # [ 120.244700] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=0 paths=1 nar_bytes_in=7685929worker1 # [ 120.249613] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429445930worker1 # [ 120.257314] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5931worker1 # [ 120.262468] nix-daemon[847]: reaped child process 1569, status = succeeded5932worker1 # [ 120.267937] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)5933client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...5934client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5935client # farm-top> LOG-farm-top-during-drain5936worker1 # [ 121.081981] nix-daemon[847]: reaped child process 1583, status = succeeded5937worker1 # [ 121.207138] nix-daemon[847]: accepted connection from pid 1598, user nix-grpc-daemon (trusted)5938worker1 # [ 121.219243] nix-daemon[847]: reaped child process 1601, status = succeeded5939lb # [ 121.228741] niks3-server[999]: 2026/09/20 12:24:03 INFO Received uploads request method=POST path=/api/pending_closures5940worker1 # [ 121.234976] nix-grpc-daemon[1420]: time=2026-09-20T12:24:03.049Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5941worker1 # [ 121.237752] nix-grpc-daemon[1420]: time=2026-09-20T12:24:03.050Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"5942lb # [ 121.246088] niks3-server[999]: 2026/09/20 12:24:03 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst5943lb # [ 121.249712] niks3-server[999]: 2026/09/20 12:24:03 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5944lb # [ 121.251842] niks3-server[999]: 2026/09/20 12:24:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5945lb # [ 121.254742] niks3-server[999]: 2026/09/20 12:24:03 INFO Signed narinfos id=44 count=15946worker1 # [ 121.256843] nix-grpc-daemon[1420]: time=2026-09-20T12:24:03.070Z level=INFO msg="Uploading 1 narinfos"5947lb # [ 121.257780] niks3-server[999]: 2026/09/20 12:24:03 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls5948lb # [ 121.262050] niks3-server[999]: 2026/09/20 12:24:03 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5949lb # [ 121.266988] niks3-server[999]: 2026/09/20 12:24:03 INFO Completed upload id=445950worker1 # [ 121.268579] nix-grpc-daemon[1420]: time=2026-09-20T12:24:03.082Z level=INFO msg="Upload complete. (194ms)"5951worker1 # [ 121.271263] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=15952lb # [ 121.271965] niks3-server[999]: 2026/09/20 12:24:03 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo5953worker1 # [ 121.277875] nix-daemon[847]: reaped child process 1581, status = succeeded5954client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 6.30 seconds)5955client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath5956client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.20 seconds)5957worker2: must succeed: pkill -f 'read -t [9]0 x'5958worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)5959client: waiting for success: ! systemctl is-active sw5960worker2 # [ 121.653163] nix-daemon[813]: reaped child process 1451, status = succeeded5961worker2 # [ 121.801667] nix-daemon[813]: accepted connection from pid 1622, user nix-grpc-daemon (trusted)5962worker2 # [ 121.814586] nix-daemon[813]: reaped child process 1625, status = succeeded5963lb # [ 121.841760] niks3-server[999]: 2026/09/20 12:24:03 INFO Received uploads request method=POST path=/api/pending_closures5964worker2 # [ 121.838466] nix-grpc-daemon[1204]: time=2026-09-20T12:24:03.673Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5965worker2 # [ 121.840324] nix-grpc-daemon[1204]: time=2026-09-20T12:24:03.675Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"5966lb # [ 121.880652] niks3-server[999]: 2026/09/20 12:24:03 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5967lb # [ 121.886248] niks3-server[999]: 2026/09/20 12:24:03 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5968lb # [ 121.891679] niks3-server[999]: 2026/09/20 12:24:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5969lb # [ 121.894267] niks3-server[999]: 2026/09/20 12:24:03 INFO Signed narinfos id=45 count=15970worker2 # [ 121.882693] nix-grpc-daemon[1204]: time=2026-09-20T12:24:03.718Z level=INFO msg="Uploading 1 narinfos"5971lb # [ 121.897228] niks3-server[999]: 2026/09/20 12:24:03 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls5972lb # [ 121.901851] niks3-server[999]: 2026/09/20 12:24:03 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5973lb # [ 121.904621] niks3-server[999]: 2026/09/20 12:24:03 INFO Completed upload id=455974worker2 # [ 121.892896] nix-grpc-daemon[1204]: time=2026-09-20T12:24:03.728Z level=INFO msg="Upload complete. (247ms)"5975lb # [ 121.907946] niks3-server[999]: 2026/09/20 12:24:03 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo5976worker2 # [ 121.897318] nix-grpc-daemon[1183]: ts=2026-09-20T12:24:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:54404 duration_s=11 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=15977worker2 # [ 121.903549] nix-daemon[813]: reaped child process 1449, status = succeeded5978client # [ 121.950281] systemd[1]: sw.service: Deactivated successfully.5979client # [ 121.954838] systemd[1]: sw.service: Consumed 112ms CPU time over 12.707s wall clock time, 39.1M memory peak, 8.3K incoming IP traffic, 8.9K outgoing IP traffic.5980client: (finished: waiting for success: ! systemctl is-active sw, in 1.08 seconds)5981client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5982client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.03 seconds)5983worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5984worker2 # [ 122.687308] nix-grpc-daemon[1183]: ts=2026-09-20T12:24:04Z level=info event=signal_exit5985worker1 # [ 122.707242] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:04Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:407525986worker1 # [ 122.708830] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:04Z level=info event=worker_gone addr=192.168.1.4:500515987worker2 # [ 122.703145] nix-grpc-daemon[1183]: ts=2026-09-20T12:24:04Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5988worker2 # [ 122.730163] nix-daemon[813]: reaped child process 1197, status = succeeded5989worker2 # [ 122.766128] systemd[1]: Starting scheduler-token.service...5990worker2 # [ 122.767738] nix-grpc-daemon[1183]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5991worker2 # [ 122.769327] nix-grpc-daemon[1183]: E0000 00:00:1789907044.603308 1194 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true5992worker2 # [ 122.845369] systemd[1]: scheduler-token.service: Deactivated successfully.5993worker2 # [ 122.846536] systemd[1]: Finished scheduler-token.service.5994worker2 # [ 122.847790] systemd[1]: scheduler-token.service: Consumed 18ms CPU time over 79ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5995worker2 # [ 123.742341] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5996worker2 # [ 123.746203] systemd[1]: nix-grpc-daemon.service: Consumed 1.729s CPU time over 52.234s wall clock time, 32.8M memory peak, 63.7K incoming IP traffic, 129.5K outgoing IP traffic.5997worker2 # [ 123.762333] systemd[1]: Starting Nix worker-protocol over gRPC...5998worker2 # [ 123.926987] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:05Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5999worker2 # [ 123.928876] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:05Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6000worker2 # [ 123.930703] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:05Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16001worker2 # [ 123.937828] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:05Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6002worker2 # [ 123.939642] systemd[1]: Started Nix worker-protocol over gRPC.6003worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 1.27 seconds)6004lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6005lb: must succeed: curl -sf localhost:9901/clusters6006worker2 # [ 123.960115] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:05Z level=info event=scheduler_connected addr=lb:500516007worker1 # [ 123.977168] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:05Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:407526008worker1 # [ 123.981695] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:05Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06009lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6010lb: must succeed: curl -sf localhost:9901/clusters6011lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)6012lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.14 seconds)6013worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6014worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)6015(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 15.97 seconds)6016subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6017client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16018worker2 # [ 125.382671] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:375526019worker2 # [ 125.393586] nix-daemon[813]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)6020worker1 # [ 125.422614] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429446021worker1 # [ 125.448411] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:07Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06022worker1 # [ 125.453434] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:07Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16023worker1 # [ 125.457667] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:07Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06024worker1 # [ 125.461479] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:07Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06025worker1 # [ 125.491929] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446026worker1 # [ 125.502263] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429446027worker1 # [ 125.511306] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429446028worker1 # [ 125.522183] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6029worker1 # [ 125.688667] nix-daemon[847]: accepted connection from pid 1610, user nix-grpc-daemon (trusted)6030worker1 # [ 125.700780] nix-daemon[847]: reaped child process 1613, status = succeeded6031worker1 # [ 125.858381] nix-daemon[847]: accepted connection from pid 1615, user nix-grpc-daemon (trusted)6032worker1 # [ 125.870183] nix-daemon[847]: reaped child process 1618, status = succeeded6033lb # [ 125.884678] niks3-server[999]: 2026/09/20 12:24:07 INFO Received uploads request method=POST path=/api/pending_closures6034worker1 # [ 125.894570] nix-grpc-daemon[1420]: time=2026-09-20T12:24:07.708Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6035worker1 # [ 125.895925] nix-grpc-daemon[1420]: time=2026-09-20T12:24:07.708Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6036lb # [ 125.908562] niks3-server[999]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6037lb # [ 125.920210] niks3-server[999]: 2026/09/20 12:24:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6038lb # [ 125.925607] niks3-server[999]: 2026/09/20 12:24:07 INFO Signed narinfos id=46 count=16039worker1 # [ 125.930459] nix-grpc-daemon[1420]: time=2026-09-20T12:24:07.744Z level=INFO msg="Uploading 1 narinfos"6040lb # [ 125.931422] niks3-server[999]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6041lb # [ 125.943268] niks3-server[999]: 2026/09/20 12:24:07 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6042lb # [ 125.946904] niks3-server[999]: 2026/09/20 12:24:07 INFO Completed upload id=466043worker1 # [ 125.948854] nix-grpc-daemon[1420]: time=2026-09-20T12:24:07.763Z level=INFO msg="Upload complete. (415ms)"6044lb # [ 125.948547] niks3-server[999]: 2026/09/20 12:24:07 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6045worker1 # [ 125.950989] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=0 paths=1 nar_bytes_in=5046046worker1 # [ 125.954452] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446047worker1 # [ 125.960728] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6048worker1 # [ 125.962991] nix-daemon[847]: reaped child process 1608, status = succeeded6049worker1 # [ 125.968090] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6050worker1 # [ 126.795274] nix-daemon[847]: reaped child process 1622, status = succeeded6051worker1 # [ 126.959427] nix-daemon[847]: accepted connection from pid 1637, user nix-grpc-daemon (trusted)6052worker1 # [ 126.970111] nix-daemon[847]: reaped child process 1640, status = succeeded6053lb # [ 126.987682] niks3-server[999]: 2026/09/20 12:24:08 INFO Received uploads request method=POST path=/api/pending_closures6054worker1 # [ 126.995403] nix-grpc-daemon[1420]: time=2026-09-20T12:24:08.809Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6055worker1 # [ 126.997022] nix-grpc-daemon[1420]: time=2026-09-20T12:24:08.811Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6056lb # [ 127.022094] niks3-server[999]: 2026/09/20 12:24:08 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6057lb # [ 127.032209] niks3-server[999]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6058lb # [ 127.043713] niks3-server[999]: 2026/09/20 12:24:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6059worker1 # [ 127.050223] nix-grpc-daemon[1420]: time=2026-09-20T12:24:08.864Z level=INFO msg="Uploading 1 narinfos"6060lb # [ 127.049374] niks3-server[999]: 2026/09/20 12:24:09 INFO Signed narinfos id=47 count=16061lb # [ 127.054234] niks3-server[999]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6062lb # [ 127.063569] niks3-server[999]: 2026/09/20 12:24:09 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6063lb # [ 127.069575] niks3-server[999]: 2026/09/20 12:24:09 INFO Completed upload id=476064worker1 # [ 127.071684] nix-grpc-daemon[1420]: time=2026-09-20T12:24:08.885Z level=INFO msg="Upload complete. (296ms)"6065lb # [ 127.071173] niks3-server[999]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6066worker1 # [ 127.079705] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=6 outputs=16067worker1 # [ 127.089444] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:08Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16068worker1 # [ 127.094422] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446069worker1 # [ 127.097425] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:08Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06070worker1 # [ 127.107339] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429446071worker1 # [ 127.110276] nix-daemon[847]: reaped child process 1620, status = succeeded6072worker1 # [ 127.114788] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429446073worker1 # [ 127.119211] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6074lb # [ 127.239414] envoy[907]: conn peer=[2001:db8:1::1]:40666 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9555 tx=3808 ms=60456075lb # [ 127.243163] envoy[907]: conn peer=[2001:db8:1::1]:49898 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2919 tx=1310 ms=124956076lb # [ 127.246687] envoy[907]: conn peer=[2001:db8:1::4]:51604 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=34365 tx=2057 ms=510196077worker1 # [ 127.278211] nix-daemon[847]: accepted connection from pid 1646, user nix-grpc-daemon (trusted)6078worker1 # [ 127.291613] nix-daemon[847]: reaped child process 1649, status = succeeded6079worker1 # [ 127.469154] nix-daemon[847]: accepted connection from pid 1651, user nix-grpc-daemon (trusted)6080worker1 # [ 127.481537] nix-daemon[847]: reaped child process 1654, status = succeeded6081lb # [ 127.494039] niks3-server[999]: 2026/09/20 12:24:09 INFO Received uploads request method=POST path=/api/pending_closures6082worker1 # [ 127.501441] nix-grpc-daemon[1420]: time=2026-09-20T12:24:09.315Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6083worker1 # [ 127.502972] nix-grpc-daemon[1420]: time=2026-09-20T12:24:09.317Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6084lb # [ 127.510276] niks3-server[999]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6085lb # [ 127.514238] niks3-server[999]: 2026/09/20 12:24:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6086lb # [ 127.516772] niks3-server[999]: 2026/09/20 12:24:09 INFO Signed narinfos id=48 count=16087worker1 # [ 127.519906] nix-grpc-daemon[1420]: time=2026-09-20T12:24:09.334Z level=INFO msg="Uploading 1 narinfos"6088lb # [ 127.519414] niks3-server[999]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6089lb # [ 127.524720] niks3-server[999]: 2026/09/20 12:24:09 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6090lb # [ 127.527482] niks3-server[999]: 2026/09/20 12:24:09 INFO Completed upload id=486091worker1 # [ 127.529291] nix-grpc-daemon[1420]: time=2026-09-20T12:24:09.343Z level=INFO msg="Upload complete. (404ms)"6092worker1 # [ 127.531189] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=0 paths=1 nar_bytes_in=5046093lb # [ 127.530460] niks3-server[999]: 2026/09/20 12:24:09 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6094worker1 # [ 127.535124] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446095worker1 # [ 127.539116] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6096worker1 # [ 127.543480] nix-daemon[847]: reaped child process 1644, status = succeeded6097worker1 # [ 127.548514] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6098worker1 # [ 128.775435] nix-daemon[847]: reaped child process 1658, status = succeeded6099worker1 # [ 128.929965] nix-daemon[847]: accepted connection from pid 1673, user nix-grpc-daemon (trusted)6100worker1 # [ 128.941874] nix-daemon[847]: reaped child process 1676, status = succeeded6101lb # [ 128.957424] niks3-server[999]: 2026/09/20 12:24:10 INFO Received uploads request method=POST path=/api/pending_closures6102worker1 # [ 128.966902] nix-grpc-daemon[1420]: time=2026-09-20T12:24:10.780Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6103worker1 # [ 128.968420] nix-grpc-daemon[1420]: time=2026-09-20T12:24:10.782Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6104lb # [ 128.996461] niks3-server[999]: 2026/09/20 12:24:10 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6105lb # [ 129.005486] niks3-server[999]: 2026/09/20 12:24:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6106lb # [ 129.010730] niks3-server[999]: 2026/09/20 12:24:10 INFO Signed narinfos id=49 count=16107worker1 # [ 129.015512] nix-grpc-daemon[1420]: time=2026-09-20T12:24:10.829Z level=INFO msg="Uploading 1 narinfos"6108lb # [ 129.017952] niks3-server[999]: 2026/09/20 12:24:10 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6109lb # [ 129.029480] niks3-server[999]: 2026/09/20 12:24:10 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6110lb # [ 129.035807] niks3-server[999]: 2026/09/20 12:24:11 INFO Completed upload id=496111lb # [ 129.038991] niks3-server[999]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6112worker1 # [ 129.040088] nix-grpc-daemon[1420]: time=2026-09-20T12:24:10.854Z level=INFO msg="Upload complete. (283ms)"6113lb # [ 129.041115] niks3-server[999]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6114worker1 # [ 129.049965] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:10Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=7 outputs=16115worker1 # [ 129.055282] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:10Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16116worker1 # [ 129.059535] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:10Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446117worker1 # [ 129.064249] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:10Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06118worker1 # [ 129.072658] nix-daemon[847]: reaped child process 1656, status = succeeded6119worker1 # [ 129.075283] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429446120worker1 # [ 129.082207] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429446121worker1 # [ 129.086181] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6122worker1 # [ 129.245792] nix-daemon[847]: accepted connection from pid 1682, user nix-grpc-daemon (trusted)6123worker1 # [ 129.259469] nix-daemon[847]: reaped child process 1685, status = succeeded6124worker1 # [ 129.423746] nix-daemon[847]: accepted connection from pid 1687, user nix-grpc-daemon (trusted)6125worker1 # [ 129.435754] nix-daemon[847]: reaped child process 1690, status = succeeded6126lb # [ 129.448936] niks3-server[999]: 2026/09/20 12:24:11 INFO Received uploads request method=POST path=/api/pending_closures6127worker1 # [ 129.458064] nix-grpc-daemon[1420]: time=2026-09-20T12:24:11.272Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6128worker1 # [ 129.459438] nix-grpc-daemon[1420]: time=2026-09-20T12:24:11.272Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6129lb # [ 129.472740] niks3-server[999]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6130lb # [ 129.483579] niks3-server[999]: 2026/09/20 12:24:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6131worker1 # [ 129.491683] nix-grpc-daemon[1420]: time=2026-09-20T12:24:11.305Z level=INFO msg="Uploading 1 narinfos"6132lb # [ 129.490112] niks3-server[999]: 2026/09/20 12:24:11 INFO Signed narinfos id=50 count=16133lb # [ 129.495283] niks3-server[999]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6134lb # [ 129.512619] niks3-server[999]: 2026/09/20 12:24:11 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6135lb # [ 129.518493] niks3-server[999]: 2026/09/20 12:24:11 INFO Completed upload id=506136worker1 # [ 129.520408] nix-grpc-daemon[1420]: time=2026-09-20T12:24:11.334Z level=INFO msg="Upload complete. (428ms)"6137lb # [ 129.520746] niks3-server[999]: 2026/09/20 12:24:11 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6138worker1 # [ 129.524162] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=0 paths=1 nar_bytes_in=5046139worker1 # [ 129.529286] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446140worker1 # [ 129.539064] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6141worker1 # [ 129.542995] nix-daemon[847]: reaped child process 1680, status = succeeded6142worker1 # [ 129.547817] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6143worker1 # [ 130.961215] nix-daemon[847]: reaped child process 1694, status = succeeded6144worker1 # [ 131.078431] nix-daemon[847]: accepted connection from pid 1709, user nix-grpc-daemon (trusted)6145worker1 # [ 131.090602] nix-daemon[847]: reaped child process 1712, status = succeeded6146lb # [ 131.098919] niks3-server[999]: 2026/09/20 12:24:13 INFO Received uploads request method=POST path=/api/pending_closures6147worker1 # [ 131.108432] nix-grpc-daemon[1420]: time=2026-09-20T12:24:12.922Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6148worker1 # [ 131.109869] nix-grpc-daemon[1420]: time=2026-09-20T12:24:12.924Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6149lb # [ 131.130949] niks3-server[999]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6150lb # [ 131.144485] niks3-server[999]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6151lb # [ 131.153077] niks3-server[999]: 2026/09/20 12:24:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6152lb # [ 131.157364] niks3-server[999]: 2026/09/20 12:24:13 INFO Signed narinfos id=51 count=16153worker1 # [ 131.162333] nix-grpc-daemon[1420]: time=2026-09-20T12:24:12.976Z level=INFO msg="Uploading 1 narinfos"6154lb # [ 131.165973] niks3-server[999]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6155lb # [ 131.173217] niks3-server[999]: 2026/09/20 12:24:13 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6156lb # [ 131.179465] niks3-server[999]: 2026/09/20 12:24:13 INFO Completed upload id=516157worker1 # [ 131.181286] nix-grpc-daemon[1420]: time=2026-09-20T12:24:12.995Z level=INFO msg="Upload complete. (227ms)"6158lb # [ 131.182928] niks3-server[999]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6159worker1 # [ 131.184415] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:12Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=8 outputs=16160worker1 # [ 131.188315] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:12Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16161worker1 # [ 131.191640] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446162worker1 # [ 131.194218] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:13Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06163worker1 # [ 131.200253] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429446164worker1 # [ 131.202434] nix-daemon[847]: reaped child process 1692, status = succeeded6165worker1 # [ 131.206089] nix-grpc-daemon[1420]: time=2026-09-20T12:24:13.020Z level=INFO msg="All 1 paths already cached"6166worker1 # [ 131.209655] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429446167worker1 # [ 131.214446] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6168worker1 # [ 131.360242] nix-daemon[847]: accepted connection from pid 1718, user nix-grpc-daemon (trusted)6169worker1 # [ 131.372614] nix-daemon[847]: reaped child process 1721, status = succeeded6170worker1 # [ 131.531207] nix-daemon[847]: accepted connection from pid 1723, user nix-grpc-daemon (trusted)6171worker1 # [ 131.543168] nix-daemon[847]: reaped child process 1726, status = succeeded6172lb # [ 131.556752] niks3-server[999]: 2026/09/20 12:24:13 INFO Received uploads request method=POST path=/api/pending_closures6173worker1 # [ 131.566152] nix-grpc-daemon[1420]: time=2026-09-20T12:24:13.380Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6174worker1 # [ 131.567520] nix-grpc-daemon[1420]: time=2026-09-20T12:24:13.380Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6175lb # [ 131.585814] niks3-server[999]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6176lb # [ 131.594771] niks3-server[999]: 2026/09/20 12:24:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6177lb # [ 131.599556] niks3-server[999]: 2026/09/20 12:24:13 INFO Signed narinfos id=52 count=16178worker1 # [ 131.604343] nix-grpc-daemon[1420]: time=2026-09-20T12:24:13.418Z level=INFO msg="Uploading 1 narinfos"6179lb # [ 131.605250] niks3-server[999]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6180lb # [ 131.618057] niks3-server[999]: 2026/09/20 12:24:13 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6181lb # [ 131.624048] niks3-server[999]: 2026/09/20 12:24:13 INFO Completed upload id=526182worker1 # [ 131.625963] nix-grpc-daemon[1420]: time=2026-09-20T12:24:13.440Z level=INFO msg="Upload complete. (406ms)"6183worker1 # [ 131.629764] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:13Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=0 paths=1 nar_bytes_in=6246184lb # [ 131.628321] niks3-server[999]: 2026/09/20 12:24:13 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6185worker1 # [ 131.634324] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446186worker1 # [ 131.643894] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6187worker1 # [ 131.646990] nix-daemon[847]: reaped child process 1716, status = succeeded6188worker1 # [ 131.651870] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6189worker1 # [ 133.266347] nix-daemon[847]: reaped child process 1730, status = succeeded6190worker1 # [ 133.407856] nix-daemon[847]: accepted connection from pid 1745, user nix-grpc-daemon (trusted)6191worker1 # [ 133.419149] nix-daemon[847]: reaped child process 1748, status = succeeded6192lb # [ 133.432825] niks3-server[999]: 2026/09/20 12:24:15 INFO Received uploads request method=POST path=/api/pending_closures6193worker1 # [ 133.444844] nix-grpc-daemon[1420]: time=2026-09-20T12:24:15.258Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6194worker1 # [ 133.446357] nix-grpc-daemon[1420]: time=2026-09-20T12:24:15.260Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6195lb # [ 133.473207] niks3-server[999]: 2026/09/20 12:24:15 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6196lb # [ 133.479884] niks3-server[999]: 2026/09/20 12:24:15 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6197lb # [ 133.490818] niks3-server[999]: 2026/09/20 12:24:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6198worker1 # [ 133.497895] nix-grpc-daemon[1420]: time=2026-09-20T12:24:15.312Z level=INFO msg="Uploading 1 narinfos"6199lb # [ 133.496065] niks3-server[999]: 2026/09/20 12:24:15 INFO Signed narinfos id=53 count=16200lb # [ 133.499623] niks3-server[999]: 2026/09/20 12:24:15 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6201lb # [ 133.505254] niks3-server[999]: 2026/09/20 12:24:15 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6202lb # [ 133.508159] niks3-server[999]: 2026/09/20 12:24:15 INFO Completed upload id=536203worker1 # [ 133.509922] nix-grpc-daemon[1420]: time=2026-09-20T12:24:15.324Z level=INFO msg="Upload complete. (250ms)"6204lb # [ 133.510530] niks3-server[999]: 2026/09/20 12:24:15 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6205worker1 # [ 133.518406] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=9 outputs=16206worker1 # [ 133.525372] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:15Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16207worker1 # [ 133.529179] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446208worker1 # [ 133.531951] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:15Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06209worker1 # [ 133.538718] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429446210worker1 # [ 133.540480] nix-daemon[847]: reaped child process 1728, status = succeeded6211worker1 # [ 133.545244] nix-grpc-daemon[1420]: time=2026-09-20T12:24:15.359Z level=INFO msg="All 1 paths already cached"6212worker1 # [ 133.548972] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429446213worker1 # [ 133.552798] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6214worker1 # [ 133.708886] nix-daemon[847]: accepted connection from pid 1754, user nix-grpc-daemon (trusted)6215worker1 # [ 133.722383] nix-daemon[847]: reaped child process 1757, status = succeeded6216worker1 # [ 133.879138] nix-daemon[847]: accepted connection from pid 1759, user nix-grpc-daemon (trusted)6217worker1 # [ 133.891413] nix-daemon[847]: reaped child process 1762, status = succeeded6218lb # [ 133.901747] niks3-server[999]: 2026/09/20 12:24:15 INFO Received uploads request method=POST path=/api/pending_closures6219worker1 # [ 133.911315] nix-grpc-daemon[1420]: time=2026-09-20T12:24:15.725Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6220worker1 # [ 133.912688] nix-grpc-daemon[1420]: time=2026-09-20T12:24:15.725Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6221lb # [ 133.923960] niks3-server[999]: 2026/09/20 12:24:15 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6222lb # [ 133.935737] niks3-server[999]: 2026/09/20 12:24:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6223lb # [ 133.940839] niks3-server[999]: 2026/09/20 12:24:15 INFO Signed narinfos id=54 count=16224worker1 # [ 133.945579] nix-grpc-daemon[1420]: time=2026-09-20T12:24:15.759Z level=INFO msg="Uploading 1 narinfos"6225lb # [ 133.947557] niks3-server[999]: 2026/09/20 12:24:15 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6226lb # [ 133.957087] niks3-server[999]: 2026/09/20 12:24:15 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6227worker1 # [ 133.964360] nix-grpc-daemon[1420]: time=2026-09-20T12:24:15.778Z level=INFO msg="Upload complete. (405ms)"6228lb # [ 133.962539] niks3-server[999]: 2026/09/20 12:24:15 INFO Completed upload id=546229worker1 # [ 133.966359] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=0 paths=1 nar_bytes_in=6246230lb # [ 133.967141] niks3-server[999]: 2026/09/20 12:24:15 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6231worker1 # [ 133.972951] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446232worker1 # [ 133.974606] nix-daemon[847]: reaped child process 1752, status = succeeded6233worker1 # [ 133.977514] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6234worker1 # [ 133.984738] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6235worker1 # [ 134.996515] nix-daemon[847]: reaped child process 1766, status = succeeded6236worker1 # [ 135.135987] nix-daemon[847]: accepted connection from pid 1781, user nix-grpc-daemon (trusted)6237worker1 # [ 135.148624] nix-daemon[847]: reaped child process 1784, status = succeeded6238lb # [ 135.161301] niks3-server[999]: 2026/09/20 12:24:17 INFO Received uploads request method=POST path=/api/pending_closures6239worker1 # [ 135.171049] nix-grpc-daemon[1420]: time=2026-09-20T12:24:16.985Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6240worker1 # [ 135.172935] nix-grpc-daemon[1420]: time=2026-09-20T12:24:16.986Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6241lb # [ 135.203715] niks3-server[999]: 2026/09/20 12:24:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6242lb # [ 135.208093] niks3-server[999]: 2026/09/20 12:24:17 INFO Signed narinfos id=55 count=16243worker1 # [ 135.212727] nix-grpc-daemon[1420]: time=2026-09-20T12:24:17.026Z level=INFO msg="Uploading 1 narinfos"6244lb # [ 135.216497] niks3-server[999]: 2026/09/20 12:24:17 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6245lb # [ 135.219510] niks3-server[999]: 2026/09/20 12:24:17 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6246lb # [ 135.227368] niks3-server[999]: 2026/09/20 12:24:17 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6247lb # [ 135.234579] niks3-server[999]: 2026/09/20 12:24:17 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6248lb # [ 135.238865] niks3-server[999]: 2026/09/20 12:24:17 INFO Completed upload id=556249worker1 # [ 135.240677] nix-grpc-daemon[1420]: time=2026-09-20T12:24:17.054Z level=INFO msg="Upload complete. (250ms)"6250lb # [ 135.241253] niks3-server[999]: 2026/09/20 12:24:17 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6251worker1 # [ 135.246726] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:17Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=10 outputs=16252worker1 # [ 135.255338] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:17Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16253worker1 # [ 135.259847] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446254worker1 # [ 135.264177] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:17Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06255worker1 # [ 135.269369] nix-daemon[847]: reaped child process 1764, status = succeeded6256worker1 # [ 135.270664] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:17Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429446257worker1 # [ 135.276182] nix-grpc-daemon[1420]: time=2026-09-20T12:24:17.090Z level=INFO msg="All 1 paths already cached"6258worker1 # [ 135.279281] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429446259worker1 # [ 135.283059] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6260worker1 # [ 135.435631] nix-daemon[847]: accepted connection from pid 1790, user nix-grpc-daemon (trusted)6261worker1 # [ 135.447838] nix-daemon[847]: reaped child process 1793, status = succeeded6262worker1 # [ 135.604789] nix-daemon[847]: accepted connection from pid 1795, user nix-grpc-daemon (trusted)6263worker1 # [ 135.618987] nix-daemon[847]: reaped child process 1798, status = succeeded6264lb # [ 135.630445] niks3-server[999]: 2026/09/20 12:24:17 INFO Received uploads request method=POST path=/api/pending_closures6265worker1 # [ 135.636234] nix-grpc-daemon[1420]: time=2026-09-20T12:24:17.450Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6266worker1 # [ 135.637717] nix-grpc-daemon[1420]: time=2026-09-20T12:24:17.451Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6267lb # [ 135.646876] niks3-server[999]: 2026/09/20 12:24:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6268lb # [ 135.648486] niks3-server[999]: 2026/09/20 12:24:17 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6269lb # [ 135.650832] niks3-server[999]: 2026/09/20 12:24:17 INFO Signed narinfos id=56 count=16270worker1 # [ 135.652458] nix-grpc-daemon[1420]: time=2026-09-20T12:24:17.466Z level=INFO msg="Uploading 1 narinfos"6271lb # [ 135.654135] niks3-server[999]: 2026/09/20 12:24:17 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6272lb # [ 135.658242] niks3-server[999]: 2026/09/20 12:24:17 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6273lb # [ 135.661686] niks3-server[999]: 2026/09/20 12:24:17 INFO Completed upload id=566274worker1 # [ 135.663624] nix-grpc-daemon[1420]: time=2026-09-20T12:24:17.477Z level=INFO msg="Upload complete. (374ms)"6275lb # [ 135.664401] niks3-server[999]: 2026/09/20 12:24:17 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6276worker1 # [ 135.665818] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=0 paths=1 nar_bytes_in=6246277worker1 # [ 135.669172] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446278worker1 # [ 135.675604] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6279worker1 # [ 135.680986] nix-daemon[847]: reaped child process 1788, status = succeeded6280worker1 # [ 135.686787] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6281worker1 # [ 136.501489] nix-daemon[847]: reaped child process 1802, status = succeeded6282worker1 # [ 136.638607] nix-daemon[847]: accepted connection from pid 1817, user nix-grpc-daemon (trusted)6283worker1 # [ 136.651058] nix-daemon[847]: reaped child process 1820, status = succeeded6284lb # [ 136.659685] niks3-server[999]: 2026/09/20 12:24:18 INFO Received uploads request method=POST path=/api/pending_closures6285worker1 # [ 136.669486] nix-grpc-daemon[1420]: time=2026-09-20T12:24:18.483Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6286worker1 # [ 136.671040] nix-grpc-daemon[1420]: time=2026-09-20T12:24:18.485Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6287lb # [ 136.682448] niks3-server[999]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6288lb # [ 136.689260] niks3-server[999]: 2026/09/20 12:24:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6289worker1 # [ 136.694069] nix-grpc-daemon[1420]: time=2026-09-20T12:24:18.508Z level=INFO msg="Uploading 1 narinfos"6290lb # [ 136.692424] niks3-server[999]: 2026/09/20 12:24:18 INFO Signed narinfos id=57 count=16291lb # [ 136.696045] niks3-server[999]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6292lb # [ 136.699514] niks3-server[999]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6293lb # [ 136.703691] niks3-server[999]: 2026/09/20 12:24:18 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6294lb # [ 136.707424] niks3-server[999]: 2026/09/20 12:24:18 INFO Completed upload id=576295worker1 # [ 136.710623] nix-grpc-daemon[1420]: time=2026-09-20T12:24:18.524Z level=INFO msg="Upload complete. (217ms)"6296lb # [ 136.710255] niks3-server[999]: 2026/09/20 12:24:18 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6297worker1 # [ 136.712840] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=11 outputs=16298worker1 # [ 136.717259] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:18Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16299worker1 # [ 136.720287] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446300worker1 # [ 136.723038] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:18Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06301worker1 # [ 136.729378] nix-daemon[847]: reaped child process 1800, status = succeeded6302worker1 # [ 136.730602] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429446303worker1 # [ 136.736172] nix-grpc-daemon[1420]: time=2026-09-20T12:24:18.550Z level=INFO msg="All 2 paths already cached"6304worker1 # [ 136.739271] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429446305worker1 # [ 136.742867] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6306worker1 # [ 136.884978] nix-daemon[847]: accepted connection from pid 1826, user nix-grpc-daemon (trusted)6307worker1 # [ 136.897276] nix-daemon[847]: reaped child process 1829, status = succeeded6308worker1 # [ 137.042342] nix-daemon[847]: accepted connection from pid 1831, user nix-grpc-daemon (trusted)6309worker1 # [ 137.054205] nix-daemon[847]: reaped child process 1834, status = succeeded6310lb # [ 137.066999] niks3-server[999]: 2026/09/20 12:24:19 INFO Received uploads request method=POST path=/api/pending_closures6311worker1 # [ 137.073171] nix-grpc-daemon[1420]: time=2026-09-20T12:24:18.887Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6312worker1 # [ 137.074955] nix-grpc-daemon[1420]: time=2026-09-20T12:24:18.889Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6313lb # [ 137.083477] niks3-server[999]: 2026/09/20 12:24:19 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6314lb # [ 137.090469] niks3-server[999]: 2026/09/20 12:24:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6315lb # [ 137.095579] niks3-server[999]: 2026/09/20 12:24:19 INFO Signed narinfos id=58 count=16316worker1 # [ 137.100297] nix-grpc-daemon[1420]: time=2026-09-20T12:24:18.914Z level=INFO msg="Uploading 1 narinfos"6317lb # [ 137.101422] niks3-server[999]: 2026/09/20 12:24:19 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6318lb # [ 137.111389] niks3-server[999]: 2026/09/20 12:24:19 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6319lb # [ 137.114175] niks3-server[999]: 2026/09/20 12:24:19 INFO Completed upload id=586320worker1 # [ 137.118260] nix-grpc-daemon[1420]: time=2026-09-20T12:24:18.932Z level=INFO msg="Upload complete. (369ms)"6321worker1 # [ 137.120392] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=0 paths=1 nar_bytes_in=7526322worker1 # [ 137.123302] nix-grpc-daemon[1420]: time=2026-09-20T12:24:18.934Z level=WARN msg="Failed to register uploaded object" key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo error="server returned 404: object is not pending upload\n"6323worker1 # [ 137.125533] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446324worker1 # [ 137.132474] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6325worker1 # [ 137.135445] nix-daemon[847]: reaped child process 1824, status = succeeded6326worker1 # [ 137.140678] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6327worker1 # [ 137.753943] nix-daemon[847]: reaped child process 1838, status = succeeded6328worker1 # [ 137.874721] nix-daemon[847]: accepted connection from pid 1853, user nix-grpc-daemon (trusted)6329worker1 # [ 137.887084] nix-daemon[847]: reaped child process 1856, status = succeeded6330lb # [ 137.895297] niks3-server[999]: 2026/09/20 12:24:19 INFO Received uploads request method=POST path=/api/pending_closures6331worker1 # [ 137.903062] nix-grpc-daemon[1420]: time=2026-09-20T12:24:19.717Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6332worker1 # [ 137.904994] nix-grpc-daemon[1420]: time=2026-09-20T12:24:19.718Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6333lb # [ 137.916490] niks3-server[999]: 2026/09/20 12:24:19 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6334lb # [ 137.921037] niks3-server[999]: 2026/09/20 12:24:19 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6335lb # [ 137.923165] niks3-server[999]: 2026/09/20 12:24:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6336lb # [ 137.925990] niks3-server[999]: 2026/09/20 12:24:19 INFO Signed narinfos id=59 count=16337worker1 # [ 137.928143] nix-grpc-daemon[1420]: time=2026-09-20T12:24:19.742Z level=INFO msg="Uploading 1 narinfos"6338lb # [ 137.928749] niks3-server[999]: 2026/09/20 12:24:19 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6339lb # [ 137.933257] niks3-server[999]: 2026/09/20 12:24:19 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6340lb # [ 137.936354] niks3-server[999]: 2026/09/20 12:24:19 INFO Completed upload id=596341worker1 # [ 137.939438] nix-grpc-daemon[1420]: time=2026-09-20T12:24:19.753Z level=INFO msg="Upload complete. (192ms)"6342lb # [ 137.938047] niks3-server[999]: 2026/09/20 12:24:19 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6343worker1 # [ 137.942850] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=0 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=12 outputs=16344worker1 # [ 137.946216] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:19Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16345worker1 # [ 137.951199] nix-daemon[847]: reaped child process 1836, status = succeeded6346worker1 # [ 137.985637] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446347worker1 # [ 137.991993] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429446348worker1 # [ 138.000695] nix-grpc-daemon[1420]: time=2026-09-20T12:24:19.814Z level=INFO msg="All 2 paths already cached"6349worker1 # [ 138.006350] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429446350worker1 # [ 138.014075] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6351worker1 # [ 138.160905] nix-daemon[847]: accepted connection from pid 1860, user nix-grpc-daemon (trusted)6352worker1 # [ 138.173579] nix-daemon[847]: reaped child process 1863, status = succeeded6353worker1 # [ 138.332495] nix-daemon[847]: accepted connection from pid 1865, user nix-grpc-daemon (trusted)6354worker1 # [ 138.344333] nix-daemon[847]: reaped child process 1868, status = succeeded6355lb # [ 138.357060] niks3-server[999]: 2026/09/20 12:24:20 INFO Received uploads request method=POST path=/api/pending_closures6356worker1 # [ 138.363388] nix-grpc-daemon[1420]: time=2026-09-20T12:24:20.177Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6357worker1 # [ 138.364693] nix-grpc-daemon[1420]: time=2026-09-20T12:24:20.177Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6358lb # [ 138.369438] niks3-server[999]: 2026/09/20 12:24:20 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6359lb # [ 138.372573] niks3-server[999]: 2026/09/20 12:24:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6360lb # [ 138.374194] niks3-server[999]: 2026/09/20 12:24:20 INFO Signed narinfos id=60 count=16361worker1 # [ 138.376420] nix-grpc-daemon[1420]: time=2026-09-20T12:24:20.190Z level=INFO msg="Uploading 1 narinfos"6362lb # [ 138.379481] niks3-server[999]: 2026/09/20 12:24:20 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6363lb # [ 138.382107] niks3-server[999]: 2026/09/20 12:24:20 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6364lb # [ 138.385535] niks3-server[999]: 2026/09/20 12:24:20 INFO Completed upload id=606365worker1 # [ 138.387404] nix-grpc-daemon[1420]: time=2026-09-20T12:24:20.201Z level=INFO msg="Upload complete. (368ms)"6366lb # [ 138.387244] niks3-server[999]: 2026/09/20 12:24:20 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6367worker1 # [ 138.389375] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=0 paths=1 nar_bytes_in=7526368worker1 # [ 138.393337] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446369worker1 # [ 138.398906] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6370worker1 # [ 138.401162] nix-daemon[847]: reaped child process 1858, status = succeeded6371worker1 # [ 138.406272] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6372worker1 # [ 139.632840] nix-daemon[847]: reaped child process 1872, status = succeeded6373worker1 # [ 139.790851] nix-daemon[847]: accepted connection from pid 1887, user nix-grpc-daemon (trusted)6374worker1 # [ 139.801729] nix-daemon[847]: reaped child process 1890, status = succeeded6375lb # [ 139.815733] niks3-server[999]: 2026/09/20 12:24:21 INFO Received uploads request method=POST path=/api/pending_closures6376worker1 # [ 139.825368] nix-grpc-daemon[1420]: time=2026-09-20T12:24:21.639Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6377worker1 # [ 139.826938] nix-grpc-daemon[1420]: time=2026-09-20T12:24:21.641Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6378lb # [ 139.843382] niks3-server[999]: 2026/09/20 12:24:21 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6379lb # [ 139.860588] niks3-server[999]: 2026/09/20 12:24:21 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6380lb # [ 139.868759] niks3-server[999]: 2026/09/20 12:24:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6381worker1 # [ 139.876727] nix-grpc-daemon[1420]: time=2026-09-20T12:24:21.690Z level=INFO msg="Uploading 1 narinfos"6382lb # [ 139.875112] niks3-server[999]: 2026/09/20 12:24:21 INFO Signed narinfos id=61 count=16383lb # [ 139.880282] niks3-server[999]: 2026/09/20 12:24:21 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6384lb # [ 139.888767] niks3-server[999]: 2026/09/20 12:24:21 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6385lb # [ 139.892850] niks3-server[999]: 2026/09/20 12:24:21 INFO Completed upload id=616386worker1 # [ 139.896786] nix-grpc-daemon[1420]: time=2026-09-20T12:24:21.710Z level=INFO msg="Upload complete. (283ms)"6387worker1 # [ 139.903188] nix-grpc-daemon[1420]: time=2026-09-20T12:24:21.714Z level=WARN msg="Failed to register uploaded object" key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo error="server returned 404: object is not pending upload\n"6388worker1 # [ 139.910586] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=13 outputs=16389worker1 # [ 139.915348] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:21Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16390worker1 # [ 139.924619] nix-daemon[847]: reaped child process 1870, status = succeeded6391worker1 # [ 139.945974] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446392worker1 # [ 139.957937] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429446393worker1 # [ 139.969545] nix-grpc-daemon[1420]: time=2026-09-20T12:24:21.783Z level=INFO msg="All 2 paths already cached"6394worker1 # [ 139.976420] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:429446395worker1 # [ 139.984669] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6396worker1 # [ 140.138978] nix-daemon[847]: accepted connection from pid 1894, user nix-grpc-daemon (trusted)6397worker1 # [ 140.151229] nix-daemon[847]: reaped child process 1897, status = succeeded6398worker1 # [ 140.302083] nix-daemon[847]: accepted connection from pid 1899, user nix-grpc-daemon (trusted)6399worker1 # [ 140.314146] nix-daemon[847]: reaped child process 1902, status = succeeded6400lb # [ 140.322109] niks3-server[999]: 2026/09/20 12:24:22 INFO Received uploads request method=POST path=/api/pending_closures6401worker1 # [ 140.331363] nix-grpc-daemon[1420]: time=2026-09-20T12:24:22.145Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6402worker1 # [ 140.332711] nix-grpc-daemon[1420]: time=2026-09-20T12:24:22.145Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6403lb # [ 140.346889] niks3-server[999]: 2026/09/20 12:24:22 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6404lb # [ 140.356951] niks3-server[999]: 2026/09/20 12:24:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6405worker1 # [ 140.363947] nix-grpc-daemon[1420]: time=2026-09-20T12:24:22.178Z level=INFO msg="Uploading 1 narinfos"6406lb # [ 140.363583] niks3-server[999]: 2026/09/20 12:24:22 INFO Signed narinfos id=62 count=16407lb # [ 140.366745] niks3-server[999]: 2026/09/20 12:24:22 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6408lb # [ 140.378453] niks3-server[999]: 2026/09/20 12:24:22 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6409worker1 # [ 140.386248] nix-grpc-daemon[1420]: time=2026-09-20T12:24:22.200Z level=INFO msg="Upload complete. (390ms)"6410lb # [ 140.384181] niks3-server[999]: 2026/09/20 12:24:22 INFO Completed upload id=626411worker1 # [ 140.389083] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=0 paths=1 nar_bytes_in=7526412lb # [ 140.386558] niks3-server[999]: 2026/09/20 12:24:22 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6413worker1 # [ 140.394401] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:429446414worker1 # [ 140.398694] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6415worker1 # [ 140.400956] nix-daemon[847]: reaped child process 1892, status = succeeded6416worker1 # [ 140.406362] nix-daemon[847]: accepted connection from pid 1353, user nix-grpc-daemon (trusted)6417worker1 # [ 141.420891] nix-daemon[847]: reaped child process 1906, status = succeeded6418worker1 # [ 141.558046] nix-daemon[847]: accepted connection from pid 1921, user nix-grpc-daemon (trusted)6419worker1 # [ 141.568823] nix-daemon[847]: reaped child process 1924, status = succeeded6420lb # [ 141.584528] niks3-server[999]: 2026/09/20 12:24:23 INFO Received uploads request method=POST path=/api/pending_closures6421worker1 # [ 141.596199] nix-grpc-daemon[1420]: time=2026-09-20T12:24:23.410Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6422worker1 # [ 141.597691] nix-grpc-daemon[1420]: time=2026-09-20T12:24:23.411Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6423lb # [ 141.628424] niks3-server[999]: 2026/09/20 12:24:23 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6424lb # [ 141.631980] niks3-server[999]: 2026/09/20 12:24:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6425lb # [ 141.639149] niks3-server[999]: 2026/09/20 12:24:23 INFO Signed narinfos id=63 count=16426worker1 # [ 141.644124] nix-grpc-daemon[1420]: time=2026-09-20T12:24:23.458Z level=INFO msg="Uploading 1 narinfos"6427lb # [ 141.646857] niks3-server[999]: 2026/09/20 12:24:23 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6428lb # [ 141.651833] niks3-server[999]: 2026/09/20 12:24:23 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6429lb # [ 141.660869] niks3-server[999]: 2026/09/20 12:24:23 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6430lb # [ 141.666143] niks3-server[999]: 2026/09/20 12:24:23 INFO Completed upload id=636431worker1 # [ 141.667687] nix-grpc-daemon[1420]: time=2026-09-20T12:24:23.481Z level=INFO msg="Upload complete. (254ms)"6432lb # [ 141.670091] niks3-server[999]: 2026/09/20 12:24:23 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6433worker1 # [ 141.674428] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:42944 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=14 outputs=16434worker1 # [ 141.686598] nix-daemon[847]: reaped child process 1904, status = succeeded6435client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 16.56 seconds)6436worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6437worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6438client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16439worker1 # [ 141.985713] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:429446440worker1 # [ 141.990810] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:429446441worker1 # [ 142.005585] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:23Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06442client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.24 seconds)6443(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 16.86 seconds)6444subtest: low disk drains a worker and builds go to the other6445worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6446worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.02 seconds)6447worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6448worker1 # [ 143.614305] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:25Z level=info event=unhealthy reason=min_free6449worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.11 seconds)6450client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26451worker1 # [ 144.357617] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:429446452client # don't know how to build these paths:6453client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6454worker2 # [ 144.354346] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375526455worker2 # [ 144.365384] nix-grpc-daemon[1642]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 28 ms (attempt 1/5)6456worker2 # [ 144.400112] nix-grpc-daemon[1642]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 123 ms (attempt 2/5)6457worker2 # [ 144.529905] nix-grpc-daemon[1642]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 341 ms (attempt 3/5)6458worker2 # [ 144.877092] nix-grpc-daemon[1642]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 196 ms (attempt 4/5)6459worker2 # [ 145.079777] nix-grpc-daemon[1642]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6460worker1 # [ 145.116779] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:26Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06461worker1 # [ 145.121181] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:26Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16462worker2 # [ 145.146871] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375526463worker2 # [ 145.158123] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375526464client # copying 1 paths to 'lb:50051'...6465client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6466worker2 # [ 145.168647] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375526467worker2 # [ 145.180643] nix-daemon[813]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)6468worker2 # [ 145.198791] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:27Z level=info event=niks3_push_started pid=16636469worker2 # [ 145.378698] nix-grpc-daemon[1663]: time=2026-09-20T12:24:27.213Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""6470worker2 # [ 145.533915] nix-daemon[813]: accepted connection from pid 1676, user nix-grpc-daemon (trusted)6471worker2 # [ 145.545334] nix-daemon[813]: reaped child process 1679, status = succeeded6472worker2 # [ 145.704550] nix-daemon[813]: accepted connection from pid 1681, user nix-grpc-daemon (trusted)6473worker2 # [ 145.717151] nix-daemon[813]: reaped child process 1684, status = succeeded6474lb # [ 145.745529] niks3-server[999]: 2026/09/20 12:24:27 INFO Received uploads request method=POST path=/api/pending_closures6475worker2 # [ 145.741167] nix-grpc-daemon[1663]: time=2026-09-20T12:24:27.576Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6476worker2 # [ 145.743989] nix-grpc-daemon[1663]: time=2026-09-20T12:24:27.578Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6477lb # [ 145.776159] niks3-server[999]: 2026/09/20 12:24:27 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6478lb # [ 145.786121] niks3-server[999]: 2026/09/20 12:24:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6479worker2 # [ 145.778961] nix-grpc-daemon[1663]: time=2026-09-20T12:24:27.614Z level=INFO msg="Uploading 1 narinfos"6480lb # [ 145.790991] niks3-server[999]: 2026/09/20 12:24:27 INFO Signed narinfos id=64 count=16481lb # [ 145.804207] niks3-server[999]: 2026/09/20 12:24:27 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6482lb # [ 145.809857] niks3-server[999]: 2026/09/20 12:24:27 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6483worker2 # [ 145.804155] nix-grpc-daemon[1663]: time=2026-09-20T12:24:27.639Z level=INFO msg="Upload complete. (421ms)"6484lb # [ 145.815896] niks3-server[999]: 2026/09/20 12:24:27 INFO Completed upload id=646485worker2 # [ 145.806594] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37552 duration_s=0 paths=1 nar_bytes_in=5126486lb # [ 145.818881] niks3-server[999]: 2026/09/20 12:24:27 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6487worker2 # [ 145.811173] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375526488worker2 # [ 145.817262] nix-daemon[813]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)6489worker2 # [ 145.819599] nix-daemon[813]: reaped child process 1661, status = succeeded6490worker2 # [ 145.824948] nix-daemon[813]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)6491client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6492client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6493client # farm-a> LOG-farm-a-drain6494worker2 # [ 146.649758] nix-daemon[813]: reaped child process 1688, status = succeeded6495worker2 # [ 146.792534] nix-daemon[813]: accepted connection from pid 1703, user nix-grpc-daemon (trusted)6496worker2 # [ 146.805146] nix-daemon[813]: reaped child process 1706, status = succeeded6497lb # [ 146.832438] niks3-server[999]: 2026/09/20 12:24:28 INFO Received uploads request method=POST path=/api/pending_closures6498worker2 # [ 146.829560] nix-grpc-daemon[1663]: time=2026-09-20T12:24:28.665Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6499worker2 # [ 146.834346] nix-grpc-daemon[1663]: time=2026-09-20T12:24:28.666Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6500lb # [ 146.868932] niks3-server[999]: 2026/09/20 12:24:28 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6501lb # [ 146.880737] niks3-server[999]: 2026/09/20 12:24:28 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6502lb # [ 146.889101] niks3-server[999]: 2026/09/20 12:24:28 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6503lb # [ 146.894287] niks3-server[999]: 2026/09/20 12:24:28 INFO Signed narinfos id=65 count=16504worker2 # [ 146.886621] nix-grpc-daemon[1663]: time=2026-09-20T12:24:28.721Z level=INFO msg="Uploading 1 narinfos"6505lb # [ 146.898306] niks3-server[999]: 2026/09/20 12:24:28 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6506lb # [ 146.908616] niks3-server[999]: 2026/09/20 12:24:28 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6507lb # [ 146.914433] niks3-server[999]: 2026/09/20 12:24:28 INFO Completed upload id=656508worker2 # [ 146.902839] nix-grpc-daemon[1663]: time=2026-09-20T12:24:28.738Z level=INFO msg="Upload complete. (270ms)"6509lb # [ 146.916763] niks3-server[999]: 2026/09/20 12:24:28 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6510worker2 # [ 146.909109] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:28Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37552 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=15 outputs=16511worker1 # [ 146.928461] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:28Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06512worker2 # [ 146.916196] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375526513worker1 # [ 146.932643] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:28Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16514worker2 # [ 146.927060] nix-daemon[813]: reaped child process 1686, status = succeeded6515worker2 # [ 146.928424] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375526516worker2 # [ 146.935218] nix-grpc-daemon[1663]: time=2026-09-20T12:24:28.770Z level=INFO msg="All 1 paths already cached"6517client # copying 1 paths to 'lb:50051'...6518worker2 # [ 146.940453] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375526519client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6520worker2 # [ 146.946711] nix-daemon[813]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)6521worker2 # [ 147.095152] nix-daemon[813]: accepted connection from pid 1710, user nix-grpc-daemon (trusted)6522worker2 # [ 147.108055] nix-daemon[813]: reaped child process 1713, status = succeeded6523lb # [ 147.241656] envoy[907]: conn peer=[2001:db8:1::1]:53244 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27042 tx=10668 ms=163036524lb # [ 147.246681] envoy[907]: conn peer=[2001:db8:1::1]:59356 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=878 tx=481 ms=346525worker2 # [ 147.265232] nix-daemon[813]: accepted connection from pid 1715, user nix-grpc-daemon (trusted)6526worker2 # [ 147.278994] nix-daemon[813]: reaped child process 1718, status = succeeded6527lb # [ 147.306076] niks3-server[999]: 2026/09/20 12:24:29 INFO Received uploads request method=POST path=/api/pending_closures6528worker2 # [ 147.301655] nix-grpc-daemon[1663]: time=2026-09-20T12:24:29.137Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6529worker2 # [ 147.303240] nix-grpc-daemon[1663]: time=2026-09-20T12:24:29.138Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6530lb # [ 147.333416] niks3-server[999]: 2026/09/20 12:24:29 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6531lb # [ 147.344367] niks3-server[999]: 2026/09/20 12:24:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6532lb # [ 147.350220] niks3-server[999]: 2026/09/20 12:24:29 INFO Signed narinfos id=66 count=16533worker2 # [ 147.341247] nix-grpc-daemon[1663]: time=2026-09-20T12:24:29.176Z level=INFO msg="Uploading 1 narinfos"6534lb # [ 147.357753] niks3-server[999]: 2026/09/20 12:24:29 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6535lb # [ 147.369718] niks3-server[999]: 2026/09/20 12:24:29 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6536worker2 # [ 147.362696] nix-grpc-daemon[1663]: time=2026-09-20T12:24:29.198Z level=INFO msg="Upload complete. (410ms)"6537lb # [ 147.374753] niks3-server[999]: 2026/09/20 12:24:29 INFO Completed upload id=666538worker2 # [ 147.365209] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37552 duration_s=0 paths=1 nar_bytes_in=6246539lb # [ 147.378356] niks3-server[999]: 2026/09/20 12:24:29 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6540worker2 # [ 147.371317] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375526541worker2 # [ 147.379495] nix-daemon[813]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)6542worker2 # [ 147.386054] nix-daemon[813]: reaped child process 1708, status = succeeded6543client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6544worker2 # [ 147.390973] nix-daemon[813]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)6545client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6546client # farm-b> LOG-farm-b-drain6547worker2 # [ 148.607353] nix-daemon[813]: reaped child process 1722, status = succeeded6548worker2 # [ 148.746312] nix-daemon[813]: accepted connection from pid 1737, user nix-grpc-daemon (trusted)6549worker2 # [ 148.759283] nix-daemon[813]: reaped child process 1740, status = succeeded6550lb # [ 148.787845] niks3-server[999]: 2026/09/20 12:24:30 INFO Received uploads request method=POST path=/api/pending_closures6551worker2 # [ 148.784613] nix-grpc-daemon[1663]: time=2026-09-20T12:24:30.620Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6552worker2 # [ 148.786160] nix-grpc-daemon[1663]: time=2026-09-20T12:24:30.621Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6553lb # [ 148.827255] niks3-server[999]: 2026/09/20 12:24:30 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6554lb # [ 148.834142] niks3-server[999]: 2026/09/20 12:24:30 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6555lb # [ 148.846944] niks3-server[999]: 2026/09/20 12:24:30 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6556worker2 # [ 148.840146] nix-grpc-daemon[1663]: time=2026-09-20T12:24:30.675Z level=INFO msg="Uploading 1 narinfos"6557lb # [ 148.852211] niks3-server[999]: 2026/09/20 12:24:30 INFO Signed narinfos id=67 count=16558lb # [ 148.857892] niks3-server[999]: 2026/09/20 12:24:30 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6559lb # [ 148.867711] niks3-server[999]: 2026/09/20 12:24:30 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6560lb # [ 148.871492] niks3-server[999]: 2026/09/20 12:24:30 INFO Completed upload id=676561lb # [ 148.873256] niks3-server[999]: 2026/09/20 12:24:30 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6562worker2 # [ 148.861194] nix-grpc-daemon[1663]: time=2026-09-20T12:24:30.696Z level=INFO msg="Upload complete. (262ms)"6563worker2 # [ 148.866819] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37552 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=16 outputs=16564worker1 # [ 148.886978] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:30Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06565worker1 # [ 148.891322] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:30Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16566worker2 # [ 148.881639] nix-daemon[813]: reaped child process 1720, status = succeeded6567worker2 # [ 148.917179] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375526568worker2 # [ 148.930196] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:375526569worker2 # [ 148.943206] nix-grpc-daemon[1663]: time=2026-09-20T12:24:30.778Z level=INFO msg="All 2 paths already cached"6570client # copying 1 paths to 'lb:50051'...6571client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6572worker2 # [ 148.952087] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:375526573worker2 # [ 148.962231] nix-daemon[813]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)6574worker2 # [ 149.123655] nix-daemon[813]: accepted connection from pid 1744, user nix-grpc-daemon (trusted)6575worker2 # [ 149.136816] nix-daemon[813]: reaped child process 1747, status = succeeded6576worker2 # [ 149.289214] nix-daemon[813]: accepted connection from pid 1749, user nix-grpc-daemon (trusted)6577worker2 # [ 149.301860] nix-daemon[813]: reaped child process 1752, status = succeeded6578lb # [ 149.329103] niks3-server[999]: 2026/09/20 12:24:31 INFO Received uploads request method=POST path=/api/pending_closures6579worker2 # [ 149.325825] nix-grpc-daemon[1663]: time=2026-09-20T12:24:31.161Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6580worker2 # [ 149.327237] nix-grpc-daemon[1663]: time=2026-09-20T12:24:31.161Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6581lb # [ 149.357557] niks3-server[999]: 2026/09/20 12:24:31 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6582lb # [ 149.367531] niks3-server[999]: 2026/09/20 12:24:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6583worker2 # [ 149.361542] nix-grpc-daemon[1663]: time=2026-09-20T12:24:31.197Z level=INFO msg="Uploading 1 narinfos"6584lb # [ 149.372989] niks3-server[999]: 2026/09/20 12:24:31 INFO Signed narinfos id=68 count=16585lb # [ 149.380787] niks3-server[999]: 2026/09/20 12:24:31 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6586lb # [ 149.388924] niks3-server[999]: 2026/09/20 12:24:31 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6587worker2 # [ 149.383210] nix-grpc-daemon[1663]: time=2026-09-20T12:24:31.218Z level=INFO msg="Upload complete. (408ms)"6588lb # [ 149.394849] niks3-server[999]: 2026/09/20 12:24:31 INFO Completed upload id=686589lb # [ 149.400083] niks3-server[999]: 2026/09/20 12:24:31 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6590worker2 # [ 149.385953] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:37552 duration_s=0 paths=1 nar_bytes_in=7526591worker2 # [ 149.391293] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:375526592worker2 # [ 149.398958] nix-daemon[813]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)6593worker2 # [ 149.404889] nix-daemon[813]: reaped child process 1742, status = succeeded6594worker2 # [ 149.408932] nix-daemon[813]: accepted connection from pid 1642, user nix-grpc-daemon (trusted)6595client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6596client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6597worker2 # [ 150.422900] nix-daemon[813]: reaped child process 1756, status = succeeded6598client # farm-top> LOG-farm-top-drain6599worker2 # [ 150.566197] nix-daemon[813]: accepted connection from pid 1771, user nix-grpc-daemon (trusted)6600worker2 # [ 150.579279] nix-daemon[813]: reaped child process 1774, status = succeeded6601lb # [ 150.607695] niks3-server[999]: 2026/09/20 12:24:32 INFO Received uploads request method=POST path=/api/pending_closures6602worker2 # [ 150.604498] nix-grpc-daemon[1663]: time=2026-09-20T12:24:32.439Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6603worker2 # [ 150.606052] nix-grpc-daemon[1663]: time=2026-09-20T12:24:32.441Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6604lb # [ 150.640283] niks3-server[999]: 2026/09/20 12:24:32 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6605lb # [ 150.652438] niks3-server[999]: 2026/09/20 12:24:32 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6606lb # [ 150.664681] niks3-server[999]: 2026/09/20 12:24:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6607lb # [ 150.670216] niks3-server[999]: 2026/09/20 12:24:32 INFO Signed narinfos id=69 count=16608worker2 # [ 150.658583] nix-grpc-daemon[1663]: time=2026-09-20T12:24:32.494Z level=INFO msg="Uploading 1 narinfos"6609lb # [ 150.673687] niks3-server[999]: 2026/09/20 12:24:32 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6610lb # [ 150.677757] niks3-server[999]: 2026/09/20 12:24:32 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6611lb # [ 150.681301] niks3-server[999]: 2026/09/20 12:24:32 INFO Completed upload id=696612worker2 # [ 150.669742] nix-grpc-daemon[1663]: time=2026-09-20T12:24:32.505Z level=INFO msg="Upload complete. (254ms)"6613lb # [ 150.683059] niks3-server[999]: 2026/09/20 12:24:32 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6614worker2 # [ 150.674853] nix-grpc-daemon[1642]: ts=2026-09-20T12:24:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:37552 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=17 outputs=16615worker2 # [ 150.686767] nix-daemon[813]: reaped child process 1754, status = succeeded6616client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 6.55 seconds)6617client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6618client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.18 seconds)6619worker1: must succeed: rm /nix/.rw-store/fill6620worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.10 seconds)6621worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6622worker1 # [ 151.623266] nix-grpc-daemon[1353]: ts=2026-09-20T12:24:33Z level=info event=healthy reason=min_free6623worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.08 seconds)6624(finished: subtest: low disk drains a worker and builds go to the other, in 10.10 seconds)6625(finished: run the VM test script, in 153.05 seconds)6626test script finished in 153.23s6627cleanup6628kill QemuMachine (pid 49)6629client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6630kill QemuMachine (pid 50)6631lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6632kill QemuMachine (pid 51)6633worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6634kill QemuMachine (pid 52)6635worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6636(finished: cleanup, in 0.98 seconds)6637additionally exposed symbols:6638 client, lb, worker1, worker2,6639 vlan1,6640 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh