vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #351
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13worker2 # Formatting '/build/vm-state-worker2/tmp.XoLsSrcYLc', fmt=raw size=107374182414worker2 # mke2fs 1.47.4 (6-Mar-2025)15worker2 # Discarding device blocks: 0/262144 done16worker2: QEMU running (pid 51)17worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes18worker2 # Filesystem UUID: a5ef0437-106e-42bc-a39f-96c97f1f35e919worker2 # Superblock backups stored on blocks:20worker2 # 32768, 98304, 163840, 22937621worker2 # 22worker2 # Allocating group tables: 0/8 done23worker2 # Writing inode tables: 0/8 done24worker2 # Creating journal (8192 blocks): done25worker2 # Writing superblocks and filesystem accounting information: 0/8 done26worker2 # 27worker2 # Virtualisation disk image created.28lb # Disk image does not exist, creating the virtualisation disk image...29lb: QEMU running (pid 52)30lb # Formatting '/build/vm-state-lb/tmp.zCCnuDp76L', fmt=raw size=107374182431lb # mke2fs 1.47.4 (6-Mar-2025)32lb # Discarding device blocks: 0/262144 done33lb # Creating filesystem with 262144 4k blocks and 65536 inodes34lb # Filesystem UUID: 9bd211e4-0874-425d-8e04-477480d2a9a235lb # Superblock backups stored on blocks:36lb # 32768, 98304, 163840, 22937637lb # 38lb # Allocating group tables: 0/8 done39lb # Writing inode tables: 0/8 done40lb # Creating journal (8192 blocks): done41lb # Writing superblocks and filesystem accounting information: 0/8 done42lb # 43lb # Virtualisation disk image created.44client: QEMU running (pid 49)45client # Disk image does not exist, creating the virtualisation disk image...46client # Formatting '/build/vm-state-client/tmp.7Ub3Zg2w2P', fmt=raw size=107374182447worker1 # Disk image does not exist, creating the virtualisation disk image...48worker1: QEMU running (pid 50)49worker1 # Formatting '/build/vm-state-worker1/tmp.hKqPQxUEDQ', fmt=raw size=107374182450client # mke2fs 1.47.4 (6-Mar-2025)51worker1 # mke2fs 1.47.4 (6-Mar-2025)52client # Discarding device blocks: 0/262144 done53worker1 # Discarding device blocks: 0/262144 done54client # Creating filesystem with 262144 4k blocks and 65536 inodes55worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes56client # Filesystem UUID: 10a2ae34-e4ee-4f1d-a11b-31413de4c53757worker1 # Filesystem UUID: 182a5670-85e3-4b28-b5e3-15c6743e6e7858client # Superblock backups stored on blocks:59worker1 # Superblock backups stored on blocks:60client # 32768, 98304, 163840, 22937661worker1 # 32768, 98304, 163840, 22937662client # 63worker1 # 64client # Allocating group tables: 0/8 done65worker1 # Allocating group tables: 0/8 done66client # Writing inode tables: 0/8 done67worker1 # Writing inode tables: 0/8 done68client # Creating journal (8192 blocks): done69worker1 # Creating journal (8192 blocks): done70client # Writing superblocks and filesystem accounting information: 0/8 done71worker1 # Writing superblocks and filesystem accounting information: 0/8 done72client # 73worker1 # 74client # Virtualisation disk image created.75worker1 # Virtualisation disk image created.76(finished: start all VMs, in 0.23 seconds)77client: waiting for unit network-addresses-eth1.service78client: waiting for the VM to finish booting79worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker2 # 84worker2 # 85worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...87worker2 # 88worker2 # 89worker2 # 90worker2 # 91worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB0092lb # 93lb # 94lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0095worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...96worker2 # 97worker2 # 98lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...99lb # 100lb # 101lb # 102lb # 103lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00104lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...105lb # 106lb # 107worker1 # 108worker1 # 109worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00110worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...111worker1 # 112worker1 # 113worker1 # 114worker1 # 115worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00116worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...117worker1 # 118worker1 # 119client # 120client # 121worker2 # Booting from ROM...122client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00123client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...124client # 125client # 126client # 127client # 128client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00129client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...130client # 131client # 132lb # Booting from ROM...133worker1 # Booting from ROM...134client # Booting from ROM...135worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026136worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cbllq2gxrg6hh6ipp2jh5qs1zv34p3dy-nixos-system-worker2-test/init regInfo=/nix/store/5xnz43w2i0p1y0x8cmr2lv32cfb2ia99-closure-info/registration console=ttyS0,115200n8 console=tty0137worker2 # [ 0.000000] BIOS-provided physical RAM map:138worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable139worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved140worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved141worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable142worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved143worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved144worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved145worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved146worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved147worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved148worker2 # [ 0.000000] NX (Execute Disable) protection: active149worker2 # [ 0.000000] APIC: Static calls initialized150worker2 # [ 0.000000] SMBIOS 2.8 present.151worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014152worker2 # [ 0.000000] DMI: Memory slots populated: 1/1153worker2 # [ 0.000000] Hypervisor detected: KVM154worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000155worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00156lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026157worker2 # [ 0.000001] kvm-clock: using sched offset of 441487273 cycles158worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns159worker2 # [ 0.000005] tsc: Detected 2400.012 MHz processor160worker2 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000161lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zfkn25gwyly4vj1wrmysvx6pxf84cpx1-nixos-system-lb-test/init regInfo=/nix/store/4sxfzvml2hymd14mj9miafa9ing1xf50-closure-info/registration console=ttyS0,115200n8 console=tty0162worker2 # [ 0.000841] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs163lb # [ 0.000000] BIOS-provided physical RAM map:164worker2 # [ 0.000843] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT165lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable166worker2 # [ 0.002758] found SMP MP-table at [mem 0x000f5450-0x000f545f]167lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved168worker2 # [ 0.002770] Using GB pages for direct mapping169lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved170worker2 # [ 0.002916] RAMDISK: [mem 0x5e367000-0x5ffcffff]171worker2 # [ 0.002923] ACPI: Early table checksum verification disabled172lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable173worker2 # [ 0.002926] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )174lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved175worker2 # [ 0.002930] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)176lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved177worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026178lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved179worker2 # [ 0.002935] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)180lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved181worker2 # [ 0.002942] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)182worker2 # [ 0.002944] ACPI: FACS 0x000000005FFE0000 000040183lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved184lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved185worker2 # [ 0.002946] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)186worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xcsqc2yis6p8zb5zf7gl4zhgg20q0y9w-nixos-system-worker1-test/init regInfo=/nix/store/yczfn772bxd9lflphzsz2g6v04hfg056-closure-info/registration console=ttyS0,115200n8 console=tty0187lb # [ 0.000000] NX (Execute Disable) protection: active188worker1 # [ 0.000000] BIOS-provided physical RAM map:189lb # [ 0.000000] APIC: Static calls initialized190worker2 # [ 0.002947] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)191lb # [ 0.000000] SMBIOS 2.8 present.192worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable193worker2 # [ 0.002949] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)194worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved195lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014196worker2 # [ 0.002950] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)197lb # [ 0.000000] DMI: Memory slots populated: 1/1198worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved199lb # [ 0.000000] Hypervisor detected: KVM200worker2 # [ 0.002952] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]201worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable202lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000203worker2 # [ 0.002953] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]204lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00205worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved206worker2 # [ 0.002953] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]207lb # [ 0.000001] kvm-clock: using sched offset of 457101594 cycles208worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved209worker2 # [ 0.002954] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]210worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved211lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns212worker2 # [ 0.002954] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]213worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved214lb # [ 0.000005] tsc: Detected 2400.012 MHz processor215worker2 # [ 0.002955] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]216lb # [ 0.000818] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000217worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved218worker2 # [ 0.002955] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]219worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved220lb # [ 0.000846] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs221client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026222worker2 # [ 0.003181] No NUMA configuration found223worker1 # [ 0.000000] NX (Execute Disable) protection: active224lb # [ 0.000849] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT225worker1 # [ 0.000000] APIC: Static calls initialized226worker2 # [ 0.003182] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]227worker1 # [ 0.000000] SMBIOS 2.8 present.228lb # [ 0.002748] found SMP MP-table at [mem 0x000f5450-0x000f545f]229worker2 # [ 0.003184] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]230lb # [ 0.002760] Using GB pages for direct mapping231worker2 # [ 0.005670] Zone ranges:232lb # [ 0.002917] RAMDISK: [mem 0x5e367000-0x5ffcffff]233worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014234worker2 # [ 0.005671] DMA [mem 0x0000000000001000-0x0000000000ffffff]235worker1 # [ 0.000000] DMI: Memory slots populated: 1/1236lb # [ 0.002925] ACPI: Early table checksum verification disabled237worker1 # [ 0.000000] Hypervisor detected: KVM238worker2 # [ 0.005673] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]239client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/akqi3x4x90vh2w3gs5b7p4df2r05p5ay-nixos-system-client-test/init regInfo=/nix/store/1llryb8dym5v4hyhgg1m1m0qdxfllq44-closure-info/registration console=ttyS0,115200n8 console=tty0240worker2 # [ 0.005674] Normal empty241lb # [ 0.002928] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )242worker2 # [ 0.005675] Device empty243client # [ 0.000000] BIOS-provided physical RAM map:244worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000245worker2 # [ 0.005675] Movable zone start for each node246worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00247lb # [ 0.002932] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)248client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable249worker2 # [ 0.005676] Early memory node ranges250worker1 # [ 0.000000] kvm-clock: using sched offset of 458892384 cycles251worker2 # [ 0.005676] node 0: [mem 0x0000000000001000-0x000000000009efff]252client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved253lb # [ 0.002936] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)254worker2 # [ 0.005677] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]255client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved256worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns257lb # [ 0.002943] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)258worker1 # [ 0.000005] tsc: Detected 2400.012 MHz processor259client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable260worker2 # [ 0.005679] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]261lb # [ 0.002945] ACPI: FACS 0x000000005FFE0000 000040262worker1 # [ 0.000813] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000263worker2 # [ 0.005699] On node 0, zone DMA: 1 pages in unavailable ranges264client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved265lb # [ 0.002953] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)266worker2 # [ 0.005975] On node 0, zone DMA: 97 pages in unavailable ranges267worker1 # [ 0.000841] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs268client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved269worker2 # [ 0.033732] On node 0, zone DMA32: 40 pages in unavailable ranges270lb # [ 0.002955] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)271worker1 # [ 0.000844] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT272client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved273worker2 # [ 0.034191] ACPI: PM-Timer IO Port: 0x608274worker1 # [ 0.002788] found SMP MP-table at [mem 0x000f5450-0x000f545f]275lb # [ 0.002956] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)276worker2 # [ 0.034204] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])277client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved278worker1 # [ 0.002800] Using GB pages for direct mapping279worker1 # [ 0.002942] RAMDISK: [mem 0x5e367000-0x5ffcffff]280worker2 # [ 0.034229] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23281client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved282lb # [ 0.002958] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)283worker1 # [ 0.002950] ACPI: Early table checksum verification disabled284worker2 # [ 0.034232] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)285client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved286lb # [ 0.002959] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]287worker1 # [ 0.002953] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )288client # [ 0.000000] NX (Execute Disable) protection: active289worker2 # [ 0.034234] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)290lb # [ 0.002960] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]291client # [ 0.000000] APIC: Static calls initialized292worker1 # [ 0.002957] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)293worker2 # [ 0.034235] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)294client # [ 0.000000] SMBIOS 2.8 present.295lb # [ 0.002961] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]296worker2 # [ 0.034236] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)297worker1 # [ 0.002962] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)298lb # [ 0.002961] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]299client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014300worker2 # [ 0.034237] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)301client # [ 0.000000] DMI: Memory slots populated: 1/1302worker1 # [ 0.002969] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)303lb # [ 0.002962] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]304client # [ 0.000000] Hypervisor detected: KVM305worker2 # [ 0.034240] ACPI: Using ACPI (MADT) for SMP configuration information306worker1 # [ 0.002971] ACPI: FACS 0x000000005FFE0000 000040307lb # [ 0.002962] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]308client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000309worker2 # [ 0.034241] ACPI: HPET id: 0x8086a201 base: 0xfed00000310client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00311worker2 # [ 0.034246] TSC deadline timer available312worker1 # [ 0.002973] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)313lb # [ 0.002963] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]314worker2 # [ 0.034250] CPU topo: Max. logical packages: 1315lb # [ 0.003196] No NUMA configuration found316client # [ 0.000000] kvm-clock: using sched offset of 470727896 cycles317worker2 # [ 0.034251] CPU topo: Max. logical dies: 1318worker1 # [ 0.002974] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)319lb # [ 0.003196] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]320worker2 # [ 0.034251] CPU topo: Max. dies per package: 1321client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns322worker1 # [ 0.002976] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)323worker2 # [ 0.034255] CPU topo: Max. threads per core: 1324lb # [ 0.003199] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]325client # [ 0.000004] tsc: Detected 2400.012 MHz processor326lb # [ 0.005529] Zone ranges:327worker2 # [ 0.034256] CPU topo: Num. cores per package: 1328worker1 # [ 0.002977] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)329client # [ 0.000814] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000330lb # [ 0.005530] DMA [mem 0x0000000000001000-0x0000000000ffffff]331worker2 # [ 0.034256] CPU topo: Num. threads per package: 1332lb # [ 0.005532] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]333worker1 # [ 0.002978] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]334worker2 # [ 0.034256] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs335client # [ 0.000841] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs336lb # [ 0.005533] Normal empty337lb # [ 0.005534] Device empty338worker1 # [ 0.002980] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]339client # [ 0.000844] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT340worker2 # [ 0.034279] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()341lb # [ 0.005535] Movable zone start for each node342client # [ 0.002745] found SMP MP-table at [mem 0x000f5450-0x000f545f]343lb # [ 0.005535] Early memory node ranges344worker1 # [ 0.002980] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]345worker2 # [ 0.034314] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]346client # [ 0.002756] Using GB pages for direct mapping347lb # [ 0.005536] node 0: [mem 0x0000000000001000-0x000000000009efff]348worker1 # [ 0.002981] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]349worker2 # [ 0.034315] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]350client # [ 0.002838] RAMDISK: [mem 0x5e366000-0x5ffcffff]351lb # [ 0.005537] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]352worker1 # [ 0.002981] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]353client # [ 0.002846] ACPI: Early table checksum verification disabled354worker2 # [ 0.034317] [mem 0x60000000-0xafffffff] available for PCI devices355worker2 # [ 0.034318] Booting paravirtualized kernel on KVM356lb # [ 0.005538] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]357client # [ 0.002848] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )358worker1 # [ 0.002981] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]359lb # [ 0.005557] On node 0, zone DMA: 1 pages in unavailable ranges360worker1 # [ 0.002982] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]361client # [ 0.002852] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)362worker2 # [ 0.034321] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns363lb # [ 0.005822] On node 0, zone DMA: 97 pages in unavailable ranges364worker1 # [ 0.003201] No NUMA configuration found365client # [ 0.002856] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)366worker2 # [ 0.038778] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1367lb # [ 0.032546] On node 0, zone DMA32: 40 pages in unavailable ranges368worker1 # [ 0.003202] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]369lb # [ 0.033013] ACPI: PM-Timer IO Port: 0x608370worker2 # [ 0.040980] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152371worker1 # [ 0.003205] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]372client # [ 0.002862] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)373worker1 # [ 0.005537] Zone ranges:374lb # [ 0.033024] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])375worker2 # [ 0.041022] kvm-guest: PV spinlocks disabled, single CPU376client # [ 0.002864] ACPI: FACS 0x000000005FFE0000 000040377worker1 # [ 0.005538] DMA [mem 0x0000000000001000-0x0000000000ffffff]378lb # [ 0.033051] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23379client # [ 0.002866] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)380worker1 # [ 0.005539] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]381lb # [ 0.033053] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)382worker1 # [ 0.005540] Normal empty383worker1 # [ 0.005541] Device empty384client # [ 0.002867] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)385lb # [ 0.033055] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)386worker1 # [ 0.005542] Movable zone start for each node387worker1 # [ 0.005542] Early memory node ranges388lb # [ 0.033056] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)389client # [ 0.002869] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)390worker1 # [ 0.005543] node 0: [mem 0x0000000000001000-0x000000000009efff]391worker2 # [ 0.041023] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cbllq2gxrg6hh6ipp2jh5qs1zv34p3dy-nixos-system-worker2-test/init regInfo=/nix/store/5xnz43w2i0p1y0x8cmr2lv32cfb2ia99-closure-info/registration console=ttyS0,115200n8 console=tty0392lb # [ 0.033057] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)393client # [ 0.002871] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)394worker1 # [ 0.005544] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]395lb # [ 0.033058] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)396client # [ 0.002872] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]397worker1 # [ 0.005545] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]398lb # [ 0.033060] ACPI: Using ACPI (MADT) for SMP configuration information399worker2 # [ 0.041118] Unknown kernel command line parameters "regInfo=/nix/store/5xnz43w2i0p1y0x8cmr2lv32cfb2ia99-closure-info/registration", will be passed to user space.400worker2 # [ 0.041132] random: crng init done401client # [ 0.002873] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]402worker1 # [ 0.005564] On node 0, zone DMA: 1 pages in unavailable ranges403lb # [ 0.033062] ACPI: HPET id: 0x8086a201 base: 0xfed00000404lb # [ 0.033065] TSC deadline timer available405worker1 # [ 0.005822] On node 0, zone DMA: 97 pages in unavailable ranges406worker2 # [ 0.041132] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes407client # [ 0.002873] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]408lb # [ 0.033069] CPU topo: Max. logical packages: 1409worker1 # [ 0.032112] On node 0, zone DMA32: 40 pages in unavailable ranges410client # [ 0.002874] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]411worker2 # [ 0.043287] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)412lb # [ 0.033070] CPU topo: Max. logical dies: 1413worker1 # [ 0.032572] ACPI: PM-Timer IO Port: 0x608414lb # [ 0.033071] CPU topo: Max. dies per package: 1415client # [ 0.002874] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]416worker1 # [ 0.032586] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])417worker2 # [ 0.044330] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)418lb # [ 0.033074] CPU topo: Max. threads per core: 1419worker2 # [ 0.044362] Fallback order for Node 0: 0420worker1 # [ 0.032625] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23421client # [ 0.002875] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]422lb # [ 0.033075] CPU topo: Num. cores per package: 1423worker2 # [ 0.044365] Built 1 zonelists, mobility grouping on. Total pages: 393078424client # [ 0.002875] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]425lb # [ 0.033075] CPU topo: Num. threads per package: 1426worker2 # [ 0.044366] Policy zone: DMA32427worker1 # [ 0.032628] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)428client # [ 0.003094] No NUMA configuration found429lb # [ 0.033075] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs430worker1 # [ 0.032631] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)431worker2 # [ 0.047068] mem auto-init: stack:all(zero), heap alloc:on, heap free:off432client # [ 0.003095] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]433worker1 # [ 0.032633] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)434lb # [ 0.033095] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()435worker2 # [ 0.050298] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1436client # [ 0.003097] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]437client # [ 0.005491] Zone ranges:438worker2 # [ 0.053591] allocated 3145728 bytes of page_ext439worker1 # [ 0.032634] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)440lb # [ 0.033128] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]441worker2 # [ 0.063494] ftrace: allocating 48731 entries in 192 pages442client # [ 0.005492] DMA [mem 0x0000000000001000-0x0000000000ffffff]443worker1 # [ 0.032636] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)444lb # [ 0.033129] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]445worker2 # [ 0.063496] ftrace: allocated 192 pages with 2 groups446client # [ 0.005494] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]447worker1 # [ 0.032639] ACPI: Using ACPI (MADT) for SMP configuration information448worker2 # [ 0.064317] Dynamic Preempt: lazy449lb # [ 0.033131] [mem 0x60000000-0xafffffff] available for PCI devices450client # [ 0.005495] Normal empty451client # [ 0.005495] Device empty452worker1 # [ 0.032641] ACPI: HPET id: 0x8086a201 base: 0xfed00000453worker2 # [ 0.064492] rcu: Preemptible hierarchical RCU implementation.454lb # [ 0.033132] Booting paravirtualized kernel on KVM455client # [ 0.005496] Movable zone start for each node456worker1 # [ 0.032649] TSC deadline timer available457worker2 # [ 0.064492] rcu: RCU event tracing is enabled.458client # [ 0.005497] Early memory node ranges459worker1 # [ 0.032653] CPU topo: Max. logical packages: 1460worker2 # [ 0.064493] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.461lb # [ 0.033136] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns462worker1 # [ 0.032654] CPU topo: Max. logical dies: 1463client # [ 0.005497] node 0: [mem 0x0000000000001000-0x000000000009efff]464worker2 # [ 0.064494] Trampoline variant of Tasks RCU enabled.465worker1 # [ 0.032654] CPU topo: Max. dies per package: 1466client # [ 0.005498] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]467lb # [ 0.037601] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1468worker2 # [ 0.064495] Rude variant of Tasks RCU enabled.469worker1 # [ 0.032658] CPU topo: Max. threads per core: 1470worker2 # [ 0.064495] Tracing variant of Tasks RCU enabled.471lb # [ 0.039961] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152472client # [ 0.005499] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]473worker1 # [ 0.032659] CPU topo: Num. cores per package: 1474lb # [ 0.040003] kvm-guest: PV spinlocks disabled, single CPU475worker1 # [ 0.032659] CPU topo: Num. threads per package: 1476client # [ 0.005522] On node 0, zone DMA: 1 pages in unavailable ranges477worker2 # [ 0.064496] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.478client # [ 0.005778] On node 0, zone DMA: 97 pages in unavailable ranges479worker1 # [ 0.032659] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs480worker2 # [ 0.064497] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1481client # [ 0.031416] On node 0, zone DMA32: 40 pages in unavailable ranges482worker1 # [ 0.032684] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()483client # [ 0.031878] ACPI: PM-Timer IO Port: 0x608484worker2 # [ 0.064506] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.485worker1 # [ 0.032727] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]486client # [ 0.031889] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])487worker2 # [ 0.064508] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.488worker1 # [ 0.032728] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]489client # [ 0.031914] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23490lb # [ 0.040005] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zfkn25gwyly4vj1wrmysvx6pxf84cpx1-nixos-system-lb-test/init regInfo=/nix/store/4sxfzvml2hymd14mj9miafa9ing1xf50-closure-info/registration console=ttyS0,115200n8 console=tty0491worker1 # [ 0.032730] [mem 0x60000000-0xafffffff] available for PCI devices492client # [ 0.031916] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)493worker2 # [ 0.064508] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.494worker1 # [ 0.032732] Booting paravirtualized kernel on KVM495worker2 # [ 0.068852] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16496client # [ 0.031918] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)497lb # [ 0.040104] Unknown kernel command line parameters "regInfo=/nix/store/4sxfzvml2hymd14mj9miafa9ing1xf50-closure-info/registration", will be passed to user space.498client # [ 0.031919] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)499worker2 # [ 0.069123] rcu: srcu_init: Setting srcu_struct sizes based on contention.500worker1 # [ 0.032735] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns501lb # [ 0.040116] random: crng init done502client # [ 0.031920] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)503worker1 # [ 0.037186] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1504lb # [ 0.040117] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes505worker2 # [ 0.069130] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns506client # [ 0.031921] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)507worker1 # [ 0.039280] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152508lb # [ 0.042241] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)509client # [ 0.031923] ACPI: Using ACPI (MADT) for SMP configuration information510worker1 # [ 0.039319] kvm-guest: PV spinlocks disabled, single CPU511worker2 # [ 0.069237] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)512worker2 # [ 0.072756] Console: colour VGA+ 80x25513lb # [ 0.043336] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)514client # [ 0.031924] ACPI: HPET id: 0x8086a201 base: 0xfed00000515worker2 # [ 0.072759] printk: legacy console [tty0] enabled516lb # [ 0.043368] Fallback order for Node 0: 0517client # [ 0.031927] TSC deadline timer available518worker2 # [ 0.102385] printk: legacy console [ttyS0] enabled519client # [ 0.031932] CPU topo: Max. logical packages: 1520lb # [ 0.043370] Built 1 zonelists, mobility grouping on. Total pages: 393078521client # [ 0.031932] CPU topo: Max. logical dies: 1522worker2 # [ 0.200442] ACPI: Core revision 20250807523lb # [ 0.043371] Policy zone: DMA32524client # [ 0.031933] CPU topo: Max. dies per package: 1525lb # [ 0.045863] mem auto-init: stack:all(zero), heap alloc:on, heap free:off526client # [ 0.031937] CPU topo: Max. threads per core: 1527worker1 # [ 0.039321] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/xcsqc2yis6p8zb5zf7gl4zhgg20q0y9w-nixos-system-worker1-test/init regInfo=/nix/store/yczfn772bxd9lflphzsz2g6v04hfg056-closure-info/registration console=ttyS0,115200n8 console=tty0528lb # [ 0.049082] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1529worker2 # [ 0.201277] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns530client # [ 0.031937] CPU topo: Num. cores per package: 1531client # [ 0.031937] CPU topo: Num. threads per package: 1532lb # [ 0.052574] allocated 3145728 bytes of page_ext533worker2 # [ 0.202759] APIC: Switch to symmetric I/O mode setup534lb # [ 0.062459] ftrace: allocating 48731 entries in 192 pages535client # [ 0.031938] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs536worker2 # [ 0.203679] x2apic enabled537worker1 # [ 0.039414] Unknown kernel command line parameters "regInfo=/nix/store/yczfn772bxd9lflphzsz2g6v04hfg056-closure-info/registration", will be passed to user space.538lb # [ 0.062461] ftrace: allocated 192 pages with 2 groups539worker1 # [ 0.039428] random: crng init done540client # [ 0.031955] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()541lb # [ 0.063297] Dynamic Preempt: lazy542worker2 # [ 0.204403] APIC: Switched APIC routing to: physical x2apic543lb # [ 0.063419] rcu: Preemptible hierarchical RCU implementation.544worker1 # [ 0.039429] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes545client # [ 0.031986] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]546lb # [ 0.063420] rcu: RCU event tracing is enabled.547worker1 # [ 0.041504] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)548client # [ 0.031987] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]549lb # [ 0.063420] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.550worker2 # [ 0.206191] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1551client # [ 0.031989] [mem 0x60000000-0xafffffff] available for PCI devices552worker1 # [ 0.042545] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)553lb # [ 0.063422] Trampoline variant of Tasks RCU enabled.554client # [ 0.031990] Booting paravirtualized kernel on KVM555worker1 # [ 0.042578] Fallback order for Node 0: 0556lb # [ 0.063422] Rude variant of Tasks RCU enabled.557lb # [ 0.063422] Tracing variant of Tasks RCU enabled.558worker1 # [ 0.042581] Built 1 zonelists, mobility grouping on. Total pages: 393078559worker2 # [ 0.207119] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns560worker1 # [ 0.042582] Policy zone: DMA32561client # [ 0.031993] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns562lb # [ 0.063423] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.563worker1 # [ 0.045262] mem auto-init: stack:all(zero), heap alloc:on, heap free:off564client # [ 0.036549] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1565worker2 # [ 0.208676] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)566lb # [ 0.063424] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1567worker1 # [ 0.048343] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1568client # [ 0.038638] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152569worker1 # [ 0.051590] allocated 3145728 bytes of page_ext570worker2 # [ 0.210759] x86/cpu: User Mode Instruction Prevention (UMIP) activated571client # [ 0.038678] kvm-guest: PV spinlocks disabled, single CPU572lb # [ 0.063439] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.573worker1 # [ 0.061478] ftrace: allocating 48731 entries in 192 pages574worker2 # [ 0.211829] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127575worker1 # [ 0.061480] ftrace: allocated 192 pages with 2 groups576lb # [ 0.063441] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.577worker1 # [ 0.062302] Dynamic Preempt: lazy578worker2 # [ 0.212674] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0579worker1 # [ 0.062426] rcu: Preemptible hierarchical RCU implementation.580lb # [ 0.063442] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.581worker1 # [ 0.062427] rcu: RCU event tracing is enabled.582lb # [ 0.067957] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16583worker1 # [ 0.062428] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.584worker2 # [ 0.213677] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto585client # [ 0.038680] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/akqi3x4x90vh2w3gs5b7p4df2r05p5ay-nixos-system-client-test/init regInfo=/nix/store/1llryb8dym5v4hyhgg1m1m0qdxfllq44-closure-info/registration console=ttyS0,115200n8 console=tty0586lb # [ 0.068237] rcu: srcu_init: Setting srcu_struct sizes based on contention.587worker1 # [ 0.062429] Trampoline variant of Tasks RCU enabled.588worker1 # [ 0.062430] Rude variant of Tasks RCU enabled.589worker2 # [ 0.214674] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl590lb # [ 0.068243] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns591worker1 # [ 0.062430] Tracing variant of Tasks RCU enabled.592client # [ 0.038770] Unknown kernel command line parameters "regInfo=/nix/store/1llryb8dym5v4hyhgg1m1m0qdxfllq44-closure-info/registration", will be passed to user space.593worker2 # [ 0.216673] Transient Scheduler Attacks: Vulnerable: No microcode594client # [ 0.038782] random: crng init done595worker1 # [ 0.062431] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.596lb # [ 0.068350] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)597worker2 # [ 0.217673] Spectre V2 : Mitigation: Enhanced / Automatic IBRS598lb # [ 0.071878] Console: colour VGA+ 80x25599client # [ 0.038783] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes600worker1 # [ 0.062431] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1601lb # [ 0.071882] printk: legacy console [tty0] enabled602worker2 # [ 0.218673] Speculative Return Stack Overflow: Mitigation: Safe RET603client # [ 0.040859] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)604worker1 # [ 0.062485] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.605lb # [ 0.101501] printk: legacy console [ttyS0] enabled606client # [ 0.041920] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)607lb # [ 0.199600] ACPI: Core revision 20250807608worker1 # [ 0.062487] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.609client # [ 0.041950] Fallback order for Node 0: 0610client # [ 0.041953] Built 1 zonelists, mobility grouping on. Total pages: 393078611worker1 # [ 0.062488] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.612client # [ 0.041954] Policy zone: DMA32613lb # [ 0.200569] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns614worker1 # [ 0.066829] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16615client # [ 0.044548] mem auto-init: stack:all(zero), heap alloc:on, heap free:off616lb # [ 0.202192] APIC: Switch to symmetric I/O mode setup617worker2 # [ 0.219673] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization618worker1 # [ 0.067110] rcu: srcu_init: Setting srcu_struct sizes based on contention.619client # [ 0.047595] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1620lb # [ 0.203163] x2apic enabled621worker2 # [ 0.221681] Spectre V2 : Enabling IBPB for BPF622client # [ 0.050797] allocated 3145728 bytes of page_ext623worker1 # [ 0.067115] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns624client # [ 0.060437] ftrace: allocating 48731 entries in 192 pages625lb # [ 0.203954] APIC: Switched APIC routing to: physical x2apic626worker2 # [ 0.223192] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier627client # [ 0.060439] ftrace: allocated 192 pages with 2 groups628client # [ 0.061262] Dynamic Preempt: lazy629worker1 # [ 0.067216] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)630worker2 # [ 0.223674] active return thunk: srso_alias_return_thunk631worker1 # [ 0.070710] Console: colour VGA+ 80x25632client # [ 0.061423] rcu: Preemptible hierarchical RCU implementation.633worker1 # [ 0.070714] printk: legacy console [tty0] enabled634lb # [ 0.205824] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1635client # [ 0.061424] rcu: RCU event tracing is enabled.636worker2 # [ 0.225355] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'637worker1 # [ 0.100084] printk: legacy console [ttyS0] enabled638client # [ 0.061424] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.639worker1 # [ 0.196142] ACPI: Core revision 20250807640worker2 # [ 0.226552] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'641client # [ 0.061426] Trampoline variant of Tasks RCU enabled.642lb # [ 0.206845] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns643client # [ 0.061426] Rude variant of Tasks RCU enabled.644worker2 # [ 0.227407] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'645client # [ 0.061426] Tracing variant of Tasks RCU enabled.646worker1 # [ 0.196942] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns647lb # [ 0.208535] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)648worker2 # [ 0.228420] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'649client # [ 0.061427] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.650worker1 # [ 0.198428] APIC: Switch to symmetric I/O mode setup651worker2 # [ 0.229412] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'652lb # [ 0.209630] x86/cpu: User Mode Instruction Prevention (UMIP) activated653client # [ 0.061428] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1654worker1 # [ 0.199374] x2apic enabled655worker2 # [ 0.230401] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'656lb # [ 0.211469] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127657client # [ 0.061441] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.658worker1 # [ 0.200113] APIC: Switched APIC routing to: physical x2apic659lb # [ 0.212219] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0660client # [ 0.061443] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.661worker2 # [ 0.231449] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'662worker2 # [ 0.232674] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256663worker1 # [ 0.201922] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1664client # [ 0.061444] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.665lb # [ 0.213334] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto666client # [ 0.065782] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16667worker2 # [ 0.233575] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64668worker1 # [ 0.202886] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns669client # [ 0.066042] rcu: srcu_init: Setting srcu_struct sizes based on contention.670worker2 # [ 0.234390] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512671lb # [ 0.214533] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl672worker2 # [ 0.235383] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024673client # [ 0.066048] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns674worker1 # [ 0.204515] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)675lb # [ 0.215533] Transient Scheduler Attacks: Vulnerable: No microcode676worker2 # [ 0.236369] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8677lb # [ 0.216468] Spectre V2 : Mitigation: Enhanced / Automatic IBRS678client # [ 0.066152] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)679worker1 # [ 0.205599] x86/cpu: User Mode Instruction Prevention (UMIP) activated680client # [ 0.069698] Console: colour VGA+ 80x25681lb # [ 0.217221] Speculative Return Stack Overflow: Mitigation: Safe RET682client # [ 0.069701] printk: legacy console [tty0] enabled683worker1 # [ 0.206631] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127684worker2 # [ 0.236673] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.685client # [ 0.099005] printk: legacy console [ttyS0] enabled686worker1 # [ 0.207513] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0687client # [ 0.195277] ACPI: Core revision 20250807688worker1 # [ 0.208516] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto689client # [ 0.196189] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns690lb # [ 0.218265] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization691client # [ 0.197837] APIC: Switch to symmetric I/O mode setup692worker1 # [ 0.209513] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl693lb # [ 0.219541] Spectre V2 : Enabling IBPB for BPF694client # [ 0.198788] x2apic enabled695worker1 # [ 0.210513] Transient Scheduler Attacks: Vulnerable: No microcode696client # [ 0.199581] APIC: Switched APIC routing to: physical x2apic697lb # [ 0.221083] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier698worker1 # [ 0.211512] Spectre V2 : Mitigation: Enhanced / Automatic IBRS699lb # [ 0.221534] active return thunk: srso_alias_return_thunk700worker1 # [ 0.212512] Speculative Return Stack Overflow: Mitigation: Safe RET701client # [ 0.201382] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1702lb # [ 0.223245] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'703lb # [ 0.224532] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'704client # [ 0.202399] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns705lb # [ 0.225533] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'706client # [ 0.204150] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)707worker1 # [ 0.213512] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization708lb # [ 0.226532] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'709worker1 # [ 0.215520] Spectre V2 : Enabling IBPB for BPF710client # [ 0.205235] x86/cpu: User Mode Instruction Prevention (UMIP) activated711lb # [ 0.227533] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'712client # [ 0.207187] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127713lb # [ 0.228533] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'714worker1 # [ 0.216513] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier715client # [ 0.208110] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0716worker1 # [ 0.217513] active return thunk: srso_alias_return_thunk717lb # [ 0.229533] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'718worker1 # [ 0.219172] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'719lb # [ 0.230533] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256720client # [ 0.209151] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto721worker1 # [ 0.220411] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'722lb # [ 0.231532] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64723client # [ 0.210148] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl724worker1 # [ 0.221512] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'725lb # [ 0.232532] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512726client # [ 0.212148] Transient Scheduler Attacks: Vulnerable: No microcode727worker1 # [ 0.222513] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'728lb # [ 0.233532] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024729client # [ 0.213148] Spectre V2 : Mitigation: Enhanced / Automatic IBRS730worker1 # [ 0.223512] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'731lb # [ 0.234532] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8732client # [ 0.214148] Speculative Return Stack Overflow: Mitigation: Safe RET733worker1 # [ 0.224512] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'734lb # [ 0.235532] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.735worker1 # [ 0.225512] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'736worker1 # [ 0.226513] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256737worker1 # [ 0.227512] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64738client # [ 0.215148] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization739worker1 # [ 0.228512] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512740client # [ 0.217155] Spectre V2 : Enabling IBPB for BPF741worker1 # [ 0.229512] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024742client # [ 0.217900] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier743worker1 # [ 0.230512] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8744client # [ 0.219148] active return thunk: srso_alias_return_thunk745worker1 # [ 0.231512] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.746client # [ 0.220169] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'747client # [ 0.221148] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'748client # [ 0.222148] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'749client # [ 0.223148] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'750client # [ 0.224148] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'751worker2 # [ 0.271184] Freeing SMP alternatives memory: 44K752client # [ 0.225148] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'753worker2 # [ 0.271676] pid_max: default: 32768 minimum: 301754worker2 # [ 0.272763] LSM: initializing lsm=capability,landlock,yama,bpf,ima755client # [ 0.226964] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'756worker2 # [ 0.273774] landlock: Up and running.757client # [ 0.228148] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256758worker2 # [ 0.274416] Yama: becoming mindful.759client # [ 0.229148] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64760worker2 # [ 0.275318] LSM support for eBPF active761client # [ 0.230148] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512762worker2 # [ 0.275783] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)763client # [ 0.231148] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024764worker2 # [ 0.276709] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)765client # [ 0.232148] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8766client # [ 0.233148] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.767worker2 # [ 0.279766] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)768worker2 # [ 0.281232] Performance Events: Fam17h+ core perfctr, AMD PMU driver.769worker2 # [ 0.281683] ... version: 2770worker2 # [ 0.282430] ... bit width: 48771worker2 # [ 0.282676] ... generic counters: 6772worker2 # [ 0.283425] ... generic bitmap: 000000000000003f773worker2 # [ 0.283675] ... fixed-purpose counters: 0774worker2 # [ 0.284422] ... fixed-purpose bitmap: 0000000000000000775worker2 # [ 0.284676] ... value mask: 0000ffffffffffff776worker2 # [ 0.285610] ... max period: 00007fffffffffff777worker2 # [ 0.286403] ... global_ctrl mask: 000000000000003f778worker2 # [ 0.286786] signal: max sigframe size: 3376779worker2 # [ 0.287585] rcu: Hierarchical SRCU implementation.780worker2 # [ 0.288290] rcu: Max phase no-delay instances is 400.781lb # [ 0.270431] Freeing SMP alternatives memory: 44K782lb # [ 0.271105] pid_max: default: 32768 minimum: 301783lb # [ 0.271631] LSM: initializing lsm=capability,landlock,yama,bpf,ima784lb # [ 0.272643] landlock: Up and running.785lb # [ 0.273533] Yama: becoming mindful.786worker2 # [ 0.293149] smp: Bringing up secondary CPUs ...787lb # [ 0.274747] LSM support for eBPF active788worker2 # [ 0.293689] smp: Brought up 1 node, 1 CPU789lb # [ 0.275570] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)790worker2 # [ 0.294377] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)791worker1 # [ 0.265458] Freeing SMP alternatives memory: 44K792lb # [ 0.276570] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)793worker1 # [ 0.266098] pid_max: default: 32768 minimum: 301794worker2 # [ 0.294908] Memory: 1454576K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)795worker1 # [ 0.266602] LSM: initializing lsm=capability,landlock,yama,bpf,ima796worker2 # [ 0.295911] devtmpfs: initialized797worker1 # [ 0.267611] landlock: Up and running.798lb # [ 0.279091] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)799worker1 # [ 0.268513] Yama: becoming mindful.800worker2 # [ 0.296691] x86/mm: Memory block size: 128MB801worker1 # [ 0.269732] LSM support for eBPF active802lb # [ 0.280107] Performance Events: Fam17h+ core perfctr, AMD PMU driver.803lb # [ 0.280537] ... version: 2804worker1 # [ 0.270611] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)805lb # [ 0.281241] ... bit width: 48806worker2 # [ 0.298440] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)807lb # [ 0.281535] ... generic counters: 6808worker1 # [ 0.271548] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)809worker2 # [ 0.299597] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).810lb # [ 0.282231] ... generic bitmap: 000000000000003f811lb # [ 0.282541] ... fixed-purpose counters: 0812worker2 # [ 0.300749] pinctrl core: initialized pinctrl subsystem813lb # [ 0.283261] ... fixed-purpose bitmap: 0000000000000000814worker2 # [ 0.301878] PM: RTC time: 12:46:06, date: 2026-09-20815worker1 # [ 0.274146] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)816lb # [ 0.283535] ... value mask: 0000ffffffffffff817worker1 # [ 0.275026] Performance Events: Fam17h+ core perfctr, AMD PMU driver.818lb # [ 0.284466] ... max period: 00007fffffffffff819worker1 # [ 0.275517] ... version: 2820lb # [ 0.285254] ... global_ctrl mask: 000000000000003f821worker1 # [ 0.276243] ... bit width: 48822lb # [ 0.285650] signal: max sigframe size: 3376823worker2 # [ 0.305265] NET: Registered PF_NETLINK/PF_ROUTE protocol family824worker1 # [ 0.276515] ... generic counters: 6825client # [ 0.267593] Freeing SMP alternatives memory: 44K826lb # [ 0.286437] rcu: Hierarchical SRCU implementation.827client # [ 0.268150] pid_max: default: 32768 minimum: 301828worker1 # [ 0.277191] ... generic bitmap: 000000000000003f829lb # [ 0.287090] rcu: Max phase no-delay instances is 400.830worker2 # [ 0.306165] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations831worker1 # [ 0.277558] ... fixed-purpose counters: 0832client # [ 0.269224] LSM: initializing lsm=capability,landlock,yama,bpf,ima833client # [ 0.270250] landlock: Up and running.834worker1 # [ 0.278323] ... fixed-purpose bitmap: 0000000000000000835worker2 # [ 0.306697] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations836client # [ 0.270884] Yama: becoming mindful.837worker1 # [ 0.279213] ... value mask: 0000ffffffffffff838client # [ 0.271361] LSM support for eBPF active839worker2 # [ 0.307937] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations840worker1 # [ 0.279514] ... max period: 00007fffffffffff841worker2 # [ 0.308687] audit: initializing netlink subsys (disabled)842worker1 # [ 0.280402] ... global_ctrl mask: 000000000000003f843client # [ 0.272251] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)844worker1 # [ 0.281326] signal: max sigframe size: 3376845worker2 # [ 0.309820] thermal_sys: Registered thermal governor 'fair_share'846client # [ 0.273185] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)847lb # [ 0.292159] smp: Bringing up secondary CPUs ...848worker1 # [ 0.281606] rcu: Hierarchical SRCU implementation.849worker2 # [ 0.309822] thermal_sys: Registered thermal governor 'bang_bang'850lb # [ 0.292550] smp: Brought up 1 node, 1 CPU851worker1 # [ 0.282361] rcu: Max phase no-delay instances is 400.852worker2 # [ 0.310678] thermal_sys: Registered thermal governor 'step_wise'853lb # [ 0.293186] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)854client # [ 0.275913] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)855worker2 # [ 0.311602] thermal_sys: Registered thermal governor 'user_space'856worker2 # [ 0.312393] audit: type=2000 audit(1789908366.879:1): state=initialized audit_enabled=0 res=1857lb # [ 0.293726] Memory: 1454576K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)858client # [ 0.276721] Performance Events: Fam17h+ core perfctr, AMD PMU driver.859client # [ 0.277153] ... version: 2860lb # [ 0.294835] devtmpfs: initialized861worker2 # [ 0.313679] thermal_sys: Registered thermal governor 'power_allocator'862client # [ 0.277842] ... bit width: 48863worker2 # [ 0.313693] cpuidle: using governor menu864lb # [ 0.295616] x86/mm: Memory block size: 128MB865client # [ 0.278150] ... generic counters: 6866worker1 # [ 0.287771] smp: Bringing up secondary CPUs ...867client # [ 0.278867] ... generic bitmap: 000000000000003f868worker2 # [ 0.315887] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5869worker1 # [ 0.288529] smp: Brought up 1 node, 1 CPU870client # [ 0.279161] ... fixed-purpose counters: 0871lb # [ 0.297356] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)872worker1 # [ 0.289191] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)873client # [ 0.279865] ... fixed-purpose bitmap: 0000000000000000874worker2 # [ 0.316910] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]875lb # [ 0.298402] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).876client # [ 0.280150] ... value mask: 0000ffffffffffff877worker2 # [ 0.317678] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry878lb # [ 0.299620] pinctrl core: initialized pinctrl subsystem879client # [ 0.281014] ... max period: 00007fffffffffff880worker1 # [ 0.289703] Memory: 1454588K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)881worker2 # [ 0.318687] PCI: Using configuration type 1 for base access882client # [ 0.281792] ... global_ctrl mask: 000000000000003f883lb # [ 0.300715] PM: RTC time: 12:46:06, date: 2026-09-20884worker1 # [ 0.290747] devtmpfs: initialized885client # [ 0.282260] signal: max sigframe size: 3376886worker2 # [ 0.319729] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.887worker1 # [ 0.291520] x86/mm: Memory block size: 128MB888client # [ 0.283029] rcu: Hierarchical SRCU implementation.889client # [ 0.283766] rcu: Max phase no-delay instances is 400.890worker1 # [ 0.293282] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)891lb # [ 0.304412] NET: Registered PF_NETLINK/PF_ROUTE protocol family892worker1 # [ 0.294459] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).893lb # [ 0.305767] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations894worker1 # [ 0.295615] pinctrl core: initialized pinctrl subsystem895worker2 # [ 0.324907] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages896worker1 # [ 0.296676] PM: RTC time: 12:46:06, date: 2026-09-20897lb # [ 0.306558] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations898worker2 # [ 0.325677] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page899client # [ 0.288835] smp: Bringing up secondary CPUs ...900lb # [ 0.307811] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations901client # [ 0.289164] smp: Brought up 1 node, 1 CPU902lb # [ 0.308545] audit: initializing netlink subsys (disabled)903client # [ 0.289848] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)904worker1 # [ 0.300154] NET: Registered PF_NETLINK/PF_ROUTE protocol family905lb # [ 0.309652] thermal_sys: Registered thermal governor 'fair_share'906lb # [ 0.309654] thermal_sys: Registered thermal governor 'bang_bang'907worker1 # [ 0.300986] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations908client # [ 0.290349] Memory: 1454580K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)909worker2 # [ 0.330677] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages910lb # [ 0.310536] thermal_sys: Registered thermal governor 'step_wise'911client # [ 0.291386] devtmpfs: initialized912worker1 # [ 0.301535] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations913lb # [ 0.311462] thermal_sys: Registered thermal governor 'user_space'914worker2 # [ 0.331675] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page915client # [ 0.292165] x86/mm: Memory block size: 128MB916lb # [ 0.312234] audit: type=2000 audit(1789908366.898:1): state=initialized audit_enabled=0 res=1917worker1 # [ 0.302777] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations918worker1 # [ 0.303523] audit: initializing netlink subsys (disabled)919lb # [ 0.313539] thermal_sys: Registered thermal governor 'power_allocator'920client # [ 0.293876] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)921lb # [ 0.313554] cpuidle: using governor menu922worker1 # [ 0.304517] audit: type=2000 audit(1789908366.906:1): state=initialized audit_enabled=0 res=1923client # [ 0.295043] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).924lb # [ 0.315545] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5925worker1 # [ 0.305626] thermal_sys: Registered thermal governor 'fair_share'926client # [ 0.296231] pinctrl core: initialized pinctrl subsystem927worker1 # [ 0.305628] thermal_sys: Registered thermal governor 'bang_bang'928client # [ 0.297417] PM: RTC time: 12:46:06, date: 2026-09-20929lb # [ 0.316775] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]930worker1 # [ 0.306515] thermal_sys: Registered thermal governor 'step_wise'931lb # [ 0.317538] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry932worker1 # [ 0.307453] thermal_sys: Registered thermal governor 'user_space'933lb # [ 0.318546] PCI: Using configuration type 1 for base access934worker1 # [ 0.308248] thermal_sys: Registered thermal governor 'power_allocator'935worker1 # [ 0.308530] cpuidle: using governor menu936lb # [ 0.319652] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.937client # [ 0.300905] NET: Registered PF_NETLINK/PF_ROUTE protocol family938worker2 # [ 0.342055] ACPI: Added _OSI(Module Device)939worker2 # [ 0.342677] ACPI: Added _OSI(Processor Device)940worker1 # [ 0.310717] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5941client # [ 0.301640] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations942worker2 # [ 0.343421] ACPI: Added _OSI(Processor Aggregator Device)943worker1 # [ 0.311763] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]944client # [ 0.302171] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations945worker1 # [ 0.312518] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry946client # [ 0.303420] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations947worker1 # [ 0.313527] PCI: Using configuration type 1 for base access948client # [ 0.304159] audit: initializing netlink subsys (disabled)949worker1 # [ 0.314625] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.950client # [ 0.305325] thermal_sys: Registered thermal governor 'fair_share'951lb # [ 0.326717] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages952client # [ 0.305327] thermal_sys: Registered thermal governor 'bang_bang'953lb # [ 0.327536] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page954client # [ 0.306151] thermal_sys: Registered thermal governor 'step_wise'955client # [ 0.307092] thermal_sys: Registered thermal governor 'user_space'956client # [ 0.307907] audit: type=2000 audit(1789908366.920:1): state=initialized audit_enabled=0 res=1957worker2 # [ 0.352170] ACPI: 1 ACPI AML tables successfully acquired and loaded958client # [ 0.309153] thermal_sys: Registered thermal governor 'power_allocator'959client # [ 0.309179] cpuidle: using governor menu960lb # [ 0.332536] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages961worker1 # [ 0.321531] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages962lb # [ 0.333537] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page963client # [ 0.311416] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5964worker1 # [ 0.322516] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page965worker2 # [ 0.355930] ACPI: Interpreter enabled966client # [ 0.312377] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]967worker2 # [ 0.356573] ACPI: PM: (supports S0 S3 S4 S5)968worker2 # [ 0.357227] ACPI: Using IOAPIC for interrupt routing969client # [ 0.313153] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry970client # [ 0.314167] PCI: Using configuration type 1 for base access971worker2 # [ 0.357726] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug972worker2 # [ 0.358677] PCI: Using E820 reservations for host bridge windows973client # [ 0.315287] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.974worker1 # [ 0.327516] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages975worker1 # [ 0.328516] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page976worker2 # [ 0.361760] ACPI: Enabled 2 GPEs in block 00 to 3F977lb # [ 0.343952] ACPI: Added _OSI(Module Device)978lb # [ 0.344537] ACPI: Added _OSI(Processor Device)979lb # [ 0.345269] ACPI: Added _OSI(Processor Aggregator Device)980client # [ 0.322378] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages981client # [ 0.323152] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page982worker2 # [ 0.370399] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])983worker1 # [ 0.339782] ACPI: Added _OSI(Module Device)984worker1 # [ 0.340502] ACPI: Added _OSI(Processor Device)985worker2 # [ 0.370682] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]986client # [ 0.328152] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages987lb # [ 0.352090] ACPI: 1 ACPI AML tables successfully acquired and loaded988worker1 # [ 0.341079] ACPI: Added _OSI(Processor Aggregator Device)989client # [ 0.329152] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page990worker2 # [ 0.372239] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]991worker2 # [ 0.372798] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]992worker2 # [ 0.374050] PCI host bridge to bus 0000:00993lb # [ 0.355942] ACPI: Interpreter enabled994worker2 # [ 0.374681] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]995lb # [ 0.356550] ACPI: PM: (supports S0 S3 S4 S5)996lb # [ 0.357223] ACPI: Using IOAPIC for interrupt routing997worker2 # [ 0.375676] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]998worker1 # [ 0.347042] ACPI: 1 ACPI AML tables successfully acquired and loaded999worker2 # [ 0.376676] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1000worker2 # [ 0.377676] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1001client # [ 0.337739] ACPI: Added _OSI(Module Device)1002lb # [ 0.359622] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1003worker2 # [ 0.378676] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1004client # [ 0.338152] ACPI: Added _OSI(Processor Device)1005lb # [ 0.360537] PCI: Using E820 reservations for host bridge windows1006worker2 # [ 0.379676] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1007worker1 # [ 0.350923] ACPI: Interpreter enabled1008client # [ 0.338879] ACPI: Added _OSI(Processor Aggregator Device)1009worker1 # [ 0.351531] ACPI: PM: (supports S0 S3 S4 S5)1010worker2 # [ 0.380677] pci_bus 0000:00: root bus resource [bus 00-ff]1011worker1 # [ 0.352260] ACPI: Using IOAPIC for interrupt routing1012worker2 # [ 0.381664] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1013lb # [ 0.363633] ACPI: Enabled 2 GPEs in block 00 to 3F1014worker2 # [ 0.383117] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1015worker1 # [ 0.354586] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1016worker1 # [ 0.355516] PCI: Using E820 reservations for host bridge windows1017client # [ 0.345678] ACPI: 1 ACPI AML tables successfully acquired and loaded1018worker1 # [ 0.358672] ACPI: Enabled 2 GPEs in block 00 to 3F1019lb # [ 0.371078] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1020client # [ 0.349096] ACPI: Interpreter enabled1021lb # [ 0.371542] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1022worker2 # [ 0.385764] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1023client # [ 0.349606] ACPI: PM: (supports S0 S3 S4 S5)1024worker2 # [ 0.386688] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1025lb # [ 0.372624] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1026client # [ 0.350151] ACPI: Using IOAPIC for interrupt routing1027worker2 # [ 0.387645] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1028lb # [ 0.373658] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1029client # [ 0.350996] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1030lb # [ 0.374947] PCI host bridge to bus 0000:001031worker2 # [ 0.388604] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1032lb # [ 0.375540] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1033worker1 # [ 0.366037] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1034lb # [ 0.376535] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1035worker2 # [ 0.390584] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1036worker1 # [ 0.366522] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1037lb # [ 0.377535] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1038client # [ 0.356151] PCI: Using E820 reservations for host bridge windows1039worker1 # [ 0.367595] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1040lb # [ 0.378535] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1041client # [ 0.357222] ACPI: Enabled 2 GPEs in block 00 to 3F1042worker1 # [ 0.368638] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1043lb # [ 0.379535] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1044worker2 # [ 0.393693] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1045worker2 # [ 0.394513] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1046worker1 # [ 0.369892] PCI host bridge to bus 0000:001047lb # [ 0.380535] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1048worker2 # [ 0.395413] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1049worker1 # [ 0.370519] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1050lb # [ 0.381536] pci_bus 0000:00: root bus resource [bus 00-ff]1051worker2 # [ 0.395682] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1052worker1 # [ 0.371515] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1053lb # [ 0.382567] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1054worker1 # [ 0.372515] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1055worker2 # [ 0.397190] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1056lb # [ 0.383975] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1057worker1 # [ 0.373516] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1058worker1 # [ 0.374515] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1059worker1 # [ 0.375515] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1060client # [ 0.365761] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1061worker2 # [ 0.399683] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1062worker1 # [ 0.376516] pci_bus 0000:00: root bus resource [bus 00-ff]1063worker2 # [ 0.400508] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1064client # [ 0.366774] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1065worker2 # [ 0.401457] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1066worker1 # [ 0.377525] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1067client # [ 0.367228] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1068worker1 # [ 0.378960] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1069worker2 # [ 0.403067] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1070client # [ 0.368272] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1071lb # [ 0.386677] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1072client # [ 0.369490] PCI host bridge to bus 0000:001073lb # [ 0.387615] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1074client # [ 0.370155] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1075lb # [ 0.388619] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1076client # [ 0.371151] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1077worker2 # [ 0.405692] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1078client # [ 0.372151] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1079lb # [ 0.389859] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1080worker2 # [ 0.406683] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1081client # [ 0.373150] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1082worker2 # [ 0.407626] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1083lb # [ 0.391322] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1084client # [ 0.374150] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1085worker1 # [ 0.381550] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1086worker1 # [ 0.382527] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1087worker2 # [ 0.409075] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1088client # [ 0.375150] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1089worker1 # [ 0.383493] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1090client # [ 0.376151] pci_bus 0000:00: root bus resource [bus 00-ff]1091lb # [ 0.393569] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1092lb # [ 0.394432] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1093client # [ 0.377152] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1094worker2 # [ 0.411507] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1095worker1 # [ 0.384489] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1096worker2 # [ 0.412281] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1097lb # [ 0.395260] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1098client # [ 0.378614] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1099lb # [ 0.395541] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1100worker2 # [ 0.412698] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1101worker1 # [ 0.386225] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1102lb # [ 0.397085] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1103worker2 # [ 0.414243] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1104worker1 # [ 0.388542] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1105worker1 # [ 0.389444] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1106lb # [ 0.398543] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1107worker1 # [ 0.390310] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1108worker2 # [ 0.417371] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1109lb # [ 0.399428] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1110worker1 # [ 0.391397] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1111worker2 # [ 0.417683] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1112lb # [ 0.400277] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1113client # [ 0.381190] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1114worker2 # [ 0.418664] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1115client # [ 0.382163] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1116lb # [ 0.401135] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1117worker1 # [ 0.393028] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1118worker2 # [ 0.420145] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1119client # [ 0.383130] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1120worker1 # [ 0.394541] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1121client # [ 0.384215] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1122worker1 # [ 0.395417] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1123lb # [ 0.403542] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1124worker2 # [ 0.422693] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1125worker1 # [ 0.396307] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1126lb # [ 0.404542] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1127client # [ 0.386029] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1128worker2 # [ 0.424294] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1129lb # [ 0.405460] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1130worker1 # [ 0.397903] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1131worker2 # [ 0.424698] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1132client # [ 0.388179] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1133lb # [ 0.406918] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1134client # [ 0.389029] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1135worker2 # [ 0.426245] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1136client # [ 0.389893] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1137lb # [ 0.408542] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1138worker1 # [ 0.400545] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1139client # [ 0.390156] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1140lb # [ 0.409374] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1141worker2 # [ 0.427693] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1142worker1 # [ 0.401522] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1143lb # [ 0.410270] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1144worker2 # [ 0.428530] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1145worker1 # [ 0.402471] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1146client # [ 0.391679] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1147worker2 # [ 0.429396] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1148worker2 # [ 0.429682] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1149lb # [ 0.411074] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1150worker1 # [ 0.403888] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1151client # [ 0.393178] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1152client # [ 0.394085] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1153lb # [ 0.412543] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1154worker2 # [ 0.431977] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1155worker1 # [ 0.405523] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1156client # [ 0.394912] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1157lb # [ 0.413357] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1158worker1 # [ 0.406350] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1159lb # [ 0.414221] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1160worker2 # [ 0.433697] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1161worker1 # [ 0.407278] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1162client # [ 0.396561] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1163worker2 # [ 0.434647] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1164lb # [ 0.415137] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1165worker1 # [ 0.408087] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1166worker2 # [ 0.436061] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1167lb # [ 0.417376] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1168client # [ 0.399179] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1169worker1 # [ 0.409544] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1170lb # [ 0.418206] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1171client # [ 0.400158] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1172worker1 # [ 0.410392] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1173worker2 # [ 0.437684] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1174client # [ 0.401109] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1175worker1 # [ 0.411229] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1176lb # [ 0.418558] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1177worker2 # [ 0.438519] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1178worker2 # [ 0.439698] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1179client # [ 0.402542] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1180worker1 # [ 0.412103] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1181lb # [ 0.420131] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1182worker2 # [ 0.441237] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1183lb # [ 0.421553] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1184client # [ 0.404172] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1185lb # [ 0.422384] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1186worker1 # [ 0.414488] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1187client # [ 0.405066] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1188worker1 # [ 0.415325] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1189lb # [ 0.423263] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1190client # [ 0.405879] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1191worker2 # [ 0.443299] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1192lb # [ 0.423541] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1193worker2 # [ 0.443683] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1194worker1 # [ 0.416227] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1195client # [ 0.406729] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1196worker2 # [ 0.444626] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1197lb # [ 0.425062] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1198worker1 # [ 0.417999] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1199worker2 # [ 0.446050] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1200client # [ 0.408178] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1201lb # [ 0.426843] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1202worker1 # [ 0.419523] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1203client # [ 0.409055] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1204lb # [ 0.427565] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1205worker1 # [ 0.420366] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1206client # [ 0.409903] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1207worker2 # [ 0.448145] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1208worker1 # [ 0.421247] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1209lb # [ 0.429076] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1210worker2 # [ 0.448873] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1211worker1 # [ 0.421521] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1212client # [ 0.410711] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1213worker2 # [ 0.450379] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1214lb # [ 0.430542] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1215worker1 # [ 0.423060] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1216lb # [ 0.431349] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1217client # [ 0.413129] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1218lb # [ 0.432236] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1219client # [ 0.413796] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1220worker1 # [ 0.424952] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1221lb # [ 0.433087] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1222client # [ 0.414173] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1223worker1 # [ 0.425539] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1224client # [ 0.415753] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1225worker1 # [ 0.427055] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1226lb # [ 0.435091] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1227lb # [ 0.435542] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1228client # [ 0.417157] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1229worker1 # [ 0.428568] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1230lb # [ 0.436475] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1231client # [ 0.418023] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1232worker1 # [ 0.429424] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1233client # [ 0.418914] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1234worker1 # [ 0.430266] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1235lb # [ 0.437883] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1236client # [ 0.419156] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1237lb # [ 0.439091] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1238worker1 # [ 0.431054] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1239worker2 # [ 0.450875] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1240client # [ 0.420686] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1241lb # [ 0.439748] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1242worker2 # [ 0.453434] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1243worker1 # [ 0.432522] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1244lb # [ 0.441134] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1245client # [ 0.422542] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1246worker1 # [ 0.433375] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1247worker2 # [ 0.453932] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1248client # [ 0.423173] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1249worker1 # [ 0.434260] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1250worker2 # [ 0.455505] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1251client # [ 0.424696] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1252worker1 # [ 0.435071] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1253worker2 # [ 0.456635] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1254worker1 # [ 0.436198] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1255client # [ 0.426183] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1256worker2 # [ 0.457981] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1257client # [ 0.427046] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1258worker1 # [ 0.436756] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1259worker2 # [ 0.458923] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1260client # [ 0.427893] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1261worker1 # [ 0.438526] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1262worker2 # [ 0.460725] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1263client # [ 0.428693] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1264worker2 # [ 0.461630] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1265client # [ 0.430157] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1266worker2 # [ 0.462771] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1267lb # [ 0.441726] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1268client # [ 0.431026] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1269client # [ 0.431867] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1270worker2 # [ 0.464455] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1271client # [ 0.432743] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1272lb # [ 0.445178] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1273client # [ 0.433771] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1274worker2 # [ 0.467656] ACPI: PCI: Interrupt link LNKA configured for IRQ 101275lb # [ 0.445789] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1276client # [ 0.434376] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1277worker2 # [ 0.468509] ACPI: PCI: Interrupt link LNKB configured for IRQ 101278worker2 # [ 0.469543] ACPI: PCI: Interrupt link LNKC configured for IRQ 111279lb # [ 0.447457] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1280client # [ 0.435775] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1281worker1 # [ 0.439593] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1282worker2 # [ 0.470532] ACPI: PCI: Interrupt link LNKD configured for IRQ 111283lb # [ 0.448501] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1284worker2 # [ 0.471526] ACPI: PCI: Interrupt link LNKE configured for IRQ 101285worker1 # [ 0.442957] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1286lb # [ 0.449820] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1287worker2 # [ 0.472563] ACPI: PCI: Interrupt link LNKF configured for IRQ 101288worker2 # [ 0.473519] ACPI: PCI: Interrupt link LNKG configured for IRQ 111289worker1 # [ 0.443755] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1290lb # [ 0.450799] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1291worker2 # [ 0.474518] ACPI: PCI: Interrupt link LNKH configured for IRQ 111292worker1 # [ 0.445540] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1293worker2 # [ 0.475516] ACPI: PCI: Interrupt link GSIA configured for IRQ 161294lb # [ 0.453248] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1295worker2 # [ 0.476431] ACPI: PCI: Interrupt link GSIB configured for IRQ 171296worker1 # [ 0.446774] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1297lb # [ 0.453542] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1298worker2 # [ 0.476690] ACPI: PCI: Interrupt link GSIC configured for IRQ 181299worker2 # [ 0.477668] ACPI: PCI: Interrupt link GSID configured for IRQ 191300worker1 # [ 0.447822] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1301lb # [ 0.454807] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1302worker2 # [ 0.478425] ACPI: PCI: Interrupt link GSIE configured for IRQ 201303worker1 # [ 0.448768] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1304lb # [ 0.456209] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1305worker2 # [ 0.478689] ACPI: PCI: Interrupt link GSIF configured for IRQ 211306worker2 # [ 0.479691] ACPI: PCI: Interrupt link GSIG configured for IRQ 221307client # [ 0.436972] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1308worker2 # [ 0.480705] ACPI: PCI: Interrupt link GSIH configured for IRQ 231309worker1 # [ 0.451007] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1310worker1 # [ 0.451522] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1311client # [ 0.439179] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1312worker2 # [ 0.482684] iommu: Default domain type: Translated1313lb # [ 0.459519] ACPI: PCI: Interrupt link LNKA configured for IRQ 101314worker2 # [ 0.483477] iommu: DMA domain TLB invalidation policy: lazy mode1315worker1 # [ 0.452834] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1316lb # [ 0.460329] ACPI: PCI: Interrupt link LNKB configured for IRQ 101317client # [ 0.440253] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1318worker2 # [ 0.484678] ACPI: bus type USB registered1319lb # [ 0.461646] ACPI: PCI: Interrupt link LNKC configured for IRQ 111320worker1 # [ 0.454250] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1321worker2 # [ 0.485432] usbcore: registered new interface driver usbfs1322client # [ 0.442027] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1323lb # [ 0.462640] ACPI: PCI: Interrupt link LNKD configured for IRQ 111324worker2 # [ 0.485694] usbcore: registered new interface driver hub1325worker2 # [ 0.486596] usbcore: registered new device driver usb1326lb # [ 0.463643] ACPI: PCI: Interrupt link LNKE configured for IRQ 101327client # [ 0.443326] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1328lb # [ 0.464635] ACPI: PCI: Interrupt link LNKF configured for IRQ 101329worker2 # [ 0.488205] NetLabel: Initializing1330worker1 # [ 0.457486] ACPI: PCI: Interrupt link LNKA configured for IRQ 101331client # [ 0.444430] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1332lb # [ 0.465635] ACPI: PCI: Interrupt link LNKG configured for IRQ 111333worker2 # [ 0.488677] NetLabel: domain hash size = 1281334lb # [ 0.466631] ACPI: PCI: Interrupt link LNKH configured for IRQ 111335worker1 # [ 0.458308] ACPI: PCI: Interrupt link LNKB configured for IRQ 101336worker2 # [ 0.489569] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1337client # [ 0.445388] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1338lb # [ 0.467574] ACPI: PCI: Interrupt link GSIA configured for IRQ 161339worker2 # [ 0.490415] NetLabel: unlabeled traffic allowed by default1340worker1 # [ 0.459616] ACPI: PCI: Interrupt link LNKC configured for IRQ 111341worker2 # [ 0.490688] PCI: Using ACPI for IRQ routing1342lb # [ 0.468487] ACPI: PCI: Interrupt link GSIB configured for IRQ 171343worker1 # [ 0.460611] ACPI: PCI: Interrupt link LNKD configured for IRQ 111344client # [ 0.447606] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1345lb # [ 0.469247] ACPI: PCI: Interrupt link GSIC configured for IRQ 181346worker1 # [ 0.461614] ACPI: PCI: Interrupt link LNKE configured for IRQ 101347client # [ 0.448157] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1348lb # [ 0.469549] ACPI: PCI: Interrupt link GSID configured for IRQ 191349worker1 # [ 0.462614] ACPI: PCI: Interrupt link LNKF configured for IRQ 101350lb # [ 0.470548] ACPI: PCI: Interrupt link GSIE configured for IRQ 201351worker1 # [ 0.463621] ACPI: PCI: Interrupt link LNKG configured for IRQ 111352client # [ 0.449419] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1353lb # [ 0.471519] ACPI: PCI: Interrupt link GSIF configured for IRQ 211354worker1 # [ 0.464616] ACPI: PCI: Interrupt link LNKH configured for IRQ 111355lb # [ 0.472261] ACPI: PCI: Interrupt link GSIG configured for IRQ 221356worker1 # [ 0.465549] ACPI: PCI: Interrupt link GSIA configured for IRQ 161357client # [ 0.451179] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1358lb # [ 0.472554] ACPI: PCI: Interrupt link GSIH configured for IRQ 231359worker1 # [ 0.466488] ACPI: PCI: Interrupt link GSIB configured for IRQ 171360worker1 # [ 0.467297] ACPI: PCI: Interrupt link GSIC configured for IRQ 181361lb # [ 0.474516] iommu: Default domain type: Translated1362worker1 # [ 0.467534] ACPI: PCI: Interrupt link GSID configured for IRQ 191363lb # [ 0.475118] iommu: DMA domain TLB invalidation policy: lazy mode1364client # [ 0.454999] ACPI: PCI: Interrupt link LNKA configured for IRQ 101365lb # [ 0.475784] ACPI: bus type USB registered1366worker1 # [ 0.468527] ACPI: PCI: Interrupt link GSIE configured for IRQ 201367worker1 # [ 0.469481] ACPI: PCI: Interrupt link GSIF configured for IRQ 211368lb # [ 0.476492] usbcore: registered new interface driver usbfs1369client # [ 0.456014] ACPI: PCI: Interrupt link LNKB configured for IRQ 101370lb # [ 0.477189] usbcore: registered new interface driver hub1371worker1 # [ 0.470254] ACPI: PCI: Interrupt link GSIG configured for IRQ 221372client # [ 0.456951] ACPI: PCI: Interrupt link LNKC configured for IRQ 111373lb # [ 0.477551] usbcore: registered new device driver usb1374worker1 # [ 0.470538] ACPI: PCI: Interrupt link GSIH configured for IRQ 231375client # [ 0.457975] ACPI: PCI: Interrupt link LNKD configured for IRQ 111376lb # [ 0.479220] NetLabel: Initializing1377client # [ 0.459015] ACPI: PCI: Interrupt link LNKE configured for IRQ 101378worker1 # [ 0.472464] iommu: Default domain type: Translated1379lb # [ 0.479536] NetLabel: domain hash size = 1281380client # [ 0.460043] ACPI: PCI: Interrupt link LNKF configured for IRQ 101381worker1 # [ 0.473111] iommu: DMA domain TLB invalidation policy: lazy mode1382lb # [ 0.480225] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1383worker1 # [ 0.473764] ACPI: bus type USB registered1384client # [ 0.460998] ACPI: PCI: Interrupt link LNKG configured for IRQ 111385lb # [ 0.480599] NetLabel: unlabeled traffic allowed by default1386lb # [ 0.481482] PCI: Using ACPI for IRQ routing1387worker1 # [ 0.474486] usbcore: registered new interface driver usbfs1388client # [ 0.462002] ACPI: PCI: Interrupt link LNKH configured for IRQ 111389worker1 # [ 0.475167] usbcore: registered new interface driver hub1390client # [ 0.462955] ACPI: PCI: Interrupt link GSIA configured for IRQ 161391worker1 # [ 0.475526] usbcore: registered new device driver usb1392client # [ 0.463933] ACPI: PCI: Interrupt link GSIB configured for IRQ 171393worker1 # [ 0.477303] NetLabel: Initializing1394client # [ 0.464165] ACPI: PCI: Interrupt link GSIC configured for IRQ 181395worker1 # [ 0.477521] NetLabel: domain hash size = 1281396client # [ 0.465163] ACPI: PCI: Interrupt link GSID configured for IRQ 191397worker1 # [ 0.478244] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1398client # [ 0.466163] ACPI: PCI: Interrupt link GSIE configured for IRQ 201399worker1 # [ 0.478550] NetLabel: unlabeled traffic allowed by default1400client # [ 0.467162] ACPI: PCI: Interrupt link GSIF configured for IRQ 211401worker1 # [ 0.479459] PCI: Using ACPI for IRQ routing1402client # [ 0.468162] ACPI: PCI: Interrupt link GSIG configured for IRQ 221403client # [ 0.469165] ACPI: PCI: Interrupt link GSIH configured for IRQ 231404client # [ 0.471188] iommu: Default domain type: Translated1405client # [ 0.472039] iommu: DMA domain TLB invalidation policy: lazy mode1406client # [ 0.473213] ACPI: bus type USB registered1407client # [ 0.473980] usbcore: registered new interface driver usbfs1408client # [ 0.474907] usbcore: registered new interface driver hub1409client # [ 0.475160] usbcore: registered new device driver usb1410client # [ 0.476917] NetLabel: Initializing1411client # [ 0.477157] NetLabel: domain hash size = 1281412client # [ 0.477909] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1413client # [ 0.478182] NetLabel: unlabeled traffic allowed by default1414client # [ 0.479150] PCI: Using ACPI for IRQ routing1415worker2 # [ 0.534700] pci 0000:00:01.0: vgaarb: setting as boot VGA device1416worker2 # [ 0.535672] pci 0000:00:01.0: vgaarb: bridge control possible1417worker2 # [ 0.535672] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1418worker2 # [ 0.535679] vgaarb: loaded1419worker2 # [ 0.536409] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01420worker2 # [ 0.536679] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1421worker2 # [ 0.541757] clocksource: Switched to clocksource kvm-clock1422worker2 # [ 0.543484] VFS: Disk quotas dquot_6.6.01423worker2 # [ 0.546014] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1424worker2 # [ 0.547482] pnp: PnP ACPI init1425worker2 # [ 0.548584] ACPI: IRQ 4 override to edge(!), high(!)1426lb # [ 0.525066] pci 0000:00:01.0: vgaarb: setting as boot VGA device1427worker2 # [ 0.549567] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1428lb # [ 0.525531] pci 0000:00:01.0: vgaarb: bridge control possible1429worker2 # [ 0.551079] pnp: PnP ACPI: found 6 devices1430lb # [ 0.525531] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1431lb # [ 0.525542] vgaarb: loaded1432lb # [ 0.526311] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01433lb # [ 0.526538] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1434worker1 # [ 0.523451] pci 0000:00:01.0: vgaarb: setting as boot VGA device1435worker1 # [ 0.523511] pci 0000:00:01.0: vgaarb: bridge control possible1436worker1 # [ 0.523511] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1437worker1 # [ 0.523520] vgaarb: loaded1438worker2 # [ 0.558635] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1439lb # [ 0.531633] clocksource: Switched to clocksource kvm-clock1440worker1 # [ 0.524374] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01441worker2 # [ 0.560248] clocksource: Switched to clocksource acpi_pm1442worker1 # [ 0.525149] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1443lb # [ 0.533280] VFS: Disk quotas dquot_6.6.01444worker2 # [ 0.561494] NET: Registered PF_INET protocol family1445worker2 # [ 0.562668] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1446lb # [ 0.535799] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1447worker1 # [ 0.528596] clocksource: Switched to clocksource kvm-clock1448lb # [ 0.537204] pnp: PnP ACPI init1449lb # [ 0.538037] ACPI: IRQ 4 override to edge(!), high(!)1450worker1 # [ 0.530266] VFS: Disk quotas dquot_6.6.01451lb # [ 0.539079] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1452lb # [ 0.540686] pnp: PnP ACPI: found 6 devices1453worker1 # [ 0.532735] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1454client # [ 0.523352] pci 0000:00:01.0: vgaarb: setting as boot VGA device1455worker1 # [ 0.534138] pnp: PnP ACPI init1456client # [ 0.524147] pci 0000:00:01.0: vgaarb: bridge control possible1457worker1 # [ 0.534918] ACPI: IRQ 4 override to edge(!), high(!)1458client # [ 0.524147] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1459worker1 # [ 0.535924] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1460client # [ 0.524156] vgaarb: loaded1461worker1 # [ 0.537486] pnp: PnP ACPI: found 6 devices1462client # [ 0.524943] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01463client # [ 0.525153] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1464lb # [ 0.548256] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1465lb # [ 0.549761] clocksource: Switched to clocksource acpi_pm1466lb # [ 0.550783] NET: Registered PF_INET protocol family1467worker2 # [ 0.578724] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1468client # [ 0.530230] clocksource: Switched to clocksource kvm-clock1469lb # [ 0.551975] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1470worker2 # [ 0.580167] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1471client # [ 0.531920] VFS: Disk quotas dquot_6.6.01472worker1 # [ 0.545129] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1473worker2 # [ 0.581441] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1474worker1 # [ 0.546604] clocksource: Switched to clocksource acpi_pm1475worker2 # [ 0.582799] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1476worker1 # [ 0.547608] NET: Registered PF_INET protocol family1477worker2 # [ 0.584092] TCP: Hash tables configured (established 16384 bind 16384)1478client # [ 0.534395] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1479client # [ 0.535726] pnp: PnP ACPI init1480worker1 # [ 0.548819] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1481worker2 # [ 0.585292] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1482client # [ 0.536570] ACPI: IRQ 4 override to edge(!), high(!)1483worker2 # [ 0.586672] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1484client # [ 0.537594] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1485worker2 # [ 0.587857] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1486client # [ 0.539193] pnp: PnP ACPI: found 6 devices1487worker2 # [ 0.589059] NET: Registered PF_UNIX/PF_LOCAL protocol family1488worker2 # [ 0.590042] NET: Registered PF_XDP protocol family1489worker2 # [ 0.590939] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1490worker2 # [ 0.592005] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1491worker2 # [ 0.593075] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1492worker2 # [ 0.594243] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1493worker2 # [ 0.595391] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1494worker2 # [ 0.596538] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1495lb # [ 0.568470] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1496client # [ 0.546803] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1497client # [ 0.548242] clocksource: Switched to clocksource acpi_pm1498worker2 # [ 0.598216] ACPI: \_SB_.GSIA: Enabled at IRQ 161499lb # [ 0.569889] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1500client # [ 0.549220] NET: Registered PF_INET protocol family1501lb # [ 0.571168] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1502worker2 # [ 0.600597] ACPI: \_SB_.GSIB: Enabled at IRQ 171503client # [ 0.550441] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1504lb # [ 0.572596] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1505worker1 # [ 0.565088] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1506lb # [ 0.573872] TCP: Hash tables configured (established 16384 bind 16384)1507worker2 # [ 0.602625] ACPI: \_SB_.GSIC: Enabled at IRQ 181508worker1 # [ 0.566645] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1509lb # [ 0.574996] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1510lb # [ 0.576256] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1511worker1 # [ 0.567986] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1512worker2 # [ 0.604802] ACPI: \_SB_.GSID: Enabled at IRQ 191513lb # [ 0.577350] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1514worker1 # [ 0.569312] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1515worker2 # [ 0.606513] PCI: CLS 0 bytes, default 641516lb # [ 0.578578] NET: Registered PF_UNIX/PF_LOCAL protocol family1517worker1 # [ 0.570569] TCP: Hash tables configured (established 16384 bind 16384)1518lb # [ 0.579562] NET: Registered PF_XDP protocol family1519worker2 # [ 0.607431] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1520worker1 # [ 0.571706] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1521lb # [ 0.580377] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1522worker2 # [ 0.609101] Trying to unpack rootfs image as initramfs...1523worker1 # [ 0.572934] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1524lb # [ 0.581326] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1525worker1 # [ 0.574017] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1526lb # [ 0.582255] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1527worker1 # [ 0.575237] NET: Registered PF_UNIX/PF_LOCAL protocol family1528lb # [ 0.583426] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1529worker1 # [ 0.576179] NET: Registered PF_XDP protocol family1530lb # [ 0.584505] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1531worker1 # [ 0.577023] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1532lb # [ 0.585611] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1533worker1 # [ 0.578047] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1534lb # [ 0.587342] ACPI: \_SB_.GSIA: Enabled at IRQ 161535worker1 # [ 0.579085] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1536worker1 # [ 0.580229] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1537client # [ 0.566764] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1538lb # [ 0.589661] ACPI: \_SB_.GSIB: Enabled at IRQ 171539worker1 # [ 0.581363] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1540client # [ 0.568280] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1541worker1 # [ 0.582473] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1542lb # [ 0.591808] ACPI: \_SB_.GSIC: Enabled at IRQ 181543client # [ 0.569641] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1544worker1 # [ 0.584152] ACPI: \_SB_.GSIA: Enabled at IRQ 161545client # [ 0.570954] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1546lb # [ 0.593805] ACPI: \_SB_.GSID: Enabled at IRQ 191547client # [ 0.572282] TCP: Hash tables configured (established 16384 bind 16384)1548worker1 # [ 0.586275] ACPI: \_SB_.GSIB: Enabled at IRQ 171549lb # [ 0.595544] PCI: CLS 0 bytes, default 641550client # [ 0.573426] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1551lb # [ 0.596430] Trying to unpack rootfs image as initramfs...1552worker1 # [ 0.588289] ACPI: \_SB_.GSIC: Enabled at IRQ 181553client # [ 0.574699] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1554client # [ 0.575741] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1555worker1 # [ 0.590335] ACPI: \_SB_.GSID: Enabled at IRQ 191556client # [ 0.577030] NET: Registered PF_UNIX/PF_LOCAL protocol family1557client # [ 0.578036] NET: Registered PF_XDP protocol family1558worker1 # [ 0.591991] PCI: CLS 0 bytes, default 641559client # [ 0.578904] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1560worker1 # [ 0.592885] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1561client # [ 0.579957] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1562lb # [ 0.601945] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1563worker1 # [ 0.594619] Trying to unpack rootfs image as initramfs...1564client # [ 0.580965] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1565client # [ 0.582063] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1566client # [ 0.583279] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1567client # [ 0.584461] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1568client # [ 0.586200] ACPI: \_SB_.GSIA: Enabled at IRQ 161569client # [ 0.588465] ACPI: \_SB_.GSIB: Enabled at IRQ 171570client # [ 0.590646] ACPI: \_SB_.GSIC: Enabled at IRQ 181571client # [ 0.592601] ACPI: \_SB_.GSID: Enabled at IRQ 191572client # [ 0.594342] PCI: CLS 0 bytes, default 641573client # [ 0.595322] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1574client # [ 0.597194] Trying to unpack rootfs image as initramfs...1575worker2 # [ 0.654971] Initialise system trusted keyrings1576worker2 # [ 0.655962] workingset: timestamp_bits=40 max_order=19 bucket_order=01577lb # [ 0.640951] Initialise system trusted keyrings1578lb # [ 0.645376] workingset: timestamp_bits=40 max_order=19 bucket_order=01579worker1 # [ 0.640844] Initialise system trusted keyrings1580worker1 # [ 0.641788] workingset: timestamp_bits=40 max_order=19 bucket_order=01581worker2 # [ 0.678685] Key type asymmetric registered1582worker2 # [ 0.679397] Asymmetric key parser 'x509' registered1583worker2 # [ 0.680241] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1584worker2 # [ 0.683707] io scheduler mq-deadline registered1585worker2 # [ 0.684513] io scheduler kyber registered1586worker2 # [ 0.688736] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1587worker2 # [ 0.690079] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1588client # [ 0.643542] Initialise system trusted keyrings1589client # [ 0.644468] workingset: timestamp_bits=40 max_order=19 bucket_order=01590lb # [ 0.666643] Key type asymmetric registered1591worker2 # [ 0.695347] Linux agpgart interface v0.1031592worker2 # [ 0.696130] ACPI: bus type drm_connector registered1593lb # [ 0.669323] Asymmetric key parser 'x509' registered1594lb # [ 0.670405] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1595worker2 # [ 0.699149] usbcore: registered new interface driver usbserial_generic1596worker2 # [ 0.700262] usbserial: USB Serial support registered for generic1597lb # [ 0.673480] io scheduler mq-deadline registered1598worker1 # [ 0.665735] Key type asymmetric registered1599worker1 # [ 0.666443] Asymmetric key parser 'x509' registered1600worker1 # [ 0.667359] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1601lb # [ 0.676344] io scheduler kyber registered1602worker2 # [ 0.703579] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1603worker2 # [ 0.703579] Please enable it if your BIOS has the CPPC option.1604lb # [ 0.677664] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1605worker2 # [ 0.705823] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1606worker1 # [ 0.670534] io scheduler mq-deadline registered1607lb # [ 0.678914] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1608worker1 # [ 0.671318] io scheduler kyber registered1609worker2 # [ 0.708690] drop_monitor: Initializing network drop monitor service1610worker2 # [ 0.709878] NET: Registered PF_INET6 protocol family1611worker1 # [ 0.674976] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1612worker1 # [ 0.676304] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1613lb # [ 0.685125] Linux agpgart interface v0.1031614lb # [ 0.685907] ACPI: bus type drm_connector registered1615worker2 # [ 0.715061] Segment Routing with IPv61616worker2 # [ 0.715797] In-situ OAM (IOAM) with IPv61617client # [ 0.666340] Key type asymmetric registered1618worker1 # [ 0.680215] Linux agpgart interface v0.1031619client # [ 0.667050] Asymmetric key parser 'x509' registered1620worker1 # [ 0.681005] ACPI: bus type drm_connector registered1621lb # [ 0.689777] usbcore: registered new interface driver usbserial_generic1622client # [ 0.667919] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1623worker2 # [ 0.718848] IPI shorthand broadcast: enabled1624lb # [ 0.690966] usbserial: USB Serial support registered for generic1625worker1 # [ 0.685890] usbcore: registered new interface driver usbserial_generic1626lb # [ 0.694329] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1627client # [ 0.673246] io scheduler mq-deadline registered1628worker1 # [ 0.686992] usbserial: USB Serial support registered for generic1629lb # [ 0.694329] Please enable it if your BIOS has the CPPC option.1630client # [ 0.673996] io scheduler kyber registered1631lb # [ 0.696480] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1632worker1 # [ 0.690439] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1633worker2 # [ 0.726967] sched_clock: Marking stable (591014493, 135542703)->(794814256, -68257060)1634lb # [ 0.699468] drop_monitor: Initializing network drop monitor service1635worker1 # [ 0.690439] Please enable it if your BIOS has the CPPC option.1636client # [ 0.677765] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1637lb # [ 0.700867] NET: Registered PF_INET6 protocol family1638worker1 # [ 0.692633] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1639client # [ 0.679350] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1640worker2 # [ 0.730655] registered taskstats version 11641worker2 # [ 0.731652] Loading compiled-in X.509 certificates1642lb # [ 0.704769] Segment Routing with IPv61643worker1 # [ 0.696557] drop_monitor: Initializing network drop monitor service1644worker1 # [ 0.697719] NET: Registered PF_INET6 protocol family1645client # [ 0.684529] Linux agpgart interface v0.1031646lb # [ 0.707333] In-situ OAM (IOAM) with IPv61647client # [ 0.685292] ACPI: bus type drm_connector registered1648lb # [ 0.708409] IPI shorthand broadcast: enabled1649worker1 # [ 0.700724] Segment Routing with IPv61650client # [ 0.688533] usbcore: registered new interface driver usbserial_generic1651worker1 # [ 0.703440] In-situ OAM (IOAM) with IPv61652client # [ 0.689577] usbserial: USB Serial support registered for generic1653worker1 # [ 0.704488] IPI shorthand broadcast: enabled1654client # [ 0.693139] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1655client # [ 0.693139] Please enable it if your BIOS has the CPPC option.1656lb # [ 0.716724] sched_clock: Marking stable (581014752, 135288549)->(793004695, -76701394)1657client # [ 0.695329] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1658client # [ 0.696637] drop_monitor: Initializing network drop monitor service1659client # [ 0.697759] NET: Registered PF_INET6 protocol family1660worker1 # [ 0.712638] sched_clock: Marking stable (579014790, 133396213)->(786048120, -73637117)1661lb # [ 0.721543] registered taskstats version 11662worker2 # [ 0.750573] Demotion targets for Node 0: null1663lb # [ 0.722579] Loading compiled-in X.509 certificates1664worker2 # [ 0.751587] Key type .fscrypt registered1665client # [ 0.702601] Segment Routing with IPv61666worker2 # [ 0.752330] Key type fscrypt-provisioning registered1667worker2 # [ 0.753265] ima: No TPM chip found, activating TPM-bypass!1668worker1 # [ 0.717517] registered taskstats version 11669client # [ 0.704138] In-situ OAM (IOAM) with IPv61670worker1 # [ 0.718495] Loading compiled-in X.509 certificates1671client # [ 0.706405] IPI shorthand broadcast: enabled1672worker2 # [ 0.756573] ima: Allocated hash algorithm: sha11673worker2 # [ 0.757369] ima: No architecture policies found1674worker2 # [ 0.761573] PM: Magic number: 10:31:7851675worker2 # [ 0.763142] RAS: Correctable Errors collector initialized.1676client # [ 0.714566] sched_clock: Marking stable (580014460, 134098760)->(788191529, -74078309)1677client # [ 0.719218] registered taskstats version 11678lb # [ 0.741329] Demotion targets for Node 0: null1679client # [ 0.720164] Loading compiled-in X.509 certificates1680worker2 # [ 0.771208] clk: Disabling unused clocks1681lb # [ 0.743356] Key type .fscrypt registered1682worker1 # [ 0.734999] Demotion targets for Node 0: null1683lb # [ 0.743987] Key type fscrypt-provisioning registered1684lb # [ 0.744922] ima: No TPM chip found, activating TPM-bypass!1685worker1 # [ 0.738466] Key type .fscrypt registered1686worker1 # [ 0.739142] Key type fscrypt-provisioning registered1687worker2 # [ 0.775588] PM: genpd: Disabling unused power domains1688lb # [ 0.748335] ima: Allocated hash algorithm: sha11689worker1 # [ 0.740094] ima: No TPM chip found, activating TPM-bypass!1690lb # [ 0.749084] ima: No architecture policies found1691worker1 # [ 0.742429] ima: Allocated hash algorithm: sha11692lb # [ 0.751321] PM: Magic number: 10:31:7851693worker1 # [ 0.743206] ima: No architecture policies found1694lb # [ 0.752937] RAS: Correctable Errors collector initialized.1695worker1 # [ 0.745432] PM: Magic number: 10:31:7851696worker1 # [ 0.747030] RAS: Correctable Errors collector initialized.1697client # [ 0.736580] Demotion targets for Node 0: null1698client # [ 0.739164] Key type .fscrypt registered1699client # [ 0.739838] Key type fscrypt-provisioning registered1700client # [ 0.740744] ima: No TPM chip found, activating TPM-bypass!1701lb # [ 0.762987] clk: Disabling unused clocks1702worker1 # [ 0.756098] clk: Disabling unused clocks1703client # [ 0.743135] ima: Allocated hash algorithm: sha11704lb # [ 0.765326] PM: genpd: Disabling unused power domains1705client # [ 0.743921] ima: No architecture policies found1706worker1 # [ 0.760423] PM: genpd: Disabling unused power domains1707client # [ 0.748131] PM: Magic number: 10:31:7851708client # [ 0.749756] RAS: Correctable Errors collector initialized.1709client # [ 0.761140] clk: Disabling unused clocks1710client # [ 0.761829] PM: genpd: Disabling unused power domains1711worker2 # [ 0.935097] Freeing initrd memory: 29092K1712worker2 # [ 0.938229] Freeing unused decrypted memory: 2028K1713worker2 # [ 0.940842] Freeing unused kernel image (initmem) memory: 3644K1714worker2 # [ 0.941949] Write protecting the kernel read-only data: 32768k1715worker2 # [ 0.943844] Freeing unused kernel image (text/rodata gap) memory: 1208K1716worker2 # [ 0.945376] Freeing unused kernel image (rodata/data gap) memory: 752K1717worker1 # [ 0.920824] Freeing initrd memory: 29092K1718worker1 # [ 0.923861] Freeing unused decrypted memory: 2028K1719worker1 # [ 0.926386] Freeing unused kernel image (initmem) memory: 3644K1720worker1 # [ 0.927464] Write protecting the kernel read-only data: 32768k1721worker1 # [ 0.929296] Freeing unused kernel image (text/rodata gap) memory: 1208K1722lb # [ 0.939151] Freeing initrd memory: 29092K1723worker1 # [ 0.930900] Freeing unused kernel image (rodata/data gap) memory: 752K1724lb # [ 0.942627] Freeing unused decrypted memory: 2028K1725client # [ 0.922904] Freeing initrd memory: 29096K1726lb # [ 0.945469] Freeing unused kernel image (initmem) memory: 3644K1727lb # [ 0.946590] Write protecting the kernel read-only data: 32768k1728client # [ 0.926075] Freeing unused decrypted memory: 2028K1729lb # [ 0.948516] Freeing unused kernel image (text/rodata gap) memory: 1208K1730lb # [ 0.950080] Freeing unused kernel image (rodata/data gap) memory: 752K1731client # [ 0.928788] Freeing unused kernel image (initmem) memory: 3644K1732client # [ 0.929897] Write protecting the kernel read-only data: 32768k1733client # [ 0.931819] Freeing unused kernel image (text/rodata gap) memory: 1208K1734client # [ 0.933394] Freeing unused kernel image (rodata/data gap) memory: 752K1735worker2 # [ 0.996844] x86/mm: Checked W+X mappings: passed, no W+X pages found.1736worker2 # [ 0.997965] Run /init as init process1737worker2 # [ 1.008055] systemd[1]: Inserted module 'autofs4'1738worker1 # [ 0.982131] x86/mm: Checked W+X mappings: passed, no W+X pages found.1739worker1 # [ 0.983184] Run /init as init process1740worker2 # [ 1.024501] fuse: init (API version 7.45)1741worker1 # [ 0.993210] systemd[1]: Inserted module 'autofs4'1742lb # [ 1.001854] x86/mm: Checked W+X mappings: passed, no W+X pages found.1743worker2 # [ 1.030588] ACPI: \_SB_.GSIG: Enabled at IRQ 221744lb # [ 1.002974] Run /init as init process1745worker2 # [ 1.033038] ACPI: \_SB_.GSIH: Enabled at IRQ 231746client # [ 0.984752] x86/mm: Checked W+X mappings: passed, no W+X pages found.1747client # [ 0.985844] Run /init as init process1748worker2 # [ 1.035826] ACPI: \_SB_.GSIE: Enabled at IRQ 201749worker2 # [ 1.037950] ACPI: \_SB_.GSIF: Enabled at IRQ 211750lb # [ 1.014037] systemd[1]: Inserted module 'autofs4'1751worker1 # [ 1.009560] fuse: init (API version 7.45)1752client # [ 0.996035] systemd[1]: Inserted module 'autofs4'1753worker1 # [ 1.015512] ACPI: \_SB_.GSIG: Enabled at IRQ 221754worker1 # [ 1.017863] ACPI: \_SB_.GSIH: Enabled at IRQ 231755worker1 # [ 1.020715] ACPI: \_SB_.GSIE: Enabled at IRQ 201756lb # [ 1.030687] fuse: init (API version 7.45)1757worker1 # [ 1.022914] ACPI: \_SB_.GSIF: Enabled at IRQ 211758client # [ 1.012666] fuse: init (API version 7.45)1759lb # [ 1.036548] ACPI: \_SB_.GSIG: Enabled at IRQ 221760worker2 # [ 1.065439] systemd[1]: Successfully made /usr/ read-only.1761lb # [ 1.039120] ACPI: \_SB_.GSIH: Enabled at IRQ 231762client # [ 1.018549] ACPI: \_SB_.GSIG: Enabled at IRQ 221763lb # [ 1.042215] ACPI: \_SB_.GSIE: Enabled at IRQ 201764client # [ 1.020866] ACPI: \_SB_.GSIH: Enabled at IRQ 231765lb # [ 1.044612] ACPI: \_SB_.GSIF: Enabled at IRQ 211766client # [ 1.023642] ACPI: \_SB_.GSIE: Enabled at IRQ 201767client # [ 1.025827] ACPI: \_SB_.GSIF: Enabled at IRQ 211768worker1 # [ 1.051180] systemd[1]: Successfully made /usr/ read-only.1769client # [ 1.053928] systemd[1]: Successfully made /usr/ read-only.1770lb # [ 1.077434] systemd[1]: Successfully made /usr/ read-only.1771worker2 # [ 1.401138] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1772worker2 # [ 1.407028] systemd[1]: Detected virtualization kvm.1773worker2 # [ 1.407977] systemd[1]: Detected architecture x86-64.1774worker2 # [ 1.408893] systemd[1]: Running in initrd.1775worker2 # [ 1.410046] systemd[1]: Initializing machine ID from random generator.1776worker2 # [ 1.411333] systemd[1]: Hostname set to <worker2>.1777worker1 # [ 1.387710] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1778worker1 # [ 1.399792] systemd[1]: Detected virtualization kvm.1779worker1 # [ 1.401898] systemd[1]: Detected architecture x86-64.1780worker1 # [ 1.404054] systemd[1]: Running in initrd.1781worker1 # [ 1.406647] systemd[1]: Initializing machine ID from random generator.1782lb # [ 1.413219] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1783lb # [ 1.418705] systemd[1]: Detected virtualization kvm.1784worker1 # [ 1.409540] systemd[1]: Hostname set to <worker1>.1785lb # [ 1.419638] systemd[1]: Detected architecture x86-64.1786lb # [ 1.420566] systemd[1]: Running in initrd.1787lb # [ 1.421804] systemd[1]: Initializing machine ID from random generator.1788lb # [ 1.423090] systemd[1]: Hostname set to <lb>.1789client # [ 1.390584] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1790client # [ 1.403462] systemd[1]: Detected virtualization kvm.1791client # [ 1.405604] systemd[1]: Detected architecture x86-64.1792client # [ 1.407785] systemd[1]: Running in initrd.1793client # [ 1.410414] systemd[1]: Initializing machine ID from random generator.1794client # [ 1.413349] systemd[1]: Hostname set to <client>.1795lb # [ 1.526900] systemd[1]: bpf-restrict-fs: LSM BPF program attached1796lb # [ 1.567262] systemd[1]: Queued start job for default target Initrd Default Target.1797lb # [ 1.571705] systemd[1]: Created slice Slice /system/modprobe.1798lb # [ 1.572935] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1799lb # [ 1.574404] systemd[1]: Expecting device /dev/disk/by-label/nixos...1800lb # [ 1.575559] systemd[1]: Reached target Path Units.1801lb # [ 1.576471] systemd[1]: Reached target Slice Units.1802lb # [ 1.577441] systemd[1]: Reached target Swaps.1803lb # [ 1.578275] systemd[1]: Reached target Timer Units.1804lb # [ 1.579362] systemd[1]: Listening on D-Bus System Message Bus Socket.1805lb # [ 1.580589] systemd[1]: Listening on Journal Socket (/dev/log).1806lb # [ 1.581785] systemd[1]: Listening on Journal Sockets.1807lb # [ 1.582832] systemd[1]: Listening on udev Control Socket.1808lb # [ 1.583902] systemd[1]: Listening on udev Kernel Socket.1809lb # [ 1.584904] systemd[1]: Reached target Socket Units.1810lb # [ 1.586930] systemd[1]: Starting Create List of Static Device Nodes...1811worker2 # [ 1.613684] systemd[1]: bpf-restrict-fs: LSM BPF program attached1812lb # [ 1.591375] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1813lb # [ 1.596477] systemd[1]: Starting Load Kernel Module configfs...1814lb # [ 1.611972] systemd[1]: Starting Journal Service...1815lb # [ 1.624372] systemd[1]: Starting Load Kernel Modules...1816worker2 # [ 1.666568] systemd[1]: Queued start job for default target Initrd Default Target.1817worker2 # [ 1.670840] systemd[1]: Created slice Slice /system/modprobe.1818worker1 # [ 1.633811] systemd[1]: bpf-restrict-fs: LSM BPF program attached1819lb # [ 1.631372] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1820worker2 # [ 1.671995] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1821worker2 # [ 1.673396] systemd[1]: Expecting device /dev/disk/by-label/nixos...1822worker2 # [ 1.674523] systemd[1]: Reached target Path Units.1823worker2 # [ 1.675410] systemd[1]: Reached target Slice Units.1824worker2 # [ 1.676306] systemd[1]: Reached target Swaps.1825worker2 # [ 1.677116] systemd[1]: Reached target Timer Units.1826lb # [ 1.650246] netfs: FS-Cache loaded1827worker2 # [ 1.678089] systemd[1]: Listening on D-Bus System Message Bus Socket.1828worker2 # [ 1.679335] systemd[1]: Listening on Journal Socket (/dev/log).1829worker2 # [ 1.680583] systemd[1]: Listening on Journal Sockets.1830worker2 # [ 1.681592] systemd[1]: Listening on udev Control Socket.1831worker2 # [ 1.682623] systemd[1]: Listening on udev Kernel Socket.1832lb # [ 1.654956] 9pnet: Installing 9P2000 support1833worker2 # [ 1.683594] systemd[1]: Reached target Socket Units.1834worker2 # [ 1.685354] systemd[1]: Starting Create List of Static Device Nodes...1835worker2 # [ 1.689642] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1836client # [ 1.642215] systemd[1]: bpf-restrict-fs: LSM BPF program attached1837lb # [ 1.665616] systemd[1]: Starting Coldplug All udev Devices...1838worker2 # [ 1.697732] systemd[1]: Starting Load Kernel Module configfs...1839lb # [ 1.680629] systemd[1]: Finished Create List of Static Device Nodes.1840worker2 # [ 1.711944] systemd[1]: Starting Journal Service...1841lb # [ 1.688414] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1842worker2 # [ 1.719785] systemd[1]: Starting Load Kernel Modules...1843lb # [ 1.694744] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1844worker1 # [ 1.687777] systemd[1]: Queued start job for default target Initrd Default Target.1845lb # [ 1.698160] systemd-journald[67]: Collecting audit messages is disabled.1846worker1 # [ 1.691766] systemd[1]: Created slice Slice /system/modprobe.1847lb # [ 1.700748] systemd[1]: modprobe@configfs.service: Deactivated successfully.1848worker1 # [ 1.692993] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1849worker1 # [ 1.694451] systemd[1]: Expecting device /dev/disk/by-label/nixos...1850worker1 # [ 1.695602] systemd[1]: Reached target Path Units.1851worker1 # [ 1.696525] systemd[1]: Reached target Slice Units.1852worker1 # [ 1.697463] systemd[1]: Reached target Swaps.1853worker1 # [ 1.698301] systemd[1]: Reached target Timer Units.1854worker1 # [ 1.699329] systemd[1]: Listening on D-Bus System Message Bus Socket.1855lb # [ 1.708672] systemd[1]: Finished Load Kernel Module configfs.1856worker1 # [ 1.700621] systemd[1]: Listening on Journal Socket (/dev/log).1857worker1 # [ 1.701762] systemd[1]: Listening on Journal Sockets.1858worker1 # [ 1.702846] systemd[1]: Listening on udev Control Socket.1859worker1 # [ 1.703917] systemd[1]: Listening on udev Kernel Socket.1860worker2 # [ 1.728996] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1861worker1 # [ 1.704888] systemd[1]: Reached target Socket Units.1862lb # [ 1.712093] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1863worker1 # [ 1.706640] systemd[1]: Starting Create List of Static Device Nodes...1864lb # [ 1.714764] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1865worker2 # [ 1.746430] netfs: FS-Cache loaded1866client # [ 1.696012] systemd[1]: Queued start job for default target Initrd Default Target.1867worker1 # [ 1.710237] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1868client # [ 1.700467] systemd[1]: Created slice Slice /system/modprobe.1869worker2 # [ 1.751698] 9pnet: Installing 9P2000 support1870client # [ 1.701731] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1871lb # [ 1.724392] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1872client # [ 1.703180] systemd[1]: Expecting device /dev/disk/by-label/nixos...1873worker1 # [ 1.717106] systemd[1]: Starting Load Kernel Module configfs...1874client # [ 1.704333] systemd[1]: Reached target Path Units.1875client # [ 1.705326] systemd[1]: Reached target Slice Units.1876lb # [ 1.727340] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1877client # [ 1.706282] systemd[1]: Reached target Swaps.1878client # [ 1.707135] systemd[1]: Reached target Timer Units.1879client # [ 1.708301] systemd[1]: Listening on D-Bus System Message Bus Socket.1880client # [ 1.709616] systemd[1]: Listening on Journal Socket (/dev/log).1881client # [ 1.710785] systemd[1]: Listening on Journal Sockets.1882client # [ 1.711810] systemd[1]: Listening on udev Control Socket.1883client # [ 1.712854] systemd[1]: Listening on udev Kernel Socket.1884client # [ 1.713883] systemd[1]: Reached target Socket Units.1885client # [ 1.715824] systemd[1]: Starting Create List of Static Device Nodes...1886worker1 # [ 1.731453] systemd[1]: Starting Journal Service...1887client # [ 1.721199] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1888worker2 # [ 1.774433] systemd[1]: Starting Coldplug All udev Devices...1889client # [ 1.726819] systemd[1]: Starting Load Kernel Module configfs...1890worker1 # [ 1.745531] systemd[1]: Starting Load Kernel Modules...1891lb # [ 1.755652] systemd[1]: Finished Load Kernel Modules.1892worker2 # [ 1.787748] systemd-journald[67]: Collecting audit messages is disabled.1893client # [ 1.741309] systemd[1]: Starting Journal Service...1894lb # [ 1.763530] systemd[1]: Starting Apply Kernel Variables...1895worker2 # [ 1.796669] systemd[1]: Finished Create List of Static Device Nodes.1896worker1 # [ 1.750501] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1897lb # [ 1.775449] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1898worker2 # [ 1.803097] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1899worker1 # [ 1.768256] netfs: FS-Cache loaded1900client # [ 1.755207] systemd[1]: Starting Load Kernel Modules...1901worker1 # [ 1.773114] 9pnet: Installing 9P2000 support1902lb # [ 1.784719] systemd[1]: Starting Create Static Device Nodes in /dev...1903worker2 # [ 1.813665] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1904worker2 # [ 1.820700] systemd[1]: modprobe@configfs.service: Deactivated successfully.1905worker1 # [ 1.785685] systemd[1]: Starting Coldplug All udev Devices...1906client # [ 1.762194] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1907client # [ 1.779137] netfs: FS-Cache loaded1908worker2 # [ 1.829118] systemd[1]: Finished Load Kernel Module configfs.1909lb # [ 1.804874] systemd[1]: Finished Apply Kernel Variables.1910client # [ 1.784023] 9pnet: Installing 9P2000 support1911worker1 # [ 1.801598] systemd[1]: Finished Create List of Static Device Nodes.1912worker2 # [ 1.837521] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1913worker2 # [ 1.841685] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1914worker1 # [ 1.808163] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1915client # [ 1.797205] systemd[1]: Starting Coldplug All udev Devices...1916lb # [ 1.820394] systemd[1]: Finished Create Static Device Nodes in /dev.1917worker2 # [ 1.849839] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1918lb # [ 1.687517] systemd-modules-load[68]: Inserted module 'dm_mod'1919worker2 # [ 1.851177] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1920lb # [ 1.688921] systemd-modules-load[68]: Inserted module 'virtio_balloon'1921worker1 # [ 1.815903] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1922lb # [ 1.690277] systemd-modules-load[68]: Inserted module 'virtio_gpu'1923lb # [ 1.827543] systemd[1]: Started Journal Service.1924worker1 # [ 1.821911] systemd[1]: modprobe@configfs.service: Deactivated successfully.1925worker1 # [ 1.824741] systemd-journald[67]: Collecting audit messages is disabled.1926client # [ 1.813620] systemd[1]: Finished Create List of Static Device Nodes.1927lb # [ 1.702211] systemd[1]: Reached target Preparation for Local File Systems.1928lb # [ 1.703242] systemd[1]: Reached target Local File Systems.1929worker1 # [ 1.830500] systemd[1]: Finished Load Kernel Module configfs.1930lb # [ 1.706851] systemd[1]: Starting Create System Files and Directories...1931client # [ 1.820255] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1932worker1 # [ 1.837013] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1933client # [ 1.826048] systemd-journald[67]: Collecting audit messages is disabled.1934lb # [ 1.713436] systemd[1]: Starting Rule-based Manager for Device Events and Files...1935worker1 # [ 1.840567] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1936client # [ 1.829548] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1937client # [ 1.833927] systemd[1]: modprobe@configfs.service: Deactivated successfully.1938worker1 # [ 1.848648] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1939worker2 # [ 1.885275] systemd[1]: Finished Load Kernel Modules.1940worker1 # [ 1.852454] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1941client # [ 1.841669] systemd[1]: Finished Load Kernel Module configfs.1942worker2 # [ 1.893822] systemd[1]: Starting Apply Kernel Variables...1943client # [ 1.846579] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1944client # [ 1.849044] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1945lb # [ 1.743203] systemd[1]: Finished Create System Files and Directories.1946client # [ 1.858317] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1947client # [ 1.860260] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1948worker2 # [ 1.910270] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1949worker2 # [ 1.920261] systemd[1]: Starting Create Static Device Nodes in /dev...1950worker1 # [ 1.886037] systemd[1]: Finished Load Kernel Modules.1951worker2 # [ 1.787670] systemd-modules-load[68]: Inserted module 'dm_mod'1952worker2 # [ 1.792087] systemd-modules-load[68]: Inserted module 'virtio_balloon'1953worker2 # [ 1.793203] systemd-modules-load[68]: Inserted module 'virtio_gpu'1954lb # [ 1.765284] systemd-udevd[83]: Using default interface naming scheme 'v261'.1955worker1 # [ 1.895658] systemd[1]: Starting Apply Kernel Variables...1956worker2 # [ 1.934948] systemd[1]: Started Journal Service.1957client # [ 1.891736] systemd[1]: Finished Load Kernel Modules.1958worker1 # [ 1.907554] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1959worker2 # [ 1.813473] systemd[1]: Finished Apply Kernel Variables.1960client # [ 1.899354] systemd[1]: Starting Apply Kernel Variables...1961lb # [ 1.789938] systemd[1]: Started Rule-based Manager for Device Events and Files.1962worker1 # [ 1.919486] systemd[1]: Starting Create Static Device Nodes in /dev...1963worker2 # [ 1.831192] systemd[1]: Finished Create Static Device Nodes in /dev.1964client # [ 1.916483] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1965worker2 # [ 1.832287] systemd[1]: Reached target Preparation for Local File Systems.1966worker2 # [ 1.833316] systemd[1]: Reached target Local File Systems.1967worker2 # [ 1.836104] systemd[1]: Starting Create System Files and Directories...1968worker2 # [ 1.840709] systemd[1]: Starting Rule-based Manager for Device Events and Files...1969worker1 # [ 1.941742] systemd[1]: Finished Apply Kernel Variables.1970client # [ 1.931207] systemd[1]: Starting Create Static Device Nodes in /dev...1971worker1 # [ 1.818312] systemd-modules-load[68]: Inserted module 'dm_mod'[ 1.952780] systemd[1]: Started Journal Service.1972worker1 # 1973worker1 # [ 1.820352] systemd-modules-load[68]: Inserted module 'virtio_balloon'1974client # [ 1.940237] systemd[1]: Finished Apply Kernel Variables.1975worker1 # [ 1.823323] systemd-modules-load[68]: Inserted module 'virtio_gpu'1976worker1 # [ 1.830139] systemd[1]: Finished Create Static Device Nodes in /dev.1977lb # [ 1.837692] systemd[1]: Finished Coldplug All udev Devices.1978client # [ 1.951609] systemd[1]: Started Journal Service.1979lb # [ 1.838642] systemd[1]: Reached target System Initialization.1980lb # [ 1.839489] systemd[1]: Reached target Basic System.1981worker1 # [ 1.834902] systemd[1]: Reached target Preparation for Local File Systems.1982client # [ 1.819266] systemd-modules-load[68]: Inserted module 'dm_mod'1983client # [ 1.822993] systemd-modules-load[68]: Inserted module 'virtio_balloon'1984worker1 # [ 1.837945] systemd[1]: Reached target Local File Systems.1985worker2 # [ 1.872498] systemd[1]: Finished Create System Files and Directories.1986worker1 # [ 1.839133] systemd[1]: Starting Create System Files and Directories...1987client # [ 1.825434] systemd-modules-load[68]: Inserted module 'virtio_gpu'1988worker1 # [ 1.844766] systemd[1]: Starting Rule-based Manager for Device Events and Files...1989client # [ 1.836187] systemd[1]: Finished Create Static Device Nodes in /dev.1990client # [ 1.837805] systemd[1]: Reached target Preparation for Local File Systems.1991client # [ 1.841057] systemd[1]: Reached target Local File Systems.1992client # [ 1.844061] systemd[1]: Starting Create System Files and Directories...1993client # [ 1.849084] systemd[1]: Starting Rule-based Manager for Device Events and Files...1994worker2 # [ 1.902076] systemd-udevd[83]: Using default interface naming scheme 'v261'.1995worker1 # [ 1.875119] systemd[1]: Finished Create System Files and Directories.1996client # [ 1.876770] systemd[1]: Finished Create System Files and Directories.1997worker1 # [ 1.894313] systemd-udevd[83]: Using default interface naming scheme 'v261'.1998worker2 # [ 1.930436] systemd[1]: Started Rule-based Manager for Device Events and Files.1999client # [ 1.900241] systemd-udevd[83]: Using default interface naming scheme 'v261'.2000worker1 # [ 1.917508] systemd[1]: Started Rule-based Manager for Device Events and Files.
loading 1,634 hidden lines…
3635worker2 # [ 9.583923] systemd[1]: Finished linger-users.service.3636worker1 # [ 9.550990] systemd[1]: Reached target User and Group Name Lookups.3637worker1 # [ 9.553240] systemd[1]: Starting User Login Management...3638lb # [ 9.562988] nsncd[523]: Sep 20 12:46:16.725 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3639worker2 # [ 9.593166] systemd[1]: Finished resolvconf update.3640worker1 # [ 9.559285] systemd[1]: Finished Import lastlog data into lastlog2 database.3641worker2 # [ 9.593879] systemd[1]: Reached target Preparation for Network.3642worker2 # [ 9.598171] systemd[1]: Starting DHCP Client...3643lb # [ 9.570400] systemd[1]: Started Name Service Cache Daemon (nsncd).3644worker2 # [ 9.601158] systemd[1]: Starting Address configuration of eth1...3645worker2 # [ 9.605201] systemd[1]: Starting Extra networking commands....3646lb # [ 9.491830] parport_pc 00:02: reported by Plug and Play ACPI3647client # [ 9.571383] dhcpcd[557]: dhcpcd-10.3.2 starting3648lb # [ 9.598336] systemd[1]: Reached target Host and Network Name Lookups.3649client # [ 9.578378] dhcpcd[566]: dev: loaded udev3650lb # [ 9.599364] systemd[1]: Reached target User and Group Name Lookups.3651lb # [ 9.491909] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]3652lb # [ 9.512097] Console: switching to colour dummy device 80x253653lb # [ 9.610077] systemd[1]: Starting D-Bus System Message Bus...3654worker1 # [ 9.606523] dbus-broker-launch[537]: Looking up NSS user entry for 'systemd-timesync'...3655client # [ 9.729985] 8021q: 802.1Q VLAN Support v1.83656worker1 # [ 9.620200] dbus-broker-launch[537]: NSS returned no entry for 'systemd-timesync'3657worker1 # [ 9.621255] dbus-broker-launch[537]: Invalid user-name in /nix/store/pzs6i23mwy5m8gakj05x4d0nyhml04hg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3658lb # [ 9.773159] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt3659client # [ 9.624040] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3660lb # [ 9.773314] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD3661worker1 # [ 9.650614] systemd[1]: Stopped target Host and Network Name Lookups.3662lb # [ 9.793141] [drm] Found bochs VGA, ID 0xb0c5.3663lb # [ 9.793144] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000.3664worker1 # [ 9.653150] systemd[1]: Stopping Host and Network Name Lookups...3665worker1 # [ 9.656476] systemd[1]: Stopped target User and Group Name Lookups.3666lb # [ 9.802786] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input63667worker1 # [ 9.659326] systemd[1]: Stopping User and Group Name Lookups...3668worker1 # [ 9.662784] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3669worker2 # [ 9.697303] network-addresses-eth1-start[630]: adding address 192.168.1.4/24... done3670worker1 # [ 9.664754] systemd[1]: Started D-Bus System Message Bus.3671lb # [ 9.807519] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input53672worker1 # [ 9.667198] systemd[1]: nscd.service: Deactivated successfully.3673lb # [ 9.675853] systemd[1]: Starting User Login Management...3674worker1 # [ 9.669485] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3675worker1 # [ 9.677694] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3676worker2 # [ 9.714421] network-addresses-eth1-start[630]: adding address 2001:db8:1::4/64... done3677lb # [ 9.833552] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic3678lb # [ 9.834212] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 03679worker1 # [ 9.694080] systemd-logind[557]: New seat seat0.3680worker2 # [ 9.735104] systemd[1]: Finished Address configuration of eth1.3681worker1 # [ 9.702174] systemd-logind[557]: Watching system buttons on /dev/input/event2 (Power Button)3682worker1 # [ 9.703874] systemd-logind[557]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3683client # [ 9.824968] cfg80211: Loading compiled-in X.509 certificates for regulatory database3684worker1 # [ 9.705834] systemd-logind[557]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3685worker1 # [ 9.710189] systemd[1]: Started User Login Management.3686client # [ 9.698833] systemd[1]: Finished nftables firewall.3687worker1 # [ 9.714723] dbus-broker-launch[537]: Ready3688client # [ 9.700606] systemd[1]: Reached target Preparation for Network.3689worker1 # [ 9.717938] systemd[1]: Starting linger-users.service...3690client # [ 9.704059] systemd[1]: Starting Address configuration of eth1...3691client # [ 9.707913] systemd[1]: Starting Extra networking commands....3692lb # [ 9.734542] systemd[1]: Finished Import lastlog data into lastlog2 database.3693worker2 # [ 9.764375] dhcpcd[638]: dhcpcd-10.3.2 starting3694client # [ 9.858291] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3695worker2 # [ 9.773378] dhcpcd[691]: dev: loaded udev3696client # [ 9.858988] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3697client # [ 9.862612] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23698client # [ 9.863510] cfg80211: failed to load regulatory.db3699worker2 # [ 9.783264] systemd[1]: Finished Extra networking commands..3700worker2 # [ 9.785368] systemd[1]: Reached target Network.3701worker2 # [ 9.789294] systemd[1]: Starting Permit User Sessions...3702worker1 # [ 9.754651] nsncd[605]: Sep 20 12:46:16.795 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3703worker1 # [ 9.756967] systemd[1]: Started Name Service Cache Daemon (nsncd).3704worker1 # [ 9.758370] systemd[1]: Reached target Host and Network Name Lookups.3705worker1 # [ 9.759691] systemd[1]: Reached target User and Group Name Lookups.3706worker2 # [ 9.936016] 8021q: 802.1Q VLAN Support v1.83707worker2 # [ 9.936449] 8021q: adding VLAN 0 to HW filter on device eth13708worker1 # [ 9.773210] systemd[1]: linger-users.service: Deactivated successfully.3709worker1 # [ 9.774234] systemd[1]: Finished linger-users.service.3710worker1 # [ 9.778150] systemd[1]: Finished resolvconf update.3711worker1 # [ 9.779462] systemd[1]: Reached target Preparation for Network.3712worker1 # [ 9.783979] systemd[1]: Starting DHCP Client...3713worker2 # [ 9.818134] systemd[1]: Finished Permit User Sessions.3714worker1 # [ 9.786270] systemd[1]: Starting Address configuration of eth1...3715worker2 # [ 9.822222] systemd[1]: Started Getty on tty1.3716worker1 # [ 9.790282] systemd[1]: Starting Extra networking commands....3717worker2 # [ 9.824748] systemd[1]: Reached target Login Prompts.3718client # [ 9.780711] dhcpcd[588]: /nix/store/gz6c2i5x5b1lmdy71d4h3i8kd7nwnnl7-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (585) - Operation not permitted3719client # [ 9.782593] dhcpcd[588]: .resolvconf-wrapped: clearing stale lock pid 5853720client # [ 9.919311] 8021q: adding VLAN 0 to HW filter on device eth13721worker2 # [ 9.839052] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3722client # [ 9.802650] network-addresses-eth1-start[578]: adding address 192.168.1.1/24... done3723client # [ 9.949958] 8021q: adding VLAN 0 to HW filter on device eth03724client # [ 9.818139] network-addresses-eth1-start[578]: adding address 2001:db8:1::1/64... done3725client # [ 9.819656] dhcpcd[566]: eth0: waiting for carrier3726client # [ 9.820829] dhcpcd[566]: eth0: carrier acquired3727lb # [ 9.843278] systemd[1]: Stopped target Host and Network Name Lookups.3728lb # [ 9.845502] dbus-broker-launch[550]: Looking up NSS user entry for 'systemd-timesync'...3729lb # [ 9.848593] systemd[1]: Stopping Host and Network Name Lookups...3730lb # [ 9.850910] systemd[1]: Stopped target User and Group Name Lookups.3731client # [ 9.832595] dhcpcd[566]: DUID 00:01:00:01:32:42:92:18:52:54:00:12:34:563732lb # [ 9.853356] systemd[1]: Stopping User and Group Name Lookups...3733client # [ 9.834071] dhcpcd[566]: eth0: IAID 00:12:34:563734lb # [ 9.854577] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...3735client # [ 9.834694] dhcpcd[566]: eth0: adding address fe80::5054:ff:fe12:34563736lb # [ 9.856834] systemd[1]: nscd.service: Deactivated successfully.3737lb # [ 9.858605] systemd[1]: Stopped Name Service Cache Daemon (nsncd).3738client # [ 9.839377] systemd[1]: Finished Address configuration of eth1.3739lb # [ 9.860801] dbus-broker-launch[550]: NSS returned no entry for 'systemd-timesync'3740lb # [ 9.862601] dbus-broker-launch[550]: Invalid user-name in /nix/store/0vgm8r903b3kyr8fcdjkv3g9zyy4h8rn-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"3741worker2 # [ 10.029469] cfg80211: Loading compiled-in X.509 certificates for regulatory database3742client # [ 9.866705] systemd[1]: Finished Extra networking commands..3743client # [ 9.869095] systemd[1]: Reached target Network.3744client # [ 9.871297] systemd[1]: Starting Permit User Sessions...3745worker2 # [ 10.056396] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3746worker1 # [ 9.886916] network-addresses-eth1-start[633]: adding address 192.168.1.3/24... done3747worker2 # [ 10.057214] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3748lb # [ 9.893944] systemd[1]: Starting Name Service Cache Daemon (nsncd)...3749worker2 # [ 10.060346] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23750worker2 # [ 10.061221] cfg80211: failed to load regulatory.db3751lb # [ 9.899652] systemd-logind[558]: New seat seat0.3752lb # [ 9.903308] systemd[1]: Started D-Bus System Message Bus.3753lb # [ 9.904351] systemd[1]: Started User Login Management.3754worker1 # [ 9.904051] network-addresses-eth1-start[633]: adding address 2001:db8:1::3/64... done3755client # [ 9.896412] systemd[1]: Finished Permit User Sessions.3756client # [ 9.900082] systemd[1]: Started Getty on tty1.3757client # [ 9.900923] systemd[1]: Reached target Login Prompts.3758lb # [ 9.924176] systemd[1]: Starting linger-users.service...3759worker1 # [ 9.924190] systemd[1]: Finished Address configuration of eth1.3760worker2 # [ 10.112066] 8021q: adding VLAN 0 to HW filter on device eth03761worker2 # [ 9.977813] dhcpcd[691]: eth0: waiting for carrier3762worker2 # [ 9.978619] dhcpcd[691]: eth0: carrier acquired3763worker1 # [ 9.947631] dhcpcd[640]: dhcpcd-10.3.2 starting3764worker2 # [ 9.988546] dhcpcd[691]: DUID 00:01:00:01:32:42:92:18:52:54:00:12:34:563765worker2 # [ 9.989722] dhcpcd[691]: eth0: IAID 00:12:34:563766worker2 # [ 9.990454] dhcpcd[691]: eth0: adding address fe80::5054:ff:fe12:34563767worker1 # [ 9.957329] dhcpcd[695]: dev: loaded udev3768worker1 # [ 9.963461] systemd[1]: Finished Extra networking commands..3769worker1 # [ 9.965303] systemd[1]: Reached target Network.3770worker1 # [ 9.968448] systemd[1]: Starting Permit User Sessions...3771lb # [ 9.974937] dbus-broker-launch[550]: Ready3772lb # [ 9.980367] systemd[1]: Starting Virtual Console Setup...3773worker1 # [ 10.116528] 8021q: 802.1Q VLAN Support v1.83774worker1 # [ 10.116995] 8021q: adding VLAN 0 to HW filter on device eth13775worker1 # [ 9.997328] systemd[1]: Finished Permit User Sessions.3776worker1 # [ 9.999705] systemd[1]: Started Getty on tty1.3777worker1 # [ 10.000819] systemd[1]: Reached target Login Prompts.3778lb # [ 10.014827] nsncd[604]: Sep 20 12:46:17.183 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"3779lb # [ 10.018683] systemd[1]: Started Name Service Cache Daemon (nsncd).3780worker1 # [ 10.015050] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3781lb # [ 10.034361] systemd[1]: linger-users.service: Deactivated successfully.3782lb # [ 10.036488] systemd[1]: Finished linger-users.service.3783lb # [ 10.042596] systemd[1]: Reached target Host and Network Name Lookups.3784lb # [ 10.044308] systemd[1]: Reached target User and Group Name Lookups.3785lb # [ 10.063067] systemd[1]: Finished resolvconf update.3786lb # [ 10.064792] systemd-logind[558]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard)3787lb # [ 10.067374] systemd[1]: Reached target Preparation for Network.3788worker1 # [ 10.204053] cfg80211: Loading compiled-in X.509 certificates for regulatory database3789worker1 # [ 10.230317] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3790worker1 # [ 10.231093] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3791worker1 # [ 10.234152] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23792worker1 # [ 10.235027] cfg80211: failed to load regulatory.db3793lb # [ 10.251092] Console: switching to colour frame buffer device 160x503794worker1 # [ 10.285031] 8021q: adding VLAN 0 to HW filter on device eth03795worker1 # [ 10.152844] dhcpcd[695]: eth0: waiting for carrier3796worker1 # [ 10.153617] dhcpcd[695]: eth0: carrier acquired3797worker1 # [ 10.162762] dhcpcd[695]: DUID 00:01:00:01:32:42:92:19:52:54:00:12:34:563798worker1 # [ 10.163966] dhcpcd[695]: eth0: IAID 00:12:34:563799worker1 # [ 10.164678] dhcpcd[695]: eth0: adding address fe80::5054:ff:fe12:34563800lb # [ 10.324838] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device3801lb # [ 10.075950] systemd[1]: Starting DHCP Client...3802worker2 # [ 10.222189] dhcpcd[691]: eth0: soliciting a DHCP lease3803lb # [ 10.196208] systemd[1]: Starting Address configuration of eth1...3804lb # [ 10.198634] systemd[1]: Starting Extra networking commands....3805lb # [ 10.200549] systemd-logind[558]: Watching system buttons on /dev/input/event2 (Power Button)3806lb # [ 10.204306] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3807lb # [ 10.207922] systemd[1]: Stopped Virtual Console Setup.3808worker2 # [ 10.380921] NET: Registered PF_PACKET protocol family3809worker2 # [ 10.251865] dhcpcd[691]: eth0: offered 10.0.2.15 from 10.0.2.23810worker2 # [ 10.257394] dhcpcd[691]: eth0: probing address 10.0.2.15/243811lb # [ 10.241723] systemd[1]: Starting Virtual Console Setup...3812lb # [ 10.243640] network-addresses-eth1-start[638]: adding address 192.168.1.2/24... done3813lb # [ 10.266797] network-addresses-eth1-start[638]: adding address 2001:db8:1::2/64... done3814lb # [ 10.424991] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)3815lb # [ 10.304323] systemd[1]: Finished Address configuration of eth1.3816lb # [ 10.507142] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0)3817lb # [ 10.514802] ppdev: user-space parallel port driver3818lb # [ 10.443093] systemd[1]: Finished Extra networking commands..3819lb # [ 10.447208] systemd[1]: Reached target Network.3820lb # [ 10.452203] dhcpcd[648]: dhcpcd-10.3.2 starting3821lb # [ 10.457205] systemd[1]: Starting PostgreSQL Server...3822client: (finished: waiting for unit network-addresses-eth1.service, in 11.12 seconds)3823lb # [ 10.462501] systemd-logind[558]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)3824client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }3825lb # [ 10.464906] dhcpcd[713]: dev: loaded udev3826lb # [ 10.471482] systemd[1]: Starting Permit User Sessions...3827lb # [ 10.635045] 8021q: 802.1Q VLAN Support v1.83828lb # [ 10.641725] 8021q: adding VLAN 0 to HW filter on device eth13829client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.04 seconds)3830lb: waiting for unit network-addresses-eth1.service3831lb: waiting for the VM to finish booting3832lb: Guest shell says: b'Spawning backdoor root shell...\n'3833lb: connected to guest root shell3834lb: (connecting took 0.00 seconds)3835lb: (finished: waiting for the VM to finish booting, in 0.00 seconds)3836lb # [ 10.560197] systemd[1]: Finished Permit User Sessions.3837lb # [ 10.576901] systemd[1]: Started Getty on tty1.3838lb # [ 10.580639] systemd[1]: Reached target Login Prompts.3839lb: (finished: waiting for unit network-addresses-eth1.service, in 0.16 seconds)3840lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }3841lb # [ 10.667424] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.3842lb # [ 10.693537] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.3843lb # [ 10.694590] systemd[1]: Stopped Virtual Console Setup.3844lb # [ 10.727197] systemd[1]: Starting Virtual Console Setup...3845lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.10 seconds)3846worker1: waiting for unit network-addresses-eth1.service3847worker1: waiting for the VM to finish booting3848worker1: Guest shell says: b'Spawning backdoor root shell...\n'3849worker1: connected to guest root shell3850worker1: (connecting took 0.00 seconds)3851worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds)3852lb # [ 10.966026] cfg80211: Loading compiled-in X.509 certificates for regulatory database3853worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.10 seconds)3854worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }3855lb # [ 11.004810] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'3856lb # [ 11.006001] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'3857lb # [ 11.010426] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -23858lb # [ 11.011328] cfg80211: failed to load regulatory.db3859worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3860worker2: waiting for unit network-addresses-eth1.service3861worker2: waiting for the VM to finish booting3862worker2: Guest shell says: b'Spawning backdoor root shell...\n'3863worker2: connected to guest root shell3864worker2: (connecting took 0.00 seconds)3865worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds)3866lb # [ 11.034951] kvm_amd: TSC scaling supported3867lb # [ 11.035531] kvm_amd: Nested Virtualization enabled3868lb # [ 11.036065] kvm_amd: Nested Paging enabled3869lb # [ 11.037759] kvm_amd: LBR virtualization supported3870lb # [ 11.038845] kvm_amd: Virtual VMLOAD VMSAVE supported3871lb # [ 11.039719] kvm_amd: Virtual GIF supported3872lb # [ 11.040186] kvm_amd: Virtual NMI enabled3873worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds)3874worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }3875lb # [ 10.942428] postgresql-pre-start[733]: The files belonging to this database system will be owned by user "postgres".3876lb # [ 10.943782] postgresql-pre-start[733]: This user must also own the server process.3877lb # [ 10.955067] postgresql-pre-start[733]: The database cluster will be initialized with locale "en_US.UTF-8".3878lb # [ 10.956271] postgresql-pre-start[733]: The default database encoding has accordingly been set to "UTF8".3879lb # [ 10.957382] postgresql-pre-start[733]: The default text search configuration will be set to "english".3880lb # [ 10.958526] postgresql-pre-start[733]: Data page checksums are enabled.3881lb # [ 10.959382] postgresql-pre-start[733]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok3882lb # [ 10.960648] postgresql-pre-start[733]: creating subdirectories ... ok3883lb # [ 10.963133] postgresql-pre-start[733]: selecting dynamic shared memory implementation ... posix3884worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.03 seconds)3885lb: waiting for unit niks3.service3886lb # [ 11.143137] EDAC MC: Ver: 3.0.03887lb # [ 11.144693] 8021q: adding VLAN 0 to HW filter on device eth03888lb # [ 11.010782] dhcpcd[713]: eth0: waiting for carrier3889lb # [ 11.013918] dhcpcd[713]: libudev: received NULL device3890lb # [ 11.015372] dhcpcd[713]: libudev: received NULL device3891lb # [ 11.016619] dhcpcd[713]: eth0: carrier acquired3892lb # [ 11.035995] dhcpcd[713]: DUID 00:01:00:01:32:42:92:1a:52:54:00:12:34:563893lb # [ 11.037797] dhcpcd[713]: eth0: IAID 00:12:34:563894lb # [ 11.039286] dhcpcd[713]: eth0: adding address fe80::5054:ff:fe12:34563895lb # [ 11.136405] postgresql-pre-start[733]: selecting default "max_connections" ... 1003896lb # [ 11.219148] systemd-vconsole-setup[735]: Configuration of first virtual console was skipped, ignoring remaining ones.3897lb # [ 11.224356] systemd[1]: Finished Virtual Console Setup.3898lb # [ 11.230218] postgresql-pre-start[733]: selecting default "shared_buffers" ... 128MB3899worker1 # [ 11.328335] dhcpcd[695]: eth0: soliciting a DHCP lease3900worker1 # [ 11.475563] NET: Registered PF_PACKET protocol family3901worker1 # [ 11.346468] dhcpcd[695]: eth0: offered 10.0.2.15 from 10.0.2.23902worker1 # [ 11.349413] dhcpcd[695]: eth0: probing address 10.0.2.15/243903client # [ 11.623827] dhcpcd[566]: eth0: soliciting a DHCP lease3904client # [ 11.783123] NET: Registered PF_PACKET protocol family3905client # [ 11.656979] dhcpcd[566]: eth0: offered 10.0.2.15 from 10.0.2.23906client # [ 11.661366] dhcpcd[566]: eth0: probing address 10.0.2.15/243907client # [ 11.965428] dhcpcd[566]: eth0: soliciting an IPv6 router3908client # [ 11.968552] dhcpcd[566]: eth0: Router Advertisement from fe80::23909client # [ 11.970617] dhcpcd[566]: eth0: adding address fec0::5054:ff:fe12:3456/643910client # [ 11.972737] dhcpcd[566]: eth0: adding route to fec0::/643911client # [ 11.974662] dhcpcd[566]: eth0: adding default route via fe80::23912worker2 # [ 12.037403] dhcpcd[691]: eth0: soliciting an IPv6 router3913worker2 # [ 12.040588] dhcpcd[691]: eth0: Router Advertisement from fe80::23914worker2 # [ 12.042635] dhcpcd[691]: eth0: adding address fec0::5054:ff:fe12:3456/643915worker2 # [ 12.044892] dhcpcd[691]: eth0: adding route to fec0::/643916worker2 # [ 12.046855] dhcpcd[691]: eth0: adding default route via fe80::23917worker1 # [ 12.284552] dhcpcd[695]: eth0: soliciting an IPv6 router3918worker1 # [ 12.287801] dhcpcd[695]: eth0: Router Advertisement from fe80::23919worker1 # [ 12.290309] dhcpcd[695]: eth0: adding address fec0::5054:ff:fe12:3456/643920worker1 # [ 12.292747] dhcpcd[695]: eth0: adding route to fec0::/643921worker1 # [ 12.294630] dhcpcd[695]: eth0: adding default route via fe80::23922lb # [ 12.823719] dhcpcd[713]: eth0: soliciting a DHCP lease3923lb # [ 12.977814] NET: Registered PF_PACKET protocol family3924lb # [ 12.849559] dhcpcd[713]: eth0: offered 10.0.2.15 from 10.0.2.23925lb # [ 12.852165] dhcpcd[713]: eth0: probing address 10.0.2.15/243926lb # [ 13.064245] postgresql-pre-start[733]: selecting default time zone ... UTC3927lb # [ 13.068428] postgresql-pre-start[733]: creating configuration files ... ok3928lb # [ 13.324459] postgresql-pre-start[733]: running bootstrap script ... ok3929lb # [ 13.383969] dhcpcd[713]: eth0: soliciting an IPv6 router3930lb # [ 13.385185] dhcpcd[713]: eth0: Router Advertisement from fe80::23931lb # [ 13.386031] dhcpcd[713]: eth0: adding address fec0::5054:ff:fe12:3456/643932lb # [ 13.386913] dhcpcd[713]: eth0: adding route to fec0::/643933lb # [ 13.387687] dhcpcd[713]: eth0: adding default route via fe80::23934lb # [ 13.869839] postgresql-pre-start[733]: performing post-bootstrap initialization ... ok3935lb # [ 13.986395] postgresql-pre-start[733]: syncing data to disk ... ok3936lb # [ 13.988193] postgresql-pre-start[733]: initdb: warning: enabling "trust" authentication for local connections3937lb # [ 13.989399] postgresql-pre-start[733]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3938lb # [ 13.991240] postgresql-pre-start[733]: Success. You can now start the database server using:3939lb # [ 13.992250] postgresql-pre-start[733]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3940lb # [ 14.086897] postgres[799]: [799] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3941lb # [ 14.090710] postgres[799]: [799] LOG: listening on IPv6 address "::1", port 54323942lb # [ 14.091708] postgres[799]: [799] LOG: listening on IPv4 address "127.0.0.1", port 54323943lb # [ 14.093795] postgres[799]: [799] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3944lb # [ 14.105939] postgres[808]: [808] LOG: database system was shut down at 2026-09-20 12:46:21 GMT3945lb # [ 14.109579] postgres[799]: [799] LOG: database system is ready to accept connections3946lb # [ 14.116348] systemd[1]: Started PostgreSQL Server.3947lb # [ 14.120427] systemd[1]: Starting PostgreSQL Setup Scripts...3948lb # [ 14.281706] postgresql-setup-start[819]: CREATE DATABASE3949lb # [ 14.337810] postgresql-setup-start[827]: CREATE ROLE3950lb # [ 14.363111] postgresql-setup-start[830]: ALTER DATABASE3951lb # [ 14.369484] systemd[1]: Finished PostgreSQL Setup Scripts.3952lb # [ 14.372515] systemd[1]: Reached target PostgreSQL.3953worker2 # [ 15.172304] dhcpcd[691]: eth0: leased 10.0.2.15 for 86400 seconds3954worker2 # [ 15.175308] dhcpcd[691]: eth0: adding route to 10.0.2.0/243955worker2 # [ 15.177407] dhcpcd[691]: eth0: adding default route via 10.0.2.23956worker2 # [ 15.292951] systemd[1]: Started DHCP Client.3957worker2 # [ 15.295047] systemd[1]: Reached target Multi-User System.3958worker2 # [ 15.295809] systemd[1]: Startup finished in 865ms (kernel) + 4.105s (initrd) + 10.323s (userspace) = 15.294s.3959worker1 # [ 16.003901] dhcpcd[695]: eth0: leased 10.0.2.15 for 86400 seconds3960worker1 # [ 16.005181] dhcpcd[695]: eth0: adding route to 10.0.2.0/243961worker1 # [ 16.006206] dhcpcd[695]: eth0: adding default route via 10.0.2.23962worker1 # [ 16.134546] systemd[1]: Started DHCP Client.3963worker1 # [ 16.136428] systemd[1]: Reached target Multi-User System.3964worker1 # [ 16.137569] systemd[1]: Startup finished in 853ms (kernel) + 4.239s (initrd) + 11.044s (userspace) = 16.137s.3965client # [ 16.856355] dhcpcd[566]: eth0: leased 10.0.2.15 for 86400 seconds3966client # [ 16.859225] dhcpcd[566]: eth0: adding route to 10.0.2.0/243967client # [ 16.861577] dhcpcd[566]: eth0: adding default route via 10.0.2.23968client # [ 16.979631] systemd[1]: Started DHCP Client.3969client # [ 16.981291] systemd[1]: Reached target Multi-User System.3970client # [ 16.982562] systemd[1]: Startup finished in 855ms (kernel) + 4.102s (initrd) + 12.024s (userspace) = 16.982s.3971lb # [ 18.302653] dhcpcd[713]: eth0: leased 10.0.2.15 for 86400 seconds3972lb # [ 18.304844] dhcpcd[713]: eth0: adding route to 10.0.2.0/243973lb # [ 18.307432] dhcpcd[713]: eth0: adding default route via 10.0.2.23974lb # [ 18.428184] systemd[1]: Started DHCP Client.3975lb # [ 18.429907] systemd[1]: Reached target Network is Online.3976lb # [ 18.433942] systemd[1]: Started Envoy reverse proxy.3977lb # [ 18.437947] systemd[1]: Started mock-oidc.service.3978lb # [ 18.529859] mock-oidc-server[927]: Mock OIDC Server running3979lb # [ 18.530877] mock-oidc-server[927]: OIDC Address: 192.168.1.2:80803980lb # [ 18.532070] mock-oidc-server[927]: Issue Address: 0.0.0.0:80813981lb # [ 18.532980] mock-oidc-server[927]: Issuer: http://192.168.1.2:8080/oidc3982lb # [ 18.534249] mock-oidc-server[927]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3983lb # [ 18.535533] mock-oidc-server[927]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3984lb # [ 18.536882] mock-oidc-server[927]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3985lb # [ 19.006968] envoy[926]: [2026-09-20 12:46:26.177][926][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3986lb # [ 19.009164] envoy[926]: [2026-09-20 12:46:26.180][926][info][main] [source/server/server.cc:469] statically linked extensions:3987lb # [ 19.010656] envoy[926]: [2026-09-20 12:46:26.181][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router3988lb # [ 19.012507] envoy[926]: [2026-09-20 12:46:26.181][926][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service3989lb # [ 19.016421] envoy[926]: [2026-09-20 12:46:26.181][926][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule3990lb # [ 19.019024] envoy[926]: [2026-09-20 12:46:26.181][926][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port3991lb # [ 19.020842] envoy[926]: [2026-09-20 12:46:26.181][926][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router3992lb # [ 19.022600] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter3993lb # [ 19.024902] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value3994lb # [ 19.028023] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor3995lb # [ 19.030360] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities3996lb # [ 19.032039] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file3997lb # [ 19.033739] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation3998lb # [ 19.035733] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata3999lb # [ 19.038267] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple4000lb # [ 19.040544] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4001lb # [ 19.044269] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4002lb # [ 19.046267] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4003lb # [ 19.048349] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4004lb # [ 19.050253] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4005lb # [ 19.051974] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4006lb # [ 19.054120] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4007lb # [ 19.055876] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4008lb # [ 19.058194] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4009lb # [ 19.071883] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4010lb # [ 19.074142] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4011lb # [ 19.076708] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4012lb # [ 19.079614] envoy[926]: [2026-09-20 12:46:26.183][926][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4013lb # [ 19.081879] envoy[926]: [2026-09-20 12:46:26.190][926][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4014lb # [ 19.084419] envoy[926]: [2026-09-20 12:46:26.190][926][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4015lb # [ 19.086189] envoy[926]: [2026-09-20 12:46:26.190][926][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed4016lb # [ 19.088099] envoy[926]: [2026-09-20 12:46:26.190][926][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4017lb # [ 19.091623] envoy[926]: [2026-09-20 12:46:26.190][926][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4018lb # [ 19.093439] envoy[926]: [2026-09-20 12:46:26.190][926][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts4019lb # [ 19.096058] envoy[926]: [2026-09-20 12:46:26.190][926][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4020lb # [ 19.104914] envoy[926]: [2026-09-20 12:46:26.190][926][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4021lb # [ 19.109249] envoy[926]: [2026-09-20 12:46:26.190][926][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4022lb # [ 19.111127] envoy[926]: [2026-09-20 12:46:26.190][926][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4023lb # [ 19.113084] envoy[926]: [2026-09-20 12:46:26.190][926][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4024lb # [ 19.117221] envoy[926]: [2026-09-20 12:46:26.191][926][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4025lb # [ 19.123277] envoy[926]: [2026-09-20 12:46:26.191][926][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4026lb # [ 19.128440] envoy[926]: [2026-09-20 12:46:26.191][926][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe4027lb # [ 19.130717] envoy[926]: [2026-09-20 12:46:26.191][926][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4028lb # [ 19.133084] envoy[926]: [2026-09-20 12:46:26.191][926][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24029lb # [ 19.134684] envoy[926]: [2026-09-20 12:46:26.191][926][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4030lb # [ 19.136378] envoy[926]: [2026-09-20 12:46:26.191][926][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4031lb # [ 19.161207] envoy[926]: [2026-09-20 12:46:26.193][926][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4032lb # [ 19.163534] envoy[926]: [2026-09-20 12:46:26.193][926][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4033lb # [ 19.165832] envoy[926]: [2026-09-20 12:46:26.193][926][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4034lb # [ 19.168587] envoy[926]: [2026-09-20 12:46:26.193][926][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4035lb # [ 19.170486] envoy[926]: [2026-09-20 12:46:26.193][926][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4036lb # [ 19.176755] envoy[926]: [2026-09-20 12:46:26.193][926][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4037lb # [ 19.178620] envoy[926]: [2026-09-20 12:46:26.193][926][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4038lb # [ 19.182711] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4039lb # [ 19.184775] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4040lb # [ 19.186573] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4041lb # [ 19.189237] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4042lb # [ 19.192280] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4043lb # [ 19.194058] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4044lb # [ 19.195747] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation4045lb # [ 19.197673] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4046lb # [ 19.199371] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4047lb # [ 19.201066] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4048lb # [ 19.205663] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4049lb # [ 19.208700] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4050lb # [ 19.214263] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4051lb # [ 19.216676] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4052lb # [ 19.219885] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4053lb # [ 19.222209] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4054lb # [ 19.224556] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4055lb # [ 19.226206] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4056lb # [ 19.230072] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4057lb # [ 19.231831] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4058lb # [ 19.234357] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4059lb # [ 19.236549] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4060lb # [ 19.239963] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24061lb # [ 19.242279] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4062lb # [ 19.244618] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4063lb # [ 19.246652] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4064lb # [ 19.250675] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4065lb # [ 19.252477] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4066lb # [ 19.254928] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4067lb # [ 19.256852] envoy[926]: [2026-09-20 12:46:26.195][926][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4068lb # [ 19.259178] envoy[926]: [2026-09-20 12:46:26.196][926][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4069lb # [ 19.261341] envoy[926]: [2026-09-20 12:46:26.196][926][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4070lb # [ 19.263819] envoy[926]: [2026-09-20 12:46:26.196][926][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4071lb # [ 19.265875] envoy[926]: [2026-09-20 12:46:26.196][926][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4072lb # [ 19.267892] envoy[926]: [2026-09-20 12:46:26.196][926][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4073lb # [ 19.272700] envoy[926]: [2026-09-20 12:46:26.196][926][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4074lb # [ 19.274329] envoy[926]: [2026-09-20 12:46:26.196][926][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4075lb # [ 19.276265] envoy[926]: [2026-09-20 12:46:26.196][926][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4076lb # [ 19.282479] envoy[926]: [2026-09-20 12:46:26.196][926][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4077lb # [ 19.284801] envoy[926]: [2026-09-20 12:46:26.196][926][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4078lb # [ 19.286583] envoy[926]: [2026-09-20 12:46:26.196][926][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4079lb # [ 19.292606] envoy[926]: [2026-09-20 12:46:26.196][926][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4080lb # [ 19.294382] envoy[926]: [2026-09-20 12:46:26.196][926][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14081lb # [ 19.296349] envoy[926]: [2026-09-20 12:46:26.209][926][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4082lb # [ 19.298071] envoy[926]: [2026-09-20 12:46:26.209][926][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4083lb # [ 19.299827] envoy[926]: [2026-09-20 12:46:26.209][926][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4084lb # [ 19.311073] envoy[926]: [2026-09-20 12:46:26.209][926][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4085lb # [ 19.312865] envoy[926]: [2026-09-20 12:46:26.209][926][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4086lb # [ 19.315313] envoy[926]: [2026-09-20 12:46:26.209][926][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84087lb # [ 19.317410] envoy[926]: [2026-09-20 12:46:26.211][926][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4088lb # [ 19.320302] envoy[926]: [2026-09-20 12:46:26.211][926][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4089lb # [ 19.322567] envoy[926]: [2026-09-20 12:46:26.211][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24090lb # [ 19.324049] envoy[926]: [2026-09-20 12:46:26.215][926][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4091lb # [ 19.325422] envoy[926]: [2026-09-20 12:46:26.339][926][info][main] [source/server/server.cc:531] HTTP header map info:4092lb # [ 19.326729] envoy[926]: [2026-09-20 12:46:26.379][926][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4093lb # [ 19.339579] envoy[926]: [2026-09-20 12:46:26.379][926][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4094lb # [ 19.341106] envoy[926]: [2026-09-20 12:46:26.379][926][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4095lb # [ 19.348724] envoy[926]: [2026-09-20 12:46:26.379][926][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4096lb # [ 19.377411] envoy[926]: [2026-09-20 12:46:26.548][926][info][main] [source/server/server.cc:968] runtime: {}4097lb # [ 19.383055] envoy[926]: [2026-09-20 12:46:26.554][926][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4098lb # [ 19.385267] envoy[926]: [2026-09-20 12:46:26.556][926][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014099lb # [ 19.387618] envoy[926]: [2026-09-20 12:46:26.558][926][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014100lb # [ 19.390188] envoy[926]: [2026-09-20 12:46:26.561][926][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4101lb # [ 19.391775] envoy[926]: [2026-09-20 12:46:26.562][926][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4102lb # [ 19.393479] envoy[926]: [2026-09-20 12:46:26.562][926][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4103lb # [ 19.433129] envoy[926]: [2026-09-20 12:46:26.604][926][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4104worker1 # [ 19.427443] systemd[1]: Starting Nix worker-protocol over gRPC...4105worker2 # [ 19.464481] systemd[1]: Reached target Network is Online.4106worker2 # [ 19.469052] systemd[1]: Starting scheduler-token.service...4107lb # [ 19.451275] envoy[926]: [2026-09-20 12:46:26.622][926][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4108lb # [ 19.453713] envoy[926]: [2026-09-20 12:46:26.624][926][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4109lb # [ 19.456615] envoy[926]: [2026-09-20 12:46:26.624][926][info][main] [source/server/server.cc:1077] starting main dispatch loop4110worker2 # [ 19.575304] systemd[1]: scheduler-token.service: Deactivated successfully.4111worker2 # [ 19.577135] systemd[1]: Finished scheduler-token.service.4112worker2 # [ 19.577890] systemd[1]: scheduler-token.service: Consumed 29ms CPU time over 106ms wall clock time, 3.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4113worker2 # [ 19.583520] systemd[1]: Starting Nix worker-protocol over gRPC...4114worker1 # [ 19.611952] nix-grpc-daemon[787]: ts=2026-09-20T12:46:26Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4115worker1 # [ 19.620609] nix-grpc-daemon[787]: ts=2026-09-20T12:46:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4116worker1 # [ 19.624955] nix-grpc-daemon[787]: ts=2026-09-20T12:46:26Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14117worker1 # [ 19.664951] nix-grpc-daemon[787]: ts=2026-09-20T12:46:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4118worker1 # [ 19.670067] systemd[1]: Started Nix worker-protocol over gRPC.4119worker1 # [ 19.716473] nix-grpc-daemon[787]: ts=2026-09-20T12:46:26Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4120lb # [ 19.724826] envoy[926]: [2026-09-20 12:46:26.895][926][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4121lb # [ 19.728803] envoy[926]: [2026-09-20 12:46:26.895][926][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4122lb # [ 19.733444] envoy[926]: [2026-09-20 12:46:26.895][926][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4123lb # [ 19.738281] envoy[926]: [2026-09-20 12:46:26.904][926][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4124worker2 # [ 19.776118] nix-grpc-daemon[788]: ts=2026-09-20T12:46:26Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"4125worker2 # [ 19.785562] nix-grpc-daemon[788]: ts=2026-09-20T12:46:26Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4126worker2 # [ 19.788844] nix-grpc-daemon[788]: ts=2026-09-20T12:46:26Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14127worker2 # [ 19.834332] nix-grpc-daemon[788]: ts=2026-09-20T12:46:26Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4128worker2 # [ 19.836864] systemd[1]: Started Nix worker-protocol over gRPC.4129worker2 # [ 19.883118] nix-grpc-daemon[788]: ts=2026-09-20T12:46:26Z level=info event=scheduler_connected addr=lb:500514130worker1 # [ 19.889258] nix-grpc-daemon[787]: ts=2026-09-20T12:46:26Z level=info event=oidc_jwks provider=mock keys=14131worker1 # [ 19.893554] nix-grpc-daemon[787]: ts=2026-09-20T12:46:26Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:604984132worker1 # [ 19.897066] nix-grpc-daemon[787]: ts=2026-09-20T12:46:26Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04133worker1 # [ 19.917309] nix-grpc-daemon[787]: ts=2026-09-20T12:46:26Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4134worker1 # [ 20.317731] nix-grpc-daemon[787]: ts=2026-09-20T12:46:27Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4135worker1 # [ 21.120316] nix-grpc-daemon[787]: ts=2026-09-20T12:46:28Z level=info event=scheduler_connected addr=lb:500514136worker1 # [ 21.122276] nix-grpc-daemon[787]: ts=2026-09-20T12:46:28Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:604984137worker1 # [ 21.124241] nix-grpc-daemon[787]: ts=2026-09-20T12:46:28Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04138lb # [ 31.885597] rustfs-bucket-start[1064]: mb s3://farm4139lb # [ 31.891669] systemd[1]: Finished rustfs-bucket.service.4140lb # [ 31.897801] systemd[1]: Starting niks3 server...4141lb # [ 32.123585] postgres[1079]: [1079] ERROR: relation "goose_db_version" does not exist at character 364142lb # [ 32.124765] postgres[1079]: [1079] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4143lb # [ 32.163480] niks3-server[1074]: 2026/09/20 12:46:39 OK 20241026095416_initial_model.sql (20.13ms)4144lb # [ 32.167221] niks3-server[1074]: 2026/09/20 12:46:39 OK 20251210153512_drop_unused_gin_index.sql (2.35ms)4145lb # [ 32.172870] niks3-server[1074]: 2026/09/20 12:46:39 OK 20251218171726_add_pins.sql (4.32ms)4146lb # [ 32.178109] niks3-server[1074]: 2026/09/20 12:46:39 OK 20260628120000_add_object_size_and_stats.sql (3.87ms)4147lb # [ 32.182149] niks3-server[1074]: 2026/09/20 12:46:39 OK 20260905000000_add_claims.sql (3.9ms)4148lb # [ 32.183296] niks3-server[1074]: 2026/09/20 12:46:39 goose: successfully migrated database to version: 202609050000004149lb # [ 32.189151] niks3-server[1074]: 2026/09/20 12:46:39 OK 1_commit_pending_closure.sql (7.01ms)4150lb # [ 32.191530] niks3-server[1074]: 2026/09/20 12:46:39 OK 2_object_stats_trigger.sql (2.33ms)4151lb # [ 32.192910] niks3-server[1074]: 2026/09/20 12:46:39 goose: up to current file version: 24152lb # [ 32.198629] niks3-server[1074]: 2026/09/20 12:46:39 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4153lb # [ 32.271026] niks3-server[1074]: 2026/09/20 12:46:39 INFO Read proxy enabled — serving cache objects from S34154lb # [ 32.272930] niks3-server[1074]: 2026/09/20 12:46:39 INFO Using socket-activated listener address=0.0.0.0:57514155lb # [ 32.278109] niks3-server[1074]: 2026/09/20 12:46:39 INFO systemd watchdog enabled interval=15s4156lb # [ 32.279673] systemd[1]: Started niks3 server.4157lb # [ 32.281951] niks3-server[1074]: 2026/09/20 12:46:39 INFO Starting HTTP server address=0.0.0.0:57514158lb # [ 32.283802] systemd[1]: Reached target Multi-User System.4159lb # [ 32.285126] systemd[1]: Startup finished in 871ms (kernel) + 4.949s (initrd) + 26.463s (userspace) = 32.283s.4160lb: (finished: waiting for unit niks3.service, in 21.81 seconds)4161lb: waiting for TCP port 5751 on localhost4162lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4163lb: (finished: waiting for TCP port 5751 on localhost, in 0.06 seconds)4164lb: waiting for unit envoy.service4165lb: (finished: waiting for unit envoy.service, in 0.04 seconds)4166lb: waiting for TCP port 50051 on localhost4167lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4168lb # [ 32.909970] envoy[926]: conn peer=[::1]:58330 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24169lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4170worker2 # [ 33.085672] systemd[1]: Starting scheduler-token.service...4171worker2 # [ 33.148637] systemd[1]: scheduler-token.service: Deactivated successfully.4172worker2 # [ 33.150374] systemd[1]: Finished scheduler-token.service.4173worker2 # [ 33.151911] systemd[1]: scheduler-token.service: Consumed 22ms CPU time over 65ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.4174lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4175??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4176 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284177lb: must succeed: curl -sf localhost:9901/clusters4178lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.09 seconds)4179lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.09 seconds)4180lb: waiting until exactly no endpoints of sched are unhealthy4181lb: must succeed: curl -sf localhost:9901/clusters4182lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4183lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 0.05 seconds)4184subtest: both builders hold a WorkerSession on the scheduler, worker2 by OIDC token4185worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4186worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.07 seconds)4187worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open'4188worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'event=worker_session_open', in 0.03 seconds)4189(finished: subtest: both builders hold a WorkerSession on the scheduler, worker2 by OIDC token, in 0.10 seconds)4190subtest: balancer auth: client cert, bearer token, nothing, unknown CN4191worker1 # [ 33.676593] nix-grpc-daemon[787]: ts=2026-09-20T12:46:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582784192worker1 # [ 33.682796] systemd[1]: Started Nix Daemon.4193worker1 # [ 33.861465] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4194worker1 # [ 33.901173] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 55 ms (attempt 1/5)4195worker1 # [ 33.956853] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 199 ms (attempt 2/5)4196worker1 # [ 34.156117] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 192 ms (attempt 3/5)4197worker1 # [ 34.349060] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 777 ms (attempt 4/5)4198worker1 # [ 35.139517] nix-grpc-daemon[787]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4199worker2 # [ 35.214091] nix-grpc-daemon[788]: ts=2026-09-20T12:46:41Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:595924200worker2 # [ 35.225930] systemd[1]: Started Nix Daemon.4201worker2 # [ 35.437057] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4202worker2 # [ 35.468262] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 64 ms (attempt 1/5)4203worker2 # [ 35.536669] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 38 ms (attempt 2/5)4204worker2 # [ 35.577464] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 187 ms (attempt 3/5)4205worker2 # [ 35.764925] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 501 ms (attempt 4/5)4206worker2 # [ 36.276319] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4207worker2 # [ 36.292368] nix-grpc-daemon[788]: ts=2026-09-20T12:46:42Z level=debug event=path_info_miss path=akqi3x4x90vh2w3gs5b7p4df2r05p5ay-nixos-system-client-test error="error: path '/nix/store/akqi3x4x90vh2w3gs5b7p4df2r05p5ay-nixos-system-client-test' is required, but there is no substituter that can build it"4208worker2 # [ 36.305467] nix-grpc-daemon[788]: ts=2026-09-20T12:46:42Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:595924209worker2 # [ 36.314571] nix-grpc-daemon[788]: ts=2026-09-20T12:46:42Z level=debug event=path_info_miss path=akqi3x4x90vh2w3gs5b7p4df2r05p5ay-nixos-system-client-test error="error: path '/nix/store/akqi3x4x90vh2w3gs5b7p4df2r05p5ay-nixos-system-client-test' is required, but there is no substituter that can build it"4210client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4211client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.09 seconds)4212client: must succeed: install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4213client: (finished: must succeed: install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.04 seconds)4214worker1 # [ 36.623798] nix-grpc-daemon[787]: ts=2026-09-20T12:46:43Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:582784215worker2 # [ 36.685259] nix-grpc-daemon[788]: ts=2026-09-20T12:46:42Z level=info event=oidc_jwks provider=mock keys=14216worker2 # [ 36.690613] nix-grpc-daemon[788]: ts=2026-09-20T12:46:42Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:595924217worker2 # [ 36.699879] nix-grpc-daemon[788]: ts=2026-09-20T12:46:42Z level=debug event=path_info_miss path=akqi3x4x90vh2w3gs5b7p4df2r05p5ay-nixos-system-client-test error="error: path '/nix/store/akqi3x4x90vh2w3gs5b7p4df2r05p5ay-nixos-system-client-test' is required, but there is no substituter that can build it"4218worker2 # [ 36.709468] nix-grpc-daemon[788]: ts=2026-09-20T12:46:42Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:595924219worker2 # [ 36.718865] nix-grpc-daemon[788]: ts=2026-09-20T12:46:42Z level=debug event=path_info_miss path=akqi3x4x90vh2w3gs5b7p4df2r05p5ay-nixos-system-client-test error="error: path '/nix/store/akqi3x4x90vh2w3gs5b7p4df2r05p5ay-nixos-system-client-test' is required, but there is no substituter that can build it"4220client: must succeed: rm -r /var/lib/nix-grpc-store4221client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.02 seconds)4222worker1 # [ 36.919399] nix-grpc-daemon[787]: ts=2026-09-20T12:46:43Z level=info event=denied method=QueryMissing cn=- role=none4223worker1 # [ 37.135175] nix-grpc-daemon[787]: ts=2026-09-20T12:46:44Z level=info event=denied method=QueryMissing cn=stranger role=none4224(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.79 seconds)4225subtest: DAG build is scheduled across workers and lands in the cache4226client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24227worker2 # [ 37.385611] nix-grpc-daemon[788]: ts=2026-09-20T12:46:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:595924228client # don't know how to build these paths:4229client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4230worker2 # [ 37.399820] nix-grpc-daemon[788]: ts=2026-09-20T12:46:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:595924231worker1 # [ 37.421704] nix-grpc-daemon[787]: ts=2026-09-20T12:46:44Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04232worker1 # [ 37.427179] nix-grpc-daemon[787]: ts=2026-09-20T12:46:44Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.4:50051 clients=14233worker2 # [ 37.507263] nix-grpc-daemon[788]: ts=2026-09-20T12:46:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924234worker2 # [ 37.538225] nix-grpc-daemon[788]: ts=2026-09-20T12:46:43Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:595924235client # copying 1 paths to 'lb:50051'...4236worker2 # [ 37.552795] nix-grpc-daemon[788]: ts=2026-09-20T12:46:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:595924237client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4238worker2 # [ 37.580105] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4239worker2 # [ 37.605966] nix-grpc-daemon[788]: ts=2026-09-20T12:46:43Z level=info event=niks3_push_started pid=8244240worker2 # [ 37.896197] nix-grpc-daemon[824]: time=2026-09-20T12:46:44.144Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""4241worker2 # [ 38.087043] nix-daemon[814]: accepted connection from pid 836, user nix-grpc-daemon (trusted)4242worker2 # [ 38.103077] nix-daemon[814]: reaped child process 839, status = succeeded4243worker2 # [ 38.276599] nix-daemon[814]: accepted connection from pid 841, user nix-grpc-daemon (trusted)4244worker2 # [ 38.289738] nix-daemon[814]: reaped child process 844, status = succeeded4245lb # [ 38.279531] niks3-server[1074]: 2026/09/20 12:46:45 INFO Received uploads request method=POST path=/api/pending_closures4246worker2 # [ 38.333081] nix-grpc-daemon[824]: time=2026-09-20T12:46:44.585Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4247worker2 # [ 38.335606] nix-grpc-daemon[824]: time=2026-09-20T12:46:44.587Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4248lb # [ 38.352093] niks3-server[1074]: 2026/09/20 12:46:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4249lb # [ 38.356619] niks3-server[1074]: 2026/09/20 12:46:45 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4250lb # [ 38.371983] niks3-server[1074]: 2026/09/20 12:46:45 INFO Signed narinfos id=1 count=14251worker2 # [ 38.401734] nix-grpc-daemon[824]: time=2026-09-20T12:46:44.653Z level=INFO msg="Uploading 1 narinfos"4252lb # [ 38.380648] niks3-server[1074]: 2026/09/20 12:46:45 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4253lb # [ 38.388460] niks3-server[1074]: 2026/09/20 12:46:45 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4254lb # [ 38.397752] niks3-server[1074]: 2026/09/20 12:46:45 INFO Completed upload id=14255worker2 # [ 38.425975] nix-grpc-daemon[824]: time=2026-09-20T12:46:44.677Z level=INFO msg="Upload complete. (506ms)"4256lb # [ 38.404244] niks3-server[1074]: 2026/09/20 12:46:45 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4257worker2 # [ 38.433603] nix-grpc-daemon[788]: ts=2026-09-20T12:46:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=0 paths=1 nar_bytes_in=5044258worker2 # [ 38.441589] nix-grpc-daemon[788]: ts=2026-09-20T12:46:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924259worker2 # [ 38.454879] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4260worker2 # [ 38.461338] nix-daemon[814]: reaped child process 822, status = succeeded4261client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4262worker2 # [ 38.472075] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4263client # farm-a> worker2: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4264lb # [ 39.441341] envoy[926]: conn peer=[2001:db8:1::1]:46874 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=26574265lb # [ 39.445164] envoy[926]: conn peer=[2001:db8:1::1]:46884 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=724266lb # [ 39.448548] envoy[926]: conn peer=[2001:db8:1::1]:46898 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=144267lb # [ 39.451898] envoy[926]: conn peer=[2001:db8:1::1]:46906 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=84268client # farm-a> LOG-farm-a-t14269worker2 # [ 39.685635] nix-daemon[814]: reaped child process 848, status = succeeded4270worker2 # [ 39.843101] nix-daemon[814]: accepted connection from pid 864, user nix-grpc-daemon (trusted)4271worker2 # [ 39.856319] nix-daemon[814]: reaped child process 867, status = succeeded4272lb # [ 39.843916] niks3-server[1074]: 2026/09/20 12:46:47 INFO Received uploads request method=POST path=/api/pending_closures4273worker2 # [ 39.890891] nix-grpc-daemon[824]: time=2026-09-20T12:46:46.142Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4274worker2 # [ 39.892582] nix-grpc-daemon[824]: time=2026-09-20T12:46:46.144Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4275lb # [ 39.907261] niks3-server[1074]: 2026/09/20 12:46:47 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4276lb # [ 39.911420] niks3-server[1074]: 2026/09/20 12:46:47 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4277lb # [ 39.913636] niks3-server[1074]: 2026/09/20 12:46:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4278lb # [ 39.916153] niks3-server[1074]: 2026/09/20 12:46:47 INFO Signed narinfos id=2 count=14279lb # [ 39.919739] niks3-server[1074]: 2026/09/20 12:46:47 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4280worker2 # [ 39.946250] nix-grpc-daemon[824]: time=2026-09-20T12:46:46.197Z level=INFO msg="Uploading 1 narinfos"4281lb # [ 39.924593] niks3-server[1074]: 2026/09/20 12:46:47 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4282lb # [ 39.928540] niks3-server[1074]: 2026/09/20 12:46:47 INFO Completed upload id=24283worker2 # [ 39.956540] nix-grpc-daemon[824]: time=2026-09-20T12:46:46.208Z level=INFO msg="Upload complete. (276ms)"4284lb # [ 39.930070] niks3-server[1074]: 2026/09/20 12:46:47 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4285worker2 # [ 39.961842] nix-grpc-daemon[788]: ts=2026-09-20T12:46:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14286worker2 # [ 39.971789] nix-daemon[814]: reaped child process 846, status = succeeded4287worker1 # [ 39.945448] nix-grpc-daemon[787]: ts=2026-09-20T12:46:46Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04288worker1 # [ 39.949569] nix-grpc-daemon[787]: ts=2026-09-20T12:46:46Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.4:50051 clients=14289worker2 # [ 40.022782] nix-grpc-daemon[788]: ts=2026-09-20T12:46:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924290worker2 # [ 40.033926] nix-grpc-daemon[788]: ts=2026-09-20T12:46:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:595924291worker2 # [ 40.046178] nix-grpc-daemon[824]: time=2026-09-20T12:46:46.298Z level=INFO msg="All 1 paths already cached"4292client # copying 1 paths to 'lb:50051'...4293client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4294worker2 # [ 40.052508] nix-grpc-daemon[788]: ts=2026-09-20T12:46:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:595924295worker2 # [ 40.064137] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4296worker2 # [ 40.236380] nix-daemon[814]: accepted connection from pid 872, user nix-grpc-daemon (trusted)4297worker2 # [ 40.251552] nix-daemon[814]: reaped child process 875, status = succeeded4298worker2 # [ 40.415281] nix-daemon[814]: accepted connection from pid 877, user nix-grpc-daemon (trusted)4299worker2 # [ 40.428953] nix-daemon[814]: reaped child process 880, status = succeeded4300lb # [ 40.417172] niks3-server[1074]: 2026/09/20 12:46:47 INFO Received uploads request method=POST path=/api/pending_closures4301worker2 # [ 40.452874] nix-grpc-daemon[824]: time=2026-09-20T12:46:46.705Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4302worker2 # [ 40.454951] nix-grpc-daemon[824]: time=2026-09-20T12:46:46.706Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4303lb # [ 40.436599] niks3-server[1074]: 2026/09/20 12:46:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4304lb # [ 40.439106] niks3-server[1074]: 2026/09/20 12:46:47 INFO Signed narinfos id=3 count=14305worker2 # [ 40.468444] nix-grpc-daemon[824]: time=2026-09-20T12:46:46.720Z level=INFO msg="Uploading 1 narinfos"4306lb # [ 40.442984] niks3-server[1074]: 2026/09/20 12:46:47 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4307lb # [ 40.448135] niks3-server[1074]: 2026/09/20 12:46:47 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4308lb # [ 40.452053] niks3-server[1074]: 2026/09/20 12:46:47 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4309lb # [ 40.458285] niks3-server[1074]: 2026/09/20 12:46:47 INFO Completed upload id=34310worker2 # [ 40.486214] nix-grpc-daemon[824]: time=2026-09-20T12:46:46.738Z level=INFO msg="Upload complete. (410ms)"4311lb # [ 40.459841] niks3-server[1074]: 2026/09/20 12:46:47 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4312worker2 # [ 40.488797] nix-grpc-daemon[788]: ts=2026-09-20T12:46:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=0 paths=1 nar_bytes_in=6244313worker2 # [ 40.492060] nix-grpc-daemon[788]: ts=2026-09-20T12:46:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924314worker2 # [ 40.497565] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4315worker2 # [ 40.502389] nix-daemon[814]: reaped child process 870, status = succeeded4316client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4317client # farm-b> worker2: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4318worker2 # [ 40.507365] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4319client # farm-b> LOG-farm-b-t14320worker2 # [ 41.720654] nix-daemon[814]: reaped child process 884, status = succeeded4321worker2 # [ 41.859097] nix-daemon[814]: accepted connection from pid 899, user nix-grpc-daemon (trusted)4322worker2 # [ 41.870336] nix-daemon[814]: reaped child process 902, status = succeeded4323lb # [ 41.858634] niks3-server[1074]: 2026/09/20 12:46:49 INFO Received uploads request method=POST path=/api/pending_closures4324worker2 # [ 41.898760] nix-grpc-daemon[824]: time=2026-09-20T12:46:48.150Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4325worker2 # [ 41.900788] nix-grpc-daemon[824]: time=2026-09-20T12:46:48.152Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4326lb # [ 41.911288] niks3-server[1074]: 2026/09/20 12:46:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4327lb # [ 41.917139] niks3-server[1074]: 2026/09/20 12:46:49 INFO Signed narinfos id=4 count=14328worker2 # [ 41.947918] nix-grpc-daemon[824]: time=2026-09-20T12:46:48.200Z level=INFO msg="Uploading 1 narinfos"4329lb # [ 41.930473] niks3-server[1074]: 2026/09/20 12:46:49 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4330lb # [ 41.980406] niks3-server[1074]: 2026/09/20 12:46:49 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4331lb # [ 41.990439] niks3-server[1074]: 2026/09/20 12:46:49 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4332lb # [ 41.998311] niks3-server[1074]: 2026/09/20 12:46:49 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4333lb # [ 42.005659] niks3-server[1074]: 2026/09/20 12:46:49 INFO Completed upload id=44334worker2 # [ 42.033726] nix-grpc-daemon[824]: time=2026-09-20T12:46:48.285Z level=INFO msg="Upload complete. (319ms)"4335lb # [ 42.010643] niks3-server[1074]: 2026/09/20 12:46:49 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4336worker2 # [ 42.038482] nix-grpc-daemon[788]: ts=2026-09-20T12:46:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14337worker2 # [ 42.049676] nix-daemon[814]: reaped child process 882, status = succeeded4338worker1 # [ 42.016849] nix-grpc-daemon[787]: ts=2026-09-20T12:46:49Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04339worker1 # [ 42.021408] nix-grpc-daemon[787]: ts=2026-09-20T12:46:49Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.4:50051 clients=14340worker2 # [ 42.103162] nix-grpc-daemon[788]: ts=2026-09-20T12:46:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924341worker2 # [ 42.115702] nix-grpc-daemon[788]: ts=2026-09-20T12:46:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:595924342worker2 # [ 42.129250] nix-grpc-daemon[824]: time=2026-09-20T12:46:48.381Z level=INFO msg="All 2 paths already cached"4343client # copying 1 paths to 'lb:50051'...4344worker2 # [ 42.137585] nix-grpc-daemon[788]: ts=2026-09-20T12:46:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:595924345client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4346worker2 # [ 42.163166] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4347worker2 # [ 42.323810] nix-daemon[814]: accepted connection from pid 907, user nix-grpc-daemon (trusted)4348worker2 # [ 42.336582] nix-daemon[814]: reaped child process 910, status = succeeded4349worker2 # [ 42.492413] nix-daemon[814]: accepted connection from pid 912, user nix-grpc-daemon (trusted)4350worker2 # [ 42.504842] nix-daemon[814]: reaped child process 915, status = succeeded4351lb # [ 42.491122] niks3-server[1074]: 2026/09/20 12:46:49 INFO Received uploads request method=POST path=/api/pending_closures4352worker2 # [ 42.528335] nix-grpc-daemon[824]: time=2026-09-20T12:46:48.780Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4353worker2 # [ 42.529717] nix-grpc-daemon[824]: time=2026-09-20T12:46:48.780Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4354lb # [ 42.519274] niks3-server[1074]: 2026/09/20 12:46:49 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4355lb # [ 42.529661] niks3-server[1074]: 2026/09/20 12:46:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4356worker2 # [ 42.563476] nix-grpc-daemon[824]: time=2026-09-20T12:46:48.815Z level=INFO msg="Uploading 1 narinfos"4357lb # [ 42.535717] niks3-server[1074]: 2026/09/20 12:46:49 INFO Signed narinfos id=5 count=14358lb # [ 42.542194] niks3-server[1074]: 2026/09/20 12:46:49 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4359lb # [ 42.552173] niks3-server[1074]: 2026/09/20 12:46:49 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4360lb # [ 42.561985] niks3-server[1074]: 2026/09/20 12:46:49 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4361lb # [ 42.567660] niks3-server[1074]: 2026/09/20 12:46:49 INFO Completed upload id=54362worker2 # [ 42.595741] nix-grpc-daemon[824]: time=2026-09-20T12:46:48.847Z level=INFO msg="Upload complete. (418ms)"4363worker2 # [ 42.600156] nix-grpc-daemon[788]: ts=2026-09-20T12:46:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=0 paths=1 nar_bytes_in=7524364worker2 # [ 42.605908] nix-grpc-daemon[788]: ts=2026-09-20T12:46:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924365worker2 # [ 42.618106] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4366worker2 # [ 42.624346] nix-daemon[814]: reaped child process 905, status = succeeded4367worker2 # [ 42.632496] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4368client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4369client # farm-top> worker2: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4370client # farm-top> LOG-farm-top-t14371worker2 # [ 44.058349] nix-daemon[814]: reaped child process 919, status = succeeded4372worker2 # [ 44.211797] nix-daemon[814]: accepted connection from pid 934, user nix-grpc-daemon (trusted)4373worker2 # [ 44.223128] nix-daemon[814]: reaped child process 937, status = succeeded4374lb # [ 44.212077] niks3-server[1074]: 2026/09/20 12:46:51 INFO Received uploads request method=POST path=/api/pending_closures4375worker2 # [ 44.249323] nix-grpc-daemon[824]: time=2026-09-20T12:46:50.501Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4376worker2 # [ 44.250818] nix-grpc-daemon[824]: time=2026-09-20T12:46:50.502Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4377lb # [ 44.250008] niks3-server[1074]: 2026/09/20 12:46:51 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4378lb # [ 44.266350] niks3-server[1074]: 2026/09/20 12:46:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4379worker2 # [ 44.299457] nix-grpc-daemon[824]: time=2026-09-20T12:46:50.551Z level=INFO msg="Uploading 1 narinfos"4380lb # [ 44.271355] niks3-server[1074]: 2026/09/20 12:46:51 INFO Signed narinfos id=6 count=14381lb # [ 44.278900] niks3-server[1074]: 2026/09/20 12:46:51 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4382lb # [ 44.285245] niks3-server[1074]: 2026/09/20 12:46:51 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4383lb # [ 44.293744] niks3-server[1074]: 2026/09/20 12:46:51 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4384lb # [ 44.297244] niks3-server[1074]: 2026/09/20 12:46:51 INFO Completed upload id=64385lb # [ 44.299133] niks3-server[1074]: 2026/09/20 12:46:51 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4386worker2 # [ 44.326707] nix-grpc-daemon[824]: time=2026-09-20T12:46:50.578Z level=INFO msg="Upload complete. (284ms)"4387worker2 # [ 44.332584] nix-grpc-daemon[788]: ts=2026-09-20T12:46:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14388worker2 # [ 44.345276] nix-daemon[814]: reaped child process 917, status = succeeded4389client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 7.18 seconds)4390client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4391client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.18 seconds)4392client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4393client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.02 seconds)4394client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4395client # copying 3 paths...4396client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4397client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4398client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4399client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.27 seconds)4400(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 7.74 seconds)4401subtest: repeat is answered Cached by the scheduler without building4402worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4403worker1 # finding garbage collector roots...4404worker1 # deleting specified paths...4405worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4406worker1 # deleting unused links...4407worker1 # note: hard linking is currently saving 0.0 KiB4408worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.25 seconds)4409worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4410worker2 # finding garbage collector roots...4411worker2 # deleting specified paths...4412worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4413worker2 # deleting unused links...4414worker2 # note: hard linking is currently saving 0.0 KiB4415worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.21 seconds)4416client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&24417client # don't know how to build these paths:4418client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4419worker1 # [ 45.558505] nix-grpc-daemon[787]: ts=2026-09-20T12:46:52Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582784420worker1 # [ 45.563936] nix-grpc-daemon[787]: ts=2026-09-20T12:46:52Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582784421worker1 # [ 45.592690] nix-grpc-daemon[787]: ts=2026-09-20T12:46:52Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14422client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 >&2, in 0.27 seconds)4423client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath4424client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 outPath, in 0.17 seconds)4425worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4426worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4427(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.03 seconds)4428subtest: inputs already in the cache are not sent to the scheduler4429worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4430worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.03 seconds)4431client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&24432worker1 # [ 46.869713] nix-grpc-daemon[787]: ts=2026-09-20T12:46:53Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582784433client # don't know how to build these paths:4434client # /nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4435worker1 # [ 46.881696] nix-grpc-daemon[787]: ts=2026-09-20T12:46:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582784436worker1 # [ 46.895263] nix-grpc-daemon[787]: ts=2026-09-20T12:46:53Z level=debug event=want client=3 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv cached=04437worker1 # [ 46.900966] nix-grpc-daemon[787]: ts=2026-09-20T12:46:53Z level=debug event=assigned drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv worker=192.168.1.4:50051 clients=14438worker2 # [ 46.979462] nix-grpc-daemon[788]: ts=2026-09-20T12:46:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924439worker2 # [ 46.995509] nix-grpc-daemon[788]: ts=2026-09-20T12:46:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:595924440worker2 # [ 47.019852] nix-grpc-daemon[824]: time=2026-09-20T12:46:53.271Z level=INFO msg="All 2 paths already cached"4441client # copying 1 paths to 'lb:50051'...4442client # copying path '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' to 'lb:50051'...4443worker2 # [ 47.026617] nix-grpc-daemon[788]: ts=2026-09-20T12:46:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:595924444worker2 # [ 47.032087] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4445worker2 # [ 47.190559] nix-daemon[814]: accepted connection from pid 954, user nix-grpc-daemon (trusted)4446worker2 # [ 47.203268] nix-daemon[814]: reaped child process 957, status = succeeded4447worker2 # [ 47.352526] nix-daemon[814]: accepted connection from pid 959, user nix-grpc-daemon (trusted)4448worker2 # [ 47.365283] nix-daemon[814]: reaped child process 962, status = succeeded4449lb # [ 47.347685] niks3-server[1074]: 2026/09/20 12:46:54 INFO Received uploads request method=POST path=/api/pending_closures4450worker2 # [ 47.383770] nix-grpc-daemon[824]: time=2026-09-20T12:46:53.635Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4451worker2 # [ 47.385408] nix-grpc-daemon[824]: time=2026-09-20T12:46:53.635Z level=INFO msg="Uploading y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv (752B)"4452lb # [ 47.374371] niks3-server[1074]: 2026/09/20 12:46:54 INFO Registered completed upload object_key=nar/0p14b74h5654i3y6qv7zaaib0ya421b01knaq0m00r5ypjyh2q1d.nar.zst4453lb # [ 47.384781] niks3-server[1074]: 2026/09/20 12:46:54 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4454worker2 # [ 47.419826] nix-grpc-daemon[824]: time=2026-09-20T12:46:53.671Z level=INFO msg="Uploading 1 narinfos"4455lb # [ 47.391825] niks3-server[1074]: 2026/09/20 12:46:54 INFO Signed narinfos id=7 count=14456lb # [ 47.395302] niks3-server[1074]: 2026/09/20 12:46:54 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.ls4457lb # [ 47.408588] niks3-server[1074]: 2026/09/20 12:46:54 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4458worker2 # [ 47.442468] nix-grpc-daemon[824]: time=2026-09-20T12:46:53.694Z level=INFO msg="Upload complete. (405ms)"4459lb # [ 47.414688] niks3-server[1074]: 2026/09/20 12:46:54 INFO Completed upload id=74460worker2 # [ 47.444815] nix-grpc-daemon[788]: ts=2026-09-20T12:46:53Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=0 paths=1 nar_bytes_in=7524461worker2 # [ 47.448116] nix-grpc-daemon[788]: ts=2026-09-20T12:46:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924462lb # [ 47.424988] niks3-server[1074]: 2026/09/20 12:46:54 INFO Registered completed upload object_key=y2wm8aizyyg449ia2pcscrjc2pklsrz4.narinfo4463worker2 # [ 47.455917] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4464worker2 # [ 47.460529] nix-daemon[814]: reaped child process 952, status = succeeded4465worker2 # [ 47.465836] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4466client # building '/nix/store/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv' on lb:50051...4467client # farm-top> worker2: building y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4468client # farm-top> LOG-farm-top-t1b4469worker2 # [ 48.890448] nix-daemon[814]: reaped child process 966, status = succeeded4470worker2 # [ 49.048638] nix-daemon[814]: accepted connection from pid 981, user nix-grpc-daemon (trusted)4471worker2 # [ 49.060476] nix-daemon[814]: reaped child process 984, status = succeeded4472lb # [ 49.048231] niks3-server[1074]: 2026/09/20 12:46:56 INFO Received uploads request method=POST path=/api/pending_closures4473worker2 # [ 49.213814] nix-grpc-daemon[824]: time=2026-09-20T12:46:55.465Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4474worker2 # [ 49.224242] nix-grpc-daemon[824]: time=2026-09-20T12:46:55.469Z level=INFO msg="Uploading v688vnrkfcqiwaygym5ifmnr3yawh4xd-farm-top (232B)"4475lb # [ 49.228134] niks3-server[1074]: 2026/09/20 12:46:56 INFO Registered completed upload object_key=log/y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv4476lb # [ 49.235047] niks3-server[1074]: 2026/09/20 12:46:56 INFO Registered completed upload object_key=nar/1j36mvvk44wddjhqvk302zl80d251m1g0d4kc4gfqy00xyklwzbf.nar.zst4477lb # [ 49.241322] niks3-server[1074]: 2026/09/20 12:46:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4478lb # [ 49.246250] niks3-server[1074]: 2026/09/20 12:46:56 INFO Signed narinfos id=8 count=14479worker2 # [ 49.276887] nix-grpc-daemon[824]: time=2026-09-20T12:46:55.528Z level=INFO msg="Uploading 1 narinfos"4480lb # [ 49.258344] niks3-server[1074]: 2026/09/20 12:46:56 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4481lb # [ 49.261527] niks3-server[1074]: 2026/09/20 12:46:56 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.ls4482lb # [ 49.266770] niks3-server[1074]: 2026/09/20 12:46:56 INFO Completed upload id=84483lb # [ 49.268321] niks3-server[1074]: 2026/09/20 12:46:56 INFO Registered completed upload object_key=v688vnrkfcqiwaygym5ifmnr3yawh4xd.narinfo4484worker2 # [ 49.294833] nix-grpc-daemon[824]: time=2026-09-20T12:46:55.546Z level=INFO msg="Upload complete. (421ms)"4485worker2 # [ 49.300558] nix-grpc-daemon[788]: ts=2026-09-20T12:46:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=1 drv=y2wm8aizyyg449ia2pcscrjc2pklsrz4-farm-top.drv assign_id=4 outputs=14486worker2 # [ 49.314348] nix-daemon[814]: reaped child process 964, status = succeeded4487client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b >&2, in 3.35 seconds)4488client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath4489lb # [ 49.441639] envoy[926]: conn peer=[2001:db8:1::1]:46914 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9494 tx=3803 ms=69894490lb # [ 49.445512] envoy[926]: conn peer=[2001:db8:1::1]:51754 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=991 tx=480 ms=544491lb # [ 49.448930] envoy[926]: conn peer=[2001:db8:1::1]:51764 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4195 tx=1729 ms=31334492client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag t1 --argstr top t1b outPath, in 0.18 seconds)4493worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true4494worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep -c 'event=want ' || true, in 0.04 seconds)4495(finished: subtest: inputs already in the cache are not sent to the scheduler, in 3.60 seconds)4496subtest: two clients wanting the same drv build it once4497client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4498client # [ 49.545959] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4499client # Running as unit: dedup1.service; invocation ID: d2a16dee0fe74cb299c1b38f719428184500client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.04 seconds)4501client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4502worker2 # [ 49.783161] nix-grpc-daemon[788]: ts=2026-09-20T12:46:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:595924503client # [ 49.740928] nix[891]: don't know how to build these paths:4504client # [ 49.742351] nix[891]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4505worker1 # [ 49.764893] nix-grpc-daemon[787]: ts=2026-09-20T12:46:56Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04506worker1 # [ 49.773947] nix-grpc-daemon[787]: ts=2026-09-20T12:46:56Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.3:50051 clients=14507worker1 # [ 49.778777] nix-grpc-daemon[787]: ts=2026-09-20T12:46:56Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582784508worker1 # [ 49.798309] nix-grpc-daemon[787]: ts=2026-09-20T12:46:56Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582784509client # [ 49.794095] nix[891]: copying 1 paths to 'lb:50051'...4510client # [ 49.795629] nix[891]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4511worker1 # [ 49.809213] nix-grpc-daemon[787]: ts=2026-09-20T12:46:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582784512worker1 # [ 49.820732] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4513worker1 # [ 49.838650] nix-grpc-daemon[787]: ts=2026-09-20T12:46:56Z level=info event=niks3_push_started pid=9014514worker1 # [ 50.066418] nix-grpc-daemon[901]: time=2026-09-20T12:46:57.105Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""4515worker1 # [ 50.271613] nix-daemon[851]: accepted connection from pid 914, user nix-grpc-daemon (trusted)4516worker1 # [ 50.286631] nix-daemon[851]: reaped child process 917, status = succeeded4517worker1 # [ 50.445087] nix-daemon[851]: accepted connection from pid 919, user nix-grpc-daemon (trusted)4518worker1 # [ 50.456598] nix-daemon[851]: reaped child process 922, status = succeeded4519lb # [ 50.480419] niks3-server[1074]: 2026/09/20 12:46:57 INFO Received uploads request method=POST path=/api/pending_closures4520worker1 # [ 50.482940] nix-grpc-daemon[901]: time=2026-09-20T12:46:57.526Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4521worker1 # [ 50.485151] nix-grpc-daemon[901]: time=2026-09-20T12:46:57.528Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4522lb # [ 50.516691] niks3-server[1074]: 2026/09/20 12:46:57 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4523lb # [ 50.526705] niks3-server[1074]: 2026/09/20 12:46:57 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4524worker1 # [ 50.525464] nix-grpc-daemon[901]: time=2026-09-20T12:46:57.568Z level=INFO msg="Uploading 1 narinfos"4525lb # [ 50.531536] niks3-server[1074]: 2026/09/20 12:46:57 INFO Signed narinfos id=9 count=14526lb # [ 50.545205] niks3-server[1074]: 2026/09/20 12:46:57 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4527lb # [ 50.549789] niks3-server[1074]: 2026/09/20 12:46:57 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4528worker1 # [ 50.550493] nix-grpc-daemon[901]: time=2026-09-20T12:46:57.593Z level=INFO msg="Upload complete. (460ms)"4529lb # [ 50.556602] niks3-server[1074]: 2026/09/20 12:46:57 INFO Completed upload id=94530worker1 # [ 50.553069] nix-grpc-daemon[787]: ts=2026-09-20T12:46:57Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58278 duration_s=0 paths=1 nar_bytes_in=4324531lb # [ 50.561748] niks3-server[1074]: 2026/09/20 12:46:57 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4532worker1 # [ 50.556255] nix-grpc-daemon[787]: ts=2026-09-20T12:46:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582784533worker1 # [ 50.562959] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4534worker1 # [ 50.565122] nix-daemon[851]: reaped child process 899, status = succeeded4535worker1 # [ 50.570371] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4536client # [ 50.555625] nix[891]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4537client # [ 50.612629] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4538client # Running as unit: dedup2.service; invocation ID: dab7451010044885806f9c34716737a34539client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.08 seconds)4540worker1 # [ 50.880764] nix-grpc-daemon[787]: ts=2026-09-20T12:46:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582784541client # [ 50.877911] nix[906]: this derivation will be built:4542worker1 # [ 50.893487] nix-grpc-daemon[787]: ts=2026-09-20T12:46:57Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582784543client # [ 50.885453] nix[906]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4544worker1 # [ 50.906953] nix-grpc-daemon[787]: ts=2026-09-20T12:46:57Z level=debug event=want client=5 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04545client # [ 50.898033] nix[906]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4546worker1 # [ 50.912211] nix-grpc-daemon[787]: ts=2026-09-20T12:46:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582784547client: must succeed: sleep 24548client: (finished: must succeed: sleep 2, in 2.05 seconds)4549??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4550 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394551client: waiting for success: ! systemctl is-active dedup1 dedup24552??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4553 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394554worker1 # [ 54.197221] nix-daemon[851]: reaped child process 926, status = succeeded4555worker1 # [ 54.354572] nix-daemon[851]: accepted connection from pid 957, user nix-grpc-daemon (trusted)4556worker1 # [ 54.367496] nix-daemon[851]: reaped child process 960, status = succeeded4557lb # [ 54.386403] niks3-server[1074]: 2026/09/20 12:47:01 INFO Received uploads request method=POST path=/api/pending_closures4558worker1 # [ 54.393513] nix-grpc-daemon[901]: time=2026-09-20T12:47:01.435Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4559worker1 # [ 54.395739] nix-grpc-daemon[901]: time=2026-09-20T12:47:01.435Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4560lb # [ 54.431116] niks3-server[1074]: 2026/09/20 12:47:01 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4561lb # [ 54.445982] niks3-server[1074]: 2026/09/20 12:47:01 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4562lb # [ 54.455387] niks3-server[1074]: 2026/09/20 12:47:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4563lb # [ 54.459575] niks3-server[1074]: 2026/09/20 12:47:01 INFO Signed narinfos id=10 count=14564lb # [ 54.461584] niks3-server[1074]: 2026/09/20 12:47:01 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4565worker1 # [ 54.455161] nix-grpc-daemon[901]: time=2026-09-20T12:47:01.496Z level=INFO msg="Uploading 1 narinfos"4566lb # [ 54.468048] niks3-server[1074]: 2026/09/20 12:47:01 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4567lb # [ 54.471907] niks3-server[1074]: 2026/09/20 12:47:01 INFO Completed upload id=104568lb # [ 54.474238] niks3-server[1074]: 2026/09/20 12:47:01 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4569worker1 # [ 54.466069] nix-grpc-daemon[901]: time=2026-09-20T12:47:01.509Z level=INFO msg="Upload complete. (282ms)"4570worker1 # [ 54.471806] nix-grpc-daemon[787]: ts=2026-09-20T12:47:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58278 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14571worker1 # [ 54.478288] nix-grpc-daemon[787]: ts=2026-09-20T12:47:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58278 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=5 outputs=14572worker1 # [ 54.488390] nix-daemon[851]: reaped child process 924, status = succeeded4573client # [ 54.511724] systemd[1]: dedup1.service: Deactivated successfully.4574client # [ 54.515144] systemd[1]: dedup1.service: Consumed 106ms CPU time over 4.966s wall clock time, 39.3M memory peak, 8.6K incoming IP traffic, 9.1K outgoing IP traffic.4575client # [ 54.521335] systemd[1]: dedup2.service: Deactivated successfully.4576client # [ 54.523739] systemd[1]: dedup2.service: Consumed 128ms CPU time over 3.909s wall clock time, 31.1M memory peak, 7.9K incoming IP traffic, 6.8K outgoing IP traffic.4577client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds)4578client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4579client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.04 seconds)4580worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4581worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4582worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4583worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4584worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics4585worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.05 seconds)4586worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics4587worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)4588(finished: subtest: two clients wanting the same drv build it once, in 5.89 seconds)4589subtest: build hook: nix-daemon with builders = grpc://lb4590client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log4591client # [ 55.597501] systemd[1]: Started Nix Daemon.4592client # [ 55.752496] nix-daemon[947]: accepted connection from pid 944, user root (trusted)4593worker2 # [ 55.968785] nix-grpc-daemon[788]: ts=2026-09-20T12:47:02Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:595924594worker2 # [ 55.973549] nix-grpc-daemon[788]: ts=2026-09-20T12:47:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:595924595worker1 # [ 55.953866] nix-grpc-daemon[787]: ts=2026-09-20T12:47:02Z level=debug event=want client=6 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04596worker1 # [ 55.958196] nix-grpc-daemon[787]: ts=2026-09-20T12:47:02Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.4:50051 clients=14597worker2 # [ 56.031502] nix-grpc-daemon[788]: ts=2026-09-20T12:47:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924598worker2 # [ 56.040355] nix-grpc-daemon[788]: ts=2026-09-20T12:47:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:595924599worker2 # [ 56.048086] nix-grpc-daemon[788]: ts=2026-09-20T12:47:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:595924600worker2 # [ 56.052510] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4601worker2 # [ 56.199523] nix-daemon[814]: accepted connection from pid 1009, user nix-grpc-daemon (trusted)4602worker2 # [ 56.215818] nix-daemon[814]: reaped child process 1012, status = succeeded4603worker2 # [ 56.375413] nix-daemon[814]: accepted connection from pid 1014, user nix-grpc-daemon (trusted)4604worker2 # [ 56.390431] nix-daemon[814]: reaped child process 1017, status = succeeded4605lb # [ 56.374933] niks3-server[1074]: 2026/09/20 12:47:03 INFO Received uploads request method=POST path=/api/pending_closures4606worker2 # [ 56.407479] nix-grpc-daemon[824]: time=2026-09-20T12:47:02.659Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4607worker2 # [ 56.408986] nix-grpc-daemon[824]: time=2026-09-20T12:47:02.661Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4608lb # [ 56.391385] niks3-server[1074]: 2026/09/20 12:47:03 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4609lb # [ 56.395139] niks3-server[1074]: 2026/09/20 12:47:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4610lb # [ 56.397187] niks3-server[1074]: 2026/09/20 12:47:03 INFO Signed narinfos id=11 count=14611worker2 # [ 56.426485] nix-grpc-daemon[824]: time=2026-09-20T12:47:02.678Z level=INFO msg="Uploading 1 narinfos"4612lb # [ 56.403345] niks3-server[1074]: 2026/09/20 12:47:03 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4613lb # [ 56.406612] niks3-server[1074]: 2026/09/20 12:47:03 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4614lb # [ 56.409354] niks3-server[1074]: 2026/09/20 12:47:03 INFO Completed upload id=114615worker2 # [ 56.437244] nix-grpc-daemon[824]: time=2026-09-20T12:47:02.689Z level=INFO msg="Upload complete. (377ms)"4616lb # [ 56.411588] niks3-server[1074]: 2026/09/20 12:47:03 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4617worker2 # [ 56.439555] nix-grpc-daemon[788]: ts=2026-09-20T12:47:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=0 paths=1 nar_bytes_in=5124618worker2 # [ 56.444166] nix-grpc-daemon[788]: ts=2026-09-20T12:47:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924619worker2 # [ 56.452221] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4620worker2 # [ 56.453558] nix-daemon[814]: reaped child process 1007, status = succeeded4621worker2 # [ 56.458907] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4622worker2 # [ 57.889693] nix-daemon[814]: reaped child process 1021, status = succeeded4623worker2 # [ 58.048552] nix-daemon[814]: accepted connection from pid 1036, user nix-grpc-daemon (trusted)4624worker2 # [ 58.062576] nix-daemon[814]: reaped child process 1039, status = succeeded4625lb # [ 58.047450] niks3-server[1074]: 2026/09/20 12:47:05 INFO Received uploads request method=POST path=/api/pending_closures4626worker2 # [ 58.291919] nix-grpc-daemon[824]: time=2026-09-20T12:47:04.537Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4627worker2 # [ 58.300438] nix-grpc-daemon[824]: time=2026-09-20T12:47:04.537Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4628lb # [ 58.303873] niks3-server[1074]: 2026/09/20 12:47:05 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4629lb # [ 58.310149] niks3-server[1074]: 2026/09/20 12:47:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4630lb # [ 58.315244] niks3-server[1074]: 2026/09/20 12:47:05 INFO Signed narinfos id=12 count=14631worker2 # [ 58.347196] nix-grpc-daemon[824]: time=2026-09-20T12:47:04.598Z level=INFO msg="Uploading 1 narinfos"4632lb # [ 58.319147] niks3-server[1074]: 2026/09/20 12:47:05 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4633lb # [ 58.336422] niks3-server[1074]: 2026/09/20 12:47:05 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4634lb # [ 58.340742] niks3-server[1074]: 2026/09/20 12:47:05 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4635lb # [ 58.350422] niks3-server[1074]: 2026/09/20 12:47:05 INFO Completed upload id=124636lb # [ 58.353258] niks3-server[1074]: 2026/09/20 12:47:05 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4637worker2 # [ 58.378477] nix-grpc-daemon[824]: time=2026-09-20T12:47:04.630Z level=INFO msg="Upload complete. (511ms)"4638worker2 # [ 58.387412] nix-grpc-daemon[788]: ts=2026-09-20T12:47:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=6 outputs=14639worker2 # [ 58.397175] nix-grpc-daemon[788]: ts=2026-09-20T12:47:04Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:595924640worker2 # [ 58.409554] nix-daemon[814]: reaped child process 1019, status = succeeded4641worker1 # [ 58.374518] nix-grpc-daemon[787]: ts=2026-09-20T12:47:05Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:582784642worker1 # [ 58.389637] nix-grpc-daemon[787]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4643worker1 # [ 58.408640] nix-grpc-daemon[787]: ts=2026-09-20T12:47:05Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:58278 duration_s=0 paths=1 nar_bytes_out=1284644worker1 # [ 58.657347] nix-grpc-daemon[787]: ts=2026-09-20T12:47:05Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:582784645worker2 # [ 58.699297] nix-grpc-daemon[788]: ts=2026-09-20T12:47:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:595924646worker2 # [ 58.708389] nix-grpc-daemon[824]: time=2026-09-20T12:47:04.960Z level=INFO msg="All 1 paths already cached"4647worker1 # [ 58.690152] nix-grpc-daemon[787]: ts=2026-09-20T12:47:05Z level=debug event=want client=7 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04648worker2 # [ 58.726990] nix-grpc-daemon[788]: ts=2026-09-20T12:47:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924649worker1 # [ 58.694771] nix-grpc-daemon[787]: ts=2026-09-20T12:47:05Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.4:50051 clients=14650worker2 # [ 58.735878] nix-grpc-daemon[788]: ts=2026-09-20T12:47:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:595924651worker2 # [ 58.744934] nix-grpc-daemon[824]: time=2026-09-20T12:47:04.997Z level=INFO msg="All 1 paths already cached"4652worker2 # [ 58.749688] nix-grpc-daemon[788]: ts=2026-09-20T12:47:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:595924653worker2 # [ 58.755759] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4654worker2 # [ 58.908488] nix-daemon[814]: accepted connection from pid 1043, user nix-grpc-daemon (trusted)4655worker2 # [ 58.922980] nix-daemon[814]: reaped child process 1046, status = succeeded4656worker2 # [ 59.063383] nix-daemon[814]: accepted connection from pid 1048, user nix-grpc-daemon (trusted)4657worker2 # [ 59.074240] nix-daemon[814]: reaped child process 1051, status = succeeded4658lb # [ 59.061325] niks3-server[1074]: 2026/09/20 12:47:06 INFO Received uploads request method=POST path=/api/pending_closures4659worker2 # [ 59.097353] nix-grpc-daemon[824]: time=2026-09-20T12:47:05.349Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4660worker2 # [ 59.098860] nix-grpc-daemon[824]: time=2026-09-20T12:47:05.351Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4661lb # [ 59.089704] niks3-server[1074]: 2026/09/20 12:47:06 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4662lb # [ 59.101534] niks3-server[1074]: 2026/09/20 12:47:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4663lb # [ 59.107063] niks3-server[1074]: 2026/09/20 12:47:06 INFO Signed narinfos id=13 count=14664worker2 # [ 59.138152] nix-grpc-daemon[824]: time=2026-09-20T12:47:05.390Z level=INFO msg="Uploading 1 narinfos"4665lb # [ 59.114104] niks3-server[1074]: 2026/09/20 12:47:06 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4666lb # [ 59.127440] niks3-server[1074]: 2026/09/20 12:47:06 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4667lb # [ 59.130922] niks3-server[1074]: 2026/09/20 12:47:06 INFO Completed upload id=134668worker2 # [ 59.160068] nix-grpc-daemon[824]: time=2026-09-20T12:47:05.412Z level=INFO msg="Upload complete. (398ms)"4669worker2 # [ 59.161514] nix-grpc-daemon[788]: ts=2026-09-20T12:47:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=0 paths=1 nar_bytes_in=6244670lb # [ 59.133284] niks3-server[1074]: 2026/09/20 12:47:06 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4671worker2 # [ 59.166793] nix-grpc-daemon[788]: ts=2026-09-20T12:47:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924672worker2 # [ 59.172305] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4673worker2 # [ 59.174543] nix-daemon[814]: reaped child process 1041, status = succeeded4674worker2 # [ 59.179791] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4675lb # [ 59.442264] envoy[926]: conn peer=[2001:db8:1::1]:51772 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2985 tx=1370 ms=47394676lb # [ 59.446500] envoy[926]: conn peer=[2001:db8:1::1]:51786 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1589 tx=1374 ms=36144677lb # [ 59.450116] envoy[926]: conn peer=[2001:db8:1::1]:59436 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3426 tx=1660 ms=25244678lb # [ 59.453643] envoy[926]: conn peer=[2001:db8:1::1]:59438 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=334 ms=844679worker2 # [ 60.005727] nix-daemon[814]: reaped child process 1055, status = succeeded4680worker2 # [ 60.152840] nix-daemon[814]: accepted connection from pid 1070, user nix-grpc-daemon (trusted)4681worker2 # [ 60.166984] nix-daemon[814]: reaped child process 1073, status = succeeded4682lb # [ 60.154752] niks3-server[1074]: 2026/09/20 12:47:07 INFO Received uploads request method=POST path=/api/pending_closures4683worker2 # [ 60.196944] nix-grpc-daemon[824]: time=2026-09-20T12:47:06.448Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4684worker2 # [ 60.199054] nix-grpc-daemon[824]: time=2026-09-20T12:47:06.450Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4685lb # [ 60.208228] niks3-server[1074]: 2026/09/20 12:47:07 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4686lb # [ 60.216271] niks3-server[1074]: 2026/09/20 12:47:07 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4687worker2 # [ 60.250376] nix-grpc-daemon[824]: time=2026-09-20T12:47:06.502Z level=INFO msg="Uploading 1 narinfos"4688lb # [ 60.223149] niks3-server[1074]: 2026/09/20 12:47:07 INFO Signed narinfos id=14 count=14689lb # [ 60.232248] niks3-server[1074]: 2026/09/20 12:47:07 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4690lb # [ 60.238339] niks3-server[1074]: 2026/09/20 12:47:07 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4691lb # [ 60.244263] niks3-server[1074]: 2026/09/20 12:47:07 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4692lb # [ 60.251140] niks3-server[1074]: 2026/09/20 12:47:07 INFO Completed upload id=144693worker2 # [ 60.279375] nix-grpc-daemon[824]: time=2026-09-20T12:47:06.531Z level=INFO msg="Upload complete. (292ms)"4694lb # [ 60.253136] niks3-server[1074]: 2026/09/20 12:47:07 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4695worker2 # [ 60.284508] nix-grpc-daemon[788]: ts=2026-09-20T12:47:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=7 outputs=14696worker2 # [ 60.297491] nix-daemon[814]: reaped child process 1053, status = succeeded4697worker2 # [ 60.329677] nix-grpc-daemon[788]: ts=2026-09-20T12:47:06Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:595924698worker2 # [ 60.345724] nix-grpc-daemon[788]: ts=2026-09-20T12:47:06Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:595924699worker2 # [ 60.351155] nix-grpc-daemon[788]: ts=2026-09-20T12:47:06Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=0 paths=1 nar_bytes_out=1764700worker2 # [ 60.608284] nix-grpc-daemon[788]: ts=2026-09-20T12:47:06Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:595924701worker2 # [ 60.615064] nix-grpc-daemon[788]: ts=2026-09-20T12:47:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:595924702worker2 # [ 60.627521] nix-grpc-daemon[824]: time=2026-09-20T12:47:06.879Z level=INFO msg="All 2 paths already cached"4703worker1 # [ 60.609756] nix-grpc-daemon[787]: ts=2026-09-20T12:47:07Z level=debug event=want client=8 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04704worker1 # [ 60.614539] nix-grpc-daemon[787]: ts=2026-09-20T12:47:07Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.4:50051 clients=14705worker2 # [ 60.650870] nix-grpc-daemon[788]: ts=2026-09-20T12:47:06Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924706worker2 # [ 60.667056] nix-grpc-daemon[788]: ts=2026-09-20T12:47:06Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:595924707worker2 # [ 60.681439] nix-grpc-daemon[824]: time=2026-09-20T12:47:06.933Z level=INFO msg="All 2 paths already cached"4708worker2 # [ 60.688858] nix-grpc-daemon[788]: ts=2026-09-20T12:47:06Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:595924709worker2 # [ 60.694070] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4710worker2 # [ 60.841101] nix-daemon[814]: accepted connection from pid 1077, user nix-grpc-daemon (trusted)4711worker2 # [ 60.854562] nix-daemon[814]: reaped child process 1080, status = succeeded4712worker2 # [ 61.002296] nix-daemon[814]: accepted connection from pid 1082, user nix-grpc-daemon (trusted)4713worker2 # [ 61.014739] nix-daemon[814]: reaped child process 1085, status = succeeded4714lb # [ 61.002805] niks3-server[1074]: 2026/09/20 12:47:08 INFO Received uploads request method=POST path=/api/pending_closures4715worker2 # [ 61.038384] nix-grpc-daemon[824]: time=2026-09-20T12:47:07.290Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4716worker2 # [ 61.039982] nix-grpc-daemon[824]: time=2026-09-20T12:47:07.292Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4717lb # [ 61.033262] niks3-server[1074]: 2026/09/20 12:47:08 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4718lb # [ 61.040124] niks3-server[1074]: 2026/09/20 12:47:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign4719lb # [ 61.044815] niks3-server[1074]: 2026/09/20 12:47:08 INFO Signed narinfos id=15 count=14720worker2 # [ 61.075739] nix-grpc-daemon[824]: time=2026-09-20T12:47:07.327Z level=INFO msg="Uploading 1 narinfos"4721lb # [ 61.059615] niks3-server[1074]: 2026/09/20 12:47:08 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4722lb # [ 61.062578] niks3-server[1074]: 2026/09/20 12:47:08 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete4723lb # [ 61.068678] niks3-server[1074]: 2026/09/20 12:47:08 INFO Completed upload id=154724worker2 # [ 61.096253] nix-grpc-daemon[824]: time=2026-09-20T12:47:07.348Z level=INFO msg="Upload complete. (397ms)"4725worker2 # [ 61.099710] nix-grpc-daemon[788]: ts=2026-09-20T12:47:07Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=0 paths=1 nar_bytes_in=7524726lb # [ 61.073517] niks3-server[1074]: 2026/09/20 12:47:08 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4727worker2 # [ 61.106533] nix-grpc-daemon[788]: ts=2026-09-20T12:47:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924728worker2 # [ 61.111748] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4729worker2 # [ 61.116042] nix-daemon[814]: reaped child process 1075, status = succeeded4730worker2 # [ 61.121076] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4731worker2 # [ 62.147532] nix-daemon[814]: reaped child process 1089, status = succeeded4732worker2 # [ 62.300176] nix-daemon[814]: accepted connection from pid 1104, user nix-grpc-daemon (trusted)4733worker2 # [ 62.311950] nix-daemon[814]: reaped child process 1107, status = succeeded4734lb # [ 62.301578] niks3-server[1074]: 2026/09/20 12:47:09 INFO Received uploads request method=POST path=/api/pending_closures4735worker2 # [ 62.338805] nix-grpc-daemon[824]: time=2026-09-20T12:47:08.590Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4736worker2 # [ 62.340482] nix-grpc-daemon[824]: time=2026-09-20T12:47:08.592Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4737lb # [ 62.342533] niks3-server[1074]: 2026/09/20 12:47:09 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4738lb # [ 62.352116] niks3-server[1074]: 2026/09/20 12:47:09 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4739lb # [ 62.361877] niks3-server[1074]: 2026/09/20 12:47:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign4740worker2 # [ 62.395237] nix-grpc-daemon[824]: time=2026-09-20T12:47:08.647Z level=INFO msg="Uploading 1 narinfos"4741lb # [ 62.367326] niks3-server[1074]: 2026/09/20 12:47:09 INFO Signed narinfos id=16 count=14742lb # [ 62.372085] niks3-server[1074]: 2026/09/20 12:47:09 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4743lb # [ 62.382269] niks3-server[1074]: 2026/09/20 12:47:09 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete4744lb # [ 62.387279] niks3-server[1074]: 2026/09/20 12:47:09 INFO Completed upload id=164745lb # [ 62.388825] niks3-server[1074]: 2026/09/20 12:47:09 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4746worker2 # [ 62.415455] nix-grpc-daemon[824]: time=2026-09-20T12:47:08.667Z level=INFO msg="Upload complete. (287ms)"4747worker2 # [ 62.422132] nix-grpc-daemon[788]: ts=2026-09-20T12:47:08Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=14748worker2 # [ 62.428790] nix-grpc-daemon[788]: ts=2026-09-20T12:47:08Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:595924749worker2 # [ 62.438774] nix-daemon[814]: reaped child process 1087, status = succeeded4750worker2 # [ 62.442628] nix-grpc-daemon[788]: ts=2026-09-20T12:47:08Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:595924751worker2 # [ 62.445721] nix-grpc-daemon[788]: ts=2026-09-20T12:47:08Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=0 paths=1 nar_bytes_out=2324752client # [ 62.504723] nix-daemon[947]: reaped child process 949, status = succeeded4753client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag hook 2>/tmp/hook.log, in 7.11 seconds)4754client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4755client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4756client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4757client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.03 seconds)4758client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }4759client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)4760(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 7.20 seconds)4761subtest: an input only one worker has still reaches the builder4762client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only4763client # this derivation will be built:4764client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv4765client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...4766client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.37 seconds)4767client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure4768client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.18 seconds)4769worker1: must succeed: nix-store --import < /tmp/shared/inp.closure4770worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.21 seconds)4771worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only4772worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)4773client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&24774client # [ 63.562348] nix-daemon[947]: accepted connection from pid 1027, user root (trusted)4775client # this derivation will be built:4776client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4777client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...4778worker2 # [ 63.791764] nix-grpc-daemon[788]: ts=2026-09-20T12:47:10Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:595924779worker2 # [ 63.797403] nix-grpc-daemon[788]: ts=2026-09-20T12:47:10Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:595924780client # copying 1 paths...4781client # copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' to 'grpc://lb:50051'...4782worker2 # [ 63.808603] nix-grpc-daemon[788]: ts=2026-09-20T12:47:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:595924783worker2 # [ 63.819100] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4784worker2 # [ 63.977300] nix-daemon[814]: accepted connection from pid 1114, user nix-grpc-daemon (trusted)4785worker2 # [ 63.991047] nix-daemon[814]: reaped child process 1117, status = succeeded4786lb # [ 63.977215] niks3-server[1074]: 2026/09/20 12:47:11 INFO Received uploads request method=POST path=/api/pending_closures4787worker2 # [ 64.010710] nix-grpc-daemon[824]: time=2026-09-20T12:47:10.262Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4788worker2 # [ 64.012574] nix-grpc-daemon[824]: time=2026-09-20T12:47:10.264Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"4789lb # [ 63.992864] niks3-server[1074]: 2026/09/20 12:47:11 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst4790lb # [ 63.995944] niks3-server[1074]: 2026/09/20 12:47:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign4791lb # [ 63.997592] niks3-server[1074]: 2026/09/20 12:47:11 INFO Signed narinfos id=17 count=14792worker2 # [ 64.025796] nix-grpc-daemon[824]: time=2026-09-20T12:47:10.277Z level=INFO msg="Uploading 1 narinfos"4793lb # [ 64.003074] niks3-server[1074]: 2026/09/20 12:47:11 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls4794lb # [ 64.005195] niks3-server[1074]: 2026/09/20 12:47:11 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete4795lb # [ 64.009346] niks3-server[1074]: 2026/09/20 12:47:11 INFO Completed upload id=174796worker2 # [ 64.037225] nix-grpc-daemon[824]: time=2026-09-20T12:47:10.289Z level=INFO msg="Upload complete. (207ms)"4797lb # [ 64.010436] niks3-server[1074]: 2026/09/20 12:47:11 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo4798worker2 # [ 64.039267] nix-grpc-daemon[788]: ts=2026-09-20T12:47:10Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=0 paths=1 nar_bytes_in=1204799worker2 # [ 64.045192] nix-daemon[814]: reaped child process 1112, status = succeeded4800worker1 # [ 64.020660] nix-grpc-daemon[787]: ts=2026-09-20T12:47:11Z level=debug event=want client=9 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=04801worker1 # [ 64.025147] nix-grpc-daemon[787]: ts=2026-09-20T12:47:11Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=14802worker1 # [ 64.063141] nix-grpc-daemon[787]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582784803worker1 # [ 64.073359] nix-grpc-daemon[787]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582784804client # copying 2 paths to 'lb:50051'...4805client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...4806worker1 # [ 64.083835] nix-grpc-daemon[787]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582784807client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...4808worker1 # [ 64.094283] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4809worker1 # [ 64.231281] nix-daemon[851]: accepted connection from pid 987, user nix-grpc-daemon (trusted)4810worker1 # [ 64.244728] nix-daemon[851]: reaped child process 990, status = succeeded4811worker1 # [ 64.382180] nix-daemon[851]: accepted connection from pid 992, user nix-grpc-daemon (trusted)4812worker1 # [ 64.393846] nix-daemon[851]: reaped child process 995, status = succeeded4813lb # [ 64.414131] niks3-server[1074]: 2026/09/20 12:47:11 INFO Received uploads request method=POST path=/api/pending_closures4814lb # [ 64.418580] niks3-server[1074]: 2026/09/20 12:47:11 INFO Received uploads request method=POST path=/api/pending_closures4815worker1 # [ 64.416496] nix-grpc-daemon[901]: time=2026-09-20T12:47:11.459Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"4816worker1 # [ 64.418140] nix-grpc-daemon[901]: time=2026-09-20T12:47:11.461Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"4817worker1 # [ 64.420744] nix-grpc-daemon[901]: time=2026-09-20T12:47:11.461Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"4818lb # [ 64.436624] niks3-server[1074]: 2026/09/20 12:47:11 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst4819lb # [ 64.443438] niks3-server[1074]: 2026/09/20 12:47:11 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst4820lb # [ 64.447768] niks3-server[1074]: 2026/09/20 12:47:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign4821lb # [ 64.450234] niks3-server[1074]: 2026/09/20 12:47:11 INFO Signed narinfos id=18 count=14822lb # [ 64.452397] niks3-server[1074]: 2026/09/20 12:47:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign4823lb # [ 64.454576] niks3-server[1074]: 2026/09/20 12:47:11 INFO Signed narinfos id=19 count=24824worker1 # [ 64.450100] nix-grpc-daemon[901]: time=2026-09-20T12:47:11.492Z level=INFO msg="Uploading 3 narinfos"4825lb # [ 64.457247] niks3-server[1074]: 2026/09/20 12:47:11 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls4826lb # [ 64.458969] niks3-server[1074]: 2026/09/20 12:47:11 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls4827lb # [ 64.472460] niks3-server[1074]: 2026/09/20 12:47:11 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4828lb # [ 64.474680] niks3-server[1074]: 2026/09/20 12:47:11 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete4829lb # [ 64.478780] niks3-server[1074]: 2026/09/20 12:47:11 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo4830lb # [ 64.480516] niks3-server[1074]: 2026/09/20 12:47:11 INFO Completed upload id=194831lb # [ 64.483026] niks3-server[1074]: 2026/09/20 12:47:11 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete4832lb # [ 64.484624] niks3-server[1074]: 2026/09/20 12:47:11 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo4833lb # [ 64.486607] niks3-server[1074]: 2026/09/20 12:47:11 INFO Completed upload id=184834worker1 # [ 64.481571] nix-grpc-daemon[901]: time=2026-09-20T12:47:11.524Z level=INFO msg="Upload complete. (373ms)"4835worker1 # [ 64.483774] nix-grpc-daemon[787]: ts=2026-09-20T12:47:11Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58278 duration_s=0 paths=2 nar_bytes_in=9764836worker1 # [ 64.486520] nix-grpc-daemon[787]: ts=2026-09-20T12:47:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582784837worker1 # [ 64.491754] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4838worker1 # [ 64.499760] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4839client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...4840worker1 # [ 64.501889] nix-daemon[851]: reaped child process 985, status = succeeded4841client # uses-input-w1onlya> node-a: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4842worker1 # [ 66.129482] nix-daemon[851]: reaped child process 999, status = succeeded4843worker1 # [ 66.281881] nix-daemon[851]: accepted connection from pid 1014, user nix-grpc-daemon (trusted)4844worker1 # [ 66.292854] nix-daemon[851]: reaped child process 1017, status = succeeded4845lb # [ 66.314406] niks3-server[1074]: 2026/09/20 12:47:13 INFO Received uploads request method=POST path=/api/pending_closures4846worker1 # [ 66.316818] nix-grpc-daemon[901]: time=2026-09-20T12:47:13.359Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4847lb # [ 66.344636] niks3-server[1074]: 2026/09/20 12:47:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign4848worker1 # [ 66.344966] nix-grpc-daemon[901]: time=2026-09-20T12:47:13.387Z level=INFO msg="Uploading 1 narinfos"4849lb # [ 66.350880] niks3-server[1074]: 2026/09/20 12:47:13 INFO Signed narinfos id=20 count=14850lb # [ 66.361879] niks3-server[1074]: 2026/09/20 12:47:13 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv4851lb # [ 66.369183] niks3-server[1074]: 2026/09/20 12:47:13 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls4852lb # [ 66.380573] niks3-server[1074]: 2026/09/20 12:47:13 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete4853lb # [ 66.386526] niks3-server[1074]: 2026/09/20 12:47:13 INFO Completed upload id=204854worker1 # [ 66.380540] nix-grpc-daemon[901]: time=2026-09-20T12:47:13.423Z level=INFO msg="Upload complete. (270ms)"4855lb # [ 66.388769] niks3-server[1074]: 2026/09/20 12:47:13 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo4856worker1 # [ 66.386377] nix-grpc-daemon[787]: ts=2026-09-20T12:47:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58278 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=9 outputs=14857worker1 # [ 66.396640] nix-daemon[851]: reaped child process 997, status = succeeded4858client # copying 1 paths...4859worker1 # [ 66.432801] nix-grpc-daemon[787]: ts=2026-09-20T12:47:13Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582784860client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...4861worker2 # [ 66.486970] nix-grpc-daemon[788]: ts=2026-09-20T12:47:12Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:595924862worker2 # [ 66.502673] nix-grpc-daemon[788]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...4863worker2 # [ 66.522666] nix-grpc-daemon[788]: ts=2026-09-20T12:47:12Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=0 paths=1 nar_bytes_out=1204864client # [ 66.539814] nix-daemon[947]: reaped child process 1030, status = succeeded4865client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 3.16 seconds)4866client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&24867client # [ 66.714081] nix-daemon[947]: accepted connection from pid 1048, user root (trusted)4868client # this derivation will be built:4869client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4870worker2 # [ 66.931573] nix-grpc-daemon[788]: ts=2026-09-20T12:47:13Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:595924871client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...4872worker1 # [ 66.905447] nix-grpc-daemon[787]: ts=2026-09-20T12:47:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582784873worker1 # [ 66.914570] nix-grpc-daemon[901]: time=2026-09-20T12:47:13.957Z level=INFO msg="All 1 paths already cached"4874worker1 # [ 66.929145] nix-grpc-daemon[787]: ts=2026-09-20T12:47:13Z level=debug event=want client=10 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=04875worker1 # [ 66.933852] nix-grpc-daemon[787]: ts=2026-09-20T12:47:13Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=14876worker2 # [ 66.970218] nix-grpc-daemon[788]: ts=2026-09-20T12:47:13Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924877worker2 # [ 66.983269] nix-grpc-daemon[788]: ts=2026-09-20T12:47:13Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:595924878client # copying 1 paths to 'lb:50051'...4879client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...4880worker2 # [ 67.002302] nix-grpc-daemon[788]: ts=2026-09-20T12:47:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:595924881worker2 # [ 67.013303] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4882worker2 # [ 67.029400] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 1/5)4883worker2 # [ 67.059173] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 105 ms (attempt 2/5)4884worker2 # [ 67.170113] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 99 ms (attempt 3/5)4885worker2 # [ 67.275059] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 4/5)4886worker2 # [ 67.335250] nix-grpc-daemon[788]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4887worker2 # [ 67.340721] nix-grpc-daemon[788]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...4888worker2 # [ 67.555814] nix-daemon[814]: accepted connection from pid 1126, user nix-grpc-daemon (trusted)4889worker2 # [ 67.569915] nix-daemon[814]: reaped child process 1129, status = succeeded4890worker2 # [ 67.732432] nix-daemon[814]: accepted connection from pid 1131, user nix-grpc-daemon (trusted)4891worker2 # [ 67.746503] nix-daemon[814]: reaped child process 1134, status = succeeded4892lb # [ 67.731676] niks3-server[1074]: 2026/09/20 12:47:14 INFO Received uploads request method=POST path=/api/pending_closures4893worker2 # [ 67.769962] nix-grpc-daemon[824]: time=2026-09-20T12:47:14.021Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4894worker2 # [ 67.771768] nix-grpc-daemon[824]: time=2026-09-20T12:47:14.023Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"4895lb # [ 67.763983] niks3-server[1074]: 2026/09/20 12:47:14 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst4896lb # [ 67.773391] niks3-server[1074]: 2026/09/20 12:47:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign4897lb # [ 67.778512] niks3-server[1074]: 2026/09/20 12:47:14 INFO Signed narinfos id=21 count=14898worker2 # [ 67.809564] nix-grpc-daemon[824]: time=2026-09-20T12:47:14.061Z level=INFO msg="Uploading 1 narinfos"4899lb # [ 67.792323] niks3-server[1074]: 2026/09/20 12:47:14 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls4900lb # [ 67.798173] niks3-server[1074]: 2026/09/20 12:47:14 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete4901lb # [ 67.805833] niks3-server[1074]: 2026/09/20 12:47:14 INFO Completed upload id=214902worker2 # [ 67.833836] nix-grpc-daemon[824]: time=2026-09-20T12:47:14.085Z level=INFO msg="Upload complete. (472ms)"4903lb # [ 67.809924] niks3-server[1074]: 2026/09/20 12:47:14 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo4904worker2 # [ 67.838642] nix-grpc-daemon[788]: ts=2026-09-20T12:47:14Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=0 paths=1 nar_bytes_in=5604905worker2 # [ 67.844285] nix-grpc-daemon[788]: ts=2026-09-20T12:47:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:595924906worker2 # [ 67.855782] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4907worker2 # [ 67.862109] nix-daemon[814]: reaped child process 1120, status = succeeded4908worker2 # [ 67.865109] nix-daemon[814]: accepted connection from pid 788, user nix-grpc-daemon (trusted)4909client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...4910client # uses-input-w1onlyb> worker2: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4911worker2 # [ 68.679836] nix-daemon[814]: reaped child process 1138, status = succeeded4912worker2 # [ 68.841288] nix-daemon[814]: accepted connection from pid 1153, user nix-grpc-daemon (trusted)4913worker2 # [ 68.855349] nix-daemon[814]: reaped child process 1156, status = succeeded4914lb # [ 68.843823] niks3-server[1074]: 2026/09/20 12:47:16 INFO Received uploads request method=POST path=/api/pending_closures4915worker2 # [ 68.880618] nix-grpc-daemon[824]: time=2026-09-20T12:47:15.132Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4916lb # [ 68.874372] niks3-server[1074]: 2026/09/20 12:47:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign4917lb # [ 68.881896] niks3-server[1074]: 2026/09/20 12:47:16 INFO Signed narinfos id=22 count=14918worker2 # [ 68.913367] nix-grpc-daemon[824]: time=2026-09-20T12:47:15.165Z level=INFO msg="Uploading 1 narinfos"4919lb # [ 68.893733] niks3-server[1074]: 2026/09/20 12:47:16 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv4920lb # [ 68.906217] niks3-server[1074]: 2026/09/20 12:47:16 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls4921lb # [ 68.912574] niks3-server[1074]: 2026/09/20 12:47:16 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete4922lb # [ 68.918401] niks3-server[1074]: 2026/09/20 12:47:16 INFO Completed upload id=224923worker2 # [ 68.945942] nix-grpc-daemon[824]: time=2026-09-20T12:47:15.198Z level=INFO msg="Upload complete. (274ms)"4924lb # [ 68.922606] niks3-server[1074]: 2026/09/20 12:47:16 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo4925worker2 # [ 68.952227] nix-grpc-daemon[788]: ts=2026-09-20T12:47:15Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=10 outputs=14926worker2 # [ 68.964044] nix-daemon[814]: reaped child process 1136, status = succeeded4927client # copying 1 paths...4928worker2 # [ 68.998384] nix-grpc-daemon[788]: ts=2026-09-20T12:47:15Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:595924929client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...4930worker2 # [ 69.018060] nix-grpc-daemon[788]: ts=2026-09-20T12:47:15Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:595924931worker2 # [ 69.021964] nix-grpc-daemon[788]: ts=2026-09-20T12:47:15Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=0 paths=1 nar_bytes_out=1204932client # [ 69.080524] nix-daemon[947]: reaped child process 1051, status = succeeded4933client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 2.54 seconds)4934client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&24935client # [ 69.251080] nix-daemon[947]: accepted connection from pid 1069, user root (trusted)4936client # this derivation will be built:4937client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4938worker2 # [ 69.466871] nix-grpc-daemon[788]: ts=2026-09-20T12:47:15Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:595924939client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux'...4940lb # [ 69.442442] envoy[926]: conn peer=[2001:db8:1::1]:59456 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=604941worker1 # [ 69.438345] nix-grpc-daemon[787]: ts=2026-09-20T12:47:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582784942lb # [ 69.446583] envoy[926]: conn peer=[2001:db8:1::1]:59442 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3854 tx=1879 ms=17134943lb # [ 69.450249] envoy[926]: conn peer=[2001:db8:1::1]:59460 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4315 tx=2108 ms=18874944lb # [ 69.453924] envoy[926]: conn peer=[2001:db8:1::1]:59470 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=410 ms=534945lb # [ 69.457764] envoy[926]: conn peer=[2001:db8:1::1]:41266 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4208 tx=1744 ms=27434946lb # [ 69.462671] envoy[926]: conn peer=[2001:db8:1::1]:41274 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=329 ms=504947lb # [ 69.466309] envoy[926]: conn peer=[2001:db8:1::1]:41288 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=564948lb # [ 69.469777] envoy[926]: conn peer=[2001:db8:1::1]:41278 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3713 tx=1806 ms=21414949worker1 # [ 69.471346] nix-grpc-daemon[901]: time=2026-09-20T12:47:16.513Z level=INFO msg="All 1 paths already cached"4950worker1 # [ 69.485938] nix-grpc-daemon[787]: ts=2026-09-20T12:47:16Z level=debug event=want client=11 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=04951worker1 # [ 69.491704] nix-grpc-daemon[787]: ts=2026-09-20T12:47:16Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=14952worker1 # [ 69.498160] nix-grpc-daemon[787]: ts=2026-09-20T12:47:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582784953worker1 # [ 69.510530] nix-grpc-daemon[787]: ts=2026-09-20T12:47:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:582784954worker1 # [ 69.523812] nix-grpc-daemon[901]: time=2026-09-20T12:47:16.566Z level=INFO msg="All 1 paths already cached"4955client # copying 1 paths to 'lb:50051'...4956client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...4957worker1 # [ 69.532424] nix-grpc-daemon[787]: ts=2026-09-20T12:47:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:582784958worker1 # [ 69.543557] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4959worker1 # [ 69.713062] nix-daemon[851]: accepted connection from pid 1025, user nix-grpc-daemon (trusted)4960worker1 # [ 69.725801] nix-daemon[851]: reaped child process 1028, status = succeeded4961worker1 # [ 69.885809] nix-daemon[851]: accepted connection from pid 1030, user nix-grpc-daemon (trusted)4962worker1 # [ 69.897154] nix-daemon[851]: reaped child process 1033, status = succeeded4963lb # [ 69.917424] niks3-server[1074]: 2026/09/20 12:47:17 INFO Received uploads request method=POST path=/api/pending_closures4964worker1 # [ 69.920404] nix-grpc-daemon[901]: time=2026-09-20T12:47:16.963Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4965worker1 # [ 69.921859] nix-grpc-daemon[901]: time=2026-09-20T12:47:16.964Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"4966lb # [ 69.952186] niks3-server[1074]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst4967lb # [ 69.961567] niks3-server[1074]: 2026/09/20 12:47:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign4968worker1 # [ 69.959830] nix-grpc-daemon[901]: time=2026-09-20T12:47:17.002Z level=INFO msg="Uploading 1 narinfos"4969lb # [ 69.965976] niks3-server[1074]: 2026/09/20 12:47:17 INFO Signed narinfos id=23 count=14970lb # [ 69.973225] niks3-server[1074]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls4971lb # [ 69.983916] niks3-server[1074]: 2026/09/20 12:47:17 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete4972lb # [ 69.989113] niks3-server[1074]: 2026/09/20 12:47:17 INFO Completed upload id=234973worker1 # [ 69.983188] nix-grpc-daemon[901]: time=2026-09-20T12:47:17.026Z level=INFO msg="Upload complete. (428ms)"4974lb # [ 69.992727] niks3-server[1074]: 2026/09/20 12:47:17 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo4975worker1 # [ 69.988133] nix-grpc-daemon[787]: ts=2026-09-20T12:47:17Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:58278 duration_s=0 paths=1 nar_bytes_in=5604976worker1 # [ 69.993134] nix-grpc-daemon[787]: ts=2026-09-20T12:47:17Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:582784977worker1 # [ 70.004064] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4978worker1 # [ 70.010150] nix-daemon[851]: reaped child process 1023, status = succeeded4979worker1 # [ 70.013582] nix-daemon[851]: accepted connection from pid 787, user nix-grpc-daemon (trusted)4980client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...4981client # uses-input-w1onlyc> node-a: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4982worker1 # [ 71.439850] nix-daemon[851]: reaped child process 1037, status = succeeded4983worker1 # [ 71.587070] nix-daemon[851]: accepted connection from pid 1052, user nix-grpc-daemon (trusted)4984worker1 # [ 71.599245] nix-daemon[851]: reaped child process 1055, status = succeeded4985lb # [ 71.617515] niks3-server[1074]: 2026/09/20 12:47:18 INFO Received uploads request method=POST path=/api/pending_closures4986worker1 # [ 71.621864] nix-grpc-daemon[901]: time=2026-09-20T12:47:18.664Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"4987lb # [ 71.649146] niks3-server[1074]: 2026/09/20 12:47:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign4988worker1 # [ 71.650531] nix-grpc-daemon[901]: time=2026-09-20T12:47:18.693Z level=INFO msg="Uploading 1 narinfos"4989lb # [ 71.657095] niks3-server[1074]: 2026/09/20 12:47:18 INFO Signed narinfos id=24 count=14990lb # [ 71.665658] niks3-server[1074]: 2026/09/20 12:47:18 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls4991lb # [ 71.676115] niks3-server[1074]: 2026/09/20 12:47:18 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete4992lb # [ 71.683410] niks3-server[1074]: 2026/09/20 12:47:18 INFO Completed upload id=244993worker1 # [ 71.679427] nix-grpc-daemon[901]: time=2026-09-20T12:47:18.722Z level=INFO msg="Upload complete. (257ms)"4994lb # [ 71.685941] niks3-server[1074]: 2026/09/20 12:47:18 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv4995worker1 # [ 71.681869] nix-grpc-daemon[787]: ts=2026-09-20T12:47:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:58278 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=11 outputs=14996lb # [ 71.690780] niks3-server[1074]: 2026/09/20 12:47:18 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo4997worker1 # [ 71.690429] nix-daemon[851]: reaped child process 1035, status = succeeded4998client # copying 1 paths...4999worker2 # [ 71.765469] nix-grpc-daemon[788]: ts=2026-09-20T12:47:18Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:595925000worker2 # [ 71.782489] nix-grpc-daemon[788]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5001client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5002worker2 # [ 71.816153] nix-grpc-daemon[788]: ts=2026-09-20T12:47:18Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:595925003worker2 # [ 71.820766] nix-grpc-daemon[788]: ts=2026-09-20T12:47:18Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:59592 duration_s=0 paths=1 nar_bytes_out=1205004client # [ 71.879623] nix-daemon[947]: reaped child process 1072, status = succeeded5005client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.80 seconds)5006(finished: subtest: an input only one worker has still reaches the builder, in 9.29 seconds)5007subtest: upload whose reference the worker lacks is completed from the cache5008client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5009client # this derivation will be built:5010client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5011client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5012client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.36 seconds)5013client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5014client # this derivation will be built:5015client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5016client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5017client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.38 seconds)5018client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5019client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.17 seconds)5020worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5021worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.20 seconds)5022worker2 # [ 73.106499] systemd[1]: Stopping Nix worker-protocol over gRPC...5023worker2 # [ 73.859958] nix-grpc-daemon[788]: ts=2026-09-20T12:47:20Z level=info event=signal_exit5024worker1 # [ 73.834879] nix-grpc-daemon[787]: ts=2026-09-20T12:47:20Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:604985025worker2 # [ 73.872730] nix-grpc-daemon[788]: ts=2026-09-20T12:47:20Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5026worker1 # [ 73.839000] nix-grpc-daemon[787]: ts=2026-09-20T12:47:20Z level=info event=worker_gone addr=192.168.1.4:500515027worker2 # [ 73.881960] nix-daemon[814]: reaped child process 816, status = succeeded5028worker2 # [ 73.979301] nix-grpc-daemon[788]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5029worker2 # [ 73.982964] nix-grpc-daemon[788]: E0000 00:00:1789908440.230710 799 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 12, started true, shutdown true5030worker2 # [ 75.496335] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5031worker2 # [ 75.498864] systemd[1]: Stopped Nix worker-protocol over gRPC.5032worker2 # [ 75.502920] systemd[1]: nix-grpc-daemon.service: Consumed 2.583s CPU time over 55.911s wall clock time, 57M memory peak, 79.3K incoming IP traffic, 140.5K outgoing IP traffic.5033worker2 # [ 75.511497] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5034worker2 # [ 75.514882] systemd[1]: Closed Nix worker-protocol over gRPC.5035worker2 # [ 75.518191] systemd[1]: nix-grpc-daemon.socket: Consumed 296us CPU time over 1min 6.296s wall clock time, 256K memory peak, 57.6K incoming IP traffic, 45.3K outgoing IP traffic.5036lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5037lb: must succeed: curl -sf localhost:9901/clusters5038lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5039lb: must succeed: curl -sf localhost:9901/clusters5040lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5041lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 1.14 seconds)5042client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25043worker1 # [ 76.815971] nix-grpc-daemon[787]: ts=2026-09-20T12:47:23Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:582785044client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5045worker1 # [ 76.822736] nix-grpc-daemon[787]: ts=2026-09-20T12:47:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:582785046client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.22 seconds)5047worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5048worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.03 seconds)5049worker2 # [ 76.958336] systemd[1]: Listening on Nix worker-protocol over gRPC.5050worker1 # [ 76.979559] systemd[1]: Stopping Nix worker-protocol over gRPC...5051worker2 # [ 77.490764] systemd[1]: Starting scheduler-token.service...5052worker2 # [ 77.570245] systemd[1]: scheduler-token.service: Deactivated successfully.5053worker2 # [ 77.572173] systemd[1]: Finished scheduler-token.service.5054worker2 # [ 77.574107] systemd[1]: scheduler-token.service: Consumed 36ms CPU time over 81ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5055worker2 # [ 77.578778] systemd[1]: Starting Nix worker-protocol over gRPC...5056worker1 # [ 77.691156] nix-grpc-daemon[787]: ts=2026-09-20T12:47:24Z level=info event=signal_exit5057worker1 # [ 77.693801] nix-grpc-daemon[787]: ts=2026-09-20T12:47:24Z level=info event=scheduler_restarting5058worker2 # [ 77.730990] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:23Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5059worker2 # [ 77.733828] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:23Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5060worker2 # [ 77.735969] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:23Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15061worker1 # [ 77.703278] nix-grpc-daemon[787]: ts=2026-09-20T12:47:24Z level=info event=scheduler_restarting addr=lb:500515062worker1 # [ 77.706979] nix-grpc-daemon[787]: ts=2026-09-20T12:47:24Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:604985063worker2 # [ 77.743113] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:23Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5064worker1 # [ 77.710729] nix-grpc-daemon[787]: ts=2026-09-20T12:47:24Z level=info event=worker_gone addr=192.168.1.3:500515065worker2 # [ 77.748219] systemd[1]: Started Nix worker-protocol over gRPC.5066worker2 # [ 77.757661] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:24Z level=info event=scheduler_connected addr=lb:500515067worker1 # [ 77.725879] nix-grpc-daemon[787]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5068worker1 # [ 77.729188] nix-grpc-daemon[787]: E0000 00:00:1789908444.768241 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true5069worker1 # [ 77.765879] nix-daemon[851]: reaped child process 853, status = succeeded5070worker1 # [ 77.823528] nix-grpc-daemon[787]: E0000 00:00:1789908444.865743 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5071worker1 # [ 77.828288] nix-grpc-daemon[787]: E0000 00:00:1789908444.865941 830 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5072worker1 # [ 77.911234] nix-grpc-daemon[787]: ts=2026-09-20T12:47:24Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5073worker2 # [ 79.433165] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5074worker1 # [ 79.413912] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5075worker1 # [ 79.419628] systemd[1]: Stopped Nix worker-protocol over gRPC.5076worker1 # [ 79.421731] systemd[1]: nix-grpc-daemon.service: Consumed 1.354s CPU time over 59.985s wall clock time, 50M memory peak, 44.2K incoming IP traffic, 79.3K outgoing IP traffic.5077worker1 # [ 79.433185] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5078worker1 # [ 79.437638] systemd[1]: Closed Nix worker-protocol over gRPC.5079lb # [ 79.442527] envoy[926]: conn peer=[2001:db8:1::1]:41292 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3714 tx=1917 ms=24095080lb # [ 79.446606] envoy[926]: conn peer=[2001:db8:1::1]:41308 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=585081worker1 # [ 79.441398] systemd[1]: nix-grpc-daemon.socket: Consumed 323us CPU time over 1min 10.045s wall clock time, 256K memory peak, 75.6K incoming IP traffic, 62.7K outgoing IP traffic.5082lb # [ 79.450163] envoy[926]: conn peer=[2001:db8:1::4]:38272 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=2647 tx=816 ms=539985083lb # [ 79.453823] envoy[926]: conn peer=[2001:db8:1::1]:35902 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=145084lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5085lb: must succeed: curl -sf localhost:9901/clusters5086lb # [ 79.457421] envoy[926]: conn peer=192.168.1.3:54216 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1223 tx=468 ms=572455087lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5088worker2 # [ 79.634261] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:25Z level=info event=scheduler_connected addr=lb:500515089worker2 # [ 79.636975] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:25Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5090worker2 # [ 79.838219] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:26Z level=info event=scheduler_connected addr=lb:500515091worker2 # [ 79.842231] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5092worker2 # [ 80.043102] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:26Z level=info event=scheduler_connected addr=lb:500515093worker2 # [ 80.047107] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5094worker2 # [ 80.248099] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:26Z level=info event=scheduler_connected addr=lb:500515095worker2 # [ 80.252177] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5096worker2 # [ 80.453801] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:26Z level=info event=scheduler_connected addr=lb:500515097worker2 # [ 80.457818] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5098lb: must succeed: curl -sf localhost:9901/clusters5099lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5100lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 1.14 seconds)5101client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25102worker2 # [ 80.658888] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:26Z level=info event=scheduler_connected addr=lb:500515103worker2 # [ 80.662893] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:26Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5104worker2 # [ 80.833534] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574685105worker2 # [ 80.844569] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5106worker2 # [ 80.861152] nix-grpc-daemon[1181]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 35 ms (attempt 1/5)5107worker2 # [ 80.867442] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:27Z level=info event=scheduler_connected addr=lb:500515108worker2 # [ 80.871542] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:27Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5109worker2 # [ 80.906883] nix-grpc-daemon[1181]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 166 ms (attempt 2/5)5110worker2 # [ 81.072614] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:27Z level=info event=scheduler_connected addr=lb:500515111worker2 # [ 81.076599] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:27Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5112worker2 # [ 81.082642] nix-grpc-daemon[1181]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 212 ms (attempt 3/5)5113worker2 # [ 81.277567] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:27Z level=info event=scheduler_connected addr=lb:500515114worker2 # [ 81.281523] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:27Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5115worker2 # [ 81.300478] nix-grpc-daemon[1181]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 237 ms (attempt 4/5)5116worker2 # [ 81.483319] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:27Z level=info event=scheduler_connected addr=lb:500515117worker2 # [ 81.487163] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:27Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5118worker2 # [ 81.543761] nix-grpc-daemon[1181]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5119client # copying 2 paths...5120client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5121client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5122worker2 # [ 81.560413] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574685123worker2 # [ 81.570167] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5124worker2 # [ 81.590325] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:27Z level=info event=niks3_push_started pid=12025125worker2 # [ 81.687715] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:27Z level=info event=scheduler_connected addr=lb:500515126worker2 # [ 81.690521] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:27Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5127worker2 # [ 81.784909] nix-grpc-daemon[1202]: time=2026-09-20T12:47:28.036Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""5128worker2 # [ 81.891448] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:28Z level=info event=scheduler_connected addr=lb:500515129worker2 # [ 81.893831] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:28Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5130worker2 # [ 81.943621] nix-daemon[814]: accepted connection from pid 1215, user nix-grpc-daemon (trusted)5131worker2 # [ 81.955991] nix-daemon[814]: reaped child process 1218, status = succeeded5132lb # [ 81.946189] niks3-server[1074]: 2026/09/20 12:47:29 INFO Received uploads request method=POST path=/api/pending_closures5133lb # [ 81.955645] niks3-server[1074]: 2026/09/20 12:47:29 INFO Received uploads request method=POST path=/api/pending_closures5134worker2 # [ 81.990939] nix-grpc-daemon[1202]: time=2026-09-20T12:47:28.243Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5135worker2 # [ 81.992550] nix-grpc-daemon[1202]: time=2026-09-20T12:47:28.244Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5136worker2 # [ 81.994623] nix-grpc-daemon[1202]: time=2026-09-20T12:47:28.246Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5137lb # [ 82.000252] niks3-server[1074]: 2026/09/20 12:47:29 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5138lb # [ 82.011181] niks3-server[1074]: 2026/09/20 12:47:29 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5139lb # [ 82.027643] niks3-server[1074]: 2026/09/20 12:47:29 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5140lb # [ 82.029555] niks3-server[1074]: 2026/09/20 12:47:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5141lb # [ 82.031580] niks3-server[1074]: 2026/09/20 12:47:29 INFO Signed narinfos id=25 count=15142lb # [ 82.033262] niks3-server[1074]: 2026/09/20 12:47:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5143lb # [ 82.035703] niks3-server[1074]: 2026/09/20 12:47:29 INFO Signed narinfos id=26 count=25144worker2 # [ 82.065241] nix-grpc-daemon[1202]: time=2026-09-20T12:47:28.315Z level=INFO msg="Uploading 3 narinfos"5145lb # [ 82.043204] niks3-server[1074]: 2026/09/20 12:47:29 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5146lb # [ 82.050508] niks3-server[1074]: 2026/09/20 12:47:29 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5147lb # [ 82.052889] niks3-server[1074]: 2026/09/20 12:47:29 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5148lb # [ 82.056450] niks3-server[1074]: 2026/09/20 12:47:29 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5149lb # [ 82.059813] niks3-server[1074]: 2026/09/20 12:47:29 INFO Completed upload id=255150lb # [ 82.061374] niks3-server[1074]: 2026/09/20 12:47:29 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5151lb # [ 82.063289] niks3-server[1074]: 2026/09/20 12:47:29 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5152lb # [ 82.066146] niks3-server[1074]: 2026/09/20 12:47:29 INFO Completed upload id=265153worker2 # [ 82.094739] nix-grpc-daemon[1202]: time=2026-09-20T12:47:28.346Z level=INFO msg="Upload complete. (306ms)"5154worker2 # [ 82.100424] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:28Z level=info event=scheduler_connected addr=lb:500515155worker2 # [ 82.104248] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57468 duration_s=0 paths=2 nar_bytes_in=3125156worker2 # [ 82.108922] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:28Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5157worker2 # [ 82.120730] nix-daemon[814]: reaped child process 1200, status = succeeded5158client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.51 seconds)5159worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5160worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.02 seconds)5161worker1 # [ 82.176638] systemd[1]: Listening on Nix worker-protocol over gRPC.5162worker1 # [ 82.185240] systemd[1]: Starting Nix worker-protocol over gRPC...5163worker2 # [ 82.301244] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:28Z level=info event=scheduler_connected addr=lb:500515164worker1 # [ 82.342240] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:29Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5165worker1 # [ 82.344259] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:29Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5166worker1 # [ 82.347708] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:29Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15167worker1 # [ 82.354058] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:29Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5168worker1 # [ 82.357622] systemd[1]: Started Nix worker-protocol over gRPC.5169worker1 # [ 82.366085] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:29Z level=info event=oidc_jwks provider=mock keys=15170worker1 # [ 82.368859] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:29Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:386465171worker1 # [ 82.371207] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:29Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05172lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5173lb: must succeed: curl -sf localhost:9901/clusters5174worker1 # [ 82.376582] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:29Z level=info event=scheduler_connected addr=lb:500515175worker1 # [ 82.378414] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:29Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:386465176worker1 # [ 82.379912] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:29Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05177lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5178lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5179(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 10.54 seconds)5180subtest: scheduler down: builds wait, then resume when it is back5181worker1 # [ 82.476098] systemd[1]: Stopping Nix worker-protocol over gRPC...5182worker2 # [ 83.394155] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:29Z level=info event=scheduler_restarting addr=lb:500515183worker1 # [ 83.360918] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:30Z level=info event=signal_exit5184worker1 # [ 83.363689] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:30Z level=info event=scheduler_restarting5185worker1 # [ 83.366419] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:30Z level=info event=scheduler_restarting addr=lb:500515186worker1 # [ 83.369389] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:30Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:386465187worker1 # [ 83.372724] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:30Z level=info event=worker_gone addr=192.168.1.3:500515188worker1 # [ 83.375900] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:30Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:386465189worker1 # [ 83.379186] nix-grpc-daemon[1078]: ts=2026-09-20T12:47:30Z level=info event=worker_gone addr=192.168.1.4:500515190worker1 # [ 83.406133] nix-grpc-daemon[1078]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5191worker1 # [ 83.409401] nix-grpc-daemon[1078]: E0000 00:00:1789908450.448916 1121 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 13, started true, shutdown true5192worker1 # [ 83.414124] nix-grpc-daemon[1078]: E0000 00:00:1789908450.449108 1121 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5193worker2 # [ 83.594122] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:29Z level=info event=scheduler_connected addr=lb:500515194worker1 # [ 83.561585] nix-grpc-daemon[1078]: E0000 00:00:1789908450.604576 1121 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5195worker2 # [ 84.389421] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:30Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5196worker1 # [ 84.374981] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5197worker1 # [ 84.379892] systemd[1]: Stopped Nix worker-protocol over gRPC.5198worker1 # [ 84.383514] systemd[1]: nix-grpc-daemon.service: Consumed 100ms CPU time over 2.190s wall clock time, 10.1M memory peak, 7.8K incoming IP traffic, 5.8K outgoing IP traffic.5199worker1 # [ 84.392593] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5200worker1 # [ 84.396612] systemd[1]: Closed Nix worker-protocol over gRPC.5201worker1 # [ 84.399821] systemd[1]: nix-grpc-daemon.socket: Consumed 498us CPU time over 2.225s wall clock time, 256K memory peak, 13.6K incoming IP traffic, 9.6K outgoing IP traffic.5202lb: waiting until exactly ['worker1'] endpoints of sched are unhealthy5203lb: must succeed: curl -sf localhost:9901/clusters5204lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5205worker2 # [ 84.591408] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:30Z level=info event=scheduler_connected addr=lb:500515206worker2 # [ 84.595247] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:30Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5207worker2 # [ 84.795886] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:31Z level=info event=scheduler_connected addr=lb:500515208worker2 # [ 84.799899] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5209worker2 # [ 85.000876] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:31Z level=info event=scheduler_connected addr=lb:500515210worker2 # [ 85.004667] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5211worker2 # [ 85.205552] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:31Z level=info event=scheduler_connected addr=lb:500515212worker2 # [ 85.209417] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5213worker2 # [ 85.410478] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:31Z level=info event=scheduler_connected addr=lb:500515214worker2 # [ 85.414437] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5215lb: must succeed: curl -sf localhost:9901/clusters5216lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5217lb: (finished: waiting until exactly ['worker1'] endpoints of sched are unhealthy, in 1.12 seconds)5218client: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag schedback5219worker2 # [ 85.615361] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:31Z level=info event=scheduler_connected addr=lb:500515220worker2 # [ 85.617240] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:31Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5221client # [ 85.568984] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag schedback.5222client # Running as unit: waits.service; invocation ID: 37f4384a100b4b1980b5178c49b35a055223client: (finished: must succeed: systemd-run --unit waits nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag schedback, in 0.07 seconds)5224??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5225 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735226client: must succeed: sleep 3.05227worker2 # [ 85.817864] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:32Z level=info event=scheduler_connected addr=lb:500515228worker2 # [ 85.820452] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:574685229client # [ 85.773477] nix[1148]: don't know how to build these paths:5230client # [ 85.774362] nix[1148]: /nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv5231worker2 # [ 85.822106] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5232worker2 # [ 85.824814] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574685233client # [ 85.787393] nix[1148]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5234worker2 # [ 86.021540] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:32Z level=info event=scheduler_connected addr=lb:500515235worker2 # [ 86.025496] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5236worker2 # [ 86.225647] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:32Z level=info event=scheduler_connected addr=lb:500515237worker2 # [ 86.228081] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5238client # [ 86.290811] nix[1148]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5239worker2 # [ 86.429359] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:32Z level=info event=scheduler_connected addr=lb:500515240worker2 # [ 86.433332] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5241worker2 # [ 86.634787] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:32Z level=info event=scheduler_connected addr=lb:500515242worker2 # [ 86.638661] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:32Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5243worker2 # [ 86.839489] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:33Z level=info event=scheduler_connected addr=lb:500515244worker2 # [ 86.842627] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5245worker2 # [ 87.043641] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:33Z level=info event=scheduler_connected addr=lb:500515246worker2 # [ 87.047535] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5247worker2 # [ 87.248481] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:33Z level=info event=scheduler_connected addr=lb:500515248worker2 # [ 87.252540] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5249client # [ 87.295253] nix[1148]: scheduler at lb:50051: upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, reconnecting5250worker2 # [ 87.453618] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:33Z level=info event=scheduler_connected addr=lb:500515251worker2 # [ 87.457532] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5252worker2 # [ 87.659444] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:33Z level=info event=scheduler_connected addr=lb:500515253worker2 # [ 87.663320] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:33Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5254worker2 # [ 87.864151] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:34Z level=info event=scheduler_connected addr=lb:500515255worker2 # [ 87.868153] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5256worker2 # [ 88.068611] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:34Z level=info event=scheduler_connected addr=lb:500515257worker2 # [ 88.071467] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5258worker2 # [ 88.272263] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:34Z level=info event=scheduler_connected addr=lb:500515259worker2 # [ 88.274800] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5260worker2 # [ 88.475540] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:34Z level=info event=scheduler_connected addr=lb:500515261worker2 # [ 88.477833] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5262client: (finished: must succeed: sleep 3.0, in 3.03 seconds)5263client: must succeed: systemctl is-active waits5264worker2 # [ 88.679857] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:34Z level=info event=scheduler_connected addr=lb:500515265worker2 # [ 88.683618] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:34Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5266client: (finished: must succeed: systemctl is-active waits, in 0.04 seconds)5267worker1 # [ 88.729797] systemd[1]: Listening on Nix worker-protocol over gRPC.5268worker1 # [ 88.737615] systemd[1]: Starting Nix worker-protocol over gRPC...5269worker2 # [ 88.884766] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:35Z level=info event=scheduler_connected addr=lb:500515270worker1 # [ 88.869338] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:35Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5271worker1 # [ 88.871607] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5272worker1 # [ 88.874856] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15273worker1 # [ 88.882852] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5274worker1 # [ 88.886482] systemd[1]: Started Nix worker-protocol over gRPC.5275lb: waiting until exactly no endpoints of sched are unhealthy5276lb: must succeed: curl -sf localhost:9901/clusters5277worker1 # [ 88.896075] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:35Z level=info event=oidc_jwks provider=mock keys=15278worker1 # [ 88.897617] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:35Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:471205279worker1 # [ 88.900558] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05280worker1 # [ 88.904315] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:35Z level=info event=scheduler_connected addr=lb:500515281worker1 # [ 88.905926] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:35Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:471205282worker1 # [ 88.907309] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05283lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5284worker1 # [ 89.319715] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:36Z level=debug event=want client=1 drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv cached=05285worker1 # [ 89.323967] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:36Z level=debug event=assigned drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv worker=192.168.1.4:50051 clients=15286worker2 # [ 89.397935] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574685287worker2 # [ 89.412131] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574685288client # [ 89.374873] nix[1148]: copying 1 paths to 'lb:50051'...5289worker2 # [ 89.423914] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574685290client # [ 89.377551] nix[1148]: copying path '/nix/store/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv' to 'lb:50051'...5291worker2 # [ 89.434795] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5292lb # [ 89.442710] envoy[926]: conn peer=[2001:db8:1::1]:35916 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1007 tx=305 ms=12795293lb # [ 89.448426] envoy[926]: conn peer=[2001:db8:1::3]:54776 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=552 tx=177 ms=11875294worker2 # [ 89.609509] nix-daemon[814]: accepted connection from pid 1225, user nix-grpc-daemon (trusted)5295worker2 # [ 89.621943] nix-daemon[814]: reaped child process 1228, status = succeeded5296worker2 # [ 89.757105] nix-daemon[814]: accepted connection from pid 1230, user nix-grpc-daemon (trusted)5297worker2 # [ 89.768791] nix-daemon[814]: reaped child process 1233, status = succeeded5298lb # [ 89.753882] niks3-server[1074]: 2026/09/20 12:47:36 INFO Received uploads request method=POST path=/api/pending_closures5299worker2 # [ 89.790154] nix-grpc-daemon[1202]: time=2026-09-20T12:47:36.041Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5300worker2 # [ 89.791533] nix-grpc-daemon[1202]: time=2026-09-20T12:47:36.041Z level=INFO msg="Uploading 78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv (520B)"5301lb # [ 89.784517] niks3-server[1074]: 2026/09/20 12:47:36 INFO Registered completed upload object_key=nar/06bjks304hxld0mwhch6kvcfiix46iimcpysvzrdsfv41vfc14ny.nar.zst5302lb # [ 89.792258] niks3-server[1074]: 2026/09/20 12:47:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5303lb # [ 89.797720] niks3-server[1074]: 2026/09/20 12:47:36 INFO Signed narinfos id=27 count=15304worker2 # [ 89.829054] nix-grpc-daemon[1202]: time=2026-09-20T12:47:36.081Z level=INFO msg="Uploading 1 narinfos"5305lb # [ 89.811199] niks3-server[1074]: 2026/09/20 12:47:36 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5306lb # [ 89.817261] niks3-server[1074]: 2026/09/20 12:47:36 INFO Completed upload id=275307worker2 # [ 89.847275] nix-grpc-daemon[1202]: time=2026-09-20T12:47:36.099Z level=INFO msg="Upload complete. (399ms)"5308worker2 # [ 89.849345] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:36Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57468 duration_s=0 paths=1 nar_bytes_in=5205309lb # [ 89.822840] niks3-server[1074]: 2026/09/20 12:47:36 INFO Registered completed upload object_key=78ilcmmhxh1nxads92k8m9r0j1mgl1vw.ls5310worker2 # [ 89.855538] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574685311lb # [ 89.827666] niks3-server[1074]: 2026/09/20 12:47:36 INFO Registered completed upload object_key=78ilcmmhxh1nxads92k8m9r0j1mgl1vw.narinfo5312worker2 # [ 89.859880] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5313worker2 # [ 89.862190] nix-daemon[814]: reaped child process 1223, status = succeeded5314client # [ 89.818089] nix[1148]: building '/nix/store/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv' on lb:50051...5315worker2 # [ 89.867298] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5316lb: must succeed: curl -sf localhost:9901/clusters5317lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5318lb: (finished: waiting until exactly no endpoints of sched are unhealthy, in 1.14 seconds)5319client: waiting for success: ! systemctl is-active waits5320worker2 # [ 90.680690] nix-daemon[814]: reaped child process 1237, status = succeeded5321worker2 # [ 90.843362] nix-daemon[814]: accepted connection from pid 1252, user nix-grpc-daemon (trusted)5322worker2 # [ 90.856723] nix-daemon[814]: reaped child process 1255, status = succeeded5323lb # [ 90.846314] niks3-server[1074]: 2026/09/20 12:47:38 INFO Received uploads request method=POST path=/api/pending_closures5324worker2 # [ 90.878482] nix-grpc-daemon[1202]: time=2026-09-20T12:47:37.130Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5325worker2 # [ 90.880000] nix-grpc-daemon[1202]: time=2026-09-20T12:47:37.132Z level=INFO msg="Uploading wxl98jgbbzfq9nz6nhndwvzybqml1mdg-farm-a (136B)"5326lb # [ 90.866187] niks3-server[1074]: 2026/09/20 12:47:38 INFO Registered completed upload object_key=log/78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv5327lb # [ 90.868520] niks3-server[1074]: 2026/09/20 12:47:38 INFO Registered completed upload object_key=nar/0857pwr5xvcgvis5zd1wyn7l7dm0a00lpfjkz94axr76vhy2l88g.nar.zst5328lb # [ 90.872584] niks3-server[1074]: 2026/09/20 12:47:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5329lb # [ 90.874450] niks3-server[1074]: 2026/09/20 12:47:38 INFO Signed narinfos id=28 count=15330worker2 # [ 90.902437] nix-grpc-daemon[1202]: time=2026-09-20T12:47:37.154Z level=INFO msg="Uploading 1 narinfos"5331lb # [ 90.878061] niks3-server[1074]: 2026/09/20 12:47:38 INFO Registered completed upload object_key=wxl98jgbbzfq9nz6nhndwvzybqml1mdg.ls5332lb # [ 90.883412] niks3-server[1074]: 2026/09/20 12:47:38 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5333lb # [ 90.886684] niks3-server[1074]: 2026/09/20 12:47:38 INFO Completed upload id=285334worker2 # [ 90.914641] nix-grpc-daemon[1202]: time=2026-09-20T12:47:37.166Z level=INFO msg="Upload complete. (241ms)"5335lb # [ 90.888299] niks3-server[1074]: 2026/09/20 12:47:38 INFO Registered completed upload object_key=wxl98jgbbzfq9nz6nhndwvzybqml1mdg.narinfo5336worker2 # [ 90.916960] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:37Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57468 duration_s=1 drv=78ilcmmhxh1nxads92k8m9r0j1mgl1vw-farm-a.drv assign_id=1 outputs=15337worker2 # [ 90.923748] nix-daemon[814]: reaped child process 1235, status = succeeded5338worker1 # [ 90.890489] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:37Z level=debug event=want client=1 drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv cached=05339worker1 # [ 90.892238] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:37Z level=debug event=assigned drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv worker=192.168.1.4:50051 clients=15340worker2 # [ 90.968192] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574685341worker2 # [ 90.977896] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:37Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574685342worker2 # [ 90.986663] nix-grpc-daemon[1202]: time=2026-09-20T12:47:37.238Z level=INFO msg="All 1 paths already cached"5343client # [ 90.943172] nix[1148]: copying 1 paths to 'lb:50051'...5344worker2 # [ 90.993241] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:37Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574685345client # [ 90.946788] nix[1148]: copying path '/nix/store/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv' to 'lb:50051'...5346worker2 # [ 91.002447] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5347worker2 # [ 91.163122] nix-daemon[814]: accepted connection from pid 1259, user nix-grpc-daemon (trusted)5348worker2 # [ 91.175352] nix-daemon[814]: reaped child process 1262, status = succeeded5349worker2 # [ 91.338429] nix-daemon[814]: accepted connection from pid 1264, user nix-grpc-daemon (trusted)5350worker2 # [ 91.350454] nix-daemon[814]: reaped child process 1267, status = succeeded5351lb # [ 91.339366] niks3-server[1074]: 2026/09/20 12:47:38 INFO Received uploads request method=POST path=/api/pending_closures5352worker2 # [ 91.371384] nix-grpc-daemon[1202]: time=2026-09-20T12:47:37.623Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5353worker2 # [ 91.373403] nix-grpc-daemon[1202]: time=2026-09-20T12:47:37.625Z level=INFO msg="Uploading jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv (632B)"5354lb # [ 91.353631] niks3-server[1074]: 2026/09/20 12:47:38 INFO Registered completed upload object_key=nar/06r703613wasx30c56zihv19sk7v1y1xsivlzw3jax3csnwjf02v.nar.zst5355lb # [ 91.357559] niks3-server[1074]: 2026/09/20 12:47:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5356lb # [ 91.360087] niks3-server[1074]: 2026/09/20 12:47:38 INFO Signed narinfos id=29 count=15357worker2 # [ 91.388226] nix-grpc-daemon[1202]: time=2026-09-20T12:47:37.640Z level=INFO msg="Uploading 1 narinfos"5358lb # [ 91.362256] niks3-server[1074]: 2026/09/20 12:47:38 INFO Registered completed upload object_key=jv6y5kiw0k6gp891vxyi80vs9q23zzaj.ls5359lb # [ 91.367053] niks3-server[1074]: 2026/09/20 12:47:38 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5360lb # [ 91.369706] niks3-server[1074]: 2026/09/20 12:47:38 INFO Completed upload id=295361worker2 # [ 91.397645] nix-grpc-daemon[1202]: time=2026-09-20T12:47:37.649Z level=INFO msg="Upload complete. (390ms)"5362lb # [ 91.372280] niks3-server[1074]: 2026/09/20 12:47:38 INFO Registered completed upload object_key=jv6y5kiw0k6gp891vxyi80vs9q23zzaj.narinfo5363worker2 # [ 91.400188] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57468 duration_s=0 paths=1 nar_bytes_in=6325364worker2 # [ 91.402515] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574685365worker2 # [ 91.409063] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5366worker2 # [ 91.411527] nix-daemon[814]: reaped child process 1257, status = succeeded5367worker2 # [ 91.417507] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5368client # [ 91.367532] nix[1148]: building '/nix/store/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv' on lb:50051...5369worker2 # [ 92.642204] nix-daemon[814]: reaped child process 1271, status = succeeded5370worker2 # [ 92.803938] nix-daemon[814]: accepted connection from pid 1286, user nix-grpc-daemon (trusted)5371worker2 # [ 92.816362] nix-daemon[814]: reaped child process 1289, status = succeeded5372lb # [ 92.800255] niks3-server[1074]: 2026/09/20 12:47:39 INFO Received uploads request method=POST path=/api/pending_closures5373worker2 # [ 92.838240] nix-grpc-daemon[1202]: time=2026-09-20T12:47:39.090Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5374worker2 # [ 92.840432] nix-grpc-daemon[1202]: time=2026-09-20T12:47:39.091Z level=INFO msg="Uploading ahy8cs7r52ad4fklig5k1khmrwzp7bkc-farm-b (184B)"5375lb # [ 92.831790] niks3-server[1074]: 2026/09/20 12:47:40 INFO Registered completed upload object_key=log/jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv5376lb # [ 92.845874] niks3-server[1074]: 2026/09/20 12:47:40 INFO Registered completed upload object_key=nar/1bxjgkmwyii071c3ahwryw7md5gl9qidg8bm2rb2v2idzf8bvmpb.nar.zst5377lb # [ 92.854066] niks3-server[1074]: 2026/09/20 12:47:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5378lb # [ 92.858242] niks3-server[1074]: 2026/09/20 12:47:40 INFO Signed narinfos id=30 count=15379worker2 # [ 92.889275] nix-grpc-daemon[1202]: time=2026-09-20T12:47:39.141Z level=INFO msg="Uploading 1 narinfos"5380lb # [ 92.869715] niks3-server[1074]: 2026/09/20 12:47:40 INFO Registered completed upload object_key=ahy8cs7r52ad4fklig5k1khmrwzp7bkc.ls5381lb # [ 92.874991] niks3-server[1074]: 2026/09/20 12:47:40 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5382lb # [ 92.880564] niks3-server[1074]: 2026/09/20 12:47:40 INFO Completed upload id=305383worker2 # [ 92.908541] nix-grpc-daemon[1202]: time=2026-09-20T12:47:39.160Z level=INFO msg="Upload complete. (282ms)"5384lb # [ 92.883512] niks3-server[1074]: 2026/09/20 12:47:40 INFO Registered completed upload object_key=ahy8cs7r52ad4fklig5k1khmrwzp7bkc.narinfo5385worker2 # [ 92.913932] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:39Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57468 duration_s=1 drv=jv6y5kiw0k6gp891vxyi80vs9q23zzaj-farm-b.drv assign_id=2 outputs=15386worker1 # [ 92.887828] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:39Z level=debug event=want client=1 drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv cached=05387worker2 # [ 92.928170] nix-daemon[814]: reaped child process 1269, status = succeeded5388worker1 # [ 92.891841] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:39Z level=debug event=assigned drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv worker=192.168.1.4:50051 clients=15389worker2 # [ 92.964617] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574685390worker2 # [ 92.977331] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:39Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574685391worker2 # [ 92.990005] nix-grpc-daemon[1202]: time=2026-09-20T12:47:39.242Z level=INFO msg="All 2 paths already cached"5392client # [ 92.947643] nix[1148]: copying 1 paths to 'lb:50051'...5393worker2 # [ 92.996116] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:39Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574685394client # [ 92.949524] nix[1148]: copying path '/nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv' to 'lb:50051'...5395worker2 # [ 93.005515] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5396worker2 # [ 93.164173] nix-daemon[814]: accepted connection from pid 1293, user nix-grpc-daemon (trusted)5397worker2 # [ 93.176708] nix-daemon[814]: reaped child process 1296, status = succeeded5398worker2 # [ 93.326144] nix-daemon[814]: accepted connection from pid 1298, user nix-grpc-daemon (trusted)5399worker2 # [ 93.337884] nix-daemon[814]: reaped child process 1301, status = succeeded5400lb # [ 93.324660] niks3-server[1074]: 2026/09/20 12:47:40 INFO Received uploads request method=POST path=/api/pending_closures5401worker2 # [ 93.360474] nix-grpc-daemon[1202]: time=2026-09-20T12:47:39.612Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5402worker2 # [ 93.361956] nix-grpc-daemon[1202]: time=2026-09-20T12:47:39.614Z level=INFO msg="Uploading 4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv (760B)"5403lb # [ 93.351637] niks3-server[1074]: 2026/09/20 12:47:40 INFO Registered completed upload object_key=nar/1dx1l3qanf0yqmk397nzvl6w8vm5z1klsskxak9mqzzqlm7rj9id.nar.zst5404lb # [ 93.364935] niks3-server[1074]: 2026/09/20 12:47:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5405worker2 # [ 93.397580] nix-grpc-daemon[1202]: time=2026-09-20T12:47:39.649Z level=INFO msg="Uploading 1 narinfos"5406lb # [ 93.370157] niks3-server[1074]: 2026/09/20 12:47:40 INFO Signed narinfos id=31 count=15407lb # [ 93.377217] niks3-server[1074]: 2026/09/20 12:47:40 INFO Registered completed upload object_key=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym.ls5408lb # [ 93.388905] niks3-server[1074]: 2026/09/20 12:47:40 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5409lb # [ 93.395156] niks3-server[1074]: 2026/09/20 12:47:40 INFO Completed upload id=315410worker2 # [ 93.425588] nix-grpc-daemon[1202]: time=2026-09-20T12:47:39.677Z level=INFO msg="Upload complete. (406ms)"5411lb # [ 93.397933] niks3-server[1074]: 2026/09/20 12:47:40 INFO Registered completed upload object_key=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym.narinfo5412worker2 # [ 93.429814] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:39Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57468 duration_s=0 paths=1 nar_bytes_in=7605413worker2 # [ 93.435270] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:39Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574685414worker2 # [ 93.443199] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5415worker2 # [ 93.451802] nix-daemon[814]: reaped child process 1291, status = succeeded5416worker2 # [ 93.456160] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5417client # [ 93.407671] nix[1148]: building '/nix/store/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv' on lb:50051...5418worker2 # [ 93.868754] nix-daemon[814]: reaped child process 1305, status = succeeded5419worker2 # [ 94.025495] nix-daemon[814]: accepted connection from pid 1320, user nix-grpc-daemon (trusted)5420worker2 # [ 94.038254] nix-daemon[814]: reaped child process 1323, status = succeeded5421lb # [ 94.025358] niks3-server[1074]: 2026/09/20 12:47:41 INFO Received uploads request method=POST path=/api/pending_closures5422worker2 # [ 94.058376] nix-grpc-daemon[1202]: time=2026-09-20T12:47:40.310Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5423worker2 # [ 94.059918] nix-grpc-daemon[1202]: time=2026-09-20T12:47:40.312Z level=INFO msg="Uploading 2kzynzc2x7d9fjl737krjzzjbsp5p77k-farm-top (240B)"5424lb # [ 94.045638] niks3-server[1074]: 2026/09/20 12:47:41 INFO Registered completed upload object_key=log/4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv5425lb # [ 94.049906] niks3-server[1074]: 2026/09/20 12:47:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5426lb # [ 94.052249] niks3-server[1074]: 2026/09/20 12:47:41 INFO Signed narinfos id=32 count=15427worker2 # [ 94.081614] nix-grpc-daemon[1202]: time=2026-09-20T12:47:40.333Z level=INFO msg="Uploading 1 narinfos"5428lb # [ 94.056117] niks3-server[1074]: 2026/09/20 12:47:41 INFO Registered completed upload object_key=nar/1x5xsygwz4a6bpv0g402i3p0nk63j2j9qkxs1rdnp6s20644kc3j.nar.zst5429lb # [ 94.060705] niks3-server[1074]: 2026/09/20 12:47:41 INFO Registered completed upload object_key=2kzynzc2x7d9fjl737krjzzjbsp5p77k.ls5430lb # [ 94.064770] niks3-server[1074]: 2026/09/20 12:47:41 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5431lb # [ 94.067943] niks3-server[1074]: 2026/09/20 12:47:41 INFO Completed upload id=325432worker2 # [ 94.095616] nix-grpc-daemon[1202]: time=2026-09-20T12:47:40.347Z level=INFO msg="Upload complete. (234ms)"5433lb # [ 94.070487] niks3-server[1074]: 2026/09/20 12:47:41 INFO Registered completed upload object_key=2kzynzc2x7d9fjl737krjzzjbsp5p77k.narinfo5434worker2 # [ 94.097853] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57468 duration_s=0 drv=4c9phyjqlf2mmv5d7gvp6vzlyj8mimym-farm-top.drv assign_id=3 outputs=15435worker2 # [ 94.104519] nix-daemon[814]: reaped child process 1303, status = succeeded5436client # [ 94.122184] systemd[1]: waits.service: Deactivated successfully.5437client # [ 94.123707] systemd[1]: waits.service: Consumed 136ms CPU time over 8.553s wall clock time, 47.5M memory peak, 14.5K incoming IP traffic, 19.9K outgoing IP traffic.5438client: (finished: waiting for success: ! systemctl is-active waits, in 4.26 seconds)5439client: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }5440client: (finished: must succeed: systemctl show -p Result --value waits | grep -qx success || { journalctl -u waits >&2; false; }, in 0.03 seconds)5441worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5442worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)5443(finished: subtest: scheduler down: builds wait, then resume when it is back, in 11.95 seconds)5444subtest: clean scheduler restart: peers are told, reconnect without error or backoff5445client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5446client # [ 94.409881] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5447client # Running as unit: rs.service; invocation ID: 5738c6ef694547568619d0627539e99a5448client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.04 seconds)5449worker1 # [ 94.619360] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:41Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:575745450worker1 # [ 94.630742] nix-daemon[851]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)5451client # [ 94.628330] nix[1203]: don't know how to build these paths:5452client # [ 94.629736] nix[1203]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5453worker1 # [ 94.652244] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:41Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05454worker1 # [ 94.657585] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:41Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15455worker1 # [ 94.662915] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:575745456worker1 # [ 94.673445] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 1/5)5457worker1 # [ 94.776254] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 56 ms (attempt 2/5)5458worker1 # [ 94.837939] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 252 ms (attempt 3/5)5459worker1 # [ 95.095862] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 719 ms (attempt 4/5)5460worker1 # [ 95.822914] nix-grpc-daemon[1139]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5461worker1 # [ 95.839456] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:575745462client # [ 95.836799] nix[1203]: copying 1 paths to 'lb:50051'...5463worker1 # [ 95.852259] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:575745464client # [ 95.840086] nix[1203]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5465worker1 # [ 95.866490] nix-daemon[851]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)5466worker1 # [ 95.885831] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:42Z level=info event=niks3_push_started pid=12115467worker1 # [ 96.068388] nix-grpc-daemon[1211]: time=2026-09-20T12:47:43.110Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""5468worker1 # [ 96.199810] nix-daemon[851]: accepted connection from pid 1224, user nix-grpc-daemon (trusted)5469worker1 # [ 96.211340] nix-daemon[851]: reaped child process 1227, status = succeeded5470worker1 # [ 96.339332] nix-daemon[851]: accepted connection from pid 1229, user nix-grpc-daemon (trusted)5471worker1 # [ 96.350751] nix-daemon[851]: reaped child process 1232, status = succeeded5472lb # [ 96.367975] niks3-server[1074]: 2026/09/20 12:47:43 INFO Received uploads request method=POST path=/api/pending_closures5473worker1 # [ 96.367468] nix-grpc-daemon[1211]: time=2026-09-20T12:47:43.410Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5474worker1 # [ 96.370367] nix-grpc-daemon[1211]: time=2026-09-20T12:47:43.412Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5475lb # [ 96.390915] niks3-server[1074]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5476lb # [ 96.395152] niks3-server[1074]: 2026/09/20 12:47:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5477lb # [ 96.397188] niks3-server[1074]: 2026/09/20 12:47:43 INFO Signed narinfos id=33 count=15478worker1 # [ 96.393057] nix-grpc-daemon[1211]: time=2026-09-20T12:47:43.435Z level=INFO msg="Uploading 1 narinfos"5479lb # [ 96.401604] niks3-server[1074]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5480lb # [ 96.406143] niks3-server[1074]: 2026/09/20 12:47:43 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5481lb # [ 96.409462] niks3-server[1074]: 2026/09/20 12:47:43 INFO Completed upload id=335482worker1 # [ 96.403196] nix-grpc-daemon[1211]: time=2026-09-20T12:47:43.446Z level=INFO msg="Upload complete. (331ms)"5483lb # [ 96.411653] niks3-server[1074]: 2026/09/20 12:47:43 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5484worker1 # [ 96.404998] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:43Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57574 duration_s=0 paths=1 nar_bytes_in=4165485worker1 # [ 96.407778] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:575745486worker1 # [ 96.414123] nix-daemon[851]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)5487worker1 # [ 96.416706] nix-daemon[851]: reaped child process 1209, status = succeeded5488client # [ 96.406198] nix[1203]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5489worker1 # [ 96.421307] nix-daemon[851]: accepted connection from pid 1139, user nix-grpc-daemon (trusted)5490worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5491worker2 # [ 98.100279] systemd-journald[287]: Received client request to rotate journal, rotating.5492worker2 # [ 98.110376] systemd-journald[287]: Vacuuming done, freed 0B of archived journals from /var/log/journal/3dec68832d994cbc930df69268a41c66.5493worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.04 seconds)5494worker1: must succeed: systemctl restart nix-grpc-daemon.service5495worker1 # [ 98.025735] systemd[1]: Stopping Nix worker-protocol over gRPC...5496worker1 # [ 98.036986] nix-daemon[851]: reaped child process 1236, status = succeeded5497worker1 # [ 98.166955] nix-daemon[851]: accepted connection from pid 1268, user nix-grpc-daemon (trusted)5498worker1 # [ 98.178843] nix-daemon[851]: reaped child process 1271, status = succeeded5499lb # [ 98.198741] niks3-server[1074]: 2026/09/20 12:47:45 INFO Received uploads request method=POST path=/api/pending_closures5500worker1 # [ 98.197583] nix-grpc-daemon[1211]: time=2026-09-20T12:47:45.240Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5501worker1 # [ 98.199127] nix-grpc-daemon[1211]: time=2026-09-20T12:47:45.242Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5502lb # [ 98.217497] niks3-server[1074]: 2026/09/20 12:47:45 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5503lb # [ 98.223585] niks3-server[1074]: 2026/09/20 12:47:45 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5504lb # [ 98.226588] niks3-server[1074]: 2026/09/20 12:47:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5505lb # [ 98.228667] niks3-server[1074]: 2026/09/20 12:47:45 INFO Signed narinfos id=34 count=15506worker1 # [ 98.222270] nix-grpc-daemon[1211]: time=2026-09-20T12:47:45.265Z level=INFO msg="Uploading 1 narinfos"5507lb # [ 98.231393] niks3-server[1074]: 2026/09/20 12:47:45 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5508lb # [ 98.236723] niks3-server[1074]: 2026/09/20 12:47:45 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5509lb # [ 98.239187] niks3-server[1074]: 2026/09/20 12:47:45 INFO Completed upload id=345510worker1 # [ 98.233135] nix-grpc-daemon[1211]: time=2026-09-20T12:47:45.276Z level=INFO msg="Upload complete. (204ms)"5511lb # [ 98.241987] niks3-server[1074]: 2026/09/20 12:47:45 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5512worker1 # [ 98.235899] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:45Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57574 duration_s=1 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15513worker1 # [ 98.242240] nix-daemon[851]: reaped child process 1234, status = succeeded5514client # [ 98.252951] systemd[1]: rs.service: Deactivated successfully.5515client # [ 98.254465] systemd[1]: rs.service: Consumed 106ms CPU time over 3.842s wall clock time, 39.1M memory peak, 8.7K incoming IP traffic, 9K outgoing IP traffic.5516worker1 # [ 98.891161] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:45Z level=info event=signal_exit5517worker2 # [ 98.928110] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:45Z level=info event=scheduler_restarting addr=lb:500515518worker1 # [ 98.897740] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:45Z level=info event=scheduler_restarting5519worker1 # [ 98.900488] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:471205520worker1 # [ 98.907263] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:45Z level=info event=worker_gone addr=192.168.1.4:500515521worker1 # [ 98.910478] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:45Z level=info event=scheduler_restarting addr=lb:500515522worker1 # [ 98.913974] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:45Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:471205523worker1 # [ 98.917384] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:45Z level=info event=worker_gone addr=192.168.1.3:500515524worker1 # [ 98.933453] nix-daemon[851]: reaped child process 1198, status = succeeded5525worker2 # [ 99.128099] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:45Z level=info event=scheduler_connected addr=lb:500515526worker1 # [ 99.096233] nix-grpc-daemon[1139]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5527worker1 # [ 99.103937] nix-grpc-daemon[1139]: E0000 00:00:1789908466.139078 1182 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 14, started true, shutdown true5528worker1 # [ 99.113944] nix-grpc-daemon[1139]: ts=2026-09-20T12:47:46Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5529worker1 # [ 99.389393] nix-grpc-daemon[1139]: E0000 00:00:1789908466.431488 1182 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5530worker1 # [ 99.394207] nix-grpc-daemon[1139]: E0000 00:00:1789908466.431717 1182 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5531lb # [ 99.443436] envoy[926]: conn peer=[2001:db8:1::1]:57702 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=10116 tx=4070 ms=83325532lb # [ 99.445081] envoy[926]: conn peer=[2001:db8:1::1]:50226 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2934 tx=1375 ms=36345533lb # [ 99.446484] envoy[926]: conn peer=[2001:db8:1::3]:59222 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=744 tx=260 ms=102105534worker2 # [ 100.438412] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:46Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5535worker1 # [ 100.424524] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5536worker1 # [ 100.426964] systemd[1]: Stopped Nix worker-protocol over gRPC.5537worker1 # [ 100.430645] systemd[1]: nix-grpc-daemon.service: Consumed 479ms CPU time over 11.686s wall clock time, 31.2M memory peak, 19.3K incoming IP traffic, 24.2K outgoing IP traffic.5538worker1 # [ 100.445524] systemd[1]: Starting Nix worker-protocol over gRPC...5539worker1 # [ 100.602340] nix-grpc-daemon[1278]: ts=2026-09-20T12:47:47Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5540worker1 # [ 100.604795] nix-grpc-daemon[1278]: ts=2026-09-20T12:47:47Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5541worker2 # [ 100.639229] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:46Z level=info event=scheduler_connected addr=lb:500515542worker1 # [ 100.608430] nix-grpc-daemon[1278]: ts=2026-09-20T12:47:47Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15543worker1 # [ 100.614552] nix-grpc-daemon[1278]: ts=2026-09-20T12:47:47Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5544worker1 # [ 100.618364] systemd[1]: Started Nix worker-protocol over gRPC.5545worker1: (finished: must succeed: systemctl restart nix-grpc-daemon.service, in 2.62 seconds)5546worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting5547worker1 # [ 100.629994] nix-grpc-daemon[1278]: ts=2026-09-20T12:47:47Z level=info event=oidc_jwks provider=mock keys=15548worker1 # [ 100.632455] nix-grpc-daemon[1278]: ts=2026-09-20T12:47:47Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:576105549worker1 # [ 100.634780] nix-grpc-daemon[1278]: ts=2026-09-20T12:47:47Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05550worker1 # [ 100.637766] nix-grpc-daemon[1278]: ts=2026-09-20T12:47:47Z level=info event=scheduler_connected addr=lb:500515551worker1 # [ 100.639299] nix-grpc-daemon[1278]: ts=2026-09-20T12:47:47Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:576105552worker1 # [ 100.640812] nix-grpc-daemon[1278]: ts=2026-09-20T12:47:47Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05553worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_restarting, in 0.06 seconds)5554worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics5555worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)5556client: waiting for success: ! systemctl is-active rs5557client: (finished: waiting for success: ! systemctl is-active rs, in 0.06 seconds)5558client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5559client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.04 seconds)5560client: must fail: journalctl -u rs | grep -q 'reconnecting'5561client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.03 seconds)5562(finished: subtest: clean scheduler restart: peers are told, reconnect without error or backoff, in 6.55 seconds)5563subtest: scheduler restart mid-build: build finishes, no double build5564client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5565client # [ 100.956931] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5566client # Running as unit: mid.service; invocation ID: 4a3c9ad404a842f49e9b94b1b2f219625567client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.04 seconds)5568worker2 # [ 101.201177] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:47Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:574685569client # [ 101.159048] nix[1235]: don't know how to build these paths:5570client # [ 101.160417] nix[1235]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5571worker1 # [ 101.184588] nix-grpc-daemon[1278]: ts=2026-09-20T12:47:48Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05572worker1 # [ 101.188848] nix-grpc-daemon[1278]: ts=2026-09-20T12:47:48Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15573worker2 # [ 101.262643] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574685574worker2 # [ 101.275484] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574685575client # [ 101.237129] nix[1235]: copying 1 paths to 'lb:50051'...5576client # [ 101.237962] nix[1235]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5577worker2 # [ 101.286507] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574685578worker2 # [ 101.297379] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5579worker2 # [ 101.477414] nix-daemon[814]: accepted connection from pid 1362, user nix-grpc-daemon (trusted)5580worker2 # [ 101.489501] nix-daemon[814]: reaped child process 1365, status = succeeded5581worker2 # [ 101.649039] nix-daemon[814]: accepted connection from pid 1367, user nix-grpc-daemon (trusted)5582worker2 # [ 101.660906] nix-daemon[814]: reaped child process 1370, status = succeeded5583lb # [ 101.650549] niks3-server[1074]: 2026/09/20 12:47:48 INFO Received uploads request method=POST path=/api/pending_closures5584worker2 # [ 101.686347] nix-grpc-daemon[1202]: time=2026-09-20T12:47:47.938Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5585worker2 # [ 101.688192] nix-grpc-daemon[1202]: time=2026-09-20T12:47:47.940Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5586lb # [ 101.679665] niks3-server[1074]: 2026/09/20 12:47:48 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5587lb # [ 101.691812] niks3-server[1074]: 2026/09/20 12:47:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5588lb # [ 101.697110] niks3-server[1074]: 2026/09/20 12:47:48 INFO Signed narinfos id=35 count=15589worker2 # [ 101.728224] nix-grpc-daemon[1202]: time=2026-09-20T12:47:47.980Z level=INFO msg="Uploading 1 narinfos"5590lb # [ 101.704350] niks3-server[1074]: 2026/09/20 12:47:48 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5591lb # [ 101.714770] niks3-server[1074]: 2026/09/20 12:47:48 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5592lb # [ 101.720610] niks3-server[1074]: 2026/09/20 12:47:48 INFO Completed upload id=355593worker2 # [ 101.748635] nix-grpc-daemon[1202]: time=2026-09-20T12:47:48.000Z level=INFO msg="Upload complete. (439ms)"5594lb # [ 101.723921] niks3-server[1074]: 2026/09/20 12:47:48 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5595worker2 # [ 101.754327] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57468 duration_s=0 paths=1 nar_bytes_in=4245596worker2 # [ 101.758970] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574685597worker2 # [ 101.768256] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5598worker2 # [ 101.772137] nix-daemon[814]: reaped child process 1360, status = succeeded5599client # [ 101.728104] nix[1235]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5600worker2 # [ 101.777177] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5601worker1: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5602worker1 # [ 103.447369] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1278 (nix-grpc-daemon) on client request.5603worker1 # [ 103.453147] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5604worker2 # [ 103.489394] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:49Z level=info event=scheduler_disconnected addr=lb:50051 error="Stream removed (RST_STREAM (Received RST_STREAM with error code 2))"5605client # [ 103.441972] nix[1235]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5606worker1: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.05 seconds)5607client: must succeed: sleep 5.05608worker1 # [ 103.475393] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5609worker1 # [ 103.476957] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5610worker1 # [ 103.479237] systemd[1]: nix-grpc-daemon.service: Consumed 103ms CPU time over 3.030s wall clock time, 10.3M memory peak, 8.6K incoming IP traffic, 7.9K outgoing IP traffic.5611worker2 # [ 103.689725] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:49Z level=info event=scheduler_connected addr=lb:500515612worker1 # [ 103.658404] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5613worker1 # [ 103.663076] systemd[1]: Starting Nix worker-protocol over gRPC...5614worker1 # [ 103.808412] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:50Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5615worker1 # [ 103.810298] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:50Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5616worker1 # [ 103.813513] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:50Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15617worker1 # [ 103.819656] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:50Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5618worker1 # [ 103.823959] systemd[1]: Started Nix worker-protocol over gRPC.5619worker1 # [ 103.833855] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:50Z level=info event=oidc_jwks provider=mock keys=15620worker1 # [ 103.836200] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:50Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:573905621worker1 # [ 103.838196] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:50Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=15622worker1 # [ 103.841125] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:50Z level=info event=scheduler_connected addr=lb:500515623worker1 # [ 103.842663] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:50Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:573905624worker1 # [ 103.844186] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:50Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05625client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5626client: waiting for success: ! systemctl is-active mid5627worker2 # [ 109.009219] nix-daemon[814]: reaped child process 1374, status = succeeded5628worker2 # [ 109.156813] nix-daemon[814]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5629worker2 # [ 109.169340] nix-daemon[814]: reaped child process 1413, status = succeeded5630lb # [ 109.153683] niks3-server[1074]: 2026/09/20 12:47:56 INFO Received uploads request method=POST path=/api/pending_closures5631worker2 # [ 109.190756] nix-grpc-daemon[1202]: time=2026-09-20T12:47:55.442Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5632worker2 # [ 109.192821] nix-grpc-daemon[1202]: time=2026-09-20T12:47:55.444Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5633lb # [ 109.193053] niks3-server[1074]: 2026/09/20 12:47:56 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5634lb # [ 109.202183] niks3-server[1074]: 2026/09/20 12:47:56 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5635lb # [ 109.214684] niks3-server[1074]: 2026/09/20 12:47:56 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5636worker2 # [ 109.246142] nix-grpc-daemon[1202]: time=2026-09-20T12:47:55.498Z level=INFO msg="Uploading 1 narinfos"5637lb # [ 109.219105] niks3-server[1074]: 2026/09/20 12:47:56 INFO Signed narinfos id=36 count=15638lb # [ 109.228728] niks3-server[1074]: 2026/09/20 12:47:56 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5639lb # [ 109.232705] niks3-server[1074]: 2026/09/20 12:47:56 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete5640lb # [ 109.235838] niks3-server[1074]: 2026/09/20 12:47:56 INFO Completed upload id=365641lb # [ 109.238077] niks3-server[1074]: 2026/09/20 12:47:56 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5642worker2 # [ 109.265485] nix-grpc-daemon[1202]: time=2026-09-20T12:47:55.517Z level=INFO msg="Upload complete. (275ms)"5643worker2 # [ 109.270906] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57468 duration_s=7 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15644worker2 # [ 109.284264] nix-daemon[814]: reaped child process 1372, status = succeeded5645client # [ 109.248620] systemd[1]: mid.service: Deactivated successfully.5646client # [ 109.250377] systemd[1]: mid.service: Consumed 102ms CPU time over 8.292s wall clock time, 39.1M memory peak, 8.8K incoming IP traffic, 9.3K outgoing IP traffic.5647lb # [ 109.444725] envoy[926]: conn peer=[2001:db8:1::3]:58122 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=496 tx=211 ms=28285648lb # [ 109.449268] envoy[926]: conn peer=[2001:db8:1::1]:50230 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3031 tx=1374 ms=80805649client: (finished: waiting for success: ! systemctl is-active mid, in 1.08 seconds)5650client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5651client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.03 seconds)5652(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 8.93 seconds)5653subtest: interrupting the client stops the build on the worker5654client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5655client # [ 109.879181] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5656client # Running as unit: intr.service; invocation ID: 7dcc078d2bdf438da9336b4f3e6e185f5657client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.03 seconds)5658worker2 # [ 110.104526] nix-grpc-daemon[1181]: ts=2026-09-20T12:47:56Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:574685659client # [ 110.061823] nix[1270]: don't know how to build these paths:5660client # [ 110.063175] nix[1270]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5661worker1 # [ 110.088843] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:57Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05662worker1 # [ 110.092848] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:57Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15663worker1 # [ 110.133990] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:57Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574205664worker1 # [ 110.145311] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5665worker1 # [ 110.161382] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 1/5)5666worker1 # [ 110.203240] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 32 ms (attempt 2/5)5667worker1 # [ 110.240910] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 154 ms (attempt 3/5)5668worker1 # [ 110.400810] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 725 ms (attempt 4/5)5669worker1 # [ 111.133377] nix-grpc-daemon[1356]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5670worker1 # [ 111.149726] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:58Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574205671client # [ 111.146786] nix[1270]: copying 1 paths to 'lb:50051'...5672client # [ 111.150141] nix[1270]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5673worker1 # [ 111.165087] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:58Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574205674worker1 # [ 111.173632] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5675worker1 # [ 111.193820] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:58Z level=info event=niks3_push_started pid=14275676worker1 # [ 111.375581] nix-grpc-daemon[1427]: time=2026-09-20T12:47:58.418Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker1.key ca=""5677worker1 # [ 111.530785] nix-daemon[851]: accepted connection from pid 1440, user nix-grpc-daemon (trusted)5678worker1 # [ 111.541414] nix-daemon[851]: reaped child process 1443, status = succeeded5679worker1 # [ 111.695044] nix-daemon[851]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)5680worker1 # [ 111.706407] nix-daemon[851]: reaped child process 1448, status = succeeded5681lb # [ 111.730682] niks3-server[1074]: 2026/09/20 12:47:58 INFO Received uploads request method=POST path=/api/pending_closures5682worker1 # [ 111.730162] nix-grpc-daemon[1427]: time=2026-09-20T12:47:58.773Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5683worker1 # [ 111.732790] nix-grpc-daemon[1427]: time=2026-09-20T12:47:58.774Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5684lb # [ 111.758598] niks3-server[1074]: 2026/09/20 12:47:58 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5685lb # [ 111.768768] niks3-server[1074]: 2026/09/20 12:47:58 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign5686lb # [ 111.773515] niks3-server[1074]: 2026/09/20 12:47:58 INFO Signed narinfos id=37 count=15687worker1 # [ 111.770528] nix-grpc-daemon[1427]: time=2026-09-20T12:47:58.813Z level=INFO msg="Uploading 1 narinfos"5688lb # [ 111.785198] niks3-server[1074]: 2026/09/20 12:47:58 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5689lb # [ 111.793064] niks3-server[1074]: 2026/09/20 12:47:58 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete5690worker1 # [ 111.793095] nix-grpc-daemon[1427]: time=2026-09-20T12:47:58.836Z level=INFO msg="Upload complete. (414ms)"5691lb # [ 111.799178] niks3-server[1074]: 2026/09/20 12:47:58 INFO Completed upload id=375692lb # [ 111.804486] niks3-server[1074]: 2026/09/20 12:47:58 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5693worker1 # [ 111.795431] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:58Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=0 paths=1 nar_bytes_in=4245694worker1 # [ 111.801457] nix-grpc-daemon[1356]: ts=2026-09-20T12:47:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574205695worker1 # [ 111.807265] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5696worker1 # [ 111.811575] nix-daemon[851]: reaped child process 1425, status = succeeded5697worker1 # [ 111.816492] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5698client # [ 111.801751] nix[1270]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5699client: must succeed: systemctl kill -s INT intr5700client # [ 113.418181] systemd[1]: intr.service: Sent signal SIGINT to main process 1270 (nix) on client request.5701client # [ 113.425802] nix[1270]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5702client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)5703client # [ 113.432639] nix[1270]: error: interrupted by the user5704client # [ 113.463442] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5705client # [ 113.465171] systemd[1]: intr.service: Failed with result 'exit-code'.5706client # [ 113.467046] systemd[1]: intr.service: Consumed 102ms CPU time over 3.586s wall clock time, 39.1M memory peak, 7.8K incoming IP traffic, 8.7K outgoing IP traffic.5707worker1 # [ 113.634774] nix-daemon[851]: reaped child process 1450, status = succeeded5708worker1 # [ 113.638258] nix-daemon[1452]: unexpected Nix daemon error: error: interrupted by the user5709worker1 # [ 113.642869] nix-daemon[851]: reaped child process 1452, status = failed with exit code 15710(finished: subtest: interrupting the client stops the build on the worker, in 4.80 seconds)5711subtest: a deploy mid-build drains: the build finishes, the new generation takes over5712client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5713client # [ 114.707182] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5714client # Running as unit: sw.service; invocation ID: c6e21a4be00f4f00997c346f595ace2a5715client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.07 seconds)5716worker1 # [ 114.930473] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:01Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:574205717client # [ 114.921887] nix[1290]: don't know how to build these paths:5718client # [ 114.922903] nix[1290]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5719worker1 # [ 114.942625] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:01Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05720worker1 # [ 114.946690] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:01Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15721worker2 # [ 115.020212] nix-grpc-daemon[1181]: ts=2026-09-20T12:48:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574685722worker2 # [ 115.026836] nix-grpc-daemon[1181]: ts=2026-09-20T12:48:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574685723worker2 # [ 115.032220] nix-grpc-daemon[1181]: ts=2026-09-20T12:48:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574685724client # [ 114.984247] nix[1290]: copying 1 paths to 'lb:50051'...5725client # [ 114.986183] nix[1290]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5726worker2 # [ 115.041906] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5727worker2 # [ 115.192514] nix-daemon[814]: accepted connection from pid 1445, user nix-grpc-daemon (trusted)5728worker2 # [ 115.204598] nix-daemon[814]: reaped child process 1448, status = succeeded5729worker2 # [ 115.364522] nix-daemon[814]: accepted connection from pid 1450, user nix-grpc-daemon (trusted)5730worker2 # [ 115.376713] nix-daemon[814]: reaped child process 1453, status = succeeded5731lb # [ 115.363126] niks3-server[1074]: 2026/09/20 12:48:02 INFO Received uploads request method=POST path=/api/pending_closures5732worker2 # [ 115.400807] nix-grpc-daemon[1202]: time=2026-09-20T12:48:01.652Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5733worker2 # [ 115.402219] nix-grpc-daemon[1202]: time=2026-09-20T12:48:01.652Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5734lb # [ 115.392822] niks3-server[1074]: 2026/09/20 12:48:02 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5735lb # [ 115.399950] niks3-server[1074]: 2026/09/20 12:48:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign5736lb # [ 115.405644] niks3-server[1074]: 2026/09/20 12:48:02 INFO Signed narinfos id=38 count=15737worker2 # [ 115.436503] nix-grpc-daemon[1202]: time=2026-09-20T12:48:01.688Z level=INFO msg="Uploading 1 narinfos"5738lb # [ 115.412532] niks3-server[1074]: 2026/09/20 12:48:02 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5739lb # [ 115.421951] niks3-server[1074]: 2026/09/20 12:48:02 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete5740lb # [ 115.426878] niks3-server[1074]: 2026/09/20 12:48:02 INFO Completed upload id=385741worker2 # [ 115.454908] nix-grpc-daemon[1202]: time=2026-09-20T12:48:01.707Z level=INFO msg="Upload complete. (407ms)"5742worker2 # [ 115.457971] nix-grpc-daemon[1181]: ts=2026-09-20T12:48:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57468 duration_s=0 paths=1 nar_bytes_in=4165743worker2 # [ 115.460119] nix-grpc-daemon[1202]: time=2026-09-20T12:48:01.709Z level=WARN msg="Failed to register uploaded object" key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo error="server returned 404: object is not pending upload\n"5744worker2 # [ 115.463108] nix-grpc-daemon[1181]: ts=2026-09-20T12:48:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574685745worker2 # [ 115.468112] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5746worker2 # [ 115.474099] nix-daemon[814]: reaped child process 1443, status = succeeded5747worker2 # [ 115.477279] nix-daemon[814]: accepted connection from pid 1181, user nix-grpc-daemon (trusted)5748client # [ 115.428551] nix[1290]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...5749worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&25750worker2 # Checking switch inhibitors... done5751worker2 # [ 117.930493] nixos[1488]: switching to system configuration /nix/store/m3yvd3iwzdwff96nc52rbzd2fnb8fjw6-nixos-system-worker2-test5752worker2 # [ 117.932882] systemd[1]: Stopped target Remote File Systems.5753worker2 # activating the configuration...5754worker2 # [ 117.935734] systemd[1]: Stopped target Local File Systems.5755worker2 # setting up /etc...5756worker2 # [ 118.585608] systemd[1]: Reload requested from client PID 1488 ('.switch-to-conf') (unit backdoor.service)...5757worker2 # [ 118.587467] systemd[1]: Reloading...5758worker2 # [ 119.260324] systemd[1]: Reloading finished in 669 ms.5759worker2 # restarting sysinit-reactivation.target5760worker2 # [ 119.313951] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....5761worker2 # [ 119.448395] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..5762worker2 # [ 119.452944] systemd[1]: Reached target Reactivate sysinit units.5763worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service5764worker2 # [ 119.458394] dbus-broker-launch[534]: Caught SIGHUP, trigger reload.5765worker2 # [ 119.461078] systemd[1]: Reloading D-Bus System Message Bus...5766worker2 # [ 119.463326] systemd[1]: Reloading Nix worker-protocol over gRPC...5767lb # [ 119.444557] envoy[926]: conn peer=[2001:db8:1::1]:53380 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2937 tx=731 ms=33875768worker2 # [ 119.494529] dbus-broker-launch[534]: Looking up NSS user entry for 'systemd-timesync'...5769worker2 # [ 119.497090] dbus-broker-launch[534]: NSS returned no entry for 'systemd-timesync'5770worker2 # [ 119.498294] dbus-broker-launch[534]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"5771worker2 # [ 119.506928] systemd[1]: Reloaded Nix worker-protocol over gRPC.5772worker2 # [ 119.526858] systemd[1]: Reloaded D-Bus System Message Bus.5773worker2 # [ 119.532733] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os5774worker2 # [ 119.534063] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki5775worker2 # [ 119.536631] systemd[1]: Reached target Local File Systems.5776worker2 # [ 119.542832] systemd[1]: Reached target Remote File Systems.5777worker2 # [ 119.549773] systemd[1]: Starting linger-users.service...5778worker2 # [ 119.556588] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore5779worker2 # [ 119.560786] systemd[1]: Starting Create SUID/SGID Wrappers...5780worker2 # [ 119.561749] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.5781worker2 # [ 119.563147] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc675782worker2 # [ 119.565496] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore5783worker2 # [ 119.568227] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5784worker2 # [ 119.570640] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os5785worker2 # [ 119.611877] systemd[1]: linger-users.service: Deactivated successfully.5786worker2 # [ 119.613982] systemd[1]: Finished linger-users.service.5787worker2 # [ 119.757972] nix-grpc-daemon[1181]: ts=2026-09-20T12:48:06Z level=info event=draining5788worker2 # [ 119.969095] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.5789worker2 # [ 119.970498] systemd[1]: Finished Create SUID/SGID Wrappers.5790worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service5791worker2 # [ 120.225826] nixos[1488]: finished switching to system configuration /nix/store/m3yvd3iwzdwff96nc52rbzd2fnb8fjw6-nixos-system-worker2-test5792worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 3.01 seconds)5793worker2: must succeed: pgrep -f 'read -t [9]0 x'5794worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)5795client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&25796worker1 # [ 120.477818] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:574205797client # don't know how to build these paths:5798client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5799worker1 # [ 120.485850] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574205800worker1 # [ 120.507637] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:07Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=05801worker1 # [ 120.512851] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:07Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=15802worker1 # [ 120.556833] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:07Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574205803worker1 # [ 120.567165] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:07Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574205804client # copying 1 paths to 'lb:50051'...5805worker1 # [ 120.577481] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:07Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574205806client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...5807worker1 # [ 120.598321] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5808worker1 # [ 120.769518] nix-daemon[851]: accepted connection from pid 1506, user nix-grpc-daemon (trusted)5809worker1 # [ 120.781250] nix-daemon[851]: reaped child process 1509, status = succeeded5810worker1 # [ 120.932258] nix-daemon[851]: accepted connection from pid 1511, user nix-grpc-daemon (trusted)5811worker1 # [ 120.943850] nix-daemon[851]: reaped child process 1514, status = succeeded5812lb # [ 120.965626] niks3-server[1074]: 2026/09/20 12:48:08 INFO Received uploads request method=POST path=/api/pending_closures5813worker1 # [ 120.970564] nix-grpc-daemon[1427]: time=2026-09-20T12:48:08.013Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5814worker1 # [ 120.972301] nix-grpc-daemon[1427]: time=2026-09-20T12:48:08.013Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"5815lb # [ 120.994372] niks3-server[1074]: 2026/09/20 12:48:08 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst5816lb # [ 121.003451] niks3-server[1074]: 2026/09/20 12:48:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign5817lb # [ 121.009733] niks3-server[1074]: 2026/09/20 12:48:08 INFO Signed narinfos id=39 count=15818worker1 # [ 121.006645] nix-grpc-daemon[1427]: time=2026-09-20T12:48:08.049Z level=INFO msg="Uploading 1 narinfos"5819lb # [ 121.016660] niks3-server[1074]: 2026/09/20 12:48:08 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls5820lb # [ 121.027684] niks3-server[1074]: 2026/09/20 12:48:08 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete5821worker1 # [ 121.027974] nix-grpc-daemon[1427]: time=2026-09-20T12:48:08.071Z level=INFO msg="Upload complete. (417ms)"5822lb # [ 121.034436] niks3-server[1074]: 2026/09/20 12:48:08 INFO Completed upload id=395823worker1 # [ 121.030059] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:08Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=0 paths=1 nar_bytes_in=5285824lb # [ 121.037571] niks3-server[1074]: 2026/09/20 12:48:08 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo5825worker1 # [ 121.035399] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574205826worker1 # [ 121.040155] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5827worker1 # [ 121.042342] nix-daemon[851]: reaped child process 1504, status = succeeded5828worker1 # [ 121.047487] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5829client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...5830client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5831client # farm-a> LOG-farm-a-during-drain5832worker1 # [ 122.261376] nix-daemon[851]: reaped child process 1518, status = succeeded5833worker1 # [ 122.402243] nix-daemon[851]: accepted connection from pid 1533, user nix-grpc-daemon (trusted)5834worker1 # [ 122.413825] nix-daemon[851]: reaped child process 1536, status = succeeded5835lb # [ 122.435871] niks3-server[1074]: 2026/09/20 12:48:09 INFO Received uploads request method=POST path=/api/pending_closures5836worker1 # [ 122.434632] nix-grpc-daemon[1427]: time=2026-09-20T12:48:09.477Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5837worker1 # [ 122.436145] nix-grpc-daemon[1427]: time=2026-09-20T12:48:09.479Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"5838lb # [ 122.455076] niks3-server[1074]: 2026/09/20 12:48:09 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv5839lb # [ 122.460426] niks3-server[1074]: 2026/09/20 12:48:09 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign5840lb # [ 122.462603] niks3-server[1074]: 2026/09/20 12:48:09 INFO Signed narinfos id=40 count=15841worker1 # [ 122.457108] nix-grpc-daemon[1427]: time=2026-09-20T12:48:09.500Z level=INFO msg="Uploading 1 narinfos"5842lb # [ 122.466833] niks3-server[1074]: 2026/09/20 12:48:09 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst5843lb # [ 122.469805] niks3-server[1074]: 2026/09/20 12:48:09 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls5844lb # [ 122.473515] niks3-server[1074]: 2026/09/20 12:48:09 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete5845lb # [ 122.476748] niks3-server[1074]: 2026/09/20 12:48:09 INFO Completed upload id=405846worker1 # [ 122.470520] nix-grpc-daemon[1427]: time=2026-09-20T12:48:09.513Z level=INFO msg="Upload complete. (216ms)"5847lb # [ 122.478484] niks3-server[1074]: 2026/09/20 12:48:09 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo5848worker1 # [ 122.472775] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:09Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=3 outputs=15849worker1 # [ 122.479394] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:09Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=05850worker1 # [ 122.481360] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:09Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=15851worker1 # [ 122.485290] nix-daemon[851]: reaped child process 1516, status = succeeded5852worker1 # [ 122.522239] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574205853worker1 # [ 122.528477] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:09Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574205854worker1 # [ 122.536446] nix-grpc-daemon[1427]: time=2026-09-20T12:48:09.579Z level=INFO msg="All 1 paths already cached"5855client # copying 1 paths to 'lb:50051'...5856worker1 # [ 122.542222] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574205857client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...5858worker1 # [ 122.554928] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5859worker1 # [ 122.705711] nix-daemon[851]: accepted connection from pid 1542, user nix-grpc-daemon (trusted)5860worker1 # [ 122.717677] nix-daemon[851]: reaped child process 1545, status = succeeded5861worker1 # [ 122.880463] nix-daemon[851]: accepted connection from pid 1547, user nix-grpc-daemon (trusted)5862worker1 # [ 122.893976] nix-daemon[851]: reaped child process 1550, status = succeeded5863lb # [ 122.913929] niks3-server[1074]: 2026/09/20 12:48:10 INFO Received uploads request method=POST path=/api/pending_closures5864worker1 # [ 122.912421] nix-grpc-daemon[1427]: time=2026-09-20T12:48:09.955Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5865worker1 # [ 122.914464] nix-grpc-daemon[1427]: time=2026-09-20T12:48:09.957Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"5866lb # [ 122.928566] niks3-server[1074]: 2026/09/20 12:48:10 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst5867lb # [ 122.933838] niks3-server[1074]: 2026/09/20 12:48:10 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign5868lb # [ 122.936530] niks3-server[1074]: 2026/09/20 12:48:10 INFO Signed narinfos id=41 count=15869worker1 # [ 122.930718] nix-grpc-daemon[1427]: time=2026-09-20T12:48:09.973Z level=INFO msg="Uploading 1 narinfos"5870lb # [ 122.939503] niks3-server[1074]: 2026/09/20 12:48:10 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls5871lb # [ 122.944153] niks3-server[1074]: 2026/09/20 12:48:10 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete5872lb # [ 122.948349] niks3-server[1074]: 2026/09/20 12:48:10 INFO Completed upload id=415873worker1 # [ 122.942189] nix-grpc-daemon[1427]: time=2026-09-20T12:48:09.985Z level=INFO msg="Upload complete. (379ms)"5874lb # [ 122.950032] niks3-server[1074]: 2026/09/20 12:48:10 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo5875worker1 # [ 122.944078] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=0 paths=1 nar_bytes_in=6405876worker1 # [ 122.948316] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574205877worker1 # [ 122.954138] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5878worker1 # [ 122.956466] nix-daemon[851]: reaped child process 1540, status = succeeded5879worker1 # [ 122.961866] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5880client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...5881client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5882client # farm-b> LOG-farm-b-during-drain5883worker1 # [ 124.376647] nix-daemon[851]: reaped child process 1554, status = succeeded5884worker1 # [ 124.504136] nix-daemon[851]: accepted connection from pid 1569, user nix-grpc-daemon (trusted)5885worker1 # [ 124.516102] nix-daemon[851]: reaped child process 1572, status = succeeded5886lb # [ 124.533543] niks3-server[1074]: 2026/09/20 12:48:11 INFO Received uploads request method=POST path=/api/pending_closures5887worker1 # [ 124.533372] nix-grpc-daemon[1427]: time=2026-09-20T12:48:11.576Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5888worker1 # [ 124.535580] nix-grpc-daemon[1427]: time=2026-09-20T12:48:11.577Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"5889lb # [ 124.551353] niks3-server[1074]: 2026/09/20 12:48:11 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv5890lb # [ 124.556197] niks3-server[1074]: 2026/09/20 12:48:11 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign5891lb # [ 124.558316] niks3-server[1074]: 2026/09/20 12:48:11 INFO Signed narinfos id=42 count=15892worker1 # [ 124.553655] nix-grpc-daemon[1427]: time=2026-09-20T12:48:11.596Z level=INFO msg="Uploading 1 narinfos"5893lb # [ 124.559774] niks3-server[1074]: 2026/09/20 12:48:11 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst5894lb # [ 124.565913] niks3-server[1074]: 2026/09/20 12:48:11 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls5895lb # [ 124.569537] niks3-server[1074]: 2026/09/20 12:48:11 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete5896lb # [ 124.572466] niks3-server[1074]: 2026/09/20 12:48:11 INFO Completed upload id=425897worker1 # [ 124.566137] nix-grpc-daemon[1427]: time=2026-09-20T12:48:11.609Z level=INFO msg="Upload complete. (196ms)"5898lb # [ 124.573989] niks3-server[1074]: 2026/09/20 12:48:11 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo5899worker1 # [ 124.568421] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:11Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=4 outputs=15900worker1 # [ 124.576549] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:11Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=05901worker1 # [ 124.578515] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:11Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=15902worker1 # [ 124.581488] nix-daemon[851]: reaped child process 1552, status = succeeded5903worker1 # [ 124.620414] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:11Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574205904worker1 # [ 124.635386] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:11Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574205905worker1 # [ 124.644720] nix-grpc-daemon[1427]: time=2026-09-20T12:48:11.687Z level=INFO msg="All 2 paths already cached"5906client # copying 1 paths to 'lb:50051'...5907worker1 # [ 124.651287] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:11Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574205908client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...5909worker1 # [ 124.668399] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5910worker1 # [ 124.846914] nix-daemon[851]: accepted connection from pid 1578, user nix-grpc-daemon (trusted)5911worker1 # [ 124.858817] nix-daemon[851]: reaped child process 1581, status = succeeded5912worker1 # [ 125.014795] nix-daemon[851]: accepted connection from pid 1583, user nix-grpc-daemon (trusted)5913worker1 # [ 125.026790] nix-daemon[851]: reaped child process 1586, status = succeeded5914lb # [ 125.044370] niks3-server[1074]: 2026/09/20 12:48:12 INFO Received uploads request method=POST path=/api/pending_closures5915worker1 # [ 125.045795] nix-grpc-daemon[1427]: time=2026-09-20T12:48:12.088Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5916worker1 # [ 125.047631] nix-grpc-daemon[1427]: time=2026-09-20T12:48:12.090Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"5917lb # [ 125.072510] niks3-server[1074]: 2026/09/20 12:48:12 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst5918lb # [ 125.082213] niks3-server[1074]: 2026/09/20 12:48:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign5919lb # [ 125.087514] niks3-server[1074]: 2026/09/20 12:48:12 INFO Signed narinfos id=43 count=15920worker1 # [ 125.083022] nix-grpc-daemon[1427]: time=2026-09-20T12:48:12.125Z level=INFO msg="Uploading 1 narinfos"5921lb # [ 125.091406] niks3-server[1074]: 2026/09/20 12:48:12 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls5922lb # [ 125.101462] niks3-server[1074]: 2026/09/20 12:48:12 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete5923lb # [ 125.106862] niks3-server[1074]: 2026/09/20 12:48:12 INFO Completed upload id=435924worker1 # [ 125.100647] nix-grpc-daemon[1427]: time=2026-09-20T12:48:12.143Z level=INFO msg="Upload complete. (420ms)"5925worker1 # [ 125.103522] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:12Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=0 paths=1 nar_bytes_in=7685926lb # [ 125.111516] niks3-server[1074]: 2026/09/20 12:48:12 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo5927worker1 # [ 125.109404] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:12Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574205928worker1 # [ 125.113851] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5929worker1 # [ 125.116064] nix-daemon[851]: reaped child process 1576, status = succeeded5930client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...5931worker1 # [ 125.122250] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)5932client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5933client # farm-top> LOG-farm-top-during-drain5934worker1 # [ 126.334173] nix-daemon[851]: reaped child process 1590, status = succeeded5935worker1 # [ 126.484426] nix-daemon[851]: accepted connection from pid 1605, user nix-grpc-daemon (trusted)5936worker1 # [ 126.496463] nix-daemon[851]: reaped child process 1608, status = succeeded5937lb # [ 126.519698] niks3-server[1074]: 2026/09/20 12:48:13 INFO Received uploads request method=POST path=/api/pending_closures5938worker1 # [ 126.521821] nix-grpc-daemon[1427]: time=2026-09-20T12:48:13.564Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5939worker1 # [ 126.523296] nix-grpc-daemon[1427]: time=2026-09-20T12:48:13.566Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"5940lb # [ 126.562950] niks3-server[1074]: 2026/09/20 12:48:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign5941lb # [ 126.565906] niks3-server[1074]: 2026/09/20 12:48:13 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst5942lb # [ 126.572909] niks3-server[1074]: 2026/09/20 12:48:13 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls5943lb # [ 126.576916] niks3-server[1074]: 2026/09/20 12:48:13 INFO Signed narinfos id=44 count=15944worker1 # [ 126.573343] nix-grpc-daemon[1427]: time=2026-09-20T12:48:13.616Z level=INFO msg="Uploading 1 narinfos"5945lb # [ 126.583159] niks3-server[1074]: 2026/09/20 12:48:13 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv5946lb # [ 126.590234] niks3-server[1074]: 2026/09/20 12:48:13 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete5947lb # [ 126.595083] niks3-server[1074]: 2026/09/20 12:48:13 INFO Completed upload id=445948worker1 # [ 126.589231] nix-grpc-daemon[1427]: time=2026-09-20T12:48:13.632Z level=INFO msg="Upload complete. (260ms)"5949lb # [ 126.596934] niks3-server[1074]: 2026/09/20 12:48:13 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo5950worker1 # [ 126.594777] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=5 outputs=15951worker1 # [ 126.606196] nix-daemon[851]: reaped child process 1588, status = succeeded5952client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain >&2, in 6.39 seconds)5953client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath5954client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag during-drain outPath, in 0.21 seconds)5955worker2: must succeed: pkill -f 'read -t [9]0 x'5956worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.05 seconds)5957client: waiting for success: ! systemctl is-active sw5958worker2 # [ 127.116561] nix-daemon[814]: reaped child process 1457, status = succeeded5959worker2 # [ 127.275412] nix-daemon[814]: accepted connection from pid 1628, user nix-grpc-daemon (trusted)5960worker2 # [ 127.287155] nix-daemon[814]: reaped child process 1631, status = succeeded5961lb # [ 127.275805] niks3-server[1074]: 2026/09/20 12:48:14 INFO Received uploads request method=POST path=/api/pending_closures5962worker2 # [ 127.313189] nix-grpc-daemon[1202]: time=2026-09-20T12:48:13.565Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5963worker2 # [ 127.314666] nix-grpc-daemon[1202]: time=2026-09-20T12:48:13.566Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"5964lb # [ 127.317069] niks3-server[1074]: 2026/09/20 12:48:14 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5965lb # [ 127.330462] niks3-server[1074]: 2026/09/20 12:48:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign5966lb # [ 127.336578] niks3-server[1074]: 2026/09/20 12:48:14 INFO Signed narinfos id=45 count=15967worker2 # [ 127.367989] nix-grpc-daemon[1202]: time=2026-09-20T12:48:13.619Z level=INFO msg="Uploading 1 narinfos"5968lb # [ 127.345129] niks3-server[1074]: 2026/09/20 12:48:14 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst5969lb # [ 127.356992] niks3-server[1074]: 2026/09/20 12:48:14 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls5970lb # [ 127.360791] niks3-server[1074]: 2026/09/20 12:48:14 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete5971lb # [ 127.364922] niks3-server[1074]: 2026/09/20 12:48:14 INFO Completed upload id=455972lb # [ 127.366833] niks3-server[1074]: 2026/09/20 12:48:14 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo5973worker2 # [ 127.394237] nix-grpc-daemon[1202]: time=2026-09-20T12:48:13.646Z level=INFO msg="Upload complete. (296ms)"5974worker2 # [ 127.400391] nix-grpc-daemon[1181]: ts=2026-09-20T12:48:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57468 duration_s=11 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=2 outputs=15975worker2 # [ 127.413184] nix-daemon[814]: reaped child process 1455, status = succeeded5976client # [ 127.377768] systemd[1]: sw.service: Deactivated successfully.5977client # [ 127.379969] systemd[1]: sw.service: Consumed 111ms CPU time over 12.672s wall clock time, 39.1M memory peak, 8.6K incoming IP traffic, 9K outgoing IP traffic.5978worker2 # [ 127.761163] nix-grpc-daemon[1181]: ts=2026-09-20T12:48:14Z level=info event=signal_exit5979worker1 # [ 127.733794] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:14Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:573905980worker1 # [ 127.737636] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:14Z level=info event=worker_gone addr=192.168.1.4:500515981worker2 # [ 127.774440] nix-grpc-daemon[1181]: ts=2026-09-20T12:48:14Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5982worker2 # [ 127.802560] nix-daemon[814]: reaped child process 1195, status = succeeded5983worker2 # [ 127.819308] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5984worker2 # [ 127.822246] systemd[1]: nix-grpc-daemon.service: Consumed 1.631s CPU time over 50.239s wall clock time, 32.7M memory peak, 64K incoming IP traffic, 130.5K outgoing IP traffic.5985worker2 # [ 127.836585] systemd[1]: Starting scheduler-token.service...5986worker2 # [ 127.902750] systemd[1]: scheduler-token.service: Deactivated successfully.5987worker2 # [ 127.903811] systemd[1]: Finished scheduler-token.service.5988worker2 # [ 127.904953] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 66ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic.5989worker2 # [ 127.909954] systemd[1]: Starting Nix worker-protocol over gRPC...5990client: (finished: waiting for success: ! systemctl is-active sw, in 1.09 seconds)5991client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }5992worker2 # [ 128.054798] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:14Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear"5993client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)5994worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service5995worker2 # [ 128.056562] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:14Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5996worker2 # [ 128.059221] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:14Z level=info event=roles builder=1 scheduler=0 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15997worker2 # [ 128.065734] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:14Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5998worker2 # [ 128.067310] systemd[1]: Started Nix worker-protocol over gRPC.5999worker2 # [ 128.081632] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:14Z level=info event=scheduler_connected addr=lb:500516000worker1 # [ 128.049337] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:15Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:573906001worker1 # [ 128.051133] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:15Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06002worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 0.05 seconds)6003lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6004lb: must succeed: curl -sf localhost:9901/clusters6005lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.08 seconds)6006lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.08 seconds)6007worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6008worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.04 seconds)6009(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 13.53 seconds)6010subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6011client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16012worker1 # [ 128.423377] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:574206013worker2 # [ 128.469699] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:350646014worker2 # [ 128.480791] nix-daemon[814]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)6015worker2 # [ 128.496744] nix-grpc-daemon[1641]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 4 ms (attempt 1/5)6016worker2 # [ 128.506701] nix-grpc-daemon[1641]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 183 ms (attempt 2/5)6017worker2 # [ 128.695625] nix-grpc-daemon[1641]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 136 ms (attempt 3/5)6018worker2 # [ 128.837757] nix-grpc-daemon[1641]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 520 ms (attempt 4/5)6019worker2 # [ 129.364642] nix-grpc-daemon[1641]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6020worker1 # [ 129.376593] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:16Z level=debug event=want client=5 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06021worker1 # [ 129.380570] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:16Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16022worker1 # [ 129.384831] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:16Z level=debug event=want client=5 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06023worker1 # [ 129.388606] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:16Z level=debug event=want client=5 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06024worker1 # [ 129.419136] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206025worker1 # [ 129.431653] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574206026lb # [ 129.446117] envoy[926]: conn peer=[2001:db8:1::1]:58572 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9555 tx=3820 ms=61366027lb # [ 129.450538] envoy[926]: conn peer=[2001:db8:1::1]:58568 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2936 tx=1348 ms=124436028lb # [ 129.455227] envoy[926]: conn peer=[2001:db8:1::4]:59462 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=35229 tx=2108 ms=500126029worker1 # [ 129.449608] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574206030worker1 # [ 129.460785] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6031worker1 # [ 129.645803] nix-daemon[851]: accepted connection from pid 1617, user nix-grpc-daemon (trusted)6032worker1 # [ 129.659901] nix-daemon[851]: reaped child process 1620, status = succeeded6033worker1 # [ 129.836337] nix-daemon[851]: accepted connection from pid 1622, user nix-grpc-daemon (trusted)6034worker1 # [ 129.850302] nix-daemon[851]: reaped child process 1625, status = succeeded6035lb # [ 129.875320] niks3-server[1074]: 2026/09/20 12:48:17 INFO Received uploads request method=POST path=/api/pending_closures6036worker1 # [ 129.879874] nix-grpc-daemon[1427]: time=2026-09-20T12:48:16.922Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6037worker1 # [ 129.881522] nix-grpc-daemon[1427]: time=2026-09-20T12:48:16.924Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6038lb # [ 129.905264] niks3-server[1074]: 2026/09/20 12:48:17 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6039lb # [ 129.916702] niks3-server[1074]: 2026/09/20 12:48:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6040lb # [ 129.921823] niks3-server[1074]: 2026/09/20 12:48:17 INFO Signed narinfos id=46 count=16041worker1 # [ 129.918985] nix-grpc-daemon[1427]: time=2026-09-20T12:48:16.961Z level=INFO msg="Uploading 1 narinfos"6042lb # [ 129.929089] niks3-server[1074]: 2026/09/20 12:48:17 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6043lb # [ 129.939148] niks3-server[1074]: 2026/09/20 12:48:17 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6044lb # [ 129.945588] niks3-server[1074]: 2026/09/20 12:48:17 INFO Completed upload id=466045worker1 # [ 129.939426] nix-grpc-daemon[1427]: time=2026-09-20T12:48:16.982Z level=INFO msg="Upload complete. (465ms)"6046lb # [ 129.948289] niks3-server[1074]: 2026/09/20 12:48:17 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6047worker1 # [ 129.943324] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=0 paths=1 nar_bytes_in=5046048worker1 # [ 129.949710] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206049worker1 # [ 129.960068] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6050worker1 # [ 129.964794] nix-daemon[851]: reaped child process 1615, status = succeeded6051worker1 # [ 129.970169] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6052worker1 # [ 130.986136] nix-daemon[851]: reaped child process 1629, status = succeeded6053worker1 # [ 131.149487] nix-daemon[851]: accepted connection from pid 1644, user nix-grpc-daemon (trusted)6054worker1 # [ 131.164620] nix-daemon[851]: reaped child process 1647, status = succeeded6055lb # [ 131.188370] niks3-server[1074]: 2026/09/20 12:48:18 INFO Received uploads request method=POST path=/api/pending_closures6056worker1 # [ 131.191656] nix-grpc-daemon[1427]: time=2026-09-20T12:48:18.234Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6057worker1 # [ 131.193686] nix-grpc-daemon[1427]: time=2026-09-20T12:48:18.236Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6058lb # [ 131.231769] niks3-server[1074]: 2026/09/20 12:48:18 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6059lb # [ 131.237710] niks3-server[1074]: 2026/09/20 12:48:18 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6060lb # [ 131.250123] niks3-server[1074]: 2026/09/20 12:48:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6061worker1 # [ 131.249189] nix-grpc-daemon[1427]: time=2026-09-20T12:48:18.291Z level=INFO msg="Uploading 1 narinfos"6062lb # [ 131.254937] niks3-server[1074]: 2026/09/20 12:48:18 INFO Signed narinfos id=47 count=16063lb # [ 131.259580] niks3-server[1074]: 2026/09/20 12:48:18 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6064lb # [ 131.268353] niks3-server[1074]: 2026/09/20 12:48:18 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6065lb # [ 131.270897] niks3-server[1074]: 2026/09/20 12:48:18 INFO Completed upload id=476066worker1 # [ 131.266149] nix-grpc-daemon[1427]: time=2026-09-20T12:48:18.309Z level=INFO msg="Upload complete. (288ms)"6067worker1 # [ 131.273856] nix-grpc-daemon[1427]: time=2026-09-20T12:48:18.313Z level=WARN msg="Failed to register uploaded object" key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo error="server returned 404: object is not pending upload\n"6068worker1 # [ 131.284460] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:18Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16069worker1 # [ 131.290231] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=6 outputs=16070worker1 # [ 131.294663] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206071worker1 # [ 131.297949] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:18Z level=debug event=want client=5 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06072worker1 # [ 131.306822] nix-daemon[851]: reaped child process 1627, status = succeeded6073worker1 # [ 131.308797] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574206074worker1 # [ 131.316592] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574206075worker1 # [ 131.321701] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6076worker1 # [ 131.498187] nix-daemon[851]: accepted connection from pid 1653, user nix-grpc-daemon (trusted)6077worker1 # [ 131.513416] nix-daemon[851]: reaped child process 1656, status = succeeded6078worker1 # [ 131.687418] nix-daemon[851]: accepted connection from pid 1658, user nix-grpc-daemon (trusted)6079worker1 # [ 131.701663] nix-daemon[851]: reaped child process 1661, status = succeeded6080lb # [ 131.724896] niks3-server[1074]: 2026/09/20 12:48:18 INFO Received uploads request method=POST path=/api/pending_closures6081worker1 # [ 131.727066] nix-grpc-daemon[1427]: time=2026-09-20T12:48:18.769Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6082worker1 # [ 131.728444] nix-grpc-daemon[1427]: time=2026-09-20T12:48:18.769Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6083lb # [ 131.749305] niks3-server[1074]: 2026/09/20 12:48:18 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6084lb # [ 131.760952] niks3-server[1074]: 2026/09/20 12:48:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6085worker1 # [ 131.760763] nix-grpc-daemon[1427]: time=2026-09-20T12:48:18.803Z level=INFO msg="Uploading 1 narinfos"6086lb # [ 131.767335] niks3-server[1074]: 2026/09/20 12:48:18 INFO Signed narinfos id=48 count=16087lb # [ 131.772207] niks3-server[1074]: 2026/09/20 12:48:18 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6088lb # [ 131.784475] niks3-server[1074]: 2026/09/20 12:48:18 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6089lb # [ 131.790582] niks3-server[1074]: 2026/09/20 12:48:18 INFO Completed upload id=486090worker1 # [ 131.784745] nix-grpc-daemon[1427]: time=2026-09-20T12:48:18.827Z level=INFO msg="Upload complete. (457ms)"6091lb # [ 131.793367] niks3-server[1074]: 2026/09/20 12:48:18 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6092worker1 # [ 131.788494] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:18Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=0 paths=1 nar_bytes_in=5046093worker1 # [ 131.794141] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206094worker1 # [ 131.803903] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6095worker1 # [ 131.808930] nix-daemon[851]: reaped child process 1651, status = succeeded6096worker1 # [ 131.815115] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6097worker1 # [ 132.642818] nix-daemon[851]: reaped child process 1665, status = succeeded6098worker1 # [ 132.812125] nix-daemon[851]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6099worker1 # [ 132.825626] nix-daemon[851]: reaped child process 1683, status = succeeded6100lb # [ 132.846738] niks3-server[1074]: 2026/09/20 12:48:20 INFO Received uploads request method=POST path=/api/pending_closures6101worker1 # [ 132.845361] nix-grpc-daemon[1427]: time=2026-09-20T12:48:19.888Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6102worker1 # [ 132.850805] nix-grpc-daemon[1427]: time=2026-09-20T12:48:19.889Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6103lb # [ 132.869907] niks3-server[1074]: 2026/09/20 12:48:20 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6104lb # [ 132.873140] niks3-server[1074]: 2026/09/20 12:48:20 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6105lb # [ 132.876383] niks3-server[1074]: 2026/09/20 12:48:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6106lb # [ 132.878152] niks3-server[1074]: 2026/09/20 12:48:20 INFO Signed narinfos id=49 count=16107worker1 # [ 132.873431] nix-grpc-daemon[1427]: time=2026-09-20T12:48:19.916Z level=INFO msg="Uploading 1 narinfos"6108lb # [ 132.882321] niks3-server[1074]: 2026/09/20 12:48:20 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6109lb # [ 132.886861] niks3-server[1074]: 2026/09/20 12:48:20 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6110lb # [ 132.889370] niks3-server[1074]: 2026/09/20 12:48:20 INFO Completed upload id=496111worker1 # [ 132.884663] nix-grpc-daemon[1427]: time=2026-09-20T12:48:19.927Z level=INFO msg="Upload complete. (263ms)"6112lb # [ 132.891741] niks3-server[1074]: 2026/09/20 12:48:20 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6113worker1 # [ 132.888405] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:19Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=7 outputs=16114worker1 # [ 132.892317] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:19Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16115worker1 # [ 132.895226] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206116worker1 # [ 132.898281] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:19Z level=debug event=want client=5 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06117worker1 # [ 132.904329] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:19Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574206118worker1 # [ 132.907483] nix-daemon[851]: reaped child process 1663, status = succeeded6119worker1 # [ 132.910976] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:19Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574206120worker1 # [ 132.915296] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6121worker1 # [ 133.087094] nix-daemon[851]: accepted connection from pid 1689, user nix-grpc-daemon (trusted)6122worker1 # [ 133.100313] nix-daemon[851]: reaped child process 1692, status = succeeded6123worker1 # [ 133.265502] nix-daemon[851]: accepted connection from pid 1694, user nix-grpc-daemon (trusted)6124worker1 # [ 133.277433] nix-daemon[851]: reaped child process 1697, status = succeeded6125lb # [ 133.300683] niks3-server[1074]: 2026/09/20 12:48:20 INFO Received uploads request method=POST path=/api/pending_closures6126worker1 # [ 133.298742] nix-grpc-daemon[1427]: time=2026-09-20T12:48:20.341Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6127worker1 # [ 133.300376] nix-grpc-daemon[1427]: time=2026-09-20T12:48:20.343Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6128lb # [ 133.316247] niks3-server[1074]: 2026/09/20 12:48:20 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6129lb # [ 133.319911] niks3-server[1074]: 2026/09/20 12:48:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6130lb # [ 133.322193] niks3-server[1074]: 2026/09/20 12:48:20 INFO Signed narinfos id=50 count=16131worker1 # [ 133.315913] nix-grpc-daemon[1427]: time=2026-09-20T12:48:20.358Z level=INFO msg="Uploading 1 narinfos"6132lb # [ 133.324333] niks3-server[1074]: 2026/09/20 12:48:20 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6133lb # [ 133.329490] niks3-server[1074]: 2026/09/20 12:48:20 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6134lb # [ 133.332240] niks3-server[1074]: 2026/09/20 12:48:20 INFO Completed upload id=506135worker1 # [ 133.326141] nix-grpc-daemon[1427]: time=2026-09-20T12:48:20.369Z level=INFO msg="Upload complete. (404ms)"6136lb # [ 133.333338] niks3-server[1074]: 2026/09/20 12:48:20 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6137worker1 # [ 133.327970] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=0 paths=1 nar_bytes_in=5046138worker1 # [ 133.331620] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206139worker1 # [ 133.337682] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6140worker1 # [ 133.340098] nix-daemon[851]: reaped child process 1687, status = succeeded6141worker1 # [ 133.344947] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6142worker1 # [ 134.570741] nix-daemon[851]: reaped child process 1701, status = succeeded6143worker1 # [ 134.733091] nix-daemon[851]: accepted connection from pid 1716, user nix-grpc-daemon (trusted)6144worker1 # [ 134.743651] nix-daemon[851]: reaped child process 1719, status = succeeded6145lb # [ 134.766700] niks3-server[1074]: 2026/09/20 12:48:21 INFO Received uploads request method=POST path=/api/pending_closures6146worker1 # [ 134.766697] nix-grpc-daemon[1427]: time=2026-09-20T12:48:21.809Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6147worker1 # [ 134.768361] nix-grpc-daemon[1427]: time=2026-09-20T12:48:21.811Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6148lb # [ 134.787866] niks3-server[1074]: 2026/09/20 12:48:21 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6149lb # [ 134.791575] niks3-server[1074]: 2026/09/20 12:48:21 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6150lb # [ 134.794236] niks3-server[1074]: 2026/09/20 12:48:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6151lb # [ 134.795974] niks3-server[1074]: 2026/09/20 12:48:21 INFO Signed narinfos id=51 count=16152worker1 # [ 134.791199] nix-grpc-daemon[1427]: time=2026-09-20T12:48:21.834Z level=INFO msg="Uploading 1 narinfos"6153lb # [ 134.801536] niks3-server[1074]: 2026/09/20 12:48:21 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6154lb # [ 134.803755] niks3-server[1074]: 2026/09/20 12:48:21 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6155lb # [ 134.807082] niks3-server[1074]: 2026/09/20 12:48:21 INFO Completed upload id=516156worker1 # [ 134.801028] nix-grpc-daemon[1427]: time=2026-09-20T12:48:21.844Z level=INFO msg="Upload complete. (248ms)"6157lb # [ 134.808599] niks3-server[1074]: 2026/09/20 12:48:21 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6158worker1 # [ 134.803323] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:21Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=8 outputs=16159worker1 # [ 134.807517] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:21Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16160worker1 # [ 134.812121] nix-daemon[851]: reaped child process 1699, status = succeeded6161worker1 # [ 134.849232] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:21Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206162worker1 # [ 134.854840] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:21Z level=debug event=want client=5 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06163worker1 # [ 134.863459] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:21Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574206164worker1 # [ 134.871980] nix-grpc-daemon[1427]: time=2026-09-20T12:48:21.915Z level=INFO msg="All 1 paths already cached"6165worker1 # [ 134.877698] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:21Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574206166worker1 # [ 134.885730] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6167worker1 # [ 135.036186] nix-daemon[851]: accepted connection from pid 1725, user nix-grpc-daemon (trusted)6168worker1 # [ 135.048162] nix-daemon[851]: reaped child process 1728, status = succeeded6169worker1 # [ 135.212534] nix-daemon[851]: accepted connection from pid 1730, user nix-grpc-daemon (trusted)6170worker1 # [ 135.224696] nix-daemon[851]: reaped child process 1733, status = succeeded6171lb # [ 135.241340] niks3-server[1074]: 2026/09/20 12:48:22 INFO Received uploads request method=POST path=/api/pending_closures6172worker1 # [ 135.245719] nix-grpc-daemon[1427]: time=2026-09-20T12:48:22.288Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6173worker1 # [ 135.247111] nix-grpc-daemon[1427]: time=2026-09-20T12:48:22.288Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6174lb # [ 135.270539] niks3-server[1074]: 2026/09/20 12:48:22 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6175lb # [ 135.279325] niks3-server[1074]: 2026/09/20 12:48:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6176worker1 # [ 135.277955] nix-grpc-daemon[1427]: time=2026-09-20T12:48:22.320Z level=INFO msg="Uploading 1 narinfos"6177lb # [ 135.284113] niks3-server[1074]: 2026/09/20 12:48:22 INFO Signed narinfos id=52 count=16178lb # [ 135.290209] niks3-server[1074]: 2026/09/20 12:48:22 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6179lb # [ 135.300932] niks3-server[1074]: 2026/09/20 12:48:22 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6180lb # [ 135.304063] niks3-server[1074]: 2026/09/20 12:48:22 INFO Completed upload id=526181worker1 # [ 135.299314] nix-grpc-daemon[1427]: time=2026-09-20T12:48:22.342Z level=INFO msg="Upload complete. (408ms)"6182lb # [ 135.306368] niks3-server[1074]: 2026/09/20 12:48:22 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6183worker1 # [ 135.302131] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=0 paths=1 nar_bytes_in=6246184worker1 # [ 135.308728] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206185worker1 # [ 135.317728] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6186worker1 # [ 135.323623] nix-daemon[851]: reaped child process 1723, status = succeeded6187worker1 # [ 135.329228] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6188worker1 # [ 136.142639] nix-daemon[851]: reaped child process 1737, status = succeeded6189worker1 # [ 136.290784] nix-daemon[851]: accepted connection from pid 1752, user nix-grpc-daemon (trusted)6190worker1 # [ 136.304082] nix-daemon[851]: reaped child process 1755, status = succeeded6191lb # [ 136.324582] niks3-server[1074]: 2026/09/20 12:48:23 INFO Received uploads request method=POST path=/api/pending_closures6192worker1 # [ 136.326397] nix-grpc-daemon[1427]: time=2026-09-20T12:48:23.369Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6193worker1 # [ 136.329059] nix-grpc-daemon[1427]: time=2026-09-20T12:48:23.371Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6194lb # [ 136.368603] niks3-server[1074]: 2026/09/20 12:48:23 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6195lb # [ 136.373908] niks3-server[1074]: 2026/09/20 12:48:23 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6196lb # [ 136.381713] niks3-server[1074]: 2026/09/20 12:48:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6197lb # [ 136.388112] niks3-server[1074]: 2026/09/20 12:48:23 INFO Signed narinfos id=53 count=16198worker1 # [ 136.384726] nix-grpc-daemon[1427]: time=2026-09-20T12:48:23.427Z level=INFO msg="Uploading 1 narinfos"6199lb # [ 136.390981] niks3-server[1074]: 2026/09/20 12:48:23 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6200lb # [ 136.401669] niks3-server[1074]: 2026/09/20 12:48:23 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6201lb # [ 136.407779] niks3-server[1074]: 2026/09/20 12:48:23 INFO Completed upload id=536202worker1 # [ 136.401718] nix-grpc-daemon[1427]: time=2026-09-20T12:48:23.444Z level=INFO msg="Upload complete. (266ms)"6203lb # [ 136.409142] niks3-server[1074]: 2026/09/20 12:48:23 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6204worker1 # [ 136.404209] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=9 outputs=16205worker1 # [ 136.408472] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:23Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16206worker1 # [ 136.413336] nix-daemon[851]: reaped child process 1735, status = succeeded6207worker1 # [ 136.448883] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206208worker1 # [ 136.453657] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:23Z level=debug event=want client=5 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06209worker1 # [ 136.458341] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:23Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574206210worker1 # [ 136.466271] nix-grpc-daemon[1427]: time=2026-09-20T12:48:23.509Z level=INFO msg="All 1 paths already cached"6211worker1 # [ 136.470174] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574206212worker1 # [ 136.475227] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6213worker1 # [ 136.616231] nix-daemon[851]: accepted connection from pid 1761, user nix-grpc-daemon (trusted)6214worker1 # [ 136.629262] nix-daemon[851]: reaped child process 1764, status = succeeded6215worker1 # [ 136.778209] nix-daemon[851]: accepted connection from pid 1766, user nix-grpc-daemon (trusted)6216worker1 # [ 136.790432] nix-daemon[851]: reaped child process 1769, status = succeeded6217lb # [ 136.812092] niks3-server[1074]: 2026/09/20 12:48:23 INFO Received uploads request method=POST path=/api/pending_closures6218worker1 # [ 136.813461] nix-grpc-daemon[1427]: time=2026-09-20T12:48:23.856Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6219worker1 # [ 136.815069] nix-grpc-daemon[1427]: time=2026-09-20T12:48:23.856Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6220lb # [ 136.834563] niks3-server[1074]: 2026/09/20 12:48:24 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6221lb # [ 136.848099] niks3-server[1074]: 2026/09/20 12:48:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6222lb # [ 136.852631] niks3-server[1074]: 2026/09/20 12:48:24 INFO Signed narinfos id=54 count=16223worker1 # [ 136.849725] nix-grpc-daemon[1427]: time=2026-09-20T12:48:23.892Z level=INFO msg="Uploading 1 narinfos"6224lb # [ 136.860513] niks3-server[1074]: 2026/09/20 12:48:24 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6225lb # [ 136.872049] niks3-server[1074]: 2026/09/20 12:48:24 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6226lb # [ 136.878508] niks3-server[1074]: 2026/09/20 12:48:24 INFO Completed upload id=546227worker1 # [ 136.872141] nix-grpc-daemon[1427]: time=2026-09-20T12:48:23.915Z level=INFO msg="Upload complete. (391ms)"6228lb # [ 136.881416] niks3-server[1074]: 2026/09/20 12:48:24 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6229worker1 # [ 136.876155] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:23Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=0 paths=1 nar_bytes_in=6246230worker1 # [ 136.881872] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:23Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206231worker1 # [ 136.889872] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6232worker1 # [ 136.894443] nix-daemon[851]: reaped child process 1759, status = succeeded6233worker1 # [ 136.899386] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6234worker1 # [ 137.913268] nix-daemon[851]: reaped child process 1773, status = succeeded6235worker1 # [ 138.069625] nix-daemon[851]: accepted connection from pid 1788, user nix-grpc-daemon (trusted)6236worker1 # [ 138.082039] nix-daemon[851]: reaped child process 1791, status = succeeded6237lb # [ 138.105400] niks3-server[1074]: 2026/09/20 12:48:25 INFO Received uploads request method=POST path=/api/pending_closures6238worker1 # [ 138.106580] nix-grpc-daemon[1427]: time=2026-09-20T12:48:25.149Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6239worker1 # [ 138.108430] nix-grpc-daemon[1427]: time=2026-09-20T12:48:25.151Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6240lb # [ 138.141599] niks3-server[1074]: 2026/09/20 12:48:25 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6241lb # [ 138.152290] niks3-server[1074]: 2026/09/20 12:48:25 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6242lb # [ 138.162712] niks3-server[1074]: 2026/09/20 12:48:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6243lb # [ 138.168651] niks3-server[1074]: 2026/09/20 12:48:25 INFO Signed narinfos id=55 count=16244worker1 # [ 138.162888] nix-grpc-daemon[1427]: time=2026-09-20T12:48:25.205Z level=INFO msg="Uploading 1 narinfos"6245lb # [ 138.174063] niks3-server[1074]: 2026/09/20 12:48:25 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6246lb # [ 138.183605] niks3-server[1074]: 2026/09/20 12:48:25 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6247lb # [ 138.190046] niks3-server[1074]: 2026/09/20 12:48:25 INFO Completed upload id=556248lb # [ 138.191176] niks3-server[1074]: 2026/09/20 12:48:25 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6249worker1 # [ 138.184133] nix-grpc-daemon[1427]: time=2026-09-20T12:48:25.227Z level=INFO msg="Upload complete. (278ms)"6250worker1 # [ 138.191732] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:25Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=10 outputs=16251worker1 # [ 138.198285] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:25Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16252worker1 # [ 138.209118] nix-daemon[851]: reaped child process 1771, status = succeeded6253worker1 # [ 138.233881] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206254worker1 # [ 138.241562] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:25Z level=debug event=want client=5 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06255worker1 # [ 138.249710] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574206256worker1 # [ 138.262120] nix-grpc-daemon[1427]: time=2026-09-20T12:48:25.305Z level=INFO msg="All 1 paths already cached"6257worker1 # [ 138.269201] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574206258worker1 # [ 138.278277] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6259worker1 # [ 138.446091] nix-daemon[851]: accepted connection from pid 1797, user nix-grpc-daemon (trusted)6260worker1 # [ 138.458102] nix-daemon[851]: reaped child process 1800, status = succeeded6261worker1 # [ 138.619638] nix-daemon[851]: accepted connection from pid 1802, user nix-grpc-daemon (trusted)6262worker1 # [ 138.631631] nix-daemon[851]: reaped child process 1805, status = succeeded6263lb # [ 138.652775] niks3-server[1074]: 2026/09/20 12:48:25 INFO Received uploads request method=POST path=/api/pending_closures6264worker1 # [ 138.654549] nix-grpc-daemon[1427]: time=2026-09-20T12:48:25.697Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6265worker1 # [ 138.656548] nix-grpc-daemon[1427]: time=2026-09-20T12:48:25.699Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6266lb # [ 138.678431] niks3-server[1074]: 2026/09/20 12:48:25 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6267lb # [ 138.691305] niks3-server[1074]: 2026/09/20 12:48:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6268lb # [ 138.696585] niks3-server[1074]: 2026/09/20 12:48:25 INFO Signed narinfos id=56 count=16269worker1 # [ 138.693662] nix-grpc-daemon[1427]: time=2026-09-20T12:48:25.736Z level=INFO msg="Uploading 1 narinfos"6270lb # [ 138.702143] niks3-server[1074]: 2026/09/20 12:48:25 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6271lb # [ 138.714564] niks3-server[1074]: 2026/09/20 12:48:25 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6272lb # [ 138.719670] niks3-server[1074]: 2026/09/20 12:48:25 INFO Completed upload id=566273worker1 # [ 138.713509] nix-grpc-daemon[1427]: time=2026-09-20T12:48:25.756Z level=INFO msg="Upload complete. (425ms)"6274lb # [ 138.722470] niks3-server[1074]: 2026/09/20 12:48:25 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6275worker1 # [ 138.717129] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=0 paths=1 nar_bytes_in=6246276worker1 # [ 138.723424] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206277worker1 # [ 138.733787] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6278worker1 # [ 138.737269] nix-daemon[851]: reaped child process 1795, status = succeeded6279worker1 # [ 138.742329] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6280worker1 # [ 139.557537] nix-daemon[851]: reaped child process 1809, status = succeeded6281worker1 # [ 139.705296] nix-daemon[851]: accepted connection from pid 1824, user nix-grpc-daemon (trusted)6282worker1 # [ 139.715889] nix-daemon[851]: reaped child process 1827, status = succeeded6283lb # [ 139.738690] niks3-server[1074]: 2026/09/20 12:48:26 INFO Received uploads request method=POST path=/api/pending_closures6284worker1 # [ 139.742732] nix-grpc-daemon[1427]: time=2026-09-20T12:48:26.785Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6285worker1 # [ 139.744532] nix-grpc-daemon[1427]: time=2026-09-20T12:48:26.787Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6286lb # [ 139.778145] niks3-server[1074]: 2026/09/20 12:48:26 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6287lb # [ 139.785189] niks3-server[1074]: 2026/09/20 12:48:26 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6288lb # [ 139.794730] niks3-server[1074]: 2026/09/20 12:48:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6289worker1 # [ 139.793629] nix-grpc-daemon[1427]: time=2026-09-20T12:48:26.836Z level=INFO msg="Uploading 1 narinfos"6290lb # [ 139.799606] niks3-server[1074]: 2026/09/20 12:48:26 INFO Signed narinfos id=57 count=16291lb # [ 139.805724] niks3-server[1074]: 2026/09/20 12:48:26 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6292lb # [ 139.814880] niks3-server[1074]: 2026/09/20 12:48:26 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6293lb # [ 139.823679] niks3-server[1074]: 2026/09/20 12:48:26 INFO Completed upload id=576294worker1 # [ 139.817822] nix-grpc-daemon[1427]: time=2026-09-20T12:48:26.860Z level=INFO msg="Upload complete. (268ms)"6295lb # [ 139.825397] niks3-server[1074]: 2026/09/20 12:48:26 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6296worker1 # [ 139.825485] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:26Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=11 outputs=16297worker1 # [ 139.832258] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:26Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16298worker1 # [ 139.844113] nix-daemon[851]: reaped child process 1807, status = succeeded6299worker1 # [ 139.868661] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206300worker1 # [ 139.876364] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:26Z level=debug event=want client=5 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06301worker1 # [ 139.885359] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574206302worker1 # [ 139.897340] nix-grpc-daemon[1427]: time=2026-09-20T12:48:26.940Z level=INFO msg="All 2 paths already cached"6303worker1 # [ 139.904125] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574206304worker1 # [ 139.912891] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6305worker1 # [ 140.064533] nix-daemon[851]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)6306worker1 # [ 140.076954] nix-daemon[851]: reaped child process 1836, status = succeeded6307worker1 # [ 140.222578] nix-daemon[851]: accepted connection from pid 1838, user nix-grpc-daemon (trusted)6308worker1 # [ 140.234301] nix-daemon[851]: reaped child process 1841, status = succeeded6309lb # [ 140.256142] niks3-server[1074]: 2026/09/20 12:48:27 INFO Received uploads request method=POST path=/api/pending_closures6310worker1 # [ 140.258265] nix-grpc-daemon[1427]: time=2026-09-20T12:48:27.301Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6311worker1 # [ 140.260359] nix-grpc-daemon[1427]: time=2026-09-20T12:48:27.303Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6312lb # [ 140.284271] niks3-server[1074]: 2026/09/20 12:48:27 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6313lb # [ 140.294121] niks3-server[1074]: 2026/09/20 12:48:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6314lb # [ 140.299242] niks3-server[1074]: 2026/09/20 12:48:27 INFO Signed narinfos id=58 count=16315worker1 # [ 140.296213] nix-grpc-daemon[1427]: time=2026-09-20T12:48:27.339Z level=INFO msg="Uploading 1 narinfos"6316lb # [ 140.306261] niks3-server[1074]: 2026/09/20 12:48:27 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6317lb # [ 140.317460] niks3-server[1074]: 2026/09/20 12:48:27 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6318worker1 # [ 140.317237] nix-grpc-daemon[1427]: time=2026-09-20T12:48:27.360Z level=INFO msg="Upload complete. (395ms)"6319lb # [ 140.323588] niks3-server[1074]: 2026/09/20 12:48:27 INFO Completed upload id=586320worker1 # [ 140.319482] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:27Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=0 paths=1 nar_bytes_in=7526321lb # [ 140.327145] niks3-server[1074]: 2026/09/20 12:48:27 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6322worker1 # [ 140.325402] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206323worker1 # [ 140.330219] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6324worker1 # [ 140.332665] nix-daemon[851]: reaped child process 1831, status = succeeded6325worker1 # [ 140.338224] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6326worker1 # [ 141.954438] nix-daemon[851]: reaped child process 1845, status = succeeded6327worker1 # [ 142.098316] nix-daemon[851]: accepted connection from pid 1860, user nix-grpc-daemon (trusted)6328worker1 # [ 142.109484] nix-daemon[851]: reaped child process 1863, status = succeeded6329lb # [ 142.131662] niks3-server[1074]: 2026/09/20 12:48:29 INFO Received uploads request method=POST path=/api/pending_closures6330worker1 # [ 142.133729] nix-grpc-daemon[1427]: time=2026-09-20T12:48:29.176Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6331worker1 # [ 142.135643] nix-grpc-daemon[1427]: time=2026-09-20T12:48:29.178Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6332lb # [ 142.171836] niks3-server[1074]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6333lb # [ 142.179051] niks3-server[1074]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6334lb # [ 142.188208] niks3-server[1074]: 2026/09/20 12:48:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6335lb # [ 142.193525] niks3-server[1074]: 2026/09/20 12:48:29 INFO Signed narinfos id=59 count=16336worker1 # [ 142.190422] nix-grpc-daemon[1427]: time=2026-09-20T12:48:29.233Z level=INFO msg="Uploading 1 narinfos"6337lb # [ 142.200280] niks3-server[1074]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6338lb # [ 142.210257] niks3-server[1074]: 2026/09/20 12:48:29 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6339lb # [ 142.215928] niks3-server[1074]: 2026/09/20 12:48:29 INFO Completed upload id=596340worker1 # [ 142.210115] nix-grpc-daemon[1427]: time=2026-09-20T12:48:29.252Z level=INFO msg="Upload complete. (263ms)"6341lb # [ 142.218349] niks3-server[1074]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6342worker1 # [ 142.219149] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=12 outputs=16343worker1 # [ 142.225190] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:29Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16344worker1 # [ 142.236346] nix-daemon[851]: reaped child process 1843, status = succeeded6345worker1 # [ 142.260346] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206346worker1 # [ 142.272687] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:29Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574206347worker1 # [ 142.288733] nix-grpc-daemon[1427]: time=2026-09-20T12:48:29.331Z level=INFO msg="All 2 paths already cached"6348worker1 # [ 142.295608] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574206349worker1 # [ 142.305161] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6350worker1 # [ 142.452081] nix-daemon[851]: accepted connection from pid 1867, user nix-grpc-daemon (trusted)6351worker1 # [ 142.464586] nix-daemon[851]: reaped child process 1870, status = succeeded6352worker1 # [ 142.594199] nix-daemon[851]: accepted connection from pid 1872, user nix-grpc-daemon (trusted)6353worker1 # [ 142.605812] nix-daemon[851]: reaped child process 1875, status = succeeded6354lb # [ 142.626829] niks3-server[1074]: 2026/09/20 12:48:29 INFO Received uploads request method=POST path=/api/pending_closures6355worker1 # [ 142.624813] nix-grpc-daemon[1427]: time=2026-09-20T12:48:29.667Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6356worker1 # [ 142.626591] nix-grpc-daemon[1427]: time=2026-09-20T12:48:29.669Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6357lb # [ 142.640199] niks3-server[1074]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6358lb # [ 142.644921] niks3-server[1074]: 2026/09/20 12:48:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6359lb # [ 142.646834] niks3-server[1074]: 2026/09/20 12:48:29 INFO Signed narinfos id=60 count=16360worker1 # [ 142.642023] nix-grpc-daemon[1427]: time=2026-09-20T12:48:29.684Z level=INFO msg="Uploading 1 narinfos"6361lb # [ 142.649478] niks3-server[1074]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6362lb # [ 142.654153] niks3-server[1074]: 2026/09/20 12:48:29 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6363lb # [ 142.657561] niks3-server[1074]: 2026/09/20 12:48:29 INFO Completed upload id=606364worker1 # [ 142.651313] nix-grpc-daemon[1427]: time=2026-09-20T12:48:29.694Z level=INFO msg="Upload complete. (334ms)"6365lb # [ 142.659208] niks3-server[1074]: 2026/09/20 12:48:29 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6366worker1 # [ 142.653851] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=0 paths=1 nar_bytes_in=7526367worker1 # [ 142.657367] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206368worker1 # [ 142.663542] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6369worker1 # [ 142.666255] nix-daemon[851]: reaped child process 1865, status = succeeded6370worker1 # [ 142.671088] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6371worker1 # [ 143.684852] nix-daemon[851]: reaped child process 1879, status = succeeded6372worker1 # [ 143.827192] nix-daemon[851]: accepted connection from pid 1894, user nix-grpc-daemon (trusted)6373worker1 # [ 143.840205] nix-daemon[851]: reaped child process 1897, status = succeeded6374lb # [ 143.862327] niks3-server[1074]: 2026/09/20 12:48:31 INFO Received uploads request method=POST path=/api/pending_closures6375worker1 # [ 143.867712] nix-grpc-daemon[1427]: time=2026-09-20T12:48:30.910Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6376worker1 # [ 143.871317] nix-grpc-daemon[1427]: time=2026-09-20T12:48:30.912Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6377lb # [ 143.905541] niks3-server[1074]: 2026/09/20 12:48:31 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6378lb # [ 143.910209] niks3-server[1074]: 2026/09/20 12:48:31 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6379lb # [ 143.922079] niks3-server[1074]: 2026/09/20 12:48:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6380lb # [ 143.926048] niks3-server[1074]: 2026/09/20 12:48:31 INFO Signed narinfos id=61 count=16381worker1 # [ 143.922724] nix-grpc-daemon[1427]: time=2026-09-20T12:48:30.965Z level=INFO msg="Uploading 1 narinfos"6382lb # [ 143.931099] niks3-server[1074]: 2026/09/20 12:48:31 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6383lb # [ 143.940902] niks3-server[1074]: 2026/09/20 12:48:31 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6384lb # [ 143.943813] niks3-server[1074]: 2026/09/20 12:48:31 INFO Completed upload id=616385worker1 # [ 143.937728] nix-grpc-daemon[1427]: time=2026-09-20T12:48:30.980Z level=INFO msg="Upload complete. (260ms)"6386lb # [ 143.945951] niks3-server[1074]: 2026/09/20 12:48:31 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6387worker1 # [ 143.946171] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=13 outputs=16388worker1 # [ 143.951475] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:30Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16389worker1 # [ 143.956258] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206390worker1 # [ 143.966905] nix-daemon[851]: reaped child process 1877, status = succeeded6391worker1 # [ 143.968734] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:31Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574206392worker1 # [ 143.976090] nix-grpc-daemon[1427]: time=2026-09-20T12:48:31.019Z level=INFO msg="All 2 paths already cached"6393worker1 # [ 143.981104] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:574206394worker1 # [ 143.986351] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6395worker1 # [ 144.133179] nix-daemon[851]: accepted connection from pid 1901, user nix-grpc-daemon (trusted)6396worker1 # [ 144.145496] nix-daemon[851]: reaped child process 1904, status = succeeded6397worker1 # [ 144.300403] nix-daemon[851]: accepted connection from pid 1906, user nix-grpc-daemon (trusted)6398worker1 # [ 144.312853] nix-daemon[851]: reaped child process 1909, status = succeeded6399lb # [ 144.333112] niks3-server[1074]: 2026/09/20 12:48:31 INFO Received uploads request method=POST path=/api/pending_closures6400worker1 # [ 144.332071] nix-grpc-daemon[1427]: time=2026-09-20T12:48:31.374Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6401worker1 # [ 144.333650] nix-grpc-daemon[1427]: time=2026-09-20T12:48:31.375Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6402lb # [ 144.351587] niks3-server[1074]: 2026/09/20 12:48:31 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6403lb # [ 144.355155] niks3-server[1074]: 2026/09/20 12:48:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6404lb # [ 144.357255] niks3-server[1074]: 2026/09/20 12:48:31 INFO Signed narinfos id=62 count=16405worker1 # [ 144.351318] nix-grpc-daemon[1427]: time=2026-09-20T12:48:31.394Z level=INFO msg="Uploading 1 narinfos"6406lb # [ 144.363266] niks3-server[1074]: 2026/09/20 12:48:31 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6407lb # [ 144.366496] niks3-server[1074]: 2026/09/20 12:48:31 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6408lb # [ 144.369534] niks3-server[1074]: 2026/09/20 12:48:31 INFO Completed upload id=626409worker1 # [ 144.363425] nix-grpc-daemon[1427]: time=2026-09-20T12:48:31.406Z level=INFO msg="Upload complete. (371ms)"6410lb # [ 144.372584] niks3-server[1074]: 2026/09/20 12:48:31 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6411worker1 # [ 144.365585] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:31Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=0 paths=1 nar_bytes_in=7526412worker1 # [ 144.368932] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:574206413worker1 # [ 144.375129] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6414worker1 # [ 144.378364] nix-daemon[851]: reaped child process 1899, status = succeeded6415worker1 # [ 144.383385] nix-daemon[851]: accepted connection from pid 1356, user nix-grpc-daemon (trusted)6416worker1 # [ 145.596664] nix-daemon[851]: reaped child process 1913, status = succeeded6417worker1 # [ 145.733786] nix-daemon[851]: accepted connection from pid 1928, user nix-grpc-daemon (trusted)6418worker1 # [ 145.746323] nix-daemon[851]: reaped child process 1931, status = succeeded6419lb # [ 145.769478] niks3-server[1074]: 2026/09/20 12:48:32 INFO Received uploads request method=POST path=/api/pending_closures6420worker1 # [ 145.772165] nix-grpc-daemon[1427]: time=2026-09-20T12:48:32.815Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6421worker1 # [ 145.773926] nix-grpc-daemon[1427]: time=2026-09-20T12:48:32.816Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6422lb # [ 145.806331] niks3-server[1074]: 2026/09/20 12:48:32 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6423lb # [ 145.816707] niks3-server[1074]: 2026/09/20 12:48:32 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6424lb # [ 145.825151] niks3-server[1074]: 2026/09/20 12:48:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6425worker1 # [ 145.824849] nix-grpc-daemon[1427]: time=2026-09-20T12:48:32.867Z level=INFO msg="Uploading 1 narinfos"6426lb # [ 145.830836] niks3-server[1074]: 2026/09/20 12:48:33 INFO Signed narinfos id=63 count=16427lb # [ 145.836092] niks3-server[1074]: 2026/09/20 12:48:33 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6428lb # [ 145.846695] niks3-server[1074]: 2026/09/20 12:48:33 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6429lb # [ 145.852330] niks3-server[1074]: 2026/09/20 12:48:33 INFO Completed upload id=636430lb # [ 145.854237] niks3-server[1074]: 2026/09/20 12:48:33 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6431worker1 # [ 145.846274] nix-grpc-daemon[1427]: time=2026-09-20T12:48:32.889Z level=INFO msg="Upload complete. (255ms)"6432worker1 # [ 145.852900] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57420 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=14 outputs=16433worker1 # [ 145.866977] nix-daemon[851]: reaped child process 1911, status = succeeded6434client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 17.73 seconds)6435worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics6436worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics, in 0.06 seconds)6437client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16438worker1 # [ 146.185273] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:574206439worker1 # [ 146.192563] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:574206440worker1 # [ 146.213514] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:33Z level=debug event=want client=6 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06441client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.27 seconds)6442(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 18.05 seconds)6443subtest: low disk drains a worker and builds go to the other6444worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6445worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 0.98 seconds)6446worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6447worker1 # [ 147.840233] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:34Z level=info event=unhealthy reason=min_free6448worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.08 seconds)6449client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&26450worker2 # [ 148.538440] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:350646451client # don't know how to build these paths:6452client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6453worker2 # [ 148.548122] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:350646454worker1 # [ 148.535189] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:35Z level=debug event=want client=7 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06455worker1 # [ 148.539793] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:35Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16456worker2 # [ 148.618247] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:34Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:350646457worker2 # [ 148.631979] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:34Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:350646458client # copying 1 paths to 'lb:50051'...6459client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6460worker2 # [ 148.643461] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:350646461worker2 # [ 148.654268] nix-daemon[814]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)6462worker2 # [ 148.670699] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:34Z level=info event=niks3_push_started pid=16676463worker2 # [ 148.846743] nix-grpc-daemon[1667]: time=2026-09-20T12:48:35.098Z level=INFO msg="Configuring client TLS" cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.pem key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/worker2.key ca=""6464worker2 # [ 148.998087] nix-daemon[814]: accepted connection from pid 1680, user nix-grpc-daemon (trusted)6465worker2 # [ 149.009616] nix-daemon[814]: reaped child process 1683, status = succeeded6466worker2 # [ 149.158102] nix-daemon[814]: accepted connection from pid 1685, user nix-grpc-daemon (trusted)6467worker2 # [ 149.170304] nix-daemon[814]: reaped child process 1688, status = succeeded6468lb # [ 149.156045] niks3-server[1074]: 2026/09/20 12:48:36 INFO Received uploads request method=POST path=/api/pending_closures6469worker2 # [ 149.189069] nix-grpc-daemon[1667]: time=2026-09-20T12:48:35.440Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6470worker2 # [ 149.190869] nix-grpc-daemon[1667]: time=2026-09-20T12:48:35.440Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6471lb # [ 149.177538] niks3-server[1074]: 2026/09/20 12:48:36 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6472lb # [ 149.181297] niks3-server[1074]: 2026/09/20 12:48:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6473lb # [ 149.183399] niks3-server[1074]: 2026/09/20 12:48:36 INFO Signed narinfos id=64 count=16474worker2 # [ 149.212605] nix-grpc-daemon[1667]: time=2026-09-20T12:48:35.464Z level=INFO msg="Uploading 1 narinfos"6475lb # [ 149.188790] niks3-server[1074]: 2026/09/20 12:48:36 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6476lb # [ 149.192189] niks3-server[1074]: 2026/09/20 12:48:36 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6477lb # [ 149.195200] niks3-server[1074]: 2026/09/20 12:48:36 INFO Completed upload id=646478worker2 # [ 149.223076] nix-grpc-daemon[1667]: time=2026-09-20T12:48:35.475Z level=INFO msg="Upload complete. (371ms)"6479worker2 # [ 149.225027] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35064 duration_s=0 paths=1 nar_bytes_in=5126480lb # [ 149.198405] niks3-server[1074]: 2026/09/20 12:48:36 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6481worker2 # [ 149.229069] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:350646482worker2 # [ 149.235209] nix-daemon[814]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)6483worker2 # [ 149.237352] nix-daemon[814]: reaped child process 1665, status = succeeded6484client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6485client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6486worker2 # [ 149.242107] nix-daemon[814]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)6487lb # [ 149.447325] envoy[926]: conn peer=[2001:db8:1::1]:46372 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=27085 tx=10674 ms=174536488lb # [ 149.451891] envoy[926]: conn peer=[2001:db8:1::1]:50840 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=878 tx=481 ms=426489client # farm-a> LOG-farm-a-drain6490worker2 # [ 150.070858] nix-daemon[814]: reaped child process 1692, status = succeeded6491worker2 # [ 150.222231] nix-daemon[814]: accepted connection from pid 1707, user nix-grpc-daemon (trusted)6492worker2 # [ 150.235333] nix-daemon[814]: reaped child process 1710, status = succeeded6493lb # [ 150.219909] niks3-server[1074]: 2026/09/20 12:48:37 INFO Received uploads request method=POST path=/api/pending_closures6494worker2 # [ 150.257534] nix-grpc-daemon[1667]: time=2026-09-20T12:48:36.509Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6495worker2 # [ 150.259106] nix-grpc-daemon[1667]: time=2026-09-20T12:48:36.511Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6496lb # [ 150.261097] niks3-server[1074]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6497lb # [ 150.266579] niks3-server[1074]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6498lb # [ 150.273991] niks3-server[1074]: 2026/09/20 12:48:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6499lb # [ 150.277982] niks3-server[1074]: 2026/09/20 12:48:37 INFO Signed narinfos id=65 count=16500worker2 # [ 150.308797] nix-grpc-daemon[1667]: time=2026-09-20T12:48:36.560Z level=INFO msg="Uploading 1 narinfos"6501lb # [ 150.288057] niks3-server[1074]: 2026/09/20 12:48:37 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6502lb # [ 150.307747] niks3-server[1074]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6503lb # [ 150.310500] niks3-server[1074]: 2026/09/20 12:48:37 INFO Completed upload id=656504worker2 # [ 150.338760] nix-grpc-daemon[1667]: time=2026-09-20T12:48:36.590Z level=INFO msg="Upload complete. (290ms)"6505lb # [ 150.312719] niks3-server[1074]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6506worker2 # [ 150.345603] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35064 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=15 outputs=16507worker1 # [ 150.318568] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:37Z level=debug event=want client=7 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06508worker1 # [ 150.322764] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:37Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16509worker2 # [ 150.359745] nix-daemon[814]: reaped child process 1690, status = succeeded6510worker2 # [ 150.398090] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:36Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:350646511worker2 # [ 150.410454] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:350646512worker2 # [ 150.425447] nix-grpc-daemon[1667]: time=2026-09-20T12:48:36.677Z level=INFO msg="All 1 paths already cached"6513client # copying 1 paths to 'lb:50051'...6514client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6515worker2 # [ 150.434676] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:350646516worker2 # [ 150.445166] nix-daemon[814]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)6517worker2 # [ 150.600206] nix-daemon[814]: accepted connection from pid 1714, user nix-grpc-daemon (trusted)6518worker2 # [ 150.613251] nix-daemon[814]: reaped child process 1717, status = succeeded6519worker2 # [ 150.758098] nix-daemon[814]: accepted connection from pid 1719, user nix-grpc-daemon (trusted)6520worker2 # [ 150.769934] nix-daemon[814]: reaped child process 1722, status = succeeded6521lb # [ 150.758060] niks3-server[1074]: 2026/09/20 12:48:37 INFO Received uploads request method=POST path=/api/pending_closures6522worker2 # [ 150.794624] nix-grpc-daemon[1667]: time=2026-09-20T12:48:37.046Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6523worker2 # [ 150.796218] nix-grpc-daemon[1667]: time=2026-09-20T12:48:37.046Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6524lb # [ 150.786350] niks3-server[1074]: 2026/09/20 12:48:37 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6525worker2 # [ 150.818730] nix-grpc-daemon[1667]: time=2026-09-20T12:48:37.070Z level=INFO msg="Uploading 1 narinfos"6526lb # [ 150.792312] niks3-server[1074]: 2026/09/20 12:48:37 INFO Signed narinfos id=66 count=16527lb # [ 150.800588] niks3-server[1074]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6528lb # [ 150.809471] niks3-server[1074]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6529lb # [ 150.818433] niks3-server[1074]: 2026/09/20 12:48:37 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6530lb # [ 150.824321] niks3-server[1074]: 2026/09/20 12:48:37 INFO Completed upload id=666531worker2 # [ 150.854578] nix-grpc-daemon[1667]: time=2026-09-20T12:48:37.106Z level=INFO msg="Upload complete. (397ms)"6532lb # [ 150.827429] niks3-server[1074]: 2026/09/20 12:48:37 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6533worker2 # [ 150.857425] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35064 duration_s=0 paths=1 nar_bytes_in=6246534worker2 # [ 150.863287] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:37Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:350646535worker2 # [ 150.874202] nix-daemon[814]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)6536worker2 # [ 150.876125] nix-daemon[814]: reaped child process 1712, status = succeeded6537worker2 # [ 150.881310] nix-daemon[814]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)6538client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6539client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6540client # farm-b> LOG-farm-b-drain6541worker2 # [ 151.908300] nix-daemon[814]: reaped child process 1726, status = succeeded6542worker2 # [ 152.053752] nix-daemon[814]: accepted connection from pid 1741, user nix-grpc-daemon (trusted)6543worker2 # [ 152.065263] nix-daemon[814]: reaped child process 1744, status = succeeded6544lb # [ 152.051206] niks3-server[1074]: 2026/09/20 12:48:39 INFO Received uploads request method=POST path=/api/pending_closures6545worker2 # [ 152.083633] nix-grpc-daemon[1667]: time=2026-09-20T12:48:38.335Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6546worker2 # [ 152.085435] nix-grpc-daemon[1667]: time=2026-09-20T12:48:38.337Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6547lb # [ 152.071660] niks3-server[1074]: 2026/09/20 12:48:39 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6548lb # [ 152.075826] niks3-server[1074]: 2026/09/20 12:48:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6549lb # [ 152.077906] niks3-server[1074]: 2026/09/20 12:48:39 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6550lb # [ 152.080178] niks3-server[1074]: 2026/09/20 12:48:39 INFO Signed narinfos id=67 count=16551worker2 # [ 152.109385] nix-grpc-daemon[1667]: time=2026-09-20T12:48:38.361Z level=INFO msg="Uploading 1 narinfos"6552lb # [ 152.084493] niks3-server[1074]: 2026/09/20 12:48:39 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6553lb # [ 152.088147] niks3-server[1074]: 2026/09/20 12:48:39 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6554lb # [ 152.092127] niks3-server[1074]: 2026/09/20 12:48:39 INFO Completed upload id=676555worker2 # [ 152.119707] nix-grpc-daemon[1667]: time=2026-09-20T12:48:38.371Z level=INFO msg="Upload complete. (231ms)"6556lb # [ 152.093365] niks3-server[1074]: 2026/09/20 12:48:39 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6557worker2 # [ 152.122698] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:38Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35064 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=16 outputs=16558worker2 # [ 152.129477] nix-daemon[814]: reaped child process 1724, status = succeeded6559worker1 # [ 152.099372] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:39Z level=debug event=want client=7 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06560worker1 # [ 152.104094] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:39Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16561worker2 # [ 152.176935] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:350646562worker2 # [ 152.189961] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:350646563worker2 # [ 152.203697] nix-grpc-daemon[1667]: time=2026-09-20T12:48:38.455Z level=INFO msg="All 2 paths already cached"6564client # copying 1 paths to 'lb:50051'...6565client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6566worker2 # [ 152.211386] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:350646567worker2 # [ 152.222105] nix-daemon[814]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)6568worker2 # [ 152.385346] nix-daemon[814]: accepted connection from pid 1748, user nix-grpc-daemon (trusted)6569worker2 # [ 152.398074] nix-daemon[814]: reaped child process 1751, status = succeeded6570worker2 # [ 152.526314] nix-daemon[814]: accepted connection from pid 1753, user nix-grpc-daemon (trusted)6571worker2 # [ 152.537571] nix-daemon[814]: reaped child process 1756, status = succeeded6572lb # [ 152.519924] niks3-server[1074]: 2026/09/20 12:48:39 INFO Received uploads request method=POST path=/api/pending_closures6573worker2 # [ 152.552295] nix-grpc-daemon[1667]: time=2026-09-20T12:48:38.804Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6574worker2 # [ 152.554039] nix-grpc-daemon[1667]: time=2026-09-20T12:48:38.806Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6575lb # [ 152.536757] niks3-server[1074]: 2026/09/20 12:48:39 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6576lb # [ 152.540874] niks3-server[1074]: 2026/09/20 12:48:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/68/sign6577lb # [ 152.543401] niks3-server[1074]: 2026/09/20 12:48:39 INFO Signed narinfos id=68 count=16578worker2 # [ 152.571520] nix-grpc-daemon[1667]: time=2026-09-20T12:48:38.823Z level=INFO msg="Uploading 1 narinfos"6579lb # [ 152.546335] niks3-server[1074]: 2026/09/20 12:48:39 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6580lb # [ 152.550808] niks3-server[1074]: 2026/09/20 12:48:39 INFO Received complete upload request method=POST path=/api/pending_closures/68/complete6581lb # [ 152.553537] niks3-server[1074]: 2026/09/20 12:48:39 INFO Completed upload id=686582worker2 # [ 152.581402] nix-grpc-daemon[1667]: time=2026-09-20T12:48:38.833Z level=INFO msg="Upload complete. (349ms)"6583lb # [ 152.556429] niks3-server[1074]: 2026/09/20 12:48:39 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6584worker2 # [ 152.584073] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:35064 duration_s=0 paths=1 nar_bytes_in=7526585worker2 # [ 152.587043] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:350646586worker2 # [ 152.593849] nix-daemon[814]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)6587worker2 # [ 152.596264] nix-daemon[814]: reaped child process 1746, status = succeeded6588client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6589worker2 # [ 152.601773] nix-daemon[814]: accepted connection from pid 1641, user nix-grpc-daemon (trusted)6590client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6591client # farm-top> LOG-farm-top-drain6592worker2 # [ 153.828722] nix-daemon[814]: reaped child process 1760, status = succeeded6593worker2 # [ 153.984090] nix-daemon[814]: accepted connection from pid 1775, user nix-grpc-daemon (trusted)6594worker2 # [ 153.996409] nix-daemon[814]: reaped child process 1778, status = succeeded6595lb # [ 153.980363] niks3-server[1074]: 2026/09/20 12:48:41 INFO Received uploads request method=POST path=/api/pending_closures6596worker2 # [ 154.017030] nix-grpc-daemon[1667]: time=2026-09-20T12:48:40.268Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6597worker2 # [ 154.020065] nix-grpc-daemon[1667]: time=2026-09-20T12:48:40.270Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6598lb # [ 154.016736] niks3-server[1074]: 2026/09/20 12:48:41 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6599lb # [ 154.025999] niks3-server[1074]: 2026/09/20 12:48:41 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6600lb # [ 154.034872] niks3-server[1074]: 2026/09/20 12:48:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/69/sign6601lb # [ 154.039662] niks3-server[1074]: 2026/09/20 12:48:41 INFO Signed narinfos id=69 count=16602worker2 # [ 154.070544] nix-grpc-daemon[1667]: time=2026-09-20T12:48:40.322Z level=INFO msg="Uploading 1 narinfos"6603lb # [ 154.049087] niks3-server[1074]: 2026/09/20 12:48:41 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6604lb # [ 154.056446] niks3-server[1074]: 2026/09/20 12:48:41 INFO Received complete upload request method=POST path=/api/pending_closures/69/complete6605lb # [ 154.061790] niks3-server[1074]: 2026/09/20 12:48:41 INFO Completed upload id=696606worker2 # [ 154.090166] nix-grpc-daemon[1667]: time=2026-09-20T12:48:40.342Z level=INFO msg="Upload complete. (280ms)"6607lb # [ 154.065136] niks3-server[1074]: 2026/09/20 12:48:41 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6608worker2 # [ 154.097369] nix-grpc-daemon[1641]: ts=2026-09-20T12:48:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:35064 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=17 outputs=16609worker2 # [ 154.110102] nix-daemon[814]: reaped child process 1758, status = succeeded6610client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ca.pem&client-cert=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.pem&client-key=/nix/store/8vm13krkgkcd458yp3j43c8n27rmhbpz-farm-certs/ci.key' --eval-store auto -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain >&2, in 5.79 seconds)6611client: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath6612client: (finished: must succeed: nix eval --raw -f /nix/store/kh0qcgyv9dmrj3hks77rdgj728ar81vy-job.nix --argstr tag drain outPath, in 0.16 seconds)6613worker1: must succeed: rm /nix/.rw-store/fill6614worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.10 seconds)6615worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6616worker1 # [ 154.848214] nix-grpc-daemon[1356]: ts=2026-09-20T12:48:41Z level=info event=healthy reason=min_free6617worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds)6618(finished: subtest: low disk drains a worker and builds go to the other, in 9.28 seconds)6619(finished: run the VM test script, in 156.42 seconds)6620test script finished in 156.67s6621cleanup6622kill QemuMachine (pid 49)6623client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6624kill QemuMachine (pid 52)6625lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6626kill QemuMachine (pid 50)6627worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6628kill QemuMachine (pid 51)6629worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6630(finished: cleanup, in 0.95 seconds)6631additionally exposed symbols:6632 client, lb, worker1, worker2,6633 vlan1,6634 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh