vm-test-run-nix-grpc-farm
checks.x86_64-linux.farm
· build #210
· raw
1tribuchet: building on jamie2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 900.0 seconds6run the VM test script7start all VMs8client: starting vm9lb: starting vm10worker1: starting vm11worker2: starting vm12worker2 # Disk image does not exist, creating the virtualisation disk image...13client # Disk image does not exist, creating the virtualisation disk image...14client: QEMU running (pid 49)15worker2: QEMU running (pid 52)16worker2 # Formatting '/build/vm-state-worker2/tmp.KzM3dZlxkT', fmt=raw size=107374182417client # Formatting '/build/vm-state-client/tmp.rcG1ugMlpc', fmt=raw size=107374182418worker2 # mke2fs 1.47.4 (6-Mar-2025)19client # mke2fs 1.47.4 (6-Mar-2025)20worker2 # Discarding device blocks: 0/262144 done21worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes22lb # Disk image does not exist, creating the virtualisation disk image...23client # Discarding device blocks: 0/262144 done24lb: QEMU running (pid 50)25client # Creating filesystem with 262144 4k blocks and 65536 inodes26lb # Formatting '/build/vm-state-lb/tmp.3xGEw6f5Pv', fmt=raw size=107374182427worker2 # Filesystem UUID: c6179bcd-3507-4d91-bfff-7580039c658828client # Filesystem UUID: 2a09633b-c9b6-4d15-9ed4-de8a3329621d29lb # mke2fs 1.47.4 (6-Mar-2025)30worker2 # Superblock backups stored on blocks:31client # Superblock backups stored on blocks:32lb # Discarding device blocks: 0/262144 done33worker2 # 32768, 98304, 163840, 22937634client # 32768, 98304, 163840, 22937635lb # Creating filesystem with 262144 4k blocks and 65536 inodes36worker2 # 37client # 38lb # Filesystem UUID: a7ce69a7-15cd-4c2a-82a1-c72195d6366539worker2 # Allocating group tables: 0/8 done40client # Allocating group tables: 0/8 done41lb # Superblock backups stored on blocks:42worker2 # Writing inode tables: 0/8 done43client # Writing inode tables: 0/8 done44lb # 32768, 98304, 163840, 22937645worker2 # Creating journal (8192 blocks): done46client # Creating journal (8192 blocks): done47lb # 48worker2 # Writing superblocks and filesystem accounting information: 0/8 done49client # Writing superblocks and filesystem accounting information: 0/8 done50lb # Allocating group tables: 0/8 done51worker2 # 52client # 53lb # Writing inode tables: 0/8 done54worker2 # Virtualisation disk image created.55client # Virtualisation disk image created.56lb # Creating journal (8192 blocks): done57worker1 # Disk image does not exist, creating the virtualisation disk image...58lb # Writing superblocks and filesystem accounting information: 0/8 done59worker1 # Formatting '/build/vm-state-worker1/tmp.xxpFPDceju', fmt=raw size=107374182460lb # 61worker1 # mke2fs 1.47.4 (6-Mar-2025)62lb # Virtualisation disk image created.63worker1 # Discarding device blocks: 0/262144 done64worker1: QEMU running (pid 51)65worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes66worker1 # Filesystem UUID: 2c426fa2-76cf-4ece-9f3c-7975c39f036667worker1 # Superblock backups stored on blocks:68worker1 # 32768, 98304, 163840, 22937669worker1 # 70worker1 # Allocating group tables: 0/8 done71worker1 # Writing inode tables: 0/8 done72(finished: start all VMs, in 0.28 seconds)73client: waiting for unit network-addresses-eth1.service74worker1 # Creating journal (8192 blocks): done75client: waiting for the VM to finish booting76worker1 # Writing superblocks and filesystem accounting information: 0/8 done77worker1 # 78worker1 # Virtualisation disk image created.79worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)80worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)81lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)82client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org)83worker1 # 84worker1 # 85worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0086worker2 # 87worker2 # 88lb # 89worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0090lb # 91lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA0092worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...93worker1 # 94worker1 # 95worker1 # 96worker1 # 97worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)...98worker2 # 99worker2 # 100worker2 # 101worker2 # 102worker1 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00103lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)...104lb # 105lb # 106lb # 107lb # 108worker2 # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00109lb # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00110worker2 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...111worker2 # 112worker2 # 113client # 114client # 115worker1 # Press Ctrl-B to configure iPXE (PCI 00:08.0)...116worker1 # 117worker1 # 118lb # Press Ctrl-B to configure iPXE (PCI 00:08.0)...119lb # 120lb # 121client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC730+5EF2C730 CA00122client # Press Ctrl-B to configure iPXE (PCI 00:02.0)...123client # 124client # 125client # 126client # 127client # iPXE (http://ipxe.org) 00:08.0 CB00 PCI2.10 PnP PMM 5EFCC730 5EF2C730 CB00128client # Press Ctrl-B to configure iPXE (PCI 00:08.0)...129client # 130client # 131worker2 # Booting from ROM...132worker2 # Probing EDD (edd=off to disable)... ok133lb # Booting from ROM...134lb # Probing EDD (edd=off to disable)... ok135worker1 # Booting from ROM...136client # Booting from ROM...137worker2 # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026138worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/91yrd213f2p7jwl5z82kgp8bb2awvds4-nixos-system-worker2-test/init regInfo=/nix/store/zyj90vplqbjqylazjsl7r7rdi140maj5-closure-info/registration console=ttyS0,115200n8 console=tty0139worker2 # [ 0.000000] BIOS-provided physical RAM map:140worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable141worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved142worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved143worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable144worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved145worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved146lb # [ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026147worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved148worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved149worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved150worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved151worker2 # [ 0.000000] NX (Execute Disable) protection: active152lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0153worker2 # [ 0.000000] APIC: Static calls initialized154lb # [ 0.000000] BIOS-provided physical RAM map:155worker2 # [ 0.000000] SMBIOS 2.8 present.156lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable157worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014158lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved159worker2 # [ 0.000000] DMI: Memory slots populated: 1/1160worker2 # [ 0.000000] Hypervisor detected: KVM161lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved162worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000163lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable164worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00165lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved166worker2 # [ 0.000001] kvm-clock: using sched offset of 568094781 cycles167lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved168worker2 # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns169lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved170worker2 # [ 0.000007] tsc: Detected 2400.012 MHz processor171lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved172worker2 # [ 0.000945] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000173lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved174worker2 # [ 0.000977] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs175lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved176worker2 # [ 0.000980] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT177lb # [ 0.000000] NX (Execute Disable) protection: active178lb # [ 0.000000] APIC: Static calls initialized179worker2 # [ 0.003157] found SMP MP-table at [mem 0x000f5450-0x000f545f]180lb # [ 0.000000] SMBIOS 2.8 present.181worker2 # [ 0.003176] Using GB pages for direct mapping182worker2 # [ 0.003315] RAMDISK: [mem 0x5e367000-0x5ffcffff]183lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014184worker2 # [ 0.003332] ACPI: Early table checksum verification disabled185lb # [ 0.000000] DMI: Memory slots populated: 1/1186worker2 # [ 0.003338] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )187lb # [ 0.000000] Hypervisor detected: KVM188lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000189worker2 # [ 0.003343] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)190lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00191client # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026192lb # [ 0.000001] kvm-clock: using sched offset of 578170670 cycles193worker2 # [ 0.003349] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)194worker2 # [ 0.003361] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)195lb # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns196worker2 # [ 0.003364] ACPI: FACS 0x000000005FFE0000 000040197lb # [ 0.000007] tsc: Detected 2400.012 MHz processor198lb # [ 0.000919] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000199worker2 # [ 0.003366] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)200lb # [ 0.000951] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs201worker2 # [ 0.003368] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)202client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/97m6rvvyik23hqk7xbnr0cyn6n1zar9d-nixos-system-client-test/init regInfo=/nix/store/12ii1ln9v6r28kidf6bi2l6rgs7796zi-closure-info/registration console=ttyS0,115200n8 console=tty0203client # [ 0.000000] BIOS-provided physical RAM map:204lb # [ 0.000955] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT205worker2 # [ 0.003371] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)206lb # [ 0.003116] found SMP MP-table at [mem 0x000f5450-0x000f545f]207client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable208lb # [ 0.003134] Using GB pages for direct mapping209worker2 # [ 0.003373] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)210client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved211lb # [ 0.003273] RAMDISK: [mem 0x5e367000-0x5ffcffff]212worker2 # [ 0.003375] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]213client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved214lb # [ 0.003288] ACPI: Early table checksum verification disabled215worker2 # [ 0.003376] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]216lb # [ 0.003293] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )217client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable218worker2 # [ 0.003377] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]219client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved220lb # [ 0.003298] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)221worker2 # [ 0.003377] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]222client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved223lb # [ 0.003304] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)224worker2 # [ 0.003378] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]225client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved226lb # [ 0.003312] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)227worker2 # [ 0.003378] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]228client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved229lb # [ 0.003314] ACPI: FACS 0x000000005FFE0000 000040230worker2 # [ 0.003379] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]231client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved232worker2 # [ 0.003661] No NUMA configuration found233lb # [ 0.003316] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)234client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved235worker2 # [ 0.003662] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]236lb # [ 0.003318] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)237client # [ 0.000000] NX (Execute Disable) protection: active238worker2 # [ 0.003665] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]239client # [ 0.000000] APIC: Static calls initialized240worker2 # [ 0.006044] Zone ranges:241client # [ 0.000000] SMBIOS 2.8 present.242worker2 # [ 0.006046] DMA [mem 0x0000000000001000-0x0000000000ffffff]243lb # [ 0.003319] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)244lb # [ 0.003321] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)245worker2 # [ 0.006047] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]246worker2 # [ 0.006049] Normal empty247client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014248worker2 # [ 0.006050] Device empty249lb # [ 0.003323] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]250client # [ 0.000000] DMI: Memory slots populated: 1/1251worker2 # [ 0.006051] Movable zone start for each node252client # [ 0.000000] Hypervisor detected: KVM253worker2 # [ 0.006052] Early memory node ranges254lb # [ 0.003324] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]255client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000256worker2 # [ 0.006052] node 0: [mem 0x0000000000001000-0x000000000009efff]257lb # [ 0.003324] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]258client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00259worker2 # [ 0.006053] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]260client # [ 0.000001] kvm-clock: using sched offset of 600907186 cycles261lb # [ 0.003325] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]262worker2 # [ 0.006054] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]263lb # [ 0.003325] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]264client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns265worker2 # [ 0.006076] On node 0, zone DMA: 1 pages in unavailable ranges266lb # [ 0.003326] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]267client # [ 0.000006] tsc: Detected 2400.012 MHz processor268worker2 # [ 0.006377] On node 0, zone DMA: 97 pages in unavailable ranges269client # [ 0.000916] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000270lb # [ 0.003326] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]271worker2 # [ 0.037349] On node 0, zone DMA32: 40 pages in unavailable ranges272lb # [ 0.003603] No NUMA configuration found273worker2 # [ 0.037873] ACPI: PM-Timer IO Port: 0x608274client # [ 0.000948] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs275lb # [ 0.003604] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]276worker2 # [ 0.037890] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])277client # [ 0.000952] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT278lb # [ 0.003607] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]279worker2 # [ 0.037925] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23280lb # [ 0.006302] Zone ranges:281client # [ 0.003065] found SMP MP-table at [mem 0x000f5450-0x000f545f]282worker2 # [ 0.037928] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)283client # [ 0.003095] Using GB pages for direct mapping284lb # [ 0.006303] DMA [mem 0x0000000000001000-0x0000000000ffffff]285client # [ 0.003187] RAMDISK: [mem 0x5e366000-0x5ffcffff]286worker2 # [ 0.037930] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)287lb # [ 0.006305] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]288lb # [ 0.006307] Normal empty289client # [ 0.003198] ACPI: Early table checksum verification disabled290lb # [ 0.006308] Device empty291worker2 # [ 0.037932] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)292client # [ 0.003202] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )293lb # [ 0.006308] Movable zone start for each node294worker2 # [ 0.037933] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)295lb # [ 0.006309] Early memory node ranges296client # [ 0.003207] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)297worker2 # [ 0.037934] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)298lb # [ 0.006310] node 0: [mem 0x0000000000001000-0x000000000009efff]299lb # [ 0.006311] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]300worker2 # [ 0.037937] ACPI: Using ACPI (MADT) for SMP configuration information301client # [ 0.003213] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)302worker2 # [ 0.037938] ACPI: HPET id: 0x8086a201 base: 0xfed00000303lb # [ 0.006313] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]304worker2 # [ 0.037945] TSC deadline timer available305client # [ 0.003224] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)306lb # [ 0.006340] On node 0, zone DMA: 1 pages in unavailable ranges307worker2 # [ 0.037950] CPU topo: Max. logical packages: 1308client # [ 0.003227] ACPI: FACS 0x000000005FFE0000 000040309worker2 # [ 0.037951] CPU topo: Max. logical dies: 1310lb # [ 0.006669] On node 0, zone DMA: 97 pages in unavailable ranges311client # [ 0.003229] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)312worker2 # [ 0.037952] CPU topo: Max. dies per package: 1313lb # [ 0.037952] On node 0, zone DMA32: 40 pages in unavailable ranges314worker2 # [ 0.037958] CPU topo: Max. threads per core: 1315lb # [ 0.038479] ACPI: PM-Timer IO Port: 0x608316client # [ 0.003232] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)317worker2 # [ 0.037958] CPU topo: Num. cores per package: 1318lb # [ 0.038496] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])319worker2 # [ 0.037959] CPU topo: Num. threads per package: 1320client # [ 0.003234] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)321lb # [ 0.038530] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23322worker2 # [ 0.037959] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs323lb # [ 0.038534] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)324client # [ 0.003237] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)325worker2 # [ 0.037986] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()326lb # [ 0.038536] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)327client # [ 0.003239] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]328worker2 # [ 0.038029] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]329lb # [ 0.038537] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)330client # [ 0.003240] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]331worker2 # [ 0.038031] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]332lb # [ 0.038538] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)333client # [ 0.003241] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]334worker2 # [ 0.038033] [mem 0x60000000-0xafffffff] available for PCI devices335lb # [ 0.038539] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)336worker2 # [ 0.038035] Booting paravirtualized kernel on KVM337client # [ 0.003242] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]338lb # [ 0.038559] ACPI: Using ACPI (MADT) for SMP configuration information339client # [ 0.003242] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]340worker2 # [ 0.038040] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns341lb # [ 0.038560] ACPI: HPET id: 0x8086a201 base: 0xfed00000342lb # [ 0.038566] TSC deadline timer available343client # [ 0.003243] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]344worker2 # [ 0.043031] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1345lb # [ 0.038571] CPU topo: Max. logical packages: 1346client # [ 0.003244] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]347lb # [ 0.038572] CPU topo: Max. logical dies: 1348worker2 # [ 0.045716] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152349client # [ 0.003528] No NUMA configuration found350lb # [ 0.038573] CPU topo: Max. dies per package: 1351worker2 # [ 0.045776] kvm-guest: PV spinlocks disabled, single CPU352client # [ 0.003529] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]353lb # [ 0.038576] CPU topo: Max. threads per core: 1354lb # [ 0.038577] CPU topo: Num. cores per package: 1355client # [ 0.003532] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]356client # [ 0.006324] Zone ranges:357lb # [ 0.038577] CPU topo: Num. threads per package: 1358lb # [ 0.038578] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs359client # [ 0.006325] DMA [mem 0x0000000000001000-0x0000000000ffffff]360lb # [ 0.038608] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()361client # [ 0.006327] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]362client # [ 0.006329] Normal empty363worker2 # [ 0.045778] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/91yrd213f2p7jwl5z82kgp8bb2awvds4-nixos-system-worker2-test/init regInfo=/nix/store/zyj90vplqbjqylazjsl7r7rdi140maj5-closure-info/registration console=ttyS0,115200n8 console=tty0364client # [ 0.006329] Device empty365lb # [ 0.038652] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]366client # [ 0.006330] Movable zone start for each node367client # [ 0.006331] Early memory node ranges368lb # [ 0.038654] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]369worker2 # [ 0.045895] Unknown kernel command line parameters "regInfo=/nix/store/zyj90vplqbjqylazjsl7r7rdi140maj5-closure-info/registration", will be passed to user space.370lb # [ 0.038656] [mem 0x60000000-0xafffffff] available for PCI devices371client # [ 0.006332] node 0: [mem 0x0000000000001000-0x000000000009efff]372worker2 # [ 0.045911] random: crng init done373lb # [ 0.038658] Booting paravirtualized kernel on KVM374client # [ 0.006333] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]375worker2 # [ 0.045912] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes376client # [ 0.006334] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]377lb # [ 0.038662] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns378worker2 # [ 0.048355] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)379client # [ 0.006357] On node 0, zone DMA: 1 pages in unavailable ranges380lb # [ 0.043686] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1381worker2 # [ 0.049535] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)382client # [ 0.006634] On node 0, zone DMA: 97 pages in unavailable ranges383worker2 # [ 0.049591] Fallback order for Node 0: 0384lb # [ 0.046332] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152385client # [ 0.036645] On node 0, zone DMA32: 40 pages in unavailable ranges386lb # [ 0.046390] kvm-guest: PV spinlocks disabled, single CPU387worker2 # [ 0.049597] Built 1 zonelists, mobility grouping on. Total pages: 393078388client # [ 0.037196] ACPI: PM-Timer IO Port: 0x608389worker2 # [ 0.049599] Policy zone: DMA32390client # [ 0.037212] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])391worker2 # [ 0.052469] mem auto-init: stack:all(zero), heap alloc:on, heap free:off392client # [ 0.037256] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23393worker2 # [ 0.056385] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1394client # [ 0.037259] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)395worker2 # [ 0.059991] allocated 3145728 bytes of page_ext396worker2 # [ 0.071867] ftrace: allocating 48731 entries in 192 pages397client # [ 0.037261] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)398lb # [ 0.046392] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/8y2rmlwiyr2iliam1yhl8i23qgaaknj8-nixos-system-lb-test/init regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration console=ttyS0,115200n8 console=tty0399worker2 # [ 0.071873] ftrace: allocated 192 pages with 2 groups400client # [ 0.037262] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)401worker2 # [ 0.073003] Dynamic Preempt: lazy402client # [ 0.037263] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)403worker2 # [ 0.073174] rcu: Preemptible hierarchical RCU implementation.404worker2 # [ 0.073175] rcu: RCU event tracing is enabled.405lb # [ 0.046506] Unknown kernel command line parameters "regInfo=/nix/store/9qjmxix17wyd2infdr8gh5ii9mr60zqd-closure-info/registration", will be passed to user space.406client # [ 0.037264] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)407lb # [ 0.046521] random: crng init done408worker2 # [ 0.073176] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.409client # [ 0.037267] ACPI: Using ACPI (MADT) for SMP configuration information410lb # [ 0.046522] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes411worker2 # [ 0.073178] Trampoline variant of Tasks RCU enabled.412client # [ 0.037268] ACPI: HPET id: 0x8086a201 base: 0xfed00000413worker2 # [ 0.073179] Rude variant of Tasks RCU enabled.414client # [ 0.037274] TSC deadline timer available415lb # [ 0.049095] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)416worker2 # [ 0.073180] Tracing variant of Tasks RCU enabled.417client # [ 0.037279] CPU topo: Max. logical packages: 1418client # [ 0.037280] CPU topo: Max. logical dies: 1419lb # [ 0.050382] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)420worker2 # [ 0.073181] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.421lb # [ 0.050430] Fallback order for Node 0: 0422client # [ 0.037281] CPU topo: Max. dies per package: 1423worker2 # [ 0.073181] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1424client # [ 0.037285] CPU topo: Max. threads per core: 1425lb # [ 0.050436] Built 1 zonelists, mobility grouping on. Total pages: 393078426client # [ 0.037285] CPU topo: Num. cores per package: 1427lb # [ 0.050437] Policy zone: DMA32428worker2 # [ 0.073247] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.429client # [ 0.037286] CPU topo: Num. threads per package: 1430lb # [ 0.053484] mem auto-init: stack:all(zero), heap alloc:on, heap free:off431client # [ 0.037286] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs432worker2 # [ 0.073250] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.433lb # [ 0.057607] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1434client # [ 0.037315] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()435lb # [ 0.061715] allocated 3145728 bytes of page_ext436worker2 # [ 0.073251] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.437lb # [ 0.073736] ftrace: allocating 48731 entries in 192 pages438client # [ 0.037355] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]439worker2 # [ 0.078451] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16440lb # [ 0.073741] ftrace: allocated 192 pages with 2 groups441lb # [ 0.074852] Dynamic Preempt: lazy442client # [ 0.037357] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]443worker2 # [ 0.078753] rcu: srcu_init: Setting srcu_struct sizes based on contention.444lb # [ 0.075065] rcu: Preemptible hierarchical RCU implementation.445client # [ 0.037359] [mem 0x60000000-0xafffffff] available for PCI devices446lb # [ 0.075066] rcu: RCU event tracing is enabled.447worker2 # [ 0.078762] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns448client # [ 0.037361] Booting paravirtualized kernel on KVM449worker1 # Probing EDD (edd=off to disable)... o[ 0.000000] Linux version 6.18.50 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC Mon Sep 7 15:23:00 UTC 2026450lb # [ 0.075067] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.451worker2 # [ 0.078889] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)452lb # [ 0.075069] Trampoline variant of Tasks RCU enabled.453client # [ 0.037365] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns454worker2 # [ 0.083035] Console: colour VGA+ 80x25455lb # [ 0.075070] Rude variant of Tasks RCU enabled.456worker2 # [ 0.083042] printk: legacy console [tty0] enabled457client # [ 0.042342] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1458lb # [ 0.075070] Tracing variant of Tasks RCU enabled.459worker2 # [ 0.116757] printk: legacy console [ttyS0] enabled460client # [ 0.044648] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152461lb # [ 0.075071] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.462worker2 # [ 0.227423] ACPI: Core revision 20250807463client # [ 0.044705] kvm-guest: PV spinlocks disabled, single CPU464lb # [ 0.075072] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1465worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fqk7si3j8vw40j1y1h5zixfchsnmi34s-nixos-system-worker1-test/init regInfo=/nix/store/d5yzf28dl8y3iz07dsfrygl7771d9bv6-closure-info/registration console=ttyS0,115200n8 console=tty0466lb # [ 0.075099] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.467worker2 # [ 0.228450] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns468worker1 # [ 0.000000] BIOS-provided physical RAM map:469worker2 # [ 0.230151] APIC: Switch to symmetric I/O mode setup470lb # [ 0.075102] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.471worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable472worker2 # [ 0.231235] x2apic enabled473lb # [ 0.075103] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.474worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved475worker2 # [ 0.232059] APIC: Switched APIC routing to: physical x2apic476lb # [ 0.080156] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16477client # [ 0.044707] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/97m6rvvyik23hqk7xbnr0cyn6n1zar9d-nixos-system-client-test/init regInfo=/nix/store/12ii1ln9v6r28kidf6bi2l6rgs7796zi-closure-info/registration console=ttyS0,115200n8 console=tty0478worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved479lb # [ 0.080449] rcu: srcu_init: Setting srcu_struct sizes based on contention.480worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable481worker2 # [ 0.234076] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1482lb # [ 0.080458] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns483client # [ 0.044818] Unknown kernel command line parameters "regInfo=/nix/store/12ii1ln9v6r28kidf6bi2l6rgs7796zi-closure-info/registration", will be passed to user space.484worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved485client # [ 0.044832] random: crng init done486lb # [ 0.080609] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)487worker2 # [ 0.235139] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns488worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved489client # [ 0.044833] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes490lb # [ 0.084556] Console: colour VGA+ 80x25491lb # [ 0.084560] printk: legacy console [tty0] enabled492client # [ 0.047112] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)493worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved494worker2 # [ 0.236943] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)495lb # [ 0.117664] printk: legacy console [ttyS0] enabled496worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved497client # [ 0.048262] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)498lb # [ 0.228889] ACPI: Core revision 20250807499client # [ 0.048305] Fallback order for Node 0: 0500worker2 # [ 0.239040] x86/cpu: User Mode Instruction Prevention (UMIP) activated501worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved502client # [ 0.048309] Built 1 zonelists, mobility grouping on. Total pages: 393078503client # [ 0.048311] Policy zone: DMA32504worker2 # [ 0.240096] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127505worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved506lb # [ 0.229875] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns507client # [ 0.050971] mem auto-init: stack:all(zero), heap alloc:on, heap free:off508worker1 # [ 0.000000] NX (Execute Disable) protection: active509worker2 # [ 0.240940] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0510lb # [ 0.231596] APIC: Switch to symmetric I/O mode setup511worker1 # [ 0.000000] APIC: Static calls initialized512client # [ 0.054841] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1513worker1 # [ 0.000000] SMBIOS 2.8 present.514lb # [ 0.232682] x2apic enabled515client # [ 0.058380] allocated 3145728 bytes of page_ext516worker2 # [ 0.242798] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto517client # [ 0.069971] ftrace: allocating 48731 entries in 192 pages518lb # [ 0.233490] APIC: Switched APIC routing to: physical x2apic519worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014520client # [ 0.069977] ftrace: allocated 192 pages with 2 groups521worker1 # [ 0.000000] DMI: Memory slots populated: 1/1522client # [ 0.071258] Dynamic Preempt: lazy523worker2 # [ 0.243940] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl524worker1 # [ 0.000000] Hypervisor detected: KVM525client # [ 0.071535] rcu: Preemptible hierarchical RCU implementation.526lb # [ 0.235493] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1527worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000528worker2 # [ 0.245940] Transient Scheduler Attacks: Vulnerable: No microcode529client # [ 0.071536] rcu: RCU event tracing is enabled.530worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00531client # [ 0.071537] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.532worker2 # [ 0.246939] Spectre V2 : Mitigation: Enhanced / Automatic IBRS533worker1 # [ 0.000001] kvm-clock: using sched offset of 659876442 cycles534client # [ 0.071540] Trampoline variant of Tasks RCU enabled.535lb # [ 0.236540] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns536worker2 # [ 0.247940] Speculative Return Stack Overflow: Mitigation: Safe RET537client # [ 0.071540] Rude variant of Tasks RCU enabled.538client # [ 0.071540] Tracing variant of Tasks RCU enabled.539lb # [ 0.238351] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)540worker1 # [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns541worker1 # [ 0.000007] tsc: Detected 2400.012 MHz processor542client # [ 0.071541] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.543lb # [ 0.240449] x86/cpu: User Mode Instruction Prevention (UMIP) activated544worker1 # [ 0.000912] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000545client # [ 0.071542] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1546lb # [ 0.241535] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127547worker1 # [ 0.000944] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs548client # [ 0.071574] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.549worker2 # [ 0.248939] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization550lb # [ 0.242347] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0551worker1 # [ 0.000947] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT552client # [ 0.071577] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.553worker2 # [ 0.250949] Spectre V2 : Enabling IBPB for BPF554worker1 # [ 0.003056] found SMP MP-table at [mem 0x000f5450-0x000f545f]555worker1 # [ 0.003074] Using GB pages for direct mapping556client # [ 0.071578] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.557lb # [ 0.244187] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto558worker2 # [ 0.252540] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier559worker1 # [ 0.003173] RAMDISK: [mem 0x5e367000-0x5ffcffff]560client # [ 0.076931] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16561worker2 # [ 0.253941] active return thunk: srso_alias_return_thunk562worker1 # [ 0.003184] ACPI: Early table checksum verification disabled563lb # [ 0.245347] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl564client # [ 0.077228] rcu: srcu_init: Setting srcu_struct sizes based on contention.565worker1 # [ 0.003188] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS )566lb # [ 0.247347] Transient Scheduler Attacks: Vulnerable: No microcode567worker2 # [ 0.254966] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'568client # [ 0.077238] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns569worker1 # [ 0.003194] ACPI: RSDT 0x000000005FFE2422 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)570lb # [ 0.248347] Spectre V2 : Mitigation: Enhanced / Automatic IBRS571worker2 # [ 0.255939] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'572client # [ 0.077362] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)573lb # [ 0.249347] Speculative Return Stack Overflow: Mitigation: Safe RET574client # [ 0.081316] Console: colour VGA+ 80x25575worker1 # [ 0.003199] ACPI: FACP 0x000000005FFE221A 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)576worker2 # [ 0.256939] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'577client # [ 0.081320] printk: legacy console [tty0] enabled578worker2 # [ 0.257939] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'579worker1 # [ 0.003208] ACPI: DSDT 0x000000005FFE0040 0021DA (v01 BOCHS BXPC 00000001 BXPC 00000001)580client # [ 0.115126] printk: legacy console [ttyS0] enabled581worker1 # [ 0.003211] ACPI: FACS 0x000000005FFE0000 000040582worker2 # [ 0.259767] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'583client # [ 0.228238] ACPI: Core revision 20250807584worker1 # [ 0.003213] ACPI: APIC 0x000000005FFE230E 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001)585worker2 # [ 0.260772] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'586lb # [ 0.250346] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization587client # [ 0.229359] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns588worker1 # [ 0.003214] ACPI: HPET 0x000000005FFE2386 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001)589worker2 # [ 0.261939] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'590lb # [ 0.252357] Spectre V2 : Enabling IBPB for BPF591client # [ 0.231217] APIC: Switch to symmetric I/O mode setup592worker1 # [ 0.003216] ACPI: MCFG 0x000000005FFE23BE 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)593worker2 # [ 0.262940] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256594client # [ 0.232407] x2apic enabled595lb # [ 0.253923] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier596worker1 # [ 0.003218] ACPI: WAET 0x000000005FFE23FA 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)597worker2 # [ 0.263939] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64598client # [ 0.233244] APIC: Switched APIC routing to: physical x2apic599lb # [ 0.255348] active return thunk: srso_alias_return_thunk600worker1 # [ 0.003219] ACPI: Reserving FACP table memory at [mem 0x5ffe221a-0x5ffe230d]601worker2 # [ 0.264939] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512602worker1 # [ 0.003220] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe2219]603lb # [ 0.256372] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'604worker2 # [ 0.266750] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024605client # [ 0.235284] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1606worker2 # [ 0.267757] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8607worker1 # [ 0.003221] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f]608lb # [ 0.257346] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'609worker1 # [ 0.003221] ACPI: Reserving APIC table memory at [mem 0x5ffe230e-0x5ffe2385]610lb # [ 0.258346] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'611client # [ 0.236377] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns612worker2 # [ 0.268747] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.613worker1 # [ 0.003222] ACPI: Reserving HPET table memory at [mem 0x5ffe2386-0x5ffe23bd]614lb # [ 0.260133] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'615client # [ 0.238255] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)616worker1 # [ 0.003222] ACPI: Reserving MCFG table memory at [mem 0x5ffe23be-0x5ffe23f9]617lb # [ 0.261178] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'618client # [ 0.239353] x86/cpu: User Mode Instruction Prevention (UMIP) activated619worker1 # [ 0.003223] ACPI: Reserving WAET table memory at [mem 0x5ffe23fa-0x5ffe2421]620lb # [ 0.262346] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'621worker1 # [ 0.003489] No NUMA configuration found622client # [ 0.241351] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127623worker1 # [ 0.003490] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff]624lb # [ 0.263346] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'625client # [ 0.242251] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0626worker1 # [ 0.003493] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff]627lb # [ 0.264347] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256628worker1 # [ 0.005956] Zone ranges:629worker1 # [ 0.005958] DMA [mem 0x0000000000001000-0x0000000000ffffff]630lb # [ 0.265346] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64631client # [ 0.243257] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto632worker1 # [ 0.005960] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff]633lb # [ 0.267156] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512634worker1 # [ 0.005962] Normal empty635worker1 # [ 0.005963] Device empty636client # [ 0.244252] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl637lb # [ 0.268156] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024638worker1 # [ 0.005963] Movable zone start for each node639worker1 # [ 0.005964] Early memory node ranges640client # [ 0.245251] Transient Scheduler Attacks: Vulnerable: No microcode641lb # [ 0.269346] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8642worker1 # [ 0.005965] node 0: [mem 0x0000000000001000-0x000000000009efff]643client # [ 0.247051] Spectre V2 : Mitigation: Enhanced / Automatic IBRS644worker1 # [ 0.005966] node 0: [mem 0x0000000000100000-0x000000005ffd7fff]645lb # [ 0.270346] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.646client # [ 0.248014] Speculative Return Stack Overflow: Mitigation: Safe RET647worker1 # [ 0.005968] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff]648worker1 # [ 0.005991] On node 0, zone DMA: 1 pages in unavailable ranges649worker1 # [ 0.006272] On node 0, zone DMA: 97 pages in unavailable ranges650worker1 # [ 0.034412] On node 0, zone DMA32: 40 pages in unavailable ranges651worker1 # [ 0.035053] ACPI: PM-Timer IO Port: 0x608652worker1 # [ 0.035073] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])653client # [ 0.249251] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization654worker1 # [ 0.035114] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23655client # [ 0.251263] Spectre V2 : Enabling IBPB for BPF656worker1 # [ 0.035117] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)657worker1 # [ 0.035120] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)658client # [ 0.252253] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier659worker1 # [ 0.035121] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)660client # [ 0.253252] active return thunk: srso_alias_return_thunk661worker1 # [ 0.035123] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)662client # [ 0.254270] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'663worker1 # [ 0.035124] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)664client # [ 0.255250] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'665worker1 # [ 0.035128] ACPI: Using ACPI (MADT) for SMP configuration information666worker1 # [ 0.035129] ACPI: HPET id: 0x8086a201 base: 0xfed00000667client # [ 0.256251] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'668worker1 # [ 0.035137] TSC deadline timer available669worker1 # [ 0.035143] CPU topo: Max. logical packages: 1670client # [ 0.257251] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'671worker1 # [ 0.035145] CPU topo: Max. logical dies: 1672worker1 # [ 0.035145] CPU topo: Max. dies per package: 1673client # [ 0.258250] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'674worker1 # [ 0.035150] CPU topo: Max. threads per core: 1675worker1 # [ 0.035151] CPU topo: Num. cores per package: 1676client # [ 0.260073] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'677worker1 # [ 0.035152] CPU topo: Num. threads per package: 1678worker1 # [ 0.035152] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs679client # [ 0.261250] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'680worker1 # [ 0.035185] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()681client # [ 0.262251] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256682worker1 # [ 0.035234] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]683client # [ 0.263251] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64684worker1 # [ 0.035236] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff]685client # [ 0.264251] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512686worker1 # [ 0.035238] [mem 0x60000000-0xafffffff] available for PCI devices687worker1 # [ 0.035241] Booting paravirtualized kernel on KVM688client # [ 0.265251] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024689client # [ 0.266250] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8690worker1 # [ 0.035246] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns691worker1 # [ 0.040689] setup_percpu: NR_CPUS:384 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1692client # [ 0.267251] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.693worker1 # [ 0.043623] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152694worker1 # [ 0.043690] kvm-guest: PV spinlocks disabled, single CPU695worker2 # [ 0.309390] Freeing SMP alternatives memory: 44K696worker1 # [ 0.043692] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/fqk7si3j8vw40j1y1h5zixfchsnmi34s-nixos-system-worker1-test/init regInfo=/nix/store/d5yzf28dl8y3iz07dsfrygl7771d9bv6-closure-info/registration console=ttyS0,115200n8 console=tty0697worker2 # [ 0.309947] pid_max: default: 32768 minimum: 301698worker2 # [ 0.311061] LSM: initializing lsm=capability,landlock,yama,bpf,ima699worker1 # [ 0.043840] Unknown kernel command line parameters "regInfo=/nix/store/d5yzf28dl8y3iz07dsfrygl7771d9bv6-closure-info/registration", will be passed to user space.700worker1 # [ 0.043858] random: crng init done701worker2 # [ 0.312061] landlock: Up and running.702worker2 # [ 0.312940] Yama: becoming mindful.703worker1 # [ 0.043859] printk: log buffer data + meta data: 262144 + 917504 = 1179648 bytes704worker2 # [ 0.314208] LSM support for eBPF active705worker1 # [ 0.046728] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)706worker1 # [ 0.048422] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)707worker2 # [ 0.315090] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)708worker1 # [ 0.048477] Fallback order for Node 0: 0709worker1 # [ 0.048483] Built 1 zonelists, mobility grouping on. Total pages: 393078710worker1 # [ 0.048485] Policy zone: DMA32711worker2 # [ 0.315982] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)712worker1 # [ 0.051880] mem auto-init: stack:all(zero), heap alloc:on, heap free:off713worker1 # [ 0.056474] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1714worker1 # [ 0.060874] allocated 3145728 bytes of page_ext715worker2 # [ 0.319381] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)716worker1 # [ 0.073710] ftrace: allocating 48731 entries in 192 pages717worker1 # [ 0.073716] ftrace: allocated 192 pages with 2 groups718lb # [ 0.311527] Freeing SMP alternatives memory: 44K719worker1 # [ 0.075040] Dynamic Preempt: lazy720worker2 # [ 0.320599] Performance Events: Fam17h+ core perfctr, AMD PMU driver.721lb # [ 0.312353] pid_max: default: 32768 minimum: 301722worker1 # [ 0.075267] rcu: Preemptible hierarchical RCU implementation.723worker2 # [ 0.320947] ... version: 2724worker1 # [ 0.075269] rcu: RCU event tracing is enabled.725lb # [ 0.313500] LSM: initializing lsm=capability,landlock,yama,bpf,ima726worker2 # [ 0.321751] ... bit width: 48727worker1 # [ 0.075269] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=1.728lb # [ 0.314475] landlock: Up and running.729worker2 # [ 0.322529] ... generic counters: 6730worker1 # [ 0.075271] Trampoline variant of Tasks RCU enabled.731lb # [ 0.315348] Yama: becoming mindful.732worker2 # [ 0.322960] ... generic bitmap: 000000000000003f733worker1 # [ 0.075272] Rude variant of Tasks RCU enabled.734lb # [ 0.316501] LSM support for eBPF active735worker1 # [ 0.075272] Tracing variant of Tasks RCU enabled.736worker2 # [ 0.323942] ... fixed-purpose counters: 0737worker2 # [ 0.324754] ... fixed-purpose bitmap: 0000000000000000738worker1 # [ 0.075273] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.739lb # [ 0.317416] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)740worker2 # [ 0.325722] ... value mask: 0000ffffffffffff741worker1 # [ 0.075274] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1742lb # [ 0.318388] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)743worker2 # [ 0.326730] ... max period: 00007fffffffffff744worker1 # [ 0.075317] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.745worker2 # [ 0.327727] ... global_ctrl mask: 000000000000003f746worker1 # [ 0.075320] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.747worker2 # [ 0.328901] signal: max sigframe size: 3376748lb # [ 0.321345] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)749worker1 # [ 0.075321] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1.750worker2 # [ 0.329744] rcu: Hierarchical SRCU implementation.751worker1 # [ 0.081880] NR_IRQS: 24832, nr_irqs: 256, preallocated irqs: 16752worker2 # [ 0.330652] rcu: Max phase no-delay instances is 400.753lb # [ 0.321958] Performance Events: Fam17h+ core perfctr, AMD PMU driver.754lb # [ 0.322355] ... version: 2755worker1 # [ 0.082251] rcu: srcu_init: Setting srcu_struct sizes based on contention.756lb # [ 0.323143] ... bit width: 48757worker1 # [ 0.082260] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns758lb # [ 0.323937] ... generic counters: 6759lb # [ 0.324397] ... generic bitmap: 000000000000003f760worker1 # [ 0.082420] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)761lb # [ 0.325349] ... fixed-purpose counters: 0762worker1 # [ 0.087203] Console: colour VGA+ 80x25763worker1 # [ 0.087211] printk: legacy console [tty0] enabled764lb # [ 0.326124] ... fixed-purpose bitmap: 0000000000000000765worker1 # [ 0.128583] printk: legacy console [ttyS0] enabled766lb # [ 0.327101] ... value mask: 0000ffffffffffff767worker2 # [ 0.336405] smp: Bringing up secondary CPUs ...768worker1 # [ 0.247365] ACPI: Core revision 20250807769worker2 # [ 0.336963] smp: Brought up 1 node, 1 CPU770lb # [ 0.327349] ... max period: 00007fffffffffff771lb # [ 0.328331] ... global_ctrl mask: 000000000000003f772worker1 # [ 0.248354] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns773worker2 # [ 0.337719] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)774lb # [ 0.329233] signal: max sigframe size: 3376775worker1 # [ 0.250046] APIC: Switch to symmetric I/O mode setup776worker1 # [ 0.251123] x2apic enabled777lb # [ 0.330028] rcu: Hierarchical SRCU implementation.778worker2 # [ 0.339077] Memory: 1454560K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)779lb # [ 0.330352] rcu: Max phase no-delay instances is 400.780worker1 # [ 0.251949] APIC: Switched APIC routing to: physical x2apic781client # [ 0.309255] Freeing SMP alternatives memory: 44K782worker2 # [ 0.340268] devtmpfs: initialized783client # [ 0.310174] pid_max: default: 32768 minimum: 301784worker2 # [ 0.341157] x86/mm: Memory block size: 128MB785worker1 # [ 0.254002] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1786client # [ 0.310967] LSM: initializing lsm=capability,landlock,yama,bpf,ima787client # [ 0.312349] landlock: Up and running.788client # [ 0.313030] Yama: becoming mindful.789worker1 # [ 0.255128] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns790worker2 # [ 0.343123] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)791client # [ 0.313507] LSM support for eBPF active792worker1 # [ 0.256940] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400012)793worker2 # [ 0.343989] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).794lb # [ 0.336705] smp: Bringing up secondary CPUs ...795client # [ 0.314389] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)796lb # [ 0.337368] smp: Brought up 1 node, 1 CPU797worker1 # [ 0.259065] x86/cpu: User Mode Instruction Prevention (UMIP) activated798worker2 # [ 0.345053] pinctrl core: initialized pinctrl subsystem799client # [ 0.316291] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)800lb # [ 0.338105] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)801worker2 # [ 0.346317] PM: RTC time: 07:57:18, date: 2026-09-20802worker1 # [ 0.261118] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127803worker1 # [ 0.261938] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0804lb # [ 0.339465] Memory: 1454564K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)805client # [ 0.318855] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)806lb # [ 0.340739] devtmpfs: initialized807worker1 # [ 0.262943] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto808worker2 # [ 0.350025] NET: Registered PF_NETLINK/PF_ROUTE protocol family809client # [ 0.319884] Performance Events: Fam17h+ core perfctr, AMD PMU driver.810lb # [ 0.341612] x86/mm: Memory block size: 128MB811client # [ 0.320257] ... version: 2812worker1 # [ 0.264938] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl813client # [ 0.321035] ... bit width: 48814worker2 # [ 0.351499] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations815worker1 # [ 0.266938] Transient Scheduler Attacks: Vulnerable: No microcode816client # [ 0.321832] ... generic counters: 6817lb # [ 0.343578] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)818worker2 # [ 0.351983] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations819client # [ 0.322267] ... generic bitmap: 000000000000003f820worker1 # [ 0.267936] Spectre V2 : Mitigation: Enhanced / Automatic IBRS821client # [ 0.323254] ... fixed-purpose counters: 0822lb # [ 0.344382] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).823worker1 # [ 0.269813] Speculative Return Stack Overflow: Mitigation: Safe RET824worker2 # [ 0.353312] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations825client # [ 0.324038] ... fixed-purpose bitmap: 0000000000000000826lb # [ 0.345464] pinctrl core: initialized pinctrl subsystem827worker2 # [ 0.353959] audit: initializing netlink subsys (disabled)828client # [ 0.325015] ... value mask: 0000ffffffffffff829lb # [ 0.346663] PM: RTC time: 07:57:18, date: 2026-09-20830client # [ 0.325254] ... max period: 00007fffffffffff831worker2 # [ 0.355340] thermal_sys: Registered thermal governor 'fair_share'832client # [ 0.326253] ... global_ctrl mask: 000000000000003f833worker2 # [ 0.355343] thermal_sys: Registered thermal governor 'bang_bang'834client # [ 0.327415] signal: max sigframe size: 3376835worker1 # [ 0.270937] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization836worker2 # [ 0.355949] audit: type=2000 audit(1789891038.870:1): state=initialized audit_enabled=0 res=1837client # [ 0.328366] rcu: Hierarchical SRCU implementation.838worker1 # [ 0.272952] Spectre V2 : Enabling IBPB for BPF839lb # [ 0.350506] NET: Registered PF_NETLINK/PF_ROUTE protocol family840client # [ 0.329258] rcu: Max phase no-delay instances is 400.841worker2 # [ 0.357945] thermal_sys: Registered thermal governor 'step_wise'842worker1 # [ 0.273938] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier843worker2 # [ 0.357947] thermal_sys: Registered thermal governor 'user_space'844lb # [ 0.351918] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations845worker1 # [ 0.274939] active return thunk: srso_alias_return_thunk846worker2 # [ 0.358942] thermal_sys: Registered thermal governor 'power_allocator'847lb # [ 0.352381] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations848worker2 # [ 0.359981] cpuidle: using governor menu849worker1 # [ 0.276766] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'850lb # [ 0.353658] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations851worker2 # [ 0.362376] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5852worker1 # [ 0.277937] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'853lb # [ 0.354383] audit: initializing netlink subsys (disabled)854client # [ 0.335492] smp: Bringing up secondary CPUs ...855worker1 # [ 0.278938] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'856lb # [ 0.355668] thermal_sys: Registered thermal governor 'fair_share'857worker2 # [ 0.363262] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]858client # [ 0.336273] smp: Brought up 1 node, 1 CPU859worker1 # [ 0.280937] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'860lb # [ 0.355671] thermal_sys: Registered thermal governor 'bang_bang'861worker2 # [ 0.363946] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry862client # [ 0.337046] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)863worker1 # [ 0.281938] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'864worker2 # [ 0.364959] PCI: Using configuration type 1 for base access865lb # [ 0.356354] audit: type=2000 audit(1789891038.881:1): state=initialized audit_enabled=0 res=1866worker1 # [ 0.282937] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'867lb # [ 0.358350] thermal_sys: Registered thermal governor 'step_wise'868client # [ 0.338470] Memory: 1454568K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109348K reserved, 0K cma-reserved)869worker2 # [ 0.366186] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.870lb # [ 0.358351] thermal_sys: Registered thermal governor 'user_space'871client # [ 0.339616] devtmpfs: initialized872worker1 # [ 0.284938] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'873lb # [ 0.359349] thermal_sys: Registered thermal governor 'power_allocator'874client # [ 0.340459] x86/mm: Memory block size: 128MB875worker1 # [ 0.285938] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256876lb # [ 0.360371] cpuidle: using governor menu877worker1 # [ 0.287938] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64878lb # [ 0.362714] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5879client # [ 0.342465] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)880worker1 # [ 0.288938] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512881worker2 # [ 0.371277] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages882lb # [ 0.363625] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]883worker1 # [ 0.289937] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024884worker2 # [ 0.371945] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page885client # [ 0.343331] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).886lb # [ 0.364353] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry887worker1 # [ 0.290938] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8888worker2 # [ 0.372944] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages889lb # [ 0.365364] PCI: Using configuration type 1 for base access890client # [ 0.344417] pinctrl core: initialized pinctrl subsystem891worker1 # [ 0.292938] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.892lb # [ 0.366612] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.893client # [ 0.345783] PM: RTC time: 07:57:18, date: 2026-09-20894client # [ 0.351016] NET: Registered PF_NETLINK/PF_ROUTE protocol family895worker2 # [ 0.381943] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page896lb # [ 0.374379] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages897client # [ 0.353267] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations898lb # [ 0.375351] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page899client # [ 0.354293] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations900lb # [ 0.378363] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages901client # [ 0.355715] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations902lb # [ 0.379351] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page903client # [ 0.356282] audit: initializing netlink subsys (disabled)904worker2 # [ 0.390281] ACPI: Added _OSI(Module Device)905worker2 # [ 0.390945] ACPI: Added _OSI(Processor Device)906client # [ 0.357770] thermal_sys: Registered thermal governor 'fair_share'907worker2 # [ 0.391768] ACPI: Added _OSI(Processor Aggregator Device)908client # [ 0.357773] thermal_sys: Registered thermal governor 'bang_bang'909client # [ 0.358259] thermal_sys: Registered thermal governor 'step_wise'910client # [ 0.359264] audit: type=2000 audit(1789891038.903:1): state=initialized audit_enabled=0 res=1911client # [ 0.361262] thermal_sys: Registered thermal governor 'user_space'912lb # [ 0.389934] ACPI: Added _OSI(Module Device)913client # [ 0.361265] thermal_sys: Registered thermal governor 'power_allocator'914lb # [ 0.390352] ACPI: Added _OSI(Processor Device)915client # [ 0.362319] cpuidle: using governor menu916lb # [ 0.391183] ACPI: Added _OSI(Processor Aggregator Device)917worker2 # [ 0.402389] ACPI: 1 ACPI AML tables successfully acquired and loaded918client # [ 0.365215] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5919client # [ 0.366778] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]920worker2 # [ 0.406441] ACPI: Interpreter enabled921client # [ 0.368261] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry922worker2 # [ 0.406962] ACPI: PM: (supports S0 S3 S4 S5)923worker2 # [ 0.407753] ACPI: Using IOAPIC for interrupt routing924client # [ 0.369278] PCI: Using configuration type 1 for base access925client # [ 0.370643] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.926worker2 # [ 0.411021] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug927worker2 # [ 0.411944] PCI: Using E820 reservations for host bridge windows928lb # [ 0.404897] ACPI: 1 ACPI AML tables successfully acquired and loaded929worker1 # [ 0.335273] Freeing SMP alternatives memory: 44K930worker1 # [ 0.335945] pid_max: default: 32768 minimum: 301931lb # [ 0.406515] ACPI: Interpreter enabled932worker2 # [ 0.415124] ACPI: Enabled 2 GPEs in block 00 to 3F933lb # [ 0.407241] ACPI: PM: (supports S0 S3 S4 S5)934worker1 # [ 0.337063] LSM: initializing lsm=capability,landlock,yama,bpf,ima935lb # [ 0.407931] ACPI: Using IOAPIC for interrupt routing936worker1 # [ 0.338098] landlock: Up and running.937worker1 # [ 0.339521] Yama: becoming mindful.938worker1 # [ 0.340194] LSM support for eBPF active939client # [ 0.379591] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages940worker1 # [ 0.341100] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)941client # [ 0.380257] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page942worker1 # [ 0.341977] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)943client # [ 0.381256] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages944lb # [ 0.412450] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug945lb # [ 0.413352] PCI: Using E820 reservations for host bridge windows946worker1 # [ 0.344815] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1)947worker2 # [ 0.424405] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])948worker2 # [ 0.425151] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]949worker1 # [ 0.345597] Performance Events: Fam17h+ core perfctr, AMD PMU driver.950lb # [ 0.416532] ACPI: Enabled 2 GPEs in block 00 to 3F951worker1 # [ 0.345943] ... version: 2952worker2 # [ 0.426044] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]953worker1 # [ 0.346806] ... bit width: 48954worker1 # [ 0.347550] ... generic counters: 6955client # [ 0.388254] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page956worker2 # [ 0.427083] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]957worker1 # [ 0.347960] ... generic bitmap: 000000000000003f958worker2 # [ 0.428395] PCI host bridge to bus 0000:00959worker1 # [ 0.348938] ... fixed-purpose counters: 0960worker1 # [ 0.349725] ... fixed-purpose bitmap: 0000000000000000961worker2 # [ 0.428950] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]962worker1 # [ 0.350677] ... value mask: 0000ffffffffffff963worker2 # [ 0.429943] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]964worker1 # [ 0.350939] ... max period: 00007fffffffffff965worker2 # [ 0.430943] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]966worker1 # [ 0.351922] ... global_ctrl mask: 000000000000003f967worker1 # [ 0.352827] signal: max sigframe size: 3376968worker2 # [ 0.431946] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]969lb # [ 0.425989] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])970worker1 # [ 0.353755] rcu: Hierarchical SRCU implementation.971worker2 # [ 0.432942] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]972worker1 # [ 0.354681] rcu: Max phase no-delay instances is 400.973lb # [ 0.426401] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]974client # [ 0.397739] ACPI: Added _OSI(Module Device)975worker2 # [ 0.433942] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]976client # [ 0.398256] ACPI: Added _OSI(Processor Device)977worker2 # [ 0.434944] pci_bus 0000:00: root bus resource [bus 00-ff]978lb # [ 0.427486] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]979client # [ 0.399107] ACPI: Added _OSI(Processor Aggregator Device)980lb # [ 0.428556] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]981worker2 # [ 0.436148] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint982lb # [ 0.429821] PCI host bridge to bus 0000:00983worker2 # [ 0.437491] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint984lb # [ 0.430356] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]985lb # [ 0.431350] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]986worker1 # [ 0.362327] smp: Bringing up secondary CPUs ...987lb # [ 0.432351] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]988worker1 # [ 0.362969] smp: Brought up 1 node, 1 CPU989lb # [ 0.433350] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]990worker1 # [ 0.363902] smpboot: Total of 1 processors activated (4800.02 BogoMIPS)991lb # [ 0.434350] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]992client # [ 0.409447] ACPI: 1 ACPI AML tables successfully acquired and loaded993lb # [ 0.435351] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]994worker1 # [ 0.365198] Memory: 1454556K/1572312K available (17223K kernel code, 2726K rwdata, 13584K rodata, 3644K init, 2988K bss, 109344K reserved, 0K cma-reserved)995lb # [ 0.436355] pci_bus 0000:00: root bus resource [bus 00-ff]996worker1 # [ 0.366403] devtmpfs: initialized997worker2 # [ 0.440111] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]998worker1 # [ 0.367143] x86/mm: Memory block size: 128MB999worker2 # [ 0.440958] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1000lb # [ 0.437529] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1001client # [ 0.413496] ACPI: Interpreter enabled1002worker2 # [ 0.441967] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1003client # [ 0.414256] ACPI: PM: (supports S0 S3 S4 S5)1004lb # [ 0.438926] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1005worker1 # [ 0.369344] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear)1006client # [ 0.415091] ACPI: Using IOAPIC for interrupt routing1007worker2 # [ 0.443175] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1008worker1 # [ 0.369983] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear).1009worker1 # [ 0.371058] pinctrl core: initialized pinctrl subsystem1010worker2 # [ 0.444875] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1011worker1 # [ 0.372333] PM: RTC time: 07:57:19, date: 2026-09-201012client # [ 0.420327] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1013worker2 # [ 0.447973] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1014client # [ 0.421255] PCI: Using E820 reservations for host bridge windows1015worker2 # [ 0.448951] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1016worker1 # [ 0.376169] NET: Registered PF_NETLINK/PF_ROUTE protocol family1017worker2 # [ 0.449980] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1018lb # [ 0.441442] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1019worker2 # [ 0.450949] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1020client # [ 0.424453] ACPI: Enabled 2 GPEs in block 00 to 3F1021worker1 # [ 0.377594] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations1022lb # [ 0.442368] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1023lb # [ 0.443379] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1024worker1 # [ 0.378985] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations1025worker2 # [ 0.452675] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1026lb # [ 0.444603] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1027worker1 # [ 0.380292] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations1028worker1 # [ 0.380960] audit: initializing netlink subsys (disabled)1029worker2 # [ 0.455944] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1030worker2 # [ 0.456903] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1031worker1 # [ 0.382354] thermal_sys: Registered thermal governor 'fair_share'1032lb # [ 0.446404] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1033worker2 # [ 0.457771] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1034worker1 # [ 0.382356] thermal_sys: Registered thermal governor 'bang_bang'1035client # [ 0.432369] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1036worker1 # [ 0.382941] thermal_sys: Registered thermal governor 'step_wise'1037worker2 # [ 0.459576] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1038client # [ 0.433264] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1039worker1 # [ 0.383945] audit: type=2000 audit(1789891038.974:1): state=initialized audit_enabled=0 res=11040lb # [ 0.449362] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1041worker1 # [ 0.385945] thermal_sys: Registered thermal governor 'user_space'1042client # [ 0.434376] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1043lb # [ 0.450371] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1044worker2 # [ 0.461981] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1045worker1 # [ 0.385947] thermal_sys: Registered thermal governor 'power_allocator'1046client # [ 0.435401] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1047lb # [ 0.451379] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1048worker1 # [ 0.386987] cpuidle: using governor menu1049worker2 # [ 0.462950] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1050client # [ 0.436677] PCI host bridge to bus 0000:001051lb # [ 0.452357] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1052worker2 # [ 0.463967] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1053worker1 # [ 0.389389] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.51054client # [ 0.437264] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1055client # [ 0.438255] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1056worker1 # [ 0.390251] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]1057worker2 # [ 0.465756] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1058lb # [ 0.454163] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1059client # [ 0.439255] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1060worker1 # [ 0.390944] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry1061worker1 # [ 0.391957] PCI: Using configuration type 1 for base access1062client # [ 0.440255] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1063lb # [ 0.457361] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1064worker1 # [ 0.393203] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.1065worker2 # [ 0.469209] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1066lb # [ 0.458359] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1067client # [ 0.441255] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1068worker2 # [ 0.469951] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1069client # [ 0.442258] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1070client # [ 0.443284] pci_bus 0000:00: root bus resource [bus 00-ff]1071worker2 # [ 0.470967] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1072lb # [ 0.459378] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1073client # [ 0.444406] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1074worker2 # [ 0.472741] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1075lb # [ 0.461164] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1076client # [ 0.445845] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1077worker1 # [ 0.402202] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages1078worker2 # [ 0.475971] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1079lb # [ 0.464878] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1080worker1 # [ 0.402941] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page1081worker2 # [ 0.477687] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1082lb # [ 0.465358] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1083worker2 # [ 0.478759] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1084lb # [ 0.466378] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1085worker2 # [ 0.480692] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1086client # [ 0.448362] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1087lb # [ 0.468147] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1088worker1 # [ 0.407941] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages1089client # [ 0.449271] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1090worker1 # [ 0.408942] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page1091worker2 # [ 0.483957] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1092client # [ 0.450281] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1093worker2 # [ 0.484951] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1094lb # [ 0.471361] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1095client # [ 0.451519] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1096worker2 # [ 0.485968] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1097lb # [ 0.472358] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1098lb # [ 0.473378] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1099worker2 # [ 0.487685] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1100client # [ 0.453191] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1101lb # [ 0.475166] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1102worker2 # [ 0.489955] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1103client # [ 0.456282] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1104worker2 # [ 0.490936] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1105client # [ 0.457263] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1106worker2 # [ 0.491969] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1107lb # [ 0.478303] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1108worker2 # [ 0.492950] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1109client # [ 0.458569] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1110lb # [ 0.479191] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1111worker1 # [ 0.420561] ACPI: Added _OSI(Module Device)1112client # [ 0.459260] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1113worker1 # [ 0.420943] ACPI: Added _OSI(Processor Device)1114lb # [ 0.480301] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1115worker2 # [ 0.494945] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1116worker1 # [ 0.421926] ACPI: Added _OSI(Processor Aggregator Device)1117client # [ 0.460972] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1118worker2 # [ 0.496934] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1119lb # [ 0.482146] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1120worker2 # [ 0.497971] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1121client # [ 0.463284] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1122client # [ 0.464264] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1123lb # [ 0.485361] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1124worker2 # [ 0.499618] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1125lb # [ 0.486358] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1126client # [ 0.465279] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1127lb # [ 0.487379] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1128worker2 # [ 0.502972] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1129client # [ 0.466986] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1130worker2 # [ 0.503954] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1131lb # [ 0.489150] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1132worker1 # [ 0.432254] ACPI: 1 ACPI AML tables successfully acquired and loaded1133worker2 # [ 0.504967] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1134client # [ 0.469264] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1135client # [ 0.470254] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1136worker2 # [ 0.506652] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1137client # [ 0.471283] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1138worker1 # [ 0.436173] ACPI: Interpreter enabled1139lb # [ 0.492361] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1140worker1 # [ 0.436963] ACPI: PM: (supports S0 S3 S4 S5)1141worker2 # [ 0.508963] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1142lb # [ 0.493359] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1143client # [ 0.472963] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1144worker1 # [ 0.437915] ACPI: Using IOAPIC for interrupt routing1145worker2 # [ 0.509936] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1146lb # [ 0.494378] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1147worker2 # [ 0.510973] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1148lb # [ 0.495357] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1149client # [ 0.476290] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1150worker2 # [ 0.513047] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1151lb # [ 0.497151] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1152client # [ 0.477265] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1153client # [ 0.478279] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1154worker2 # [ 0.514679] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1155worker1 # [ 0.443061] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug1156worker1 # [ 0.443941] PCI: Using E820 reservations for host bridge windows1157lb # [ 0.499796] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1158worker2 # [ 0.515206] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1159client # [ 0.479953] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1160lb # [ 0.500379] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1161worker2 # [ 0.516640] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1162worker1 # [ 0.447134] ACPI: Enabled 2 GPEs in block 00 to 3F1163client # [ 0.482281] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1164lb # [ 0.502110] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1165client # [ 0.483261] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1166client # [ 0.484280] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1167lb # [ 0.504360] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1168lb # [ 0.505324] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1169client # [ 0.486044] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1170lb # [ 0.506183] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1171lb # [ 0.508362] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1172worker1 # [ 0.455822] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])1173client # [ 0.489295] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1174worker1 # [ 0.456846] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]1175lb # [ 0.510365] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1176client # [ 0.490286] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1177lb # [ 0.511356] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1178worker1 # [ 0.458055] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR]1179lb # [ 0.512373] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1180worker2 # [ 0.517198] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1181client # [ 0.491307] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1182worker1 # [ 0.459117] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability]1183lb # [ 0.514013] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1184worker1 # [ 0.460596] PCI host bridge to bus 0000:001185worker2 # [ 0.520569] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1186worker1 # [ 0.460948] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]1187client # [ 0.494341] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1188lb # [ 0.516227] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1189worker1 # [ 0.461939] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]1190worker2 # [ 0.521305] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1191lb # [ 0.517311] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1192worker1 # [ 0.462941] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]1193worker2 # [ 0.522952] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1194client # [ 0.497275] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1195lb # [ 0.518977] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1196worker1 # [ 0.463941] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window]1197client # [ 0.498270] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1198worker2 # [ 0.524258] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1199worker1 # [ 0.464940] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]1200worker2 # [ 0.525272] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1201worker1 # [ 0.465941] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window]1202client # [ 0.499311] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1203worker1 # [ 0.466941] pci_bus 0000:00: root bus resource [bus 00-ff]1204worker2 # [ 0.526245] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1205client # [ 0.501273] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1206worker1 # [ 0.468176] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint1207worker2 # [ 0.528064] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1208client # [ 0.503269] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1209worker1 # [ 0.469516] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint1210worker2 # [ 0.529007] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1211worker2 # [ 0.530617] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1212client # [ 0.506088] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1213worker2 # [ 0.532975] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1214client # [ 0.507296] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1215lb # [ 0.519593] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1216lb # [ 0.522002] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1217client # [ 0.509221] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1218lb # [ 0.522618] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1219worker2 # [ 0.537701] ACPI: PCI: Interrupt link LNKA configured for IRQ 101220worker1 # [ 0.473054] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]1221lb # [ 0.523953] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1222worker2 # [ 0.538887] ACPI: PCI: Interrupt link LNKB configured for IRQ 101223worker1 # [ 0.473961] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff]1224worker2 # [ 0.539833] ACPI: PCI: Interrupt link LNKC configured for IRQ 111225client # [ 0.512305] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1226lb # [ 0.524648] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1227worker1 # [ 0.474967] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref]1228worker2 # [ 0.540846] ACPI: PCI: Interrupt link LNKD configured for IRQ 111229client # [ 0.513273] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1230lb # [ 0.525673] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1231worker2 # [ 0.541861] ACPI: PCI: Interrupt link LNKE configured for IRQ 101232worker1 # [ 0.476300] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]1233worker2 # [ 0.542851] ACPI: PCI: Interrupt link LNKF configured for IRQ 101234lb # [ 0.526646] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1235client # [ 0.514292] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1236worker2 # [ 0.543850] ACPI: PCI: Interrupt link LNKG configured for IRQ 111237worker1 # [ 0.478112] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1238lb # [ 0.528382] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1239worker2 # [ 0.545093] ACPI: PCI: Interrupt link LNKH configured for IRQ 111240client # [ 0.516268] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1241lb # [ 0.529315] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1242worker2 # [ 0.545991] ACPI: PCI: Interrupt link GSIA configured for IRQ 161243worker2 # [ 0.546961] ACPI: PCI: Interrupt link GSIB configured for IRQ 171244lb # [ 0.531012] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1245worker1 # [ 0.480967] pci 0000:00:02.0: BAR 0 [io 0xc140-0xc15f]1246worker2 # [ 0.547965] ACPI: PCI: Interrupt link GSIC configured for IRQ 181247worker2 # [ 0.548957] ACPI: PCI: Interrupt link GSID configured for IRQ 191248client # [ 0.519294] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1249lb # [ 0.532980] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1250worker1 # [ 0.481950] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff]1251worker2 # [ 0.549958] ACPI: PCI: Interrupt link GSIE configured for IRQ 201252client # [ 0.520271] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1253worker1 # [ 0.482972] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref]1254worker2 # [ 0.550956] ACPI: PCI: Interrupt link GSIF configured for IRQ 211255worker1 # [ 0.483947] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref]1256worker2 # [ 0.551997] ACPI: PCI: Interrupt link GSIG configured for IRQ 221257client # [ 0.521324] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1258worker2 # [ 0.552957] ACPI: PCI: Interrupt link GSIH configured for IRQ 231259lb # [ 0.536663] ACPI: PCI: Interrupt link LNKA configured for IRQ 101260worker1 # [ 0.485670] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1261lb # [ 0.537474] ACPI: PCI: Interrupt link LNKB configured for IRQ 101262worker2 # [ 0.555253] iommu: Default domain type: Translated1263client # [ 0.523288] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1264worker2 # [ 0.555953] iommu: DMA domain TLB invalidation policy: lazy mode1265lb # [ 0.538534] ACPI: PCI: Interrupt link LNKC configured for IRQ 111266worker2 # [ 0.557258] ACPI: bus type USB registered1267worker1 # [ 0.488972] pci 0000:00:03.0: BAR 0 [io 0xc160-0xc17f]1268lb # [ 0.539476] ACPI: PCI: Interrupt link LNKD configured for IRQ 111269client # [ 0.525312] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1270worker2 # [ 0.558018] usbcore: registered new interface driver usbfs1271lb # [ 0.540460] ACPI: PCI: Interrupt link LNKE configured for IRQ 101272worker1 # [ 0.489952] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff]1273worker2 # [ 0.558961] usbcore: registered new interface driver hub1274lb # [ 0.541457] ACPI: PCI: Interrupt link LNKF configured for IRQ 101275worker2 # [ 0.559925] usbcore: registered new device driver usb1276client # [ 0.526678] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1277worker1 # [ 0.490977] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref]1278lb # [ 0.542460] ACPI: PCI: Interrupt link LNKG configured for IRQ 111279worker2 # [ 0.561626] NetLabel: Initializing1280lb # [ 0.543458] ACPI: PCI: Interrupt link LNKH configured for IRQ 111281worker2 # [ 0.561943] NetLabel: domain hash size = 1281282client # [ 0.528289] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1283worker1 # [ 0.492797] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1284lb # [ 0.544404] ACPI: PCI: Interrupt link GSIA configured for IRQ 161285worker2 # [ 0.562733] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1286lb # [ 0.545365] ACPI: PCI: Interrupt link GSIB configured for IRQ 171287worker2 # [ 0.563745] NetLabel: unlabeled traffic allowed by default1288lb # [ 0.546365] ACPI: PCI: Interrupt link GSIC configured for IRQ 181289worker2 # [ 0.564694] PCI: Using ACPI for IRQ routing1290worker1 # [ 0.495956] pci 0000:00:04.0: BAR 0 [io 0xc080-0xc0bf]1291lb # [ 0.547366] ACPI: PCI: Interrupt link GSID configured for IRQ 191292lb # [ 0.548362] ACPI: PCI: Interrupt link GSIE configured for IRQ 201293worker1 # [ 0.496950] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff]1294lb # [ 0.549362] ACPI: PCI: Interrupt link GSIF configured for IRQ 211295worker1 # [ 0.497972] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref]1296lb # [ 0.550362] ACPI: PCI: Interrupt link GSIG configured for IRQ 221297lb # [ 0.551363] ACPI: PCI: Interrupt link GSIH configured for IRQ 231298worker1 # [ 0.499774] pci 0000:00:05.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1299lb # [ 0.553801] iommu: Default domain type: Translated1300lb # [ 0.554358] iommu: DMA domain TLB invalidation policy: lazy mode1301worker1 # [ 0.501973] pci 0000:00:05.0: BAR 0 [io 0xc180-0xc19f]1302lb # [ 0.555659] ACPI: bus type USB registered1303worker1 # [ 0.502950] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff]1304lb # [ 0.556422] usbcore: registered new interface driver usbfs1305lb # [ 0.557374] usbcore: registered new interface driver hub1306worker1 # [ 0.503973] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref]1307lb # [ 0.558363] usbcore: registered new device driver usb1308lb # [ 0.560414] NetLabel: Initializing1309worker1 # [ 0.505791] pci 0000:00:06.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint1310lb # [ 0.561097] NetLabel: domain hash size = 1281311lb # [ 0.561350] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1312client # [ 0.529794] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1313lb # [ 0.562419] NetLabel: unlabeled traffic allowed by default1314worker1 # [ 0.508867] pci 0000:00:06.0: BAR 0 [io 0xc1a0-0xc1bf]1315lb # [ 0.563363] PCI: Using ACPI for IRQ routing1316worker1 # [ 0.509790] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff]1317worker1 # [ 0.510808] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref]1318client # [ 0.533122] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1319worker1 # [ 0.512589] pci 0000:00:07.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint1320client # [ 0.535067] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1321client # [ 0.537294] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1322worker1 # [ 0.516181] pci 0000:00:07.0: BAR 0 [io 0xc000-0xc07f]1323worker1 # [ 0.517635] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff]1324client # [ 0.538750] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1325worker1 # [ 0.517965] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref]1326client # [ 0.539754] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1327worker1 # [ 0.519678] pci 0000:00:08.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint1328client # [ 0.541734] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1329worker1 # [ 0.521948] pci 0000:00:08.0: BAR 0 [io 0xc1c0-0xc1df]1330worker1 # [ 0.522874] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff]1331worker1 # [ 0.523725] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref]1332client # [ 0.544322] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1333worker1 # [ 0.524945] pci 0000:00:08.0: ROM [mem 0xfeb80000-0xfebbffff pref]1334client # [ 0.545271] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1335worker1 # [ 0.526657] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint1336client # [ 0.546882] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1337worker1 # [ 0.528970] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff]1338worker1 # [ 0.529964] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref]1339client # [ 0.549304] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1340worker1 # [ 0.531591] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint1341worker1 # [ 0.534792] pci 0000:00:0a.0: BAR 0 [io 0xc0c0-0xc0ff]1342worker2 # [ 0.613538] pci 0000:00:01.0: vgaarb: setting as boot VGA device1343worker1 # [ 0.535641] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff]1344worker2 # [ 0.613938] pci 0000:00:01.0: vgaarb: bridge control possible1345client # [ 0.555068] ACPI: PCI: Interrupt link LNKA configured for IRQ 101346worker1 # [ 0.535963] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref]1347worker2 # [ 0.613938] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1348client # [ 0.556436] ACPI: PCI: Interrupt link LNKB configured for IRQ 101349worker2 # [ 0.613950] vgaarb: loaded1350worker1 # [ 0.537602] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint1351worker2 # [ 0.614766] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01352client # [ 0.557450] ACPI: PCI: Interrupt link LNKC configured for IRQ 111353worker2 # [ 0.615581] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1354worker1 # [ 0.539948] pci 0000:00:0b.0: BAR 0 [io 0xc1e0-0xc1ff]1355client # [ 0.558460] ACPI: PCI: Interrupt link LNKD configured for IRQ 111356worker1 # [ 0.540881] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff]1357client # [ 0.559431] ACPI: PCI: Interrupt link LNKE configured for IRQ 101358worker1 # [ 0.541744] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref]1359client # [ 0.560438] ACPI: PCI: Interrupt link LNKF configured for IRQ 101360worker2 # [ 0.619052] clocksource: Switched to clocksource kvm-clock1361worker1 # [ 0.544199] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint1362client # [ 0.561474] ACPI: PCI: Interrupt link LNKG configured for IRQ 111363worker2 # [ 0.620970] VFS: Disk quotas dquot_6.6.01364worker1 # [ 0.545623] pci 0000:00:1d.0: BAR 4 [io 0xc200-0xc21f]1365client # [ 0.562428] ACPI: PCI: Interrupt link LNKH configured for IRQ 111366worker1 # [ 0.546192] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint1367client # [ 0.563325] ACPI: PCI: Interrupt link GSIA configured for IRQ 161368worker2 # [ 0.623967] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1369worker2 # [ 0.625544] pnp: PnP ACPI init1370client # [ 0.564319] ACPI: PCI: Interrupt link GSIB configured for IRQ 171371worker1 # [ 0.547594] pci 0000:00:1d.1: BAR 4 [io 0xc220-0xc23f]1372lb # [ 0.611218] pci 0000:00:01.0: vgaarb: setting as boot VGA device1373worker2 # [ 0.626511] ACPI: IRQ 4 override to edge(!), high(!)1374client # [ 0.565295] ACPI: PCI: Interrupt link GSIC configured for IRQ 181375lb # [ 0.611345] pci 0000:00:01.0: vgaarb: bridge control possible1376worker2 # [ 0.627603] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1377client # [ 0.566289] ACPI: PCI: Interrupt link GSID configured for IRQ 191378lb # [ 0.611345] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1379worker2 # [ 0.629366] pnp: PnP ACPI: found 6 devices1380lb # [ 0.611356] vgaarb: loaded1381client # [ 0.567295] ACPI: PCI: Interrupt link GSIE configured for IRQ 201382lb # [ 0.612283] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01383client # [ 0.568299] ACPI: PCI: Interrupt link GSIF configured for IRQ 211384lb # [ 0.613015] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1385client # [ 0.569299] ACPI: PCI: Interrupt link GSIG configured for IRQ 221386client # [ 0.570339] ACPI: PCI: Interrupt link GSIH configured for IRQ 231387lb # [ 0.615482] clocksource: Switched to clocksource kvm-clock1388client # [ 0.573287] iommu: Default domain type: Translated1389worker2 # [ 0.637476] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1390lb # [ 0.619696] VFS: Disk quotas dquot_6.6.01391worker2 # [ 0.639396] clocksource: Switched to clocksource acpi_pm1392client # [ 0.574300] iommu: DMA domain TLB invalidation policy: lazy mode1393lb # [ 0.620591] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1394worker2 # [ 0.640673] NET: Registered PF_INET protocol family1395client # [ 0.575772] ACPI: bus type USB registered1396worker1 # [ 0.548217] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint1397lb # [ 0.623033] pnp: PnP ACPI init1398client # [ 0.576379] usbcore: registered new interface driver usbfs1399worker2 # [ 0.642284] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1400lb # [ 0.624039] ACPI: IRQ 4 override to edge(!), high(!)1401client # [ 0.577294] usbcore: registered new interface driver hub1402worker1 # [ 0.550991] pci 0000:00:1d.2: BAR 4 [io 0xc240-0xc25f]1403lb # [ 0.625164] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1404client # [ 0.578288] usbcore: registered new device driver usb1405lb # [ 0.626957] pnp: PnP ACPI: found 6 devices1406worker1 # [ 0.552440] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint1407client # [ 0.580759] NetLabel: Initializing1408client # [ 0.581257] NetLabel: domain hash size = 1281409worker1 # [ 0.553970] pci 0000:00:1d.7: BAR 0 [mem 0xfebdb000-0xfebdbfff]1410client # [ 0.582258] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1411worker1 # [ 0.555342] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint1412client # [ 0.583330] NetLabel: unlabeled traffic allowed by default1413client # [ 0.584287] PCI: Using ACPI for IRQ routing1414worker1 # [ 0.556270] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO1415worker1 # [ 0.557329] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint1416lb # [ 0.635104] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1417lb # [ 0.636815] clocksource: Switched to clocksource acpi_pm1418lb # [ 0.638065] NET: Registered PF_INET protocol family1419worker1 # [ 0.560048] pci 0000:00:1f.2: BAR 4 [io 0xc260-0xc27f]1420lb # [ 0.639423] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1421worker1 # [ 0.560949] pci 0000:00:1f.2: BAR 5 [mem 0xfebdc000-0xfebdcfff]1422worker1 # [ 0.562602] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint1423worker2 # [ 0.661946] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1424worker2 # [ 0.663826] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1425worker1 # [ 0.565417] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f]1426worker2 # [ 0.665523] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1427worker2 # [ 0.667061] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1428worker2 # [ 0.668514] TCP: Hash tables configured (established 16384 bind 16384)1429worker1 # [ 0.569572] ACPI: PCI: Interrupt link LNKA configured for IRQ 101430worker2 # [ 0.669828] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1431worker1 # [ 0.570078] ACPI: PCI: Interrupt link LNKB configured for IRQ 101432worker2 # [ 0.671405] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1433worker1 # [ 0.571097] ACPI: PCI: Interrupt link LNKC configured for IRQ 111434worker2 # [ 0.672624] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1435worker1 # [ 0.572055] ACPI: PCI: Interrupt link LNKD configured for IRQ 111436worker2 # [ 0.674010] NET: Registered PF_UNIX/PF_LOCAL protocol family1437worker2 # [ 0.675105] NET: Registered PF_XDP protocol family1438worker1 # [ 0.573113] ACPI: PCI: Interrupt link LNKE configured for IRQ 101439worker2 # [ 0.676043] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1440worker1 # [ 0.574088] ACPI: PCI: Interrupt link LNKF configured for IRQ 101441worker2 # [ 0.677140] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1442worker1 # [ 0.575112] ACPI: PCI: Interrupt link LNKG configured for IRQ 111443worker2 # [ 0.678264] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1444worker1 # [ 0.576092] ACPI: PCI: Interrupt link LNKH configured for IRQ 111445worker2 # [ 0.679506] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1446worker1 # [ 0.576995] ACPI: PCI: Interrupt link GSIA configured for IRQ 161447lb # [ 0.660448] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1448worker2 # [ 0.680753] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1449worker1 # [ 0.577964] ACPI: PCI: Interrupt link GSIB configured for IRQ 171450worker2 # [ 0.682029] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1451lb # [ 0.662206] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1452worker1 # [ 0.578968] ACPI: PCI: Interrupt link GSIC configured for IRQ 181453worker2 # [ 0.683929] ACPI: \_SB_.GSIA: Enabled at IRQ 161454lb # [ 0.663665] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1455worker1 # [ 0.579972] ACPI: PCI: Interrupt link GSID configured for IRQ 191456lb # [ 0.665174] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1457worker1 # [ 0.580960] ACPI: PCI: Interrupt link GSIE configured for IRQ 201458worker2 # [ 0.686356] ACPI: \_SB_.GSIB: Enabled at IRQ 171459lb # [ 0.666545] TCP: Hash tables configured (established 16384 bind 16384)1460worker1 # [ 0.581972] ACPI: PCI: Interrupt link GSIF configured for IRQ 211461lb # [ 0.667776] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1462worker1 # [ 0.582962] ACPI: PCI: Interrupt link GSIG configured for IRQ 221463worker2 # [ 0.688758] ACPI: \_SB_.GSIC: Enabled at IRQ 181464lb # [ 0.669188] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1465worker1 # [ 0.583974] ACPI: PCI: Interrupt link GSIH configured for IRQ 231466lb # [ 0.670389] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1467worker2 # [ 0.690884] ACPI: \_SB_.GSID: Enabled at IRQ 191468lb # [ 0.671722] NET: Registered PF_UNIX/PF_LOCAL protocol family1469worker1 # [ 0.586262] iommu: Default domain type: Translated1470worker2 # [ 0.692682] PCI: CLS 0 bytes, default 641471lb # [ 0.672875] NET: Registered PF_XDP protocol family1472worker1 # [ 0.586953] iommu: DMA domain TLB invalidation policy: lazy mode1473lb # [ 0.673810] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1474worker1 # [ 0.588302] ACPI: bus type USB registered1475worker2 # [ 0.693688] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1476lb # [ 0.674956] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1477worker1 # [ 0.589032] usbcore: registered new interface driver usbfs1478worker2 # [ 0.695636] Trying to unpack rootfs image as initramfs...1479lb # [ 0.676043] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1480worker1 # [ 0.589970] usbcore: registered new interface driver hub1481lb # [ 0.677249] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1482worker1 # [ 0.590985] usbcore: registered new device driver usb1483lb # [ 0.678467] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1484lb # [ 0.679670] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1485worker1 # [ 0.593133] NetLabel: Initializing1486worker1 # [ 0.593880] NetLabel: domain hash size = 1281487lb # [ 0.681583] ACPI: \_SB_.GSIA: Enabled at IRQ 161488worker1 # [ 0.594614] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO1489worker1 # [ 0.595004] NetLabel: unlabeled traffic allowed by default1490lb # [ 0.683873] ACPI: \_SB_.GSIB: Enabled at IRQ 171491worker1 # [ 0.595960] PCI: Using ACPI for IRQ routing1492lb # [ 0.686066] ACPI: \_SB_.GSIC: Enabled at IRQ 181493lb # [ 0.688210] ACPI: \_SB_.GSID: Enabled at IRQ 191494lb # [ 0.690061] PCI: CLS 0 bytes, default 641495lb # [ 0.691078] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1496lb # [ 0.693027] Trying to unpack rootfs image as initramfs...1497client # [ 0.651217] pci 0000:00:01.0: vgaarb: setting as boot VGA device1498client # [ 0.651249] pci 0000:00:01.0: vgaarb: bridge control possible1499client # [ 0.651249] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1500client # [ 0.651270] vgaarb: loaded1501client # [ 0.652430] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01502client # [ 0.653263] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1503client # [ 0.657444] clocksource: Switched to clocksource kvm-clock1504client # [ 0.662951] VFS: Disk quotas dquot_6.6.01505client # [ 0.664103] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1506client # [ 0.666271] pnp: PnP ACPI init1507client # [ 0.667539] ACPI: IRQ 4 override to edge(!), high(!)1508worker2 # [ 0.744748] Initialise system trusted keyrings1509client # [ 0.669047] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1510client # [ 0.671440] pnp: PnP ACPI: found 6 devices1511worker2 # [ 0.748259] workingset: timestamp_bits=40 max_order=19 bucket_order=01512worker1 # [ 0.646484] pci 0000:00:01.0: vgaarb: setting as boot VGA device1513worker1 # [ 0.646934] pci 0000:00:01.0: vgaarb: bridge control possible1514worker1 # [ 0.646934] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none1515worker1 # [ 0.646950] vgaarb: loaded1516client # [ 0.681250] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1517worker1 # [ 0.647817] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 01518client # [ 0.683518] clocksource: Switched to clocksource acpi_pm1519worker1 # [ 0.648619] hpet0: 3 comparators, 64-bit 100.000000 MHz counter1520client # [ 0.685007] NET: Registered PF_INET protocol family1521client # [ 0.686839] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1522lb # [ 0.745883] Initialise system trusted keyrings1523worker1 # [ 0.654068] clocksource: Switched to clocksource kvm-clock1524lb # [ 0.748973] workingset: timestamp_bits=40 max_order=19 bucket_order=01525worker1 # [ 0.658143] VFS: Disk quotas dquot_6.6.01526worker1 # [ 0.659002] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)1527worker1 # [ 0.660594] pnp: PnP ACPI init1528worker2 # [ 0.773751] Key type asymmetric registered1529worker1 # [ 0.661530] ACPI: IRQ 4 override to edge(!), high(!)1530worker1 # [ 0.662740] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved1531worker1 # [ 0.664474] pnp: PnP ACPI: found 6 devices1532worker2 # [ 0.778228] Asymmetric key parser 'x509' registered1533worker2 # [ 0.779277] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1534worker2 # [ 0.782413] io scheduler mq-deadline registered1535worker2 # [ 0.783298] io scheduler kyber registered1536worker1 # [ 0.672561] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns1537client # [ 0.710376] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1538worker1 # [ 0.674180] clocksource: Switched to clocksource acpi_pm1539worker2 # [ 0.786911] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1540worker1 # [ 0.675406] NET: Registered PF_INET protocol family1541client # [ 0.712384] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1542worker1 # [ 0.676737] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)1543client # [ 0.714129] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1544worker2 # [ 0.790538] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1545client # [ 0.715855] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1546lb # [ 0.772564] Key type asymmetric registered1547client # [ 0.717435] TCP: Hash tables configured (established 16384 bind 16384)1548client # [ 0.718984] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1549worker2 # [ 0.796281] Linux agpgart interface v0.1031550client # [ 0.720806] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1551worker2 # [ 0.797154] ACPI: bus type drm_connector registered1552lb # [ 0.777945] Asymmetric key parser 'x509' registered1553client # [ 0.722331] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1554lb # [ 0.778968] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1555client # [ 0.724088] NET: Registered PF_UNIX/PF_LOCAL protocol family1556client # [ 0.725486] NET: Registered PF_XDP protocol family1557lb # [ 0.782111] io scheduler mq-deadline registered1558worker2 # [ 0.801824] usbcore: registered new interface driver usbserial_generic1559lb # [ 0.782990] io scheduler kyber registered1560client # [ 0.726658] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1561worker2 # [ 0.803064] usbserial: USB Serial support registered for generic1562client # [ 0.728053] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1563client # [ 0.729458] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1564worker2 # [ 0.806215] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1565client # [ 0.730991] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1566lb # [ 0.787660] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1567worker2 # [ 0.806215] Please enable it if your BIOS has the CPPC option.1568client # [ 0.732579] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1569worker2 # [ 0.808659] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1570worker1 # [ 0.696264] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)1571client # [ 0.734072] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1572worker1 # [ 0.698083] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)1573lb # [ 0.791153] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1574client # [ 0.736614] ACPI: \_SB_.GSIA: Enabled at IRQ 161575worker1 # [ 0.699539] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)1576worker2 # [ 0.813444] drop_monitor: Initializing network drop monitor service1577worker1 # [ 0.701030] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)1578lb # [ 0.795006] Linux agpgart interface v0.1031579worker2 # [ 0.814765] NET: Registered PF_INET6 protocol family1580worker1 # [ 0.702434] TCP: Hash tables configured (established 16384 bind 16384)1581client # [ 0.739670] ACPI: \_SB_.GSIB: Enabled at IRQ 171582lb # [ 0.795861] ACPI: bus type drm_connector registered1583worker1 # [ 0.703721] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear)1584worker1 # [ 0.705143] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear)1585worker2 # [ 0.818743] Segment Routing with IPv61586client # [ 0.742994] ACPI: \_SB_.GSIC: Enabled at IRQ 181587lb # [ 0.799377] usbcore: registered new interface driver usbserial_generic1588worker1 # [ 0.706340] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear)1589worker2 # [ 0.819523] In-situ OAM (IOAM) with IPv61590lb # [ 0.800526] usbserial: USB Serial support registered for generic1591worker1 # [ 0.707704] NET: Registered PF_UNIX/PF_LOCAL protocol family1592worker1 # [ 0.708789] NET: Registered PF_XDP protocol family1593client # [ 0.745942] ACPI: \_SB_.GSID: Enabled at IRQ 191594worker1 # [ 0.709743] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]1595worker2 # [ 0.822692] IPI shorthand broadcast: enabled1596client # [ 0.748307] PCI: CLS 0 bytes, default 641597worker1 # [ 0.710885] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]1598lb # [ 0.803932] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1599lb # [ 0.803932] Please enable it if your BIOS has the CPPC option.1600worker1 # [ 0.712168] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]1601client # [ 0.749493] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1602worker1 # [ 0.713384] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window]1603lb # [ 0.806381] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1604worker1 # [ 0.714587] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]1605client # [ 0.751779] Trying to unpack rootfs image as initramfs...1606worker1 # [ 0.715813] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window]1607worker1 # [ 0.717796] ACPI: \_SB_.GSIA: Enabled at IRQ 161608lb # [ 0.811111] drop_monitor: Initializing network drop monitor service1609worker2 # [ 0.830595] sched_clock: Marking stable (677016795, 153177579)->(906507817, -76313443)1610lb # [ 0.812454] NET: Registered PF_INET6 protocol family1611worker1 # [ 0.720159] ACPI: \_SB_.GSIB: Enabled at IRQ 171612worker1 # [ 0.722404] ACPI: \_SB_.GSIC: Enabled at IRQ 181613lb # [ 0.816547] Segment Routing with IPv61614lb # [ 0.817289] In-situ OAM (IOAM) with IPv61615worker1 # [ 0.724556] ACPI: \_SB_.GSID: Enabled at IRQ 191616worker2 # [ 0.837554] registered taskstats version 11617worker2 # [ 0.838718] Loading compiled-in X.509 certificates1618worker1 # [ 0.726667] PCI: CLS 0 bytes, default 641619lb # [ 0.820382] IPI shorthand broadcast: enabled1620worker1 # [ 0.727852] Trying to unpack rootfs image as initramfs...1621worker1 # [ 0.732179] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229842dd0bd, max_idle_ns: 440795319571 ns1622lb # [ 0.829313] sched_clock: Marking stable (676016794, 152888580)->(915123994, -86218620)1623lb # [ 0.835119] registered taskstats version 11624lb # [ 0.836204] Loading compiled-in X.509 certificates1625worker2 # [ 0.857973] Demotion targets for Node 0: null1626worker2 # [ 0.860339] Key type .fscrypt registered1627worker2 # [ 0.861098] Key type fscrypt-provisioning registered1628worker2 # [ 0.862166] ima: No TPM chip found, activating TPM-bypass!1629worker2 # [ 0.867224] ima: Allocated hash algorithm: sha11630worker2 # [ 0.868121] ima: No architecture policies found1631worker2 # [ 0.871264] PM: Magic number: 10:704:9761632worker2 # [ 0.873172] RAS: Correctable Errors collector initialized.1633lb # [ 0.855811] Demotion targets for Node 0: null1634lb # [ 0.858002] Key type .fscrypt registered1635lb # [ 0.858769] Key type fscrypt-provisioning registered1636lb # [ 0.859822] ima: No TPM chip found, activating TPM-bypass!1637lb # [ 0.862928] ima: Allocated hash algorithm: sha11638lb # [ 0.863847] ima: No architecture policies found1639worker2 # [ 0.884636] clk: Disabling unused clocks1640lb # [ 0.866967] PM: Magic number: 10:704:9761641worker2 # [ 0.887212] PM: genpd: Disabling unused power domains1642lb # [ 0.868847] RAS: Correctable Errors collector initialized.1643client # [ 0.818778] Initialise system trusted keyrings1644worker1 # [ 0.783215] Initialise system trusted keyrings1645worker1 # [ 0.784320] workingset: timestamp_bits=40 max_order=19 bucket_order=01646client # [ 0.822292] workingset: timestamp_bits=40 max_order=19 bucket_order=01647lb # [ 0.882270] clk: Disabling unused clocks1648lb # [ 0.883148] PM: genpd: Disabling unused power domains1649worker1 # [ 0.809435] Key type asymmetric registered1650worker1 # [ 0.812731] Asymmetric key parser 'x509' registered1651worker1 # [ 0.813733] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1652worker1 # [ 0.818871] io scheduler mq-deadline registered1653worker1 # [ 0.819754] io scheduler kyber registered1654client # [ 0.858567] Key type asymmetric registered1655client # [ 0.859562] Asymmetric key parser 'x509' registered1656worker1 # [ 0.823939] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1657worker1 # [ 0.825396] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1658client # [ 0.863147] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)1659client # [ 0.865179] io scheduler mq-deadline registered1660worker1 # [ 0.830728] Linux agpgart interface v0.1031661client # [ 0.868070] io scheduler kyber registered1662worker1 # [ 0.831564] ACPI: bus type drm_connector registered1663client # [ 0.872448] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled1664worker1 # [ 0.836874] usbcore: registered new interface driver usbserial_generic1665worker1 # [ 0.838053] usbserial: USB Serial support registered for generic1666client # [ 0.875385] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A1667worker1 # [ 0.839139] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1668worker1 # [ 0.839139] Please enable it if your BIOS has the CPPC option.1669client # [ 0.883785] Linux agpgart interface v0.1031670worker1 # [ 0.846714] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1671worker1 # [ 0.848308] drop_monitor: Initializing network drop monitor service1672client # [ 0.887272] ACPI: bus type drm_connector registered1673worker1 # [ 0.851912] NET: Registered PF_INET6 protocol family1674worker1 # [ 0.853458] Segment Routing with IPv61675client # [ 0.891309] usbcore: registered new interface driver usbserial_generic1676worker1 # [ 0.855749] In-situ OAM (IOAM) with IPv61677client # [ 0.892765] usbserial: USB Serial support registered for generic1678worker1 # [ 0.858073] IPI shorthand broadcast: enabled1679client # [ 0.896065] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS.1680client # [ 0.896065] Please enable it if your BIOS has the CPPC option.1681client # [ 0.899078] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled1682worker1 # [ 0.866971] sched_clock: Marking stable (696015797, 170674967)->(961697011, -95006247)1683client # [ 0.904403] drop_monitor: Initializing network drop monitor service1684worker1 # [ 0.872066] registered taskstats version 11685client # [ 0.909290] NET: Registered PF_INET6 protocol family1686worker1 # [ 0.873210] Loading compiled-in X.509 certificates1687client # [ 0.913766] Segment Routing with IPv61688client # [ 0.917104] In-situ OAM (IOAM) with IPv61689client # [ 0.918830] IPI shorthand broadcast: enabled1690client # [ 0.931539] sched_clock: Marking stable (775029643, 156012415)->(1049785351, -118743293)1691worker1 # [ 0.895711] Demotion targets for Node 0: null1692worker1 # [ 0.896930] Key type .fscrypt registered1693worker1 # [ 0.897657] Key type fscrypt-provisioning registered1694client # [ 0.938571] registered taskstats version 11695worker1 # [ 0.901863] ima: No TPM chip found, activating TPM-bypass!1696worker1 # [ 0.903036] ima: Allocated hash algorithm: sha11697client # [ 0.942101] Loading compiled-in X.509 certificates1698worker1 # [ 0.905799] ima: No architecture policies found1699worker1 # [ 0.907070] PM: Magic number: 10:704:9761700worker1 # [ 0.911092] RAS: Correctable Errors collector initialized.1701worker1 # [ 0.920619] clk: Disabling unused clocks1702worker1 # [ 0.925717] PM: genpd: Disabling unused power domains1703client # [ 0.967727] Demotion targets for Node 0: null1704client # [ 0.971170] Key type .fscrypt registered1705client # [ 0.972114] Key type fscrypt-provisioning registered1706client # [ 0.975252] ima: No TPM chip found, activating TPM-bypass!1707client # [ 0.976594] ima: Allocated hash algorithm: sha11708client # [ 0.982107] ima: No architecture policies found1709client # [ 0.983639] PM: Magic number: 10:704:9761710client # [ 0.988511] RAS: Correctable Errors collector initialized.1711client # [ 1.004956] clk: Disabling unused clocks1712client # [ 1.008096] PM: genpd: Disabling unused power domains1713worker2 # [ 1.090086] Freeing initrd memory: 29092K1714worker2 # [ 1.093725] Freeing unused decrypted memory: 2028K1715worker2 # [ 1.096588] Freeing unused kernel image (initmem) memory: 3644K1716worker2 # [ 1.097813] Write protecting the kernel read-only data: 32768k1717worker2 # [ 1.099970] Freeing unused kernel image (text/rodata gap) memory: 1208K1718worker2 # [ 1.101665] Freeing unused kernel image (rodata/data gap) memory: 752K1719lb # [ 1.083919] Freeing initrd memory: 29092K1720lb # [ 1.087698] Freeing unused decrypted memory: 2028K1721lb # [ 1.090784] Freeing unused kernel image (initmem) memory: 3644K1722lb # [ 1.092026] Write protecting the kernel read-only data: 32768k1723lb # [ 1.094203] Freeing unused kernel image (text/rodata gap) memory: 1208K1724lb # [ 1.095936] Freeing unused kernel image (rodata/data gap) memory: 752K1725worker2 # [ 1.158791] x86/mm: Checked W+X mappings: passed, no W+X pages found.1726worker2 # [ 1.160065] Run /init as init process1727worker2 # [ 1.171751] systemd[1]: Inserted module 'autofs4'1728lb # [ 1.153615] x86/mm: Checked W+X mappings: passed, no W+X pages found.1729lb # [ 1.154825] Run /init as init process1730lb # [ 1.167015] systemd[1]: Inserted module 'autofs4'1731worker2 # [ 1.191142] fuse: init (API version 7.45)1732worker2 # [ 1.198677] ACPI: \_SB_.GSIG: Enabled at IRQ 221733worker2 # [ 1.201391] ACPI: \_SB_.GSIH: Enabled at IRQ 231734worker2 # [ 1.204778] ACPI: \_SB_.GSIE: Enabled at IRQ 201735lb # [ 1.185917] fuse: init (API version 7.45)1736worker2 # [ 1.207369] ACPI: \_SB_.GSIF: Enabled at IRQ 211737lb # [ 1.192636] ACPI: \_SB_.GSIG: Enabled at IRQ 221738lb # [ 1.195473] ACPI: \_SB_.GSIH: Enabled at IRQ 231739lb # [ 1.199455] ACPI: \_SB_.GSIE: Enabled at IRQ 201740lb # [ 1.202218] ACPI: \_SB_.GSIF: Enabled at IRQ 211741worker2 # [ 1.240141] systemd[1]: Successfully made /usr/ read-only.1742lb # [ 1.235562] systemd[1]: Successfully made /usr/ read-only.1743worker1 # [ 1.147457] Freeing initrd memory: 29092K1744worker1 # [ 1.151166] Freeing unused decrypted memory: 2028K1745worker1 # [ 1.154118] Freeing unused kernel image (initmem) memory: 3644K1746worker1 # [ 1.155367] Write protecting the kernel read-only data: 32768k1747worker1 # [ 1.157560] Freeing unused kernel image (text/rodata gap) memory: 1208K1748worker1 # [ 1.159331] Freeing unused kernel image (rodata/data gap) memory: 752K1749worker1 # [ 1.218654] x86/mm: Checked W+X mappings: passed, no W+X pages found.1750worker1 # [ 1.220074] Run /init as init process1751worker1 # [ 1.231889] systemd[1]: Inserted module 'autofs4'1752worker1 # [ 1.251476] fuse: init (API version 7.45)1753worker1 # [ 1.259212] ACPI: \_SB_.GSIG: Enabled at IRQ 221754worker1 # [ 1.262526] ACPI: \_SB_.GSIH: Enabled at IRQ 231755worker1 # [ 1.266000] ACPI: \_SB_.GSIE: Enabled at IRQ 201756worker1 # [ 1.268732] ACPI: \_SB_.GSIF: Enabled at IRQ 211757client # [ 1.322754] Freeing initrd memory: 29096K1758client # [ 1.327714] Freeing unused decrypted memory: 2028K1759client # [ 1.331711] Freeing unused kernel image (initmem) memory: 3644K1760client # [ 1.333358] Write protecting the kernel read-only data: 32768k1761worker1 # [ 1.297061] systemd[1]: Successfully made /usr/ read-only.1762client # [ 1.336099] Freeing unused kernel image (text/rodata gap) memory: 1208K1763client # [ 1.338310] Freeing unused kernel image (rodata/data gap) memory: 752K1764client # [ 1.405181] x86/mm: Checked W+X mappings: passed, no W+X pages found.1765client # [ 1.406900] Run /init as init process1766client # [ 1.421238] systemd[1]: Inserted module 'autofs4'1767client # [ 1.440292] fuse: init (API version 7.45)1768client # [ 1.447090] ACPI: \_SB_.GSIG: Enabled at IRQ 221769client # [ 1.449767] ACPI: \_SB_.GSIH: Enabled at IRQ 231770client # [ 1.453099] ACPI: \_SB_.GSIE: Enabled at IRQ 201771client # [ 1.455486] ACPI: \_SB_.GSIF: Enabled at IRQ 211772client # [ 1.489634] systemd[1]: Successfully made /usr/ read-only.1773worker2 # [ 1.577014] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1774worker2 # [ 1.584244] systemd[1]: Detected virtualization kvm.1775worker2 # [ 1.585518] systemd[1]: Detected architecture x86-64.1776worker2 # [ 1.586783] systemd[1]: Running in initrd.1777worker2 # [ 1.588413] systemd[1]: Initializing machine ID from random generator.1778worker2 # [ 1.590166] systemd[1]: Hostname set to <worker2>.1779lb # [ 1.571699] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1780lb # [ 1.576976] systemd[1]: Detected virtualization kvm.1781lb # [ 1.577876] systemd[1]: Detected architecture x86-64.1782lb # [ 1.578806] systemd[1]: Running in initrd.1783lb # [ 1.580096] systemd[1]: Initializing machine ID from random generator.1784lb # [ 1.581374] systemd[1]: Hostname set to <lb>.1785worker2 # [ 1.732388] systemd[1]: bpf-restrict-fs: LSM BPF program attached1786worker1 # [ 1.633429] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1787worker1 # [ 1.640847] systemd[1]: Detected virtualization kvm.1788worker1 # [ 1.641942] systemd[1]: Detected architecture x86-64.1789worker1 # [ 1.643302] systemd[1]: Running in initrd.1790worker1 # [ 1.645075] systemd[1]: Initializing machine ID from random generator.1791worker1 # [ 1.646878] systemd[1]: Hostname set to <worker1>.1792worker2 # [ 1.800423] systemd[1]: Queued start job for default target Initrd Default Target.1793worker2 # [ 1.806371] systemd[1]: Created slice Slice /system/modprobe.1794worker2 # [ 1.808132] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1795worker2 # [ 1.810273] systemd[1]: Expecting device /dev/disk/by-label/nixos...1796worker2 # [ 1.811897] systemd[1]: Reached target Path Units.1797worker2 # [ 1.813366] systemd[1]: Reached target Slice Units.1798lb # [ 1.793576] systemd[1]: bpf-restrict-fs: LSM BPF program attached1799worker2 # [ 1.814685] systemd[1]: Reached target Swaps.1800worker2 # [ 1.815848] systemd[1]: Reached target Timer Units.1801worker2 # [ 1.817369] systemd[1]: Listening on D-Bus System Message Bus Socket.1802worker2 # [ 1.819079] systemd[1]: Listening on Journal Socket (/dev/log).1803worker2 # [ 1.820822] systemd[1]: Listening on Journal Sockets.1804worker2 # [ 1.822335] systemd[1]: Listening on udev Control Socket.1805worker2 # [ 1.823806] systemd[1]: Listening on udev Kernel Socket.1806worker2 # [ 1.825237] systemd[1]: Reached target Socket Units.1807worker2 # [ 1.828075] systemd[1]: Starting Create List of Static Device Nodes...1808worker2 # [ 1.833506] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1809worker2 # [ 1.851451] systemd[1]: Starting Load Kernel Module configfs...1810worker2 # [ 1.870409] systemd[1]: Starting Journal Service...1811lb # [ 1.858667] systemd[1]: Queued start job for default target Initrd Default Target.1812worker2 # [ 1.884622] systemd[1]: Starting Load Kernel Modules...1813lb # [ 1.865594] systemd[1]: Created slice Slice /system/modprobe.1814lb # [ 1.867337] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1815lb # [ 1.869439] systemd[1]: Expecting device /dev/disk/by-label/nixos...1816lb # [ 1.871014] systemd[1]: Reached target Path Units.1817lb # [ 1.872277] systemd[1]: Reached target Slice Units.1818lb # [ 1.873464] systemd[1]: Reached target Swaps.1819lb # [ 1.874590] systemd[1]: Reached target Timer Units.1820lb # [ 1.876065] systemd[1]: Listening on D-Bus System Message Bus Socket.1821lb # [ 1.877808] systemd[1]: Listening on Journal Socket (/dev/log).1822lb # [ 1.879702] systemd[1]: Listening on Journal Sockets.1823lb # [ 1.881221] systemd[1]: Listening on udev Control Socket.1824lb # [ 1.882798] systemd[1]: Listening on udev Kernel Socket.1825lb # [ 1.884205] systemd[1]: Reached target Socket Units.1826lb # [ 1.887158] systemd[1]: Starting Create List of Static Device Nodes...1827client # [ 1.826308] systemd[1]: systemd 261.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)1828client # [ 1.832871] systemd[1]: Detected virtualization kvm.1829client # [ 1.833914] systemd[1]: Detected architecture x86-64.1830client # [ 1.835100] systemd[1]: Running in initrd.1831worker2 # [ 1.898408] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1832client # [ 1.836740] systemd[1]: Initializing machine ID from random generator.1833lb # [ 1.893415] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1834client # [ 1.838416] systemd[1]: Hostname set to <client>.1835worker2 # [ 1.915527] netfs: FS-Cache loaded1836worker2 # [ 1.921670] 9pnet: Installing 9P2000 support1837lb # [ 1.905075] systemd[1]: Starting Load Kernel Module configfs...1838worker2 # [ 1.938381] systemd[1]: Starting Coldplug All udev Devices...1839lb # [ 1.929146] systemd[1]: Starting Journal Service...1840worker2 # [ 1.957378] systemd[1]: Finished Create List of Static Device Nodes.1841lb # [ 1.946219] systemd[1]: Starting Load Kernel Modules...1842worker1 # [ 1.858036] systemd[1]: bpf-restrict-fs: LSM BPF program attached1843worker2 # [ 1.971489] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1844worker2 # [ 1.979330] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1845worker2 # [ 1.983897] systemd-journald[67]: Collecting audit messages is disabled.1846worker2 # [ 1.987595] systemd[1]: modprobe@configfs.service: Deactivated successfully.1847lb # [ 1.958103] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1848worker2 # [ 1.996862] systemd[1]: Finished Load Kernel Module configfs.1849lb # [ 1.984654] netfs: FS-Cache loaded1850worker2 # [ 2.003937] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1851worker2 # [ 2.007638] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1852lb # [ 1.992499] 9pnet: Installing 9P2000 support1853worker2 # [ 2.017425] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1854worker2 # [ 2.020612] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1855worker1 # [ 1.912957] systemd[1]: Queued start job for default target Initrd Default Target.1856lb # [ 2.009259] systemd[1]: Starting Coldplug All udev Devices...1857worker1 # [ 1.917548] systemd[1]: Created slice Slice /system/modprobe.1858worker1 # [ 1.919244] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1859worker1 # [ 1.921031] systemd[1]: Expecting device /dev/disk/by-label/nixos...1860worker1 # [ 1.922430] systemd[1]: Reached target Path Units.1861worker1 # [ 1.923537] systemd[1]: Reached target Slice Units.1862worker1 # [ 1.924725] systemd[1]: Reached target Swaps.1863worker1 # [ 1.925750] systemd[1]: Reached target Timer Units.1864worker1 # [ 1.926995] systemd[1]: Listening on D-Bus System Message Bus Socket.1865worker1 # [ 1.928567] systemd[1]: Listening on Journal Socket (/dev/log).1866worker1 # [ 1.930091] systemd[1]: Listening on Journal Sockets.1867worker1 # [ 1.931378] systemd[1]: Listening on udev Control Socket.1868worker1 # [ 1.932649] systemd[1]: Listening on udev Kernel Socket.1869worker1 # [ 1.933895] systemd[1]: Reached target Socket Units.1870worker1 # [ 1.936514] systemd[1]: Starting Create List of Static Device Nodes...1871lb # [ 2.033096] systemd[1]: Finished Create List of Static Device Nodes.1872worker1 # [ 1.942117] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1873worker2 # [ 2.062334] systemd[1]: Finished Load Kernel Modules.1874lb # [ 2.042834] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1875worker1 # [ 1.956322] systemd[1]: Starting Load Kernel Module configfs...1876lb # [ 2.055067] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1877worker2 # [ 2.078618] systemd[1]: Starting Apply Kernel Variables...1878worker1 # [ 1.972822] systemd[1]: Starting Journal Service...1879lb # [ 2.066126] systemd[1]: modprobe@configfs.service: Deactivated successfully.1880lb # [ 2.069610] systemd-journald[67]: Collecting audit messages is disabled.1881lb # [ 2.074667] systemd[1]: Finished Load Kernel Module configfs.1882worker1 # [ 1.987840] systemd[1]: Starting Load Kernel Modules...1883lb # [ 2.081673] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1884worker2 # [ 2.107669] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1885lb # [ 2.088524] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1886lb # [ 2.098737] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1887lb # [ 2.101090] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1888worker2 # [ 2.121338] systemd[1]: Starting Create Static Device Nodes in /dev...1889worker1 # [ 1.994841] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1890worker1 # [ 2.019041] netfs: FS-Cache loaded1891client # [ 2.059704] systemd[1]: bpf-restrict-fs: LSM BPF program attached1892worker1 # [ 2.025795] 9pnet: Installing 9P2000 support1893worker2 # [ 2.149483] systemd[1]: Finished Apply Kernel Variables.1894worker1 # [ 2.042012] systemd[1]: Starting Coldplug All udev Devices...1895worker2 # [ 2.004188] systemd-modules-load[68]: Inserted module 'dm_mod'[ 2.159973] systemd[1]: Started Journal Service.1896worker2 # 1897worker2 # [ 2.009571] systemd-modules-load[68]: Inserted module 'virtio_balloon'1898worker2 # [ 2.012471] systemd-modules-load[68]: Inserted module 'virtio_gpu'1899lb # [ 2.150062] systemd[1]: Finished Load Kernel Modules.1900worker1 # [ 2.059296] systemd[1]: Finished Create List of Static Device Nodes.1901lb # [ 2.160830] systemd[1]: Starting Apply Kernel Variables...1902worker1 # [ 2.068168] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1903worker1 # [ 2.076807] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1904worker1 # [ 2.080491] systemd-journald[67]: Collecting audit messages is disabled.1905worker1 # [ 2.086936] systemd[1]: modprobe@configfs.service: Deactivated successfully.1906client # [ 2.128224] systemd[1]: Queued start job for default target Initrd Default Target.1907lb # [ 2.185036] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1908worker2 # [ 2.053440] systemd[1]: Finished Create Static Device Nodes in /dev.1909worker1 # [ 2.094272] systemd[1]: Finished Load Kernel Module configfs.1910client # [ 2.132832] systemd[1]: Created slice Slice /system/modprobe.1911client # [ 2.134369] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.1912worker2 # [ 2.057416] systemd[1]: Reached target Preparation for Local File Systems.1913client # [ 2.135917] systemd[1]: Expecting device /dev/disk/by-label/nixos...1914worker2 # [ 2.059144] systemd[1]: Reached target Local File Systems.1915client # [ 2.137200] systemd[1]: Reached target Path Units.1916client # [ 2.138195] systemd[1]: Reached target Slice Units.1917worker1 # [ 2.100392] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1918client # [ 2.139213] systemd[1]: Reached target Swaps.1919client # [ 2.140125] systemd[1]: Reached target Timer Units.1920client # [ 2.141298] systemd[1]: Listening on D-Bus System Message Bus Socket.1921worker2 # [ 2.064180] systemd[1]: Starting Create System Files and Directories...1922worker1 # [ 2.104215] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1923client # [ 2.142676] systemd[1]: Listening on Journal Socket (/dev/log).1924client # [ 2.144054] systemd[1]: Listening on Journal Sockets.1925lb # [ 2.200244] systemd[1]: Starting Create Static Device Nodes in /dev...1926client # [ 2.145209] systemd[1]: Listening on udev Control Socket.1927client # [ 2.146410] systemd[1]: Listening on udev Kernel Socket.1928client # [ 2.147485] systemd[1]: Reached target Socket Units.1929client # [ 2.149987] systemd[1]: Starting Create List of Static Device Nodes...1930worker1 # [ 2.113943] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1931worker2 # [ 2.075151] systemd[1]: Starting Rule-based Manager for Device Events and Files...1932worker1 # [ 2.116315] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1933client # [ 2.156140] systemd[1]: Starting Load Kernel Module 9pnet_virtio...1934client # [ 2.170346] systemd[1]: Starting Load Kernel Module configfs...1935lb # [ 2.229009] systemd[1]: Finished Apply Kernel Variables.1936client # [ 2.183347] systemd[1]: Starting Journal Service...1937worker1 # [ 2.154795] systemd[1]: Finished Load Kernel Modules.1938lb # [ 2.253644] systemd[1]: Finished Create Static Device Nodes in /dev.1939worker2 # [ 2.123081] systemd[1]: Finished Create System Files and Directories.1940client # [ 2.201156] systemd[1]: Starting Load Kernel Modules...1941worker1 # [ 2.164215] systemd[1]: Starting Apply Kernel Variables...1942lb # [ 2.103913] systemd-modules-load[68]: Inserted module 'dm_mod'1943lb # [ 2.106206] systemd-modules-load[68]: Inserted module 'virtio_balloon'1944lb # [ 2.108373] systemd-modules-load[68]: Inserted module 'virtio_gpu'1945lb # [ 2.262633] systemd[1]: Started Journal Service.1946lb # [ 2.123139] systemd[1]: Reached target Preparation for Local File Systems.1947lb # [ 2.124366] systemd[1]: Reached target Local File Systems.1948client # [ 2.207218] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os1949worker1 # [ 2.187910] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1950lb # [ 2.129107] systemd[1]: Starting Create System Files and Directories...1951worker2 # [ 2.149417] systemd-udevd[82]: Using default interface naming scheme 'v261'.1952client # [ 2.230872] netfs: FS-Cache loaded1953lb # [ 2.135640] systemd[1]: Starting Rule-based Manager for Device Events and Files...1954client # [ 2.237174] 9pnet: Installing 9P2000 support1955worker1 # [ 2.199811] systemd[1]: Starting Create Static Device Nodes in /dev...1956client # [ 2.257437] systemd[1]: Starting Coldplug All udev Devices...1957worker2 # [ 2.181127] systemd[1]: Started Rule-based Manager for Device Events and Files.1958worker1 # [ 2.224888] systemd[1]: Finished Apply Kernel Variables.1959lb # [ 2.173250] systemd[1]: Finished Create System Files and Directories.1960client # [ 2.276253] systemd[1]: Finished Create List of Static Device Nodes.1961worker1 # [ 2.246133] systemd[1]: Started Journal Service.1962worker1 # [ 2.076942] systemd-modules-load[68]: Inserted module 'dm_mod'1963client # [ 2.287577] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.1964worker1 # [ 2.081418] systemd-modules-load[68]: Inserted module 'virtio_balloon'1965worker1 # [ 2.083785] systemd-modules-load[68]: Inserted module 'virtio_gpu'1966client # [ 2.295350] systemd-journald[67]: Collecting audit messages is disabled.1967client # [ 2.297319] systemd[1]: Finished Load Kernel Module 9pnet_virtio.1968worker1 # [ 2.090087] systemd[1]: Finished Create Static Device Nodes in /dev.1969lb # [ 2.202384] systemd-udevd[83]: Using default interface naming scheme 'v261'.1970worker2 # [ 2.225082] systemd[1]: Finished Coldplug All udev Devices.1971worker2 # [ 2.227608] systemd[1]: Reached target System Initialization.1972client # [ 2.304651] systemd[1]: modprobe@configfs.service: Deactivated successfully.1973worker1 # [ 2.098960] systemd[1]: Reached target Preparation for Local File Systems.1974worker2 # [ 2.230099] systemd[1]: Reached target Basic System.1975worker1 # [ 2.103082] systemd[1]: Reached target Local File Systems.1976worker1 # [ 2.105085] systemd[1]: Starting Create System Files and Directories...1977client # [ 2.312703] systemd[1]: Finished Load Kernel Module configfs.1978client # [ 2.316558] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.1979worker1 # [ 2.116090] systemd[1]: Starting Rule-based Manager for Device Events and Files...1980client # [ 2.324094] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config1981lb # [ 2.232634] systemd[1]: Started Rule-based Manager for Device Events and Files.1982client # [ 2.331083] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev1983client # [ 2.335925] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...1984worker1 # [ 2.156291] systemd[1]: Finished Create System Files and Directories.1985client # [ 2.372440] systemd[1]: Finished Load Kernel Modules.1986lb # [ 2.282211] systemd[1]: Finished Coldplug All udev Devices.1987lb # [ 2.284881] systemd[1]: Reached target System Initialization.1988lb # [ 2.285897] systemd[1]: Reached target Basic System.1989client # [ 2.382664] systemd[1]: Starting Apply Kernel Variables...1990worker1 # [ 2.186404] systemd-udevd[83]: Using default interface naming scheme 'v261'.1991client # [ 2.409179] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.1992client # [ 2.421133] systemd[1]: Starting Create Static Device Nodes in /dev...1993worker1 # [ 2.216647] systemd[1]: Started Rule-based Manager for Device Events and Files.1994client # [ 2.442273] systemd[1]: Finished Apply Kernel Variables.1995client # [ 2.298400] systemd-modules-load[68]: Inserted module 'dm_mod'[ 2.455793] systemd[1]: Started Journal Service.1996client # 1997client # [ 2.303414] systemd-modules-load[68]: Inserted module 'virtio_balloon'1998client # [ 2.304712] systemd-modules-load[68]: Inserted module 'virtio_gpu'1999client # [ 2.319225] systemd[1]: Finished Create Static Device Nodes in /dev.2000client # [ 2.324599] systemd[1]: Reached target Preparation for Local File Systems.
loading 1,916 hidden lines…
3917lb # [ 14.049949] NET: Registered PF_PACKET protocol family3918lb # [ 13.901547] dhcpcd[693]: eth0: offered 10.0.2.15 from 10.0.2.23919lb # [ 13.904189] dhcpcd[693]: eth0: probing address 10.0.2.15/243920lb # [ 14.307771] dhcpcd[693]: eth0: soliciting an IPv6 router3921lb # [ 14.308957] dhcpcd[693]: eth0: Router Advertisement from fe80::23922lb # [ 14.310272] dhcpcd[693]: eth0: adding address fec0::5054:ff:fe12:3456/643923lb # [ 14.311405] dhcpcd[693]: eth0: adding route to fec0::/643924lb # [ 14.312275] dhcpcd[693]: eth0: adding default route via fe80::23925worker1 # [ 14.255539] dhcpcd[746]: eth0: soliciting a DHCP lease3926worker1 # [ 14.444525] NET: Registered PF_PACKET protocol family3927worker1 # [ 14.279680] dhcpcd[746]: eth0: offered 10.0.2.15 from 10.0.2.23928worker1 # [ 14.283541] dhcpcd[746]: eth0: probing address 10.0.2.15/243929worker1 # [ 14.727713] dhcpcd[746]: eth0: soliciting an IPv6 router3930worker1 # [ 14.729313] dhcpcd[746]: eth0: Router Advertisement from fe80::23931worker1 # [ 14.730205] dhcpcd[746]: eth0: adding address fec0::5054:ff:fe12:3456/643932worker1 # [ 14.731181] dhcpcd[746]: eth0: adding route to fec0::/643933worker1 # [ 14.731963] dhcpcd[746]: eth0: adding default route via fe80::23934client # [ 14.806446] dhcpcd[628]: eth0: soliciting an IPv6 router3935client # [ 14.807873] dhcpcd[628]: eth0: Router Advertisement from fe80::23936client # [ 14.808837] dhcpcd[628]: eth0: adding address fec0::5054:ff:fe12:3456/643937client # [ 14.809775] dhcpcd[628]: eth0: adding route to fec0::/643938client # [ 14.810661] dhcpcd[628]: eth0: adding default route via fe80::23939lb # [ 14.880819] postgresql-pre-start[717]: selecting default time zone ... UTC3940lb # [ 14.884353] postgresql-pre-start[717]: creating configuration files ... ok3941lb # [ 15.198089] postgresql-pre-start[717]: running bootstrap script ... ok3942lb # [ 15.819084] postgresql-pre-start[717]: performing post-bootstrap initialization ... ok3943lb # [ 15.950753] postgresql-pre-start[717]: syncing data to disk ... ok3944lb # [ 15.952623] postgresql-pre-start[717]: initdb: warning: enabling "trust" authentication for local connections3945lb # [ 15.953897] postgresql-pre-start[717]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.3946lb # [ 15.955678] postgresql-pre-start[717]: Success. You can now start the database server using:3947lb # [ 15.956701] postgresql-pre-start[717]: pg_ctl -D /var/lib/postgresql/18 -l logfile start3948lb # [ 16.072179] postgres[817]: [817] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit3949lb # [ 16.077733] postgres[817]: [817] LOG: listening on IPv6 address "::1", port 54323950lb # [ 16.078924] postgres[817]: [817] LOG: listening on IPv4 address "127.0.0.1", port 54323951lb # [ 16.108206] postgres[817]: [817] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"3952lb # [ 16.172932] postgres[830]: [830] LOG: database system was shut down at 2026-09-20 07:57:34 GMT3953lb # [ 16.193601] postgres[817]: [817] LOG: database system is ready to accept connections3954lb # [ 16.206790] systemd[1]: Started PostgreSQL Server.3955lb # [ 16.216594] systemd[1]: Starting PostgreSQL Setup Scripts...3956lb # [ 16.472211] postgresql-setup-start[846]: CREATE DATABASE3957lb # [ 16.517179] postgresql-setup-start[851]: CREATE ROLE3958lb # [ 16.538576] postgresql-setup-start[853]: ALTER DATABASE3959lb # [ 16.544305] systemd[1]: Finished PostgreSQL Setup Scripts.3960lb # [ 16.545837] systemd[1]: Reached target PostgreSQL.3961client # [ 17.416271] dhcpcd[628]: eth0: leased 10.0.2.15 for 86400 seconds3962client # [ 17.417236] dhcpcd[628]: eth0: adding route to 10.0.2.0/243963client # [ 17.417966] dhcpcd[628]: eth0: adding default route via 10.0.2.23964client # [ 17.504351] systemd[1]: Started DHCP Client.3965client # [ 17.506908] systemd[1]: Reached target Multi-User System.3966client # [ 17.508166] systemd[1]: Startup finished in 1.256s (kernel) + 4.302s (initrd) + 11.948s (userspace) = 17.507s.3967worker2 # [ 18.787878] dhcpcd[748]: eth0: leased 10.0.2.15 for 86400 seconds3968worker2 # [ 18.790240] dhcpcd[748]: eth0: adding route to 10.0.2.0/243969worker2 # [ 18.792717] dhcpcd[748]: eth0: adding default route via 10.0.2.23970worker2 # [ 18.900376] systemd[1]: Started DHCP Client.3971worker2 # [ 18.902398] systemd[1]: Reached target Multi-User System.3972worker2 # [ 18.903335] systemd[1]: Startup finished in 1.010s (kernel) + 5.448s (initrd) + 12.442s (userspace) = 18.902s.3973worker1 # [ 19.233589] dhcpcd[746]: eth0: leased 10.0.2.15 for 86400 seconds3974worker1 # [ 19.234763] dhcpcd[746]: eth0: adding route to 10.0.2.0/243975lb # [ 19.345603] dhcpcd[693]: eth0: leased 10.0.2.15 for 86400 seconds3976worker1 # [ 19.235607] dhcpcd[746]: eth0: adding default route via 10.0.2.23977lb # [ 19.347816] dhcpcd[693]: eth0: adding route to 10.0.2.0/243978lb # [ 19.349723] dhcpcd[693]: eth0: adding default route via 10.0.2.23979worker1 # [ 19.335456] systemd[1]: Started DHCP Client.3980worker1 # [ 19.337048] systemd[1]: Reached target Multi-User System.3981worker1 # [ 19.337885] systemd[1]: Startup finished in 1.053s (kernel) + 5.415s (initrd) + 12.868s (userspace) = 19.337s.3982lb # [ 19.493596] systemd[1]: Started DHCP Client.3983lb # [ 19.495694] systemd[1]: Reached target Network is Online.3984lb # [ 19.500175] systemd[1]: Started Envoy reverse proxy.3985lb # [ 19.503425] systemd[1]: Started mock-oidc.service.3986lb # [ 19.592632] mock-oidc-server[940]: Mock OIDC Server running3987lb # [ 19.593708] mock-oidc-server[940]: OIDC Address: 192.168.1.2:80803988lb # [ 19.595411] mock-oidc-server[940]: Issue Address: 0.0.0.0:80813989lb # [ 19.597308] mock-oidc-server[940]: Issuer: http://192.168.1.2:8080/oidc3990lb # [ 19.598647] mock-oidc-server[940]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json3991lb # [ 19.600144] mock-oidc-server[940]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration3992lb # [ 19.601984] mock-oidc-server[940]: Issue tokens: http://0.0.0.0:8081/issue?sub=...3993lb # [ 20.020548] envoy[939]: [2026-09-20 07:57:38.572][939][info][main] [source/server/server.cc:467] initializing epoch 0 (base id=0, hot restart version=11.104)3994lb # [ 20.022415] envoy[939]: [2026-09-20 07:57:38.572][939][info][main] [source/server/server.cc:469] statically linked extensions:3995lb # [ 20.023907] envoy[939]: [2026-09-20 07:57:38.572][939][info][main] [source/server/server.cc:471] envoy.thrift_proxy.transports: auto, framed, header, unframed3996lb # [ 20.025675] envoy[939]: [2026-09-20 07:57:38.572][939][info][main] [source/server/server.cc:471] envoy.http.early_header_mutation: envoy.http.early_header_mutation.header_mutation3997lb # [ 20.027668] envoy[939]: [2026-09-20 07:57:38.572][939][info][main] [source/server/server.cc:471] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe3998lb # [ 20.029988] envoy[939]: [2026-09-20 07:57:38.572][939][info][main] [source/server/server.cc:471] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple3999lb # [ 20.032675] envoy[939]: [2026-09-20 07:57:38.572][939][info][main] [source/server/server.cc:471] envoy.generic_proxy.filters: envoy.filters.generic.router4000lb # [ 20.034219] envoy[939]: [2026-09-20 07:57:38.572][939][info][main] [source/server/server.cc:471] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory4001lb # [ 20.036514] envoy[939]: [2026-09-20 07:57:38.572][939][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4002lb # [ 20.038547] envoy[939]: [2026-09-20 07:57:38.572][939][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.serializers: dubbo.hessian24003lb # [ 20.040041] envoy[939]: [2026-09-20 07:57:38.572][939][info][main] [source/server/server.cc:471] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service4004lb # [ 20.043894] envoy[939]: [2026-09-20 07:57:38.572][939][info][main] [source/server/server.cc:471] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router4005lb # [ 20.075347] envoy[939]: [2026-09-20 07:57:38.572][939][info][main] [source/server/server.cc:471] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest4006lb # [ 20.080300] envoy[939]: [2026-09-20 07:57:38.573][939][info][main] [source/server/server.cc:471] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override4007lb # [ 20.083276] envoy[939]: [2026-09-20 07:57:38.573][939][info][main] [source/server/server.cc:471] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts4008lb # [ 20.086224] envoy[939]: [2026-09-20 07:57:38.574][939][info][main] [source/server/server.cc:471] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats4009lb # [ 20.088570] envoy[939]: [2026-09-20 07:57:38.576][939][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based4010lb # [ 20.092320] envoy[939]: [2026-09-20 07:57:38.576][939][info][main] [source/server/server.cc:471] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed4011lb # [ 20.094622] envoy[939]: [2026-09-20 07:57:38.576][939][info][main] [source/server/server.cc:471] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory4012lb # [ 20.098058] envoy[939]: [2026-09-20 07:57:38.576][939][info][main] [source/server/server.cc:471] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso4013lb # [ 20.100045] envoy[939]: [2026-09-20 07:57:38.576][939][info][main] [source/server/server.cc:471] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v84014lb # [ 20.101740] envoy[939]: [2026-09-20 07:57:38.576][939][info][main] [source/server/server.cc:471] envoy.health_check.event_sinks: envoy.health_check.event_sink.file4015lb # [ 20.103388] envoy[939]: [2026-09-20 07:57:38.576][939][info][main] [source/server/server.cc:471] envoy.string_matcher: envoy.string_matcher.lua4016lb # [ 20.104865] envoy[939]: [2026-09-20 07:57:38.578][939][info][main] [source/server/server.cc:471] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san4017lb # [ 20.111186] envoy[939]: [2026-09-20 07:57:38.578][939][info][main] [source/server/server.cc:471] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response4018lb # [ 20.113237] envoy[939]: [2026-09-20 07:57:38.580][939][info][main] [source/server/server.cc:471] envoy.connection_handler: envoy.connection_handler.default4019lb # [ 20.115174] envoy[939]: [2026-09-20 07:57:38.580][939][info][main] [source/server/server.cc:471] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher4020lb # [ 20.117079] envoy[939]: [2026-09-20 07:57:38.580][939][info][main] [source/server/server.cc:471] envoy.config.validators: envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator4021lb # [ 20.119682] envoy[939]: [2026-09-20 07:57:38.580][939][info][main] [source/server/server.cc:471] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port4022lb # [ 20.121993] envoy[939]: [2026-09-20 07:57:38.580][939][info][main] [source/server/server.cc:471] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name4023lb # [ 20.124133] envoy[939]: [2026-09-20 07:57:38.580][939][info][main] [source/server/server.cc:471] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.profile_action4024lb # [ 20.125954] envoy[939]: [2026-09-20 07:57:38.580][939][info][main] [source/server/server.cc:471] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr4025lb # [ 20.127613] envoy[939]: [2026-09-20 07:57:38.580][939][info][main] [source/server/server.cc:471] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor4026lb # [ 20.129883] envoy[939]: [2026-09-20 07:57:38.580][939][info][main] [source/server/server.cc:471] envoy.upstreams: envoy.filters.connection_pools.tcp.generic4027lb # [ 20.131450] envoy[939]: [2026-09-20 07:57:38.580][939][info][main] [source/server/server.cc:471] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm4028lb # [ 20.137537] envoy[939]: [2026-09-20 07:57:38.580][939][info][main] [source/server/server.cc:471] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter4029lb # [ 20.139384] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query4030lb # [ 20.143106] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value4031lb # [ 20.146193] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override4032lb # [ 20.148563] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default4033lb # [ 20.150335] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router4034lb # [ 20.152887] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable4035lb # [ 20.154653] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log4036lb # [ 20.160476] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.rds_factory: envoy.rds_factory.default4037lb # [ 20.161917] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche4038lb # [ 20.163664] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap4039lb # [ 20.168079] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.preserve_case, preserve_case4040lb # [ 20.170621] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple4041lb # [ 20.172766] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift4042lb # [ 20.175942] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection4043lb # [ 20.177641] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin4044lb # [ 20.180821] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection4045lb # [ 20.185399] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.http.forward_client_cert_details: forward_client_cert4046lb # [ 20.187123] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule4047lb # [ 20.189634] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] network.connection.client: default, envoy_internal4048lb # [ 20.191235] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.request_id: envoy.request_id.uuid4049lb # [ 20.192783] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor4050lb # [ 20.195447] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata4051lb # [ 20.197576] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls4052lb # [ 20.202751] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.route_config_update_requester: envoy.route_config_update_requester.default4053lb # [ 20.204684] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder4054lb # [ 20.206842] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd4055lb # [ 20.211346] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter4056lb # [ 20.213157] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls4057lb # [ 20.217214] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input4058lb # [ 20.218972] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header4059lb # [ 20.221459] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource4060lb # [ 20.224309] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth24061lb # [ 20.226599] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options4062lb # [ 20.230406] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string, filter-chain-name4063lb # [ 20.232797] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.retry_priorities: envoy.retry_priorities.previous_priorities4064lb # [ 20.234497] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy4065lb # [ 20.237077] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator4066lb # [ 20.239490] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4067lb # [ 20.242691] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.geoip_providers: envoy.geoip_providers.maxmind4068lb # [ 20.244392] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated4069lb # [ 20.246112] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain4070lb # [ 20.247848] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.content_parsers: envoy.content_parsers.json4071lb # [ 20.249401] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.regex_engines: envoy.regex_engines.google_re24072lb # [ 20.251030] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher4073lb # [ 20.253453] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] quic.http_server_connection: quic.http_server_connection.default4074lb # [ 20.255271] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state4075lb # [ 20.258115] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.route.early_data_policy: envoy.route.early_data_policy.default4076lb # [ 20.260083] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] filter_state.object: envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port4077lb # [ 20.267030] envoy[939]: [2026-09-20 07:57:38.582][939][info][main] [source/server/server.cc:471] envoy.srds_factory: envoy.srds_factory.default4078lb # [ 20.268549] envoy[939]: [2026-09-20 07:57:38.583][939][info][main] [source/server/server.cc:471] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy4079lb # [ 20.280260] envoy[939]: [2026-09-20 07:57:38.583][939][info][main] [source/server/server.cc:471] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction4080lb # [ 20.284318] envoy[939]: [2026-09-20 07:57:38.583][939][info][main] [source/server/server.cc:471] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy4081lb # [ 20.286681] envoy[939]: [2026-09-20 07:57:38.583][939][info][main] [source/server/server.cc:471] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme4082lb # [ 20.289535] envoy[939]: [2026-09-20 07:57:38.583][939][info][main] [source/server/server.cc:471] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher4083lb # [ 20.291810] envoy[939]: [2026-09-20 07:57:38.590][939][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.protocols: dubbo4084lb # [ 20.293163] envoy[939]: [2026-09-20 07:57:38.590][939][info][main] [source/server/server.cc:471] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http14085lb # [ 20.295529] envoy[939]: [2026-09-20 07:57:38.590][939][info][main] [source/server/server.cc:471] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret4086lb # [ 20.297960] envoy[939]: [2026-09-20 07:57:38.590][939][info][main] [source/server/server.cc:471] envoy.http.header_validators: envoy.http.header_validators.envoy_default4087lb # [ 20.300189] envoy[939]: [2026-09-20 07:57:38.590][939][info][main] [source/server/server.cc:471] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality4088lb # [ 20.306878] envoy[939]: [2026-09-20 07:57:38.590][939][info][main] [source/server/server.cc:471] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit4089lb # [ 20.309574] envoy[939]: [2026-09-20 07:57:38.590][939][info][main] [source/server/server.cc:471] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params4090lb # [ 20.318398] envoy[939]: [2026-09-20 07:57:38.590][939][info][main] [source/server/server.cc:471] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector4091lb # [ 20.323741] envoy[939]: [2026-09-20 07:57:38.590][939][info][main] [source/server/server.cc:471] envoy.matching.stat_matching_data.input: stat_full_name_match_input4092lb # [ 20.325511] envoy[939]: [2026-09-20 07:57:38.590][939][info][main] [source/server/server.cc:471] envoy.common.key_value: envoy.key_value.file_based4093lb # [ 20.327127] envoy[939]: [2026-09-20 07:57:38.590][939][info][main] [source/server/server.cc:471] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router4094lb # [ 20.328786] envoy[939]: [2026-09-20 07:57:38.590][939][info][main] [source/server/server.cc:471] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff4095lb # [ 20.331049] envoy[939]: [2026-09-20 07:57:38.590][939][info][main] [source/server/server.cc:471] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config4096lb # [ 20.334153] envoy[939]: [2026-09-20 07:57:38.590][939][info][main] [source/server/server.cc:471] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation4097lb # [ 20.336324] envoy[939]: [2026-09-20 07:57:38.591][939][info][main] [source/server/server.cc:471] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default4098lb # [ 20.338175] envoy[939]: [2026-09-20 07:57:38.591][939][info][main] [source/server/server.cc:471] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle4099lb # [ 20.340204] envoy[939]: [2026-09-20 07:57:38.737][939][info][main] [source/server/server.cc:531] HTTP header map info:4100lb # [ 20.341640] envoy[939]: [2026-09-20 07:57:38.776][939][info][main] [source/server/server.cc:534] request header map: 664 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id4101lb # [ 20.355277] envoy[939]: [2026-09-20 07:57:38.776][939][info][main] [source/server/server.cc:534] request trailer map: 120 bytes:4102lb # [ 20.356693] envoy[939]: [2026-09-20 07:57:38.776][939][info][main] [source/server/server.cc:534] response header map: 432 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id4103lb # [ 20.363924] envoy[939]: [2026-09-20 07:57:38.776][939][info][main] [source/server/server.cc:534] response trailer map: 144 bytes: grpc-message,grpc-status4104lb # [ 20.402457] envoy[939]: [2026-09-20 07:57:38.954][939][info][main] [source/server/server.cc:968] runtime: {}4105lb # [ 20.409294] envoy[939]: [2026-09-20 07:57:38.961][939][info][main] [source/server/server.cc:420] Raised file descriptor limits from 1024 to 524288.4106lb # [ 20.411604] envoy[939]: [2026-09-20 07:57:38.964][939][info][main] [source/server/server.cc:796] Starting admin HTTP server at 127.0.0.1:99014107lb # [ 20.414413] envoy[939]: [2026-09-20 07:57:38.966][939][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:99014108lb # [ 20.417508] envoy[939]: [2026-09-20 07:57:38.969][939][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration4109lb # [ 20.419160] envoy[939]: [2026-09-20 07:57:38.971][939][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s)4110lb # [ 20.420732] envoy[939]: [2026-09-20 07:57:38.971][939][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s)4111worker1 # [ 20.358067] systemd[1]: Starting Nix worker-protocol over gRPC...4112lb # [ 20.469640] envoy[939]: [2026-09-20 07:57:39.022][939][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s)4113worker2 # [ 20.493116] systemd[1]: Starting Nix worker-protocol over gRPC...4114lb # [ 20.500541] envoy[939]: [2026-09-20 07:57:39.052][939][info][config] [source/server/configuration_impl.cc:164] loading stats configuration4115lb # [ 20.503739] envoy[939]: [2026-09-20 07:57:39.056][939][warning][main] [source/server/server.cc:1038] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor.4116lb # [ 20.506732] envoy[939]: [2026-09-20 07:57:39.059][939][info][main] [source/server/server.cc:1077] starting main dispatch loop4117worker1 # [ 20.548597] nix-grpc-daemon[851]: ts=2026-09-20T07:57:39Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4118worker1 # [ 20.565083] nix-grpc-daemon[851]: ts=2026-09-20T07:57:39Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=14119worker2 # [ 20.703292] nix-grpc-daemon[851]: ts=2026-09-20T07:57:39Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc4120worker2 # [ 20.715507] nix-grpc-daemon[851]: ts=2026-09-20T07:57:39Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=14121worker1 # [ 20.612337] nix-grpc-daemon[851]: ts=2026-09-20T07:57:39Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4122worker1 # [ 20.615943] systemd[1]: Started Nix worker-protocol over gRPC.4123worker2 # [ 20.755397] nix-grpc-daemon[851]: ts=2026-09-20T07:57:39Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket4124worker2 # [ 20.760674] systemd[1]: Started Nix worker-protocol over gRPC.4125lb # [ 20.775390] envoy[939]: [2026-09-20 07:57:39.327][939][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization4126worker1 # [ 20.663806] nix-grpc-daemon[851]: ts=2026-09-20T07:57:39Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4127worker2 # [ 20.794656] nix-grpc-daemon[851]: ts=2026-09-20T07:57:39Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4128lb # [ 20.777420] envoy[939]: [2026-09-20 07:57:39.329][939][info][upstream] [source/common/upstream/cluster_manager_impl.cc:250] cm init: all clusters initialized4129lb # [ 20.779307] envoy[939]: [2026-09-20 07:57:39.329][939][info][main] [source/server/server.cc:1057] all clusters initialized. initializing init manager4130lb # [ 20.781250] envoy[939]: [2026-09-20 07:57:39.329][939][info][config] [source/common/listener_manager/listener_manager_impl.cc:1067] all dependencies initialized. starting workers4131worker1 # [ 20.864878] nix-grpc-daemon[851]: ts=2026-09-20T07:57:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4132worker2 # [ 20.995665] nix-grpc-daemon[851]: ts=2026-09-20T07:57:39Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4133worker1 # [ 21.265294] nix-grpc-daemon[851]: ts=2026-09-20T07:57:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4134worker2 # [ 21.396220] nix-grpc-daemon[851]: ts=2026-09-20T07:57:40Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused"4135worker2 # [ 22.199622] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_connected addr=lb:500514136worker1 # [ 22.069964] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_connected addr=lb:500514137worker2 # [ 22.231279] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4138worker1 # [ 22.101193] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4139worker2 # [ 22.432130] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_connected addr=lb:500514140worker1 # [ 22.302363] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_connected addr=lb:500514141worker2 # [ 22.436774] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4142worker1 # [ 22.306602] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4143worker2 # [ 22.637931] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_connected addr=lb:500514144worker1 # [ 22.507289] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_connected addr=lb:500514145worker2 # [ 22.641844] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4146worker1 # [ 22.511918] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4147worker1 # [ 22.712416] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_connected addr=lb:500514148worker2 # [ 22.842636] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_connected addr=lb:500514149worker1 # [ 22.715519] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4150worker2 # [ 22.845674] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4151worker1 # [ 22.916287] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_connected addr=lb:500514152worker2 # [ 23.046607] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_connected addr=lb:500514153worker1 # [ 22.918992] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4154worker2 # [ 23.052373] nix-grpc-daemon[851]: ts=2026-09-20T07:57:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4155worker1 # [ 23.121241] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_connected addr=lb:500514156worker2 # [ 23.254058] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_connected addr=lb:500514157worker2 # [ 23.255947] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4158worker1 # [ 23.126365] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4159worker2 # [ 23.456494] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_connected addr=lb:500514160worker1 # [ 23.327892] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_connected addr=lb:500514161worker2 # [ 23.462502] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4162worker1 # [ 23.332500] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4163worker2 # [ 23.663770] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_connected addr=lb:500514164worker1 # [ 23.533095] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_connected addr=lb:500514165worker2 # [ 23.667385] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4166worker1 # [ 23.538116] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4167worker2 # [ 23.868271] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_connected addr=lb:500514168worker1 # [ 23.739318] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_connected addr=lb:500514169worker2 # [ 23.875190] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4170worker1 # [ 23.744494] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4171worker2 # [ 24.076393] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_connected addr=lb:500514172worker1 # [ 23.945500] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_connected addr=lb:500514173worker2 # [ 24.079740] nix-grpc-daemon[851]: ts=2026-09-20T07:57:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4174worker1 # [ 23.950742] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4175worker2 # [ 24.281523] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_connected addr=lb:500514176worker1 # [ 24.153687] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_connected addr=lb:500514177worker2 # [ 24.285255] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4178worker1 # [ 24.157827] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4179worker2 # [ 24.485917] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_connected addr=lb:500514180worker1 # [ 24.357897] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_connected addr=lb:500514181worker2 # [ 24.488243] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4182worker1 # [ 24.360696] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4183worker2 # [ 24.689151] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_connected addr=lb:500514184worker2 # [ 24.691574] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4185worker1 # [ 24.561689] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_connected addr=lb:500514186worker1 # [ 24.565417] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4187worker2 # [ 24.892421] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_connected addr=lb:500514188worker2 # [ 24.894942] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4189worker1 # [ 24.766200] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_connected addr=lb:500514190worker1 # [ 24.770229] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4191worker2 # [ 25.096078] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_connected addr=lb:500514192worker2 # [ 25.098732] nix-grpc-daemon[851]: ts=2026-09-20T07:57:43Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4193worker1 # [ 24.970404] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_connected addr=lb:500514194worker1 # [ 24.972276] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4195worker2 # [ 25.300246] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_connected addr=lb:500514196worker1 # [ 25.172926] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_connected addr=lb:500514197worker2 # [ 25.302581] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4198worker1 # [ 25.175976] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4199worker2 # [ 25.503427] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_connected addr=lb:500514200worker1 # [ 25.376452] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_connected addr=lb:500514201worker2 # [ 25.505843] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4202worker1 # [ 25.378856] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4203worker2 # [ 25.706660] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_connected addr=lb:500514204worker2 # [ 25.709130] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4205worker1 # [ 25.580043] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_connected addr=lb:500514206worker1 # [ 25.582334] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4207worker2 # [ 25.910039] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_connected addr=lb:500514208worker2 # [ 25.912379] nix-grpc-daemon[851]: ts=2026-09-20T07:57:44Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4209worker1 # [ 25.784833] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_connected addr=lb:500514210worker1 # [ 25.786826] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4211worker2 # [ 26.113089] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_connected addr=lb:500514212worker2 # [ 26.115547] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4213worker1 # [ 25.987111] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_connected addr=lb:500514214worker1 # [ 25.988877] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4215worker2 # [ 26.317069] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_connected addr=lb:500514216worker1 # [ 26.189624] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_connected addr=lb:500514217worker2 # [ 26.319534] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4218worker1 # [ 26.192679] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4219worker2 # [ 26.520217] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_connected addr=lb:500514220worker1 # [ 26.393208] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_connected addr=lb:500514221worker2 # [ 26.522974] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4222worker1 # [ 26.396671] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4223worker2 # [ 26.723961] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_connected addr=lb:500514224worker2 # [ 26.726612] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4225worker1 # [ 26.597658] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_connected addr=lb:500514226worker1 # [ 26.601533] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4227worker2 # [ 26.927475] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_connected addr=lb:500514228worker2 # [ 26.930461] nix-grpc-daemon[851]: ts=2026-09-20T07:57:45Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4229worker1 # [ 26.802137] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_connected addr=lb:500514230worker1 # [ 26.806170] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4231worker2 # [ 27.131435] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_connected addr=lb:500514232worker2 # [ 27.134307] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4233worker1 # [ 27.006423] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_connected addr=lb:500514234worker1 # [ 27.008675] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4235worker2 # [ 27.335809] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_connected addr=lb:500514236worker2 # [ 27.338330] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4237worker1 # [ 27.209563] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_connected addr=lb:500514238worker1 # [ 27.211716] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4239worker2 # [ 27.539366] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_connected addr=lb:500514240worker1 # [ 27.412135] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_connected addr=lb:500514241worker2 # [ 27.542397] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4242worker1 # [ 27.415485] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4243worker2 # [ 27.743317] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_connected addr=lb:500514244worker1 # [ 27.616103] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_connected addr=lb:500514245worker2 # [ 27.746050] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4246worker1 # [ 27.619106] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4247worker2 # [ 27.947094] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_connected addr=lb:500514248worker1 # [ 27.819763] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_connected addr=lb:500514249worker2 # [ 27.949763] nix-grpc-daemon[851]: ts=2026-09-20T07:57:46Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4250worker1 # [ 27.823178] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4251worker2 # [ 28.150505] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_connected addr=lb:500514252worker1 # [ 28.023693] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_connected addr=lb:500514253worker2 # [ 28.153132] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4254worker1 # [ 28.025835] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4255worker2 # [ 28.354267] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_connected addr=lb:500514256worker2 # [ 28.356123] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4257worker1 # [ 28.227562] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_connected addr=lb:500514258worker1 # [ 28.231345] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4259worker2 # [ 28.556952] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_connected addr=lb:500514260worker1 # [ 28.431729] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_connected addr=lb:500514261worker2 # [ 28.561697] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4262worker1 # [ 28.438291] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4263worker2 # [ 28.762953] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_connected addr=lb:500514264worker2 # [ 28.767126] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4265worker1 # [ 28.639186] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_connected addr=lb:500514266worker1 # [ 28.643321] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4267worker2 # [ 28.967533] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_connected addr=lb:500514268worker1 # [ 28.843453] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_connected addr=lb:500514269worker2 # [ 28.971320] nix-grpc-daemon[851]: ts=2026-09-20T07:57:47Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4270worker1 # [ 28.846454] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4271worker2 # [ 29.172235] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_connected addr=lb:500514272worker2 # [ 29.176340] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4273worker1 # [ 29.047402] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_connected addr=lb:500514274worker1 # [ 29.052515] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4275worker2 # [ 29.378261] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_connected addr=lb:500514276worker1 # [ 29.253681] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_connected addr=lb:500514277worker2 # [ 29.382109] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4278worker1 # [ 29.257409] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4279worker2 # [ 29.582934] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_connected addr=lb:500514280worker2 # [ 29.585392] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4281worker1 # [ 29.457972] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_connected addr=lb:500514282worker1 # [ 29.459921] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4283worker2 # [ 29.786152] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_connected addr=lb:500514284worker2 # [ 29.789088] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4285worker1 # [ 29.660412] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_connected addr=lb:500514286worker1 # [ 29.663073] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4287worker2 # [ 29.990037] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_connected addr=lb:500514288worker2 # [ 29.993171] nix-grpc-daemon[851]: ts=2026-09-20T07:57:48Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4289worker1 # [ 29.863729] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_connected addr=lb:500514290worker1 # [ 29.867740] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4291worker2 # [ 30.194149] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_connected addr=lb:500514292worker2 # [ 30.196576] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4293worker1 # [ 30.068125] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_connected addr=lb:500514294worker1 # [ 30.069791] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4295worker2 # [ 30.397950] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_connected addr=lb:500514296worker2 # [ 30.400059] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4297worker1 # [ 30.270661] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_connected addr=lb:500514298worker1 # [ 30.272803] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4299worker2 # [ 30.600932] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_connected addr=lb:500514300worker2 # [ 30.603737] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4301worker1 # [ 30.473562] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_connected addr=lb:500514302worker1 # [ 30.477134] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4303worker2 # [ 30.804438] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_connected addr=lb:500514304worker2 # [ 30.806923] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4305worker1 # [ 30.677671] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_connected addr=lb:500514306worker1 # [ 30.683724] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4307worker2 # [ 31.008101] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_connected addr=lb:500514308worker1 # [ 30.883710] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_connected addr=lb:500514309worker2 # [ 31.012299] nix-grpc-daemon[851]: ts=2026-09-20T07:57:49Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4310worker1 # [ 30.887803] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4311worker2 # [ 31.213193] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_connected addr=lb:500514312worker2 # [ 31.217297] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4313worker1 # [ 31.088852] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_connected addr=lb:500514314worker1 # [ 31.092990] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4315worker2 # [ 31.417917] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_connected addr=lb:500514316worker2 # [ 31.421100] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4317worker1 # [ 31.294080] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_connected addr=lb:500514318worker1 # [ 31.295951] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4319worker2 # [ 31.622072] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_connected addr=lb:500514320worker1 # [ 31.496487] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_connected addr=lb:500514321worker2 # [ 31.625983] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4322worker1 # [ 31.501875] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4323worker2 # [ 31.826491] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_connected addr=lb:500514324worker2 # [ 31.830497] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4325worker1 # [ 31.702806] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_connected addr=lb:500514326worker1 # [ 31.707215] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4327worker2 # [ 32.031492] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_connected addr=lb:500514328worker2 # [ 32.035783] nix-grpc-daemon[851]: ts=2026-09-20T07:57:50Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4329worker1 # [ 31.907905] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_connected addr=lb:500514330worker1 # [ 31.911820] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4331worker2 # [ 32.236880] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_connected addr=lb:500514332worker2 # [ 32.240878] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4333worker1 # [ 32.112356] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_connected addr=lb:500514334worker1 # [ 32.116190] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4335worker2 # [ 32.441793] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_connected addr=lb:500514336worker2 # [ 32.444106] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4337worker1 # [ 32.318532] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_connected addr=lb:500514338worker1 # [ 32.321600] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4339worker2 # [ 32.644826] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_connected addr=lb:500514340worker2 # [ 32.647446] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4341worker1 # [ 32.518705] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_connected addr=lb:500514342worker1 # [ 32.520890] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4343worker2 # [ 32.848628] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_connected addr=lb:500514344worker1 # [ 32.721480] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_connected addr=lb:500514345worker2 # [ 32.853679] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4346worker1 # [ 32.725702] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4347worker1 # [ 32.926203] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_connected addr=lb:500514348worker2 # [ 33.054357] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_connected addr=lb:500514349worker2 # [ 33.059975] nix-grpc-daemon[851]: ts=2026-09-20T07:57:51Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4350worker1 # [ 32.929986] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4351worker1 # [ 33.131095] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_connected addr=lb:500514352worker2 # [ 33.260845] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_connected addr=lb:500514353worker1 # [ 33.134293] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4354worker2 # [ 33.264754] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4355worker2 # [ 33.466531] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_connected addr=lb:500514356worker1 # [ 33.337953] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_connected addr=lb:500514357worker2 # [ 33.470995] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4358worker1 # [ 33.341904] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4359worker1 # [ 33.542692] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_connected addr=lb:500514360worker2 # [ 33.671280] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_connected addr=lb:500514361worker1 # [ 33.545707] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4362worker2 # [ 33.676346] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4363worker1 # [ 33.746483] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_connected addr=lb:500514364worker2 # [ 33.876879] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_connected addr=lb:500514365worker1 # [ 33.749263] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4366worker2 # [ 33.879468] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4367worker1 # [ 33.950182] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_connected addr=lb:500514368worker2 # [ 34.080662] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_connected addr=lb:500514369worker1 # [ 33.953290] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4370worker2 # [ 34.085771] nix-grpc-daemon[851]: ts=2026-09-20T07:57:52Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4371worker1 # [ 34.154210] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_connected addr=lb:500514372worker2 # [ 34.286330] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_connected addr=lb:500514373worker1 # [ 34.157243] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4374worker2 # [ 34.289145] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4375worker1 # [ 34.359395] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_connected addr=lb:500514376worker2 # [ 34.490125] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_connected addr=lb:500514377worker1 # [ 34.361275] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4378worker2 # [ 34.492325] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4379worker2 # [ 34.693111] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_connected addr=lb:500514380worker1 # [ 34.562410] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_connected addr=lb:500514381worker2 # [ 34.696070] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4382worker1 # [ 34.567814] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4383worker2 # [ 34.896608] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_connected addr=lb:500514384worker1 # [ 34.769204] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_connected addr=lb:500514385worker2 # [ 34.904081] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4386worker1 # [ 34.773649] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4387worker2 # [ 35.104643] nix-grpc-daemon[851]: ts=2026-09-20T07:57:53Z level=info event=scheduler_connected addr=lb:500514388worker1 # [ 34.974914] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_connected addr=lb:500514389worker1 # [ 34.980561] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4390worker2 # [ 35.110894] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4391worker2 # [ 35.311611] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_connected addr=lb:500514392worker1 # [ 35.181791] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_connected addr=lb:500514393worker2 # [ 35.315749] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4394worker1 # [ 35.186367] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4395worker2 # [ 35.516981] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_connected addr=lb:500514396worker1 # [ 35.388340] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_connected addr=lb:500514397worker2 # [ 35.519442] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4398worker1 # [ 35.390312] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4399worker2 # [ 35.719762] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_connected addr=lb:500514400worker1 # [ 35.591324] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_connected addr=lb:500514401worker1 # [ 35.593602] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4402worker2 # [ 35.724254] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4403worker1 # [ 35.795365] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_connected addr=lb:500514404worker2 # [ 35.925582] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_connected addr=lb:500514405worker1 # [ 35.800797] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4406worker2 # [ 35.931159] nix-grpc-daemon[851]: ts=2026-09-20T07:57:54Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4407worker2 # [ 36.131763] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_connected addr=lb:500514408worker1 # [ 36.002097] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_connected addr=lb:500514409worker2 # [ 36.137308] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4410worker1 # [ 36.006752] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4411worker1 # [ 36.207340] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_connected addr=lb:500514412worker2 # [ 36.338192] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_connected addr=lb:500514413worker1 # [ 36.210882] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4414worker2 # [ 36.341162] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4415worker1 # [ 36.413359] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_connected addr=lb:500514416worker2 # [ 36.545092] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_connected addr=lb:500514417worker2 # [ 36.548416] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4418worker1 # [ 36.418370] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4419worker2 # [ 36.746070] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_connected addr=lb:500514420worker1 # [ 36.619222] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_connected addr=lb:500514421worker2 # [ 36.751354] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4422worker1 # [ 36.623089] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4423worker2 # [ 36.951712] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_connected addr=lb:500514424worker1 # [ 36.824986] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_connected addr=lb:500514425worker2 # [ 36.956980] nix-grpc-daemon[851]: ts=2026-09-20T07:57:55Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4426worker1 # [ 36.829149] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4427worker2 # [ 37.158236] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_connected addr=lb:500514428worker1 # [ 37.029971] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_connected addr=lb:500514429worker2 # [ 37.164731] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4430worker1 # [ 37.034740] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4431lb # [ 37.159524] rustfs-bucket-start[1104]: mb s3://farm4432lb # [ 37.165834] systemd[1]: Finished rustfs-bucket.service.4433lb # [ 37.172164] systemd[1]: Starting niks3 server...4434worker2 # [ 37.365835] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_connected addr=lb:500514435worker1 # [ 37.235823] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_connected addr=lb:500514436worker2 # [ 37.370739] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4437worker1 # [ 37.240801] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4438lb # [ 37.408328] postgres[1120]: [1120] ERROR: relation "goose_db_version" does not exist at character 364439lb # [ 37.409516] postgres[1120]: [1120] STATEMENT: SELECT version_id, is_applied from goose_db_version ORDER BY id DESC4440lb # [ 37.445568] niks3-server[1114]: 2026/09/20 07:57:55 OK 20241026095416_initial_model.sql (20.19ms)4441lb # [ 37.449533] niks3-server[1114]: 2026/09/20 07:57:56 OK 20251210153512_drop_unused_gin_index.sql (2.15ms)4442lb # [ 37.454403] niks3-server[1114]: 2026/09/20 07:57:56 OK 20251218171726_add_pins.sql (3.68ms)4443lb # [ 37.459732] niks3-server[1114]: 2026/09/20 07:57:56 OK 20260628120000_add_object_size_and_stats.sql (4.15ms)4444lb # [ 37.463995] niks3-server[1114]: 2026/09/20 07:57:56 OK 20260905000000_add_claims.sql (2.91ms)4445lb # [ 37.468624] niks3-server[1114]: 2026/09/20 07:57:56 OK 20260920000000_drop_claims.sql (4.51ms)4446lb # [ 37.469764] niks3-server[1114]: 2026/09/20 07:57:56 goose: successfully migrated database to version: 202609200000004447lb # [ 37.475139] niks3-server[1114]: 2026/09/20 07:57:56 OK 1_commit_pending_closure.sql (6.57ms)4448lb # [ 37.477583] niks3-server[1114]: 2026/09/20 07:57:56 OK 2_object_stats_trigger.sql (1.26ms)4449lb # [ 37.478764] niks3-server[1114]: 2026/09/20 07:57:56 goose: up to current file version: 24450lb # [ 37.484635] niks3-server[1114]: 2026/09/20 07:57:56 INFO Loaded signing key name=farm-test-1 path=/nix/store/c745bsy529madd2s6hz4z5is2436ni04-key4451worker1 # [ 37.443452] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_connected addr=lb:500514452worker2 # [ 37.575109] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_connected addr=lb:500514453worker1 # [ 37.446684] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4454worker2 # [ 37.578373] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4455lb # [ 37.564534] niks3-server[1114]: 2026/09/20 07:57:56 INFO Read proxy enabled — serving cache objects from S34456lb # [ 37.566261] niks3-server[1114]: 2026/09/20 07:57:56 INFO Using socket-activated listener address=0.0.0.0:57514457lb # [ 37.572085] niks3-server[1114]: 2026/09/20 07:57:56 INFO systemd watchdog enabled interval=15s4458lb # [ 37.573279] systemd[1]: Started niks3 server.4459lb # [ 37.573889] systemd[1]: Reached target Multi-User System.4460lb # [ 37.576235] systemd[1]: Startup finished in 1.005s (kernel) + 5.437s (initrd) + 31.132s (userspace) = 37.576s.4461lb # [ 37.577786] niks3-server[1114]: 2026/09/20 07:57:56 INFO Starting HTTP server address=0.0.0.0:57514462lb # [ 37.584411] niks3-server[1114]: 2026/09/20 07:57:56 INFO lead: acquired remote=192.168.1.3:469564463worker1 # [ 37.479827] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_take_over4464lb: (finished: waiting for unit niks3.service, in 24.93 seconds)4465lb: waiting for TCP port 5751 on localhost4466worker1 # [ 37.643784] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_connected addr=lb:500514467worker2 # [ 37.775570] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_connected addr=lb:500514468worker1 # [ 37.647281] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04469worker2 # [ 37.780928] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"4470lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded!4471lb: (finished: waiting for TCP port 5751 on localhost, in 0.06 seconds)4472lb: waiting for unit envoy.service4473lb: (finished: waiting for unit envoy.service, in 0.05 seconds)4474lb: waiting for TCP port 50051 on localhost4475lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded!4476lb # [ 37.872407] envoy[939]: conn peer=[::1]:41244 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=24477lb: (finished: waiting for TCP port 50051 on localhost, in 0.03 seconds)4478worker2 # [ 37.981485] nix-grpc-daemon[851]: ts=2026-09-20T07:57:56Z level=info event=scheduler_connected addr=lb:500514479worker1 # [ 37.852789] nix-grpc-daemon[851]: ts=2026-09-20T07:57:57Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=04480lb: waiting until exactly no endpoints of x86_64-linux are unhealthy4481??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead.4482 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 1284483lb: must succeed: curl -sf localhost:9901/clusters4484lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)4485lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 0.07 seconds)4486subtest: one node schedules and both builders hold a WorkerSession on it4487lb: must succeed: curl -sf localhost:9901/clusters4488lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)4489worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true4490worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.06 seconds)4491(finished: subtest: one node schedules and both builders hold a WorkerSession on it, in 0.11 seconds)4492subtest: balancer auth: client cert, bearer token, nothing, unknown CN4493worker1 # [ 38.322180] nix-grpc-daemon[851]: ts=2026-09-20T07:57:57Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:539364494worker1 # [ 38.338200] systemd[1]: Started Nix Daemon.4495worker1 # [ 38.587813] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4496worker1 # [ 38.635237] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 24 ms (attempt 1/5)4497worker1 # [ 38.664076] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 199 ms (attempt 2/5)4498worker1 # [ 38.863568] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 259 ms (attempt 3/5)4499worker1 # [ 39.127714] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 95 ms (attempt 4/5)4500worker1 # [ 39.234392] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4501worker1 # [ 39.264132] nix-grpc-daemon[851]: ts=2026-09-20T07:57:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:539364502worker1 # [ 39.280767] nix-grpc-daemon[851]: ts=2026-09-20T07:57:58Z level=debug event=path_info_miss path=97m6rvvyik23hqk7xbnr0cyn6n1zar9d-nixos-system-client-test error="error: path '/nix/store/97m6rvvyik23hqk7xbnr0cyn6n1zar9d-nixos-system-client-test' is required, but there is no substituter that can build it"4503worker2 # [ 39.427406] nix-grpc-daemon[851]: ts=2026-09-20T07:57:58Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:460164504worker2 # [ 39.439880] systemd[1]: Started Nix Daemon.4505worker2 # [ 39.716548] nix-daemon[911]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4506worker2 # [ 39.746037] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 53 ms (attempt 1/5)4507worker2 # [ 39.799358] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 154 ms (attempt 2/5)4508worker2 # [ 39.953902] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 75 ms (attempt 3/5)4509worker2 # [ 40.035288] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 759 ms (attempt 4/5)4510worker2 # [ 40.804974] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org4511worker2 # [ 40.819626] nix-grpc-daemon[851]: ts=2026-09-20T07:57:59Z level=debug event=path_info_miss path=97m6rvvyik23hqk7xbnr0cyn6n1zar9d-nixos-system-client-test error="error: path '/nix/store/97m6rvvyik23hqk7xbnr0cyn6n1zar9d-nixos-system-client-test' is required, but there is no substituter that can build it"4512client: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt4513client: (finished: must succeed: curl -sfG http://lb:8081/issue --data-urlencode 'aud=grpc://lb:50051' --data-urlencode sub=dev:alice > /root/dev.jwt && test -s /root/dev.jwt, in 0.09 seconds)4514client: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key4515client: (finished: must succeed: install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.pem /var/lib/nix-grpc-store/client.crt && install -D /nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/foreign.key /var/lib/nix-grpc-store/client.key, in 0.03 seconds)4516worker1 # [ 41.017417] nix-grpc-daemon[851]: ts=2026-09-20T07:58:00Z level=info event=oidc_jwks provider=mock keys=14517worker1 # [ 41.018869] nix-grpc-daemon[851]: ts=2026-09-20T07:58:00Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:539364518worker2 # [ 41.170318] nix-grpc-daemon[851]: ts=2026-09-20T07:58:00Z level=info event=oidc_jwks provider=mock keys=14519worker2 # [ 41.174930] nix-grpc-daemon[851]: ts=2026-09-20T07:58:00Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:460164520worker2 # [ 41.184598] nix-grpc-daemon[851]: ts=2026-09-20T07:58:00Z level=debug event=path_info_miss path=97m6rvvyik23hqk7xbnr0cyn6n1zar9d-nixos-system-client-test error="error: path '/nix/store/97m6rvvyik23hqk7xbnr0cyn6n1zar9d-nixos-system-client-test' is required, but there is no substituter that can build it"4521worker2 # [ 41.193680] nix-grpc-daemon[851]: ts=2026-09-20T07:58:00Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:460164522worker2 # [ 41.202884] nix-grpc-daemon[851]: ts=2026-09-20T07:58:00Z level=debug event=path_info_miss path=97m6rvvyik23hqk7xbnr0cyn6n1zar9d-nixos-system-client-test error="error: path '/nix/store/97m6rvvyik23hqk7xbnr0cyn6n1zar9d-nixos-system-client-test' is required, but there is no substituter that can build it"4523client: must succeed: rm -r /var/lib/nix-grpc-store4524client: (finished: must succeed: rm -r /var/lib/nix-grpc-store, in 0.03 seconds)4525worker1 # [ 41.315306] nix-grpc-daemon[851]: ts=2026-09-20T07:58:00Z level=info event=denied method=QueryMissing cn=- role=none4526worker2 # [ 41.651906] nix-grpc-daemon[851]: ts=2026-09-20T07:58:00Z level=info event=denied method=QueryMissing cn=stranger role=none4527(finished: subtest: balancer auth: client cert, bearer token, nothing, unknown CN, in 3.51 seconds)4528subtest: DAG build is scheduled across workers and lands in the cache4529client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24530worker2 # [ 41.890624] nix-grpc-daemon[851]: ts=2026-09-20T07:58:00Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:460164531client # don't know how to build these paths:4532client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4533worker1 # [ 41.795901] nix-grpc-daemon[851]: ts=2026-09-20T07:58:01Z level=debug event=want client=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=04534worker1 # [ 41.801117] nix-grpc-daemon[851]: ts=2026-09-20T07:58:01Z level=debug event=assigned drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv worker=192.168.1.3:50051 clients=14535worker1 # [ 41.847366] nix-grpc-daemon[851]: ts=2026-09-20T07:58:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539364536worker1 # [ 41.872569] nix-grpc-daemon[851]: ts=2026-09-20T07:58:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:539364537client # copying 1 paths to 'lb:50051'...4538worker1 # [ 41.882344] nix-grpc-daemon[851]: ts=2026-09-20T07:58:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:539364539client # copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'...4540worker1 # [ 41.909334] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4541worker1 # [ 41.924606] nix-grpc-daemon[851]: ts=2026-09-20T07:58:01Z level=info event=niks3_push_started pid=9284542worker1 # [ 42.363622] nix-daemon[915]: accepted connection from pid 940, user nix-grpc-daemon (trusted)4543worker1 # [ 42.379329] nix-daemon[915]: reaped child process 943, status = succeeded4544worker1 # [ 42.538789] nix-daemon[915]: accepted connection from pid 946, user nix-grpc-daemon (trusted)4545worker1 # [ 42.550332] nix-daemon[915]: reaped child process 949, status = succeeded4546lb # [ 42.675347] niks3-server[1114]: 2026/09/20 07:58:01 INFO Received uploads request method=POST path=/api/pending_closures4547worker1 # [ 42.583029] nix-grpc-daemon[928]: time=2026-09-20T07:58:01.804Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4548worker1 # [ 42.586156] nix-grpc-daemon[928]: time=2026-09-20T07:58:01.807Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)"4549lb # [ 42.735561] niks3-server[1114]: 2026/09/20 07:58:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/1/sign4550lb # [ 42.750103] niks3-server[1114]: 2026/09/20 07:58:01 INFO Registered completed upload object_key=nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst4551lb # [ 42.755626] niks3-server[1114]: 2026/09/20 07:58:01 INFO Signed narinfos id=1 count=14552worker1 # [ 42.646473] nix-grpc-daemon[928]: time=2026-09-20T07:58:01.868Z level=INFO msg="Uploading 1 narinfos"4553lb # [ 42.767915] niks3-server[1114]: 2026/09/20 07:58:01 INFO Received complete upload request method=POST path=/api/pending_closures/1/complete4554lb # [ 42.770787] niks3-server[1114]: 2026/09/20 07:58:01 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls4555lb # [ 42.778102] niks3-server[1114]: 2026/09/20 07:58:01 INFO Registered completed upload object_key=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo4556lb # [ 42.785128] niks3-server[1114]: 2026/09/20 07:58:01 INFO Completed upload id=14557worker1 # [ 42.674758] nix-grpc-daemon[928]: time=2026-09-20T07:58:01.896Z level=INFO msg="Upload complete. (480ms)"4558worker1 # [ 42.680870] nix-grpc-daemon[851]: ts=2026-09-20T07:58:01Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=0 paths=1 nar_bytes_in=5044559worker1 # [ 42.687502] nix-grpc-daemon[851]: ts=2026-09-20T07:58:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539364560worker1 # [ 42.699966] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4561worker1 # [ 42.708305] nix-daemon[915]: reaped child process 926, status = succeeded4562client # building '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' on lb:50051...4563client # farm-a> node-a: building 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4564worker1 # [ 42.717291] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4565client # farm-a> LOG-farm-a-t14566worker1 # [ 43.945700] nix-daemon[915]: reaped child process 953, status = succeeded4567worker1 # [ 44.089810] nix-daemon[915]: accepted connection from pid 968, user nix-grpc-daemon (trusted)4568worker1 # [ 44.101166] nix-daemon[915]: reaped child process 971, status = succeeded4569lb # [ 44.224474] niks3-server[1114]: 2026/09/20 07:58:02 INFO Received uploads request method=POST path=/api/pending_closures4570worker1 # [ 44.119426] nix-grpc-daemon[928]: time=2026-09-20T07:58:03.341Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4571worker1 # [ 44.120893] nix-grpc-daemon[928]: time=2026-09-20T07:58:03.343Z level=INFO msg="Uploading qm96yd1cmricgf2hr21k88syh75l317v-farm-a (128B)"4572lb # [ 44.256494] niks3-server[1114]: 2026/09/20 07:58:02 INFO Registered completed upload object_key=log/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv4573lb # [ 44.261166] niks3-server[1114]: 2026/09/20 07:58:02 INFO Received sign narinfos request method=POST path=/api/pending_closures/2/sign4574lb # [ 44.263453] niks3-server[1114]: 2026/09/20 07:58:02 INFO Registered completed upload object_key=nar/1rmil4ja9jzfwn6l5hwbir70b6plx99sgk0pnjjy377ngbc3vz28.nar.zst4575lb # [ 44.266525] niks3-server[1114]: 2026/09/20 07:58:02 INFO Signed narinfos id=2 count=14576worker1 # [ 44.156376] nix-grpc-daemon[928]: time=2026-09-20T07:58:03.378Z level=INFO msg="Uploading 1 narinfos"4577lb # [ 44.268093] niks3-server[1114]: 2026/09/20 07:58:02 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.ls4578lb # [ 44.273714] niks3-server[1114]: 2026/09/20 07:58:02 INFO Received complete upload request method=POST path=/api/pending_closures/2/complete4579lb # [ 44.278555] niks3-server[1114]: 2026/09/20 07:58:02 INFO Registered completed upload object_key=qm96yd1cmricgf2hr21k88syh75l317v.narinfo4580lb # [ 44.281825] niks3-server[1114]: 2026/09/20 07:58:02 INFO Completed upload id=24581worker1 # [ 44.171183] nix-grpc-daemon[928]: time=2026-09-20T07:58:03.393Z level=INFO msg="Upload complete. (242ms)"4582worker1 # [ 44.175744] nix-grpc-daemon[851]: ts=2026-09-20T07:58:03Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=1 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv assign_id=1 outputs=14583worker1 # [ 44.183881] nix-daemon[915]: reaped child process 951, status = succeeded4584worker1 # [ 44.190117] nix-grpc-daemon[851]: ts=2026-09-20T07:58:03Z level=debug event=want client=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=04585worker1 # [ 44.192333] nix-grpc-daemon[851]: ts=2026-09-20T07:58:03Z level=debug event=assigned drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv worker=192.168.1.3:50051 clients=14586worker1 # [ 44.234720] nix-grpc-daemon[851]: ts=2026-09-20T07:58:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539364587worker1 # [ 44.244226] nix-grpc-daemon[851]: ts=2026-09-20T07:58:03Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:539364588worker1 # [ 44.255632] nix-grpc-daemon[928]: time=2026-09-20T07:58:03.477Z level=INFO msg="All 1 paths already cached"4589client # copying 1 paths to 'lb:50051'...4590client # copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'...4591worker1 # [ 44.261503] nix-grpc-daemon[851]: ts=2026-09-20T07:58:03Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:539364592worker1 # [ 44.274075] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4593worker1 # [ 44.403079] nix-daemon[915]: accepted connection from pid 977, user nix-grpc-daemon (trusted)4594worker1 # [ 44.417545] nix-daemon[915]: reaped child process 980, status = succeeded4595worker1 # [ 44.567448] nix-daemon[915]: accepted connection from pid 982, user nix-grpc-daemon (trusted)4596worker1 # [ 44.579427] nix-daemon[915]: reaped child process 985, status = succeeded4597lb # [ 44.706682] niks3-server[1114]: 2026/09/20 07:58:03 INFO Received uploads request method=POST path=/api/pending_closures4598worker1 # [ 44.601973] nix-grpc-daemon[928]: time=2026-09-20T07:58:03.824Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4599worker1 # [ 44.604095] nix-grpc-daemon[928]: time=2026-09-20T07:58:03.825Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)"4600lb # [ 44.732363] niks3-server[1114]: 2026/09/20 07:58:03 INFO Registered completed upload object_key=nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst4601lb # [ 44.743463] niks3-server[1114]: 2026/09/20 07:58:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/3/sign4602lb # [ 44.750554] niks3-server[1114]: 2026/09/20 07:58:03 INFO Signed narinfos id=3 count=14603worker1 # [ 44.642514] nix-grpc-daemon[928]: time=2026-09-20T07:58:03.864Z level=INFO msg="Uploading 1 narinfos"4604lb # [ 44.753319] niks3-server[1114]: 2026/09/20 07:58:03 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls4605lb # [ 44.763827] niks3-server[1114]: 2026/09/20 07:58:03 INFO Received complete upload request method=POST path=/api/pending_closures/3/complete4606worker1 # [ 44.660271] nix-grpc-daemon[928]: time=2026-09-20T07:58:03.882Z level=INFO msg="Upload complete. (376ms)"4607lb # [ 44.770788] niks3-server[1114]: 2026/09/20 07:58:03 INFO Completed upload id=34608worker1 # [ 44.663083] nix-grpc-daemon[851]: ts=2026-09-20T07:58:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=0 paths=1 nar_bytes_in=6244609lb # [ 44.774557] niks3-server[1114]: 2026/09/20 07:58:03 INFO Registered completed upload object_key=zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo4610worker1 # [ 44.666039] nix-grpc-daemon[851]: ts=2026-09-20T07:58:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539364611worker1 # [ 44.672414] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4612worker1 # [ 44.674861] nix-daemon[915]: reaped child process 975, status = succeeded4613client # building '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' on lb:50051...4614client # farm-b> node-a: building zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4615worker1 # [ 44.680135] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4616worker1 # [ 45.493314] nix-daemon[915]: reaped child process 989, status = succeeded4617client # farm-b> LOG-farm-b-t14618worker1 # [ 45.631749] nix-daemon[915]: accepted connection from pid 1005, user nix-grpc-daemon (trusted)4619worker1 # [ 45.643373] nix-daemon[915]: reaped child process 1008, status = succeeded4620lb # [ 45.771685] niks3-server[1114]: 2026/09/20 07:58:04 INFO Received uploads request method=POST path=/api/pending_closures4621worker1 # [ 45.671483] nix-grpc-daemon[928]: time=2026-09-20T07:58:04.893Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4622worker1 # [ 45.673440] nix-grpc-daemon[928]: time=2026-09-20T07:58:04.895Z level=INFO msg="Uploading jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b (176B)"4623lb # [ 45.815301] niks3-server[1114]: 2026/09/20 07:58:04 INFO Registered completed upload object_key=nar/0n7l6rw4y681bymb8bwra2nh13s7ybxcm2l7y8iwy0k5mmnaznjg.nar.zst4624lb # [ 45.823849] niks3-server[1114]: 2026/09/20 07:58:04 INFO Registered completed upload object_key=log/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv4625lb # [ 45.827620] niks3-server[1114]: 2026/09/20 07:58:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/4/sign4626lb # [ 45.832512] niks3-server[1114]: 2026/09/20 07:58:04 INFO Signed narinfos id=4 count=14627worker1 # [ 45.725436] nix-grpc-daemon[928]: time=2026-09-20T07:58:04.947Z level=INFO msg="Uploading 1 narinfos"4628lb # [ 45.841536] niks3-server[1114]: 2026/09/20 07:58:04 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.ls4629lb # [ 45.850529] niks3-server[1114]: 2026/09/20 07:58:04 INFO Received complete upload request method=POST path=/api/pending_closures/4/complete4630lb # [ 45.855537] niks3-server[1114]: 2026/09/20 07:58:04 INFO Completed upload id=44631lb # [ 45.858193] niks3-server[1114]: 2026/09/20 07:58:04 INFO Registered completed upload object_key=jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo4632worker1 # [ 45.746426] nix-grpc-daemon[928]: time=2026-09-20T07:58:04.968Z level=INFO msg="Upload complete. (260ms)"4633worker1 # [ 45.753584] nix-grpc-daemon[851]: ts=2026-09-20T07:58:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=1 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv assign_id=2 outputs=14634worker1 # [ 45.764885] nix-grpc-daemon[851]: ts=2026-09-20T07:58:04Z level=debug event=want client=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=04635worker1 # [ 45.770297] nix-grpc-daemon[851]: ts=2026-09-20T07:58:04Z level=debug event=assigned drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv worker=192.168.1.3:50051 clients=14636worker1 # [ 45.774299] nix-grpc-daemon[851]: ts=2026-09-20T07:58:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539364637worker1 # [ 45.783241] nix-daemon[915]: reaped child process 987, status = succeeded4638worker1 # [ 45.784937] nix-grpc-daemon[851]: ts=2026-09-20T07:58:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:539364639worker1 # [ 45.792811] nix-grpc-daemon[928]: time=2026-09-20T07:58:05.015Z level=INFO msg="All 2 paths already cached"4640client # copying 1 paths to 'lb:50051'...4641worker1 # [ 45.798739] nix-grpc-daemon[851]: ts=2026-09-20T07:58:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:539364642client # copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'...4643worker1 # [ 45.810832] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4644worker1 # [ 45.960479] nix-daemon[915]: accepted connection from pid 1014, user nix-grpc-daemon (trusted)4645worker1 # [ 45.973207] nix-daemon[915]: reaped child process 1017, status = succeeded4646worker1 # [ 46.132311] nix-daemon[915]: accepted connection from pid 1019, user nix-grpc-daemon (trusted)4647worker1 # [ 46.144201] nix-daemon[915]: reaped child process 1022, status = succeeded4648lb # [ 46.271489] niks3-server[1114]: 2026/09/20 07:58:04 INFO Received uploads request method=POST path=/api/pending_closures4649worker1 # [ 46.169444] nix-grpc-daemon[928]: time=2026-09-20T07:58:05.391Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4650worker1 # [ 46.170791] nix-grpc-daemon[928]: time=2026-09-20T07:58:05.391Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)"4651lb # [ 46.296680] niks3-server[1114]: 2026/09/20 07:58:04 INFO Registered completed upload object_key=nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst4652lb # [ 46.308429] niks3-server[1114]: 2026/09/20 07:58:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/5/sign4653worker1 # [ 46.204041] nix-grpc-daemon[928]: time=2026-09-20T07:58:05.426Z level=INFO msg="Uploading 1 narinfos"4654lb # [ 46.314713] niks3-server[1114]: 2026/09/20 07:58:04 INFO Signed narinfos id=5 count=14655lb # [ 46.319052] niks3-server[1114]: 2026/09/20 07:58:04 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls4656lb # [ 46.331248] niks3-server[1114]: 2026/09/20 07:58:04 INFO Received complete upload request method=POST path=/api/pending_closures/5/complete4657lb # [ 46.337541] niks3-server[1114]: 2026/09/20 07:58:04 INFO Completed upload id=54658worker1 # [ 46.228102] nix-grpc-daemon[928]: time=2026-09-20T07:58:05.450Z level=INFO msg="Upload complete. (411ms)"4659lb # [ 46.339486] niks3-server[1114]: 2026/09/20 07:58:04 INFO Registered completed upload object_key=c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo4660worker1 # [ 46.230206] nix-grpc-daemon[851]: ts=2026-09-20T07:58:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=0 paths=1 nar_bytes_in=7524661worker1 # [ 46.232954] nix-grpc-daemon[851]: ts=2026-09-20T07:58:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539364662worker1 # [ 46.239931] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4663worker1 # [ 46.245926] nix-daemon[915]: reaped child process 1012, status = succeeded4664client # building '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' on lb:50051...4665client # farm-top> node-a: building c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4666worker1 # [ 46.249220] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4667client # farm-top> LOG-farm-top-t14668worker1 # [ 47.463263] nix-daemon[915]: reaped child process 1026, status = succeeded4669worker1 # [ 47.598851] nix-daemon[915]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)4670worker1 # [ 47.610407] nix-daemon[915]: reaped child process 1044, status = succeeded4671lb # [ 47.733281] niks3-server[1114]: 2026/09/20 07:58:06 INFO Received uploads request method=POST path=/api/pending_closures4672worker1 # [ 47.627228] nix-grpc-daemon[928]: time=2026-09-20T07:58:06.849Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4673worker1 # [ 47.628879] nix-grpc-daemon[928]: time=2026-09-20T07:58:06.851Z level=INFO msg="Uploading 5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top (232B)"4674lb # [ 47.752684] niks3-server[1114]: 2026/09/20 07:58:06 INFO Registered completed upload object_key=log/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4675lb # [ 47.757841] niks3-server[1114]: 2026/09/20 07:58:06 INFO Registered completed upload object_key=nar/0pq8hp2qdfznpnf4pn4my9c4nd9yx6cfjn0x0bgv1rpk0536kpjy.nar.zst4676lb # [ 47.760514] niks3-server[1114]: 2026/09/20 07:58:06 INFO Received sign narinfos request method=POST path=/api/pending_closures/6/sign4677lb # [ 47.763023] niks3-server[1114]: 2026/09/20 07:58:06 INFO Signed narinfos id=6 count=14678worker1 # [ 47.652402] nix-grpc-daemon[928]: time=2026-09-20T07:58:06.874Z level=INFO msg="Uploading 1 narinfos"4679lb # [ 47.766882] niks3-server[1114]: 2026/09/20 07:58:06 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.ls4680lb # [ 47.771879] niks3-server[1114]: 2026/09/20 07:58:06 INFO Received complete upload request method=POST path=/api/pending_closures/6/complete4681lb # [ 47.775288] niks3-server[1114]: 2026/09/20 07:58:06 INFO Completed upload id=64682worker1 # [ 47.665963] nix-grpc-daemon[928]: time=2026-09-20T07:58:06.888Z level=INFO msg="Upload complete. (209ms)"4683lb # [ 47.776981] niks3-server[1114]: 2026/09/20 07:58:06 INFO Registered completed upload object_key=5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo4684worker1 # [ 47.670128] nix-grpc-daemon[851]: ts=2026-09-20T07:58:06Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=1 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv assign_id=3 outputs=14685worker1 # [ 47.675607] nix-daemon[915]: reaped child process 1024, status = succeeded4686client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 6.16 seconds)4687client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4688client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.18 seconds)4689client: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4690client: (finished: must fail: test -e /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.01 seconds)4691client: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4692client # copying 3 paths...4693client # copying path '/nix/store/qm96yd1cmricgf2hr21k88syh75l317v-farm-a' from 'http://lb:5751'...4694client # copying path '/nix/store/jicn175r0p4806ghnhxdvn7fsa1akkr0-farm-b' from 'http://lb:5751'...4695client # copying path '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top' from 'http://lb:5751'...4696client: (finished: must succeed: nix copy --from http://lb:5751 --no-check-sigs /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top && grep farm-top-t1 /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.24 seconds)4697(finished: subtest: DAG build is scheduled across workers and lands in the cache, in 6.64 seconds)4698subtest: repeat is answered Cached by the scheduler without building4699worker1: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4700worker1 # finding garbage collector roots...4701worker1 # deleting specified paths...4702worker1 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4703worker1 # deleting unused links...4704worker1 # note: hard linking is currently saving 0.0 KiB4705worker1: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.19 seconds)4706worker2: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top4707worker2 # finding garbage collector roots...4708worker2 # deleting specified paths...4709worker2 # deleting '/nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top'4710worker2 # deleting unused links...4711worker2 # note: hard linking is currently saving 0.0 KiB4712worker2: (finished: must succeed: nix-store --delete /nix/store/5qgbfb7awggfq3smlyfxgz8zixnqxk2n-farm-top, in 0.27 seconds)4713client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&24714client # don't know how to build these paths:4715client # /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv4716worker2 # [ 48.958272] nix-grpc-daemon[851]: ts=2026-09-20T07:58:07Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:460164717worker1 # [ 48.840487] nix-grpc-daemon[851]: ts=2026-09-20T07:58:08Z level=debug event=want client=2 drv=3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv cached=14718worker1 # [ 48.849889] nix-grpc-daemon[851]: ts=2026-09-20T07:58:08Z level=debug event=want client=2 drv=zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv cached=14719worker1 # [ 48.859231] nix-grpc-daemon[851]: ts=2026-09-20T07:58:08Z level=debug event=want client=2 drv=c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv cached=14720client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 >&2, in 0.23 seconds)4721client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath4722client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag t1 outPath, in 0.19 seconds)4723lb: must succeed: curl -sf localhost:9901/clusters4724lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)4725lb: must succeed: curl -sf localhost:9901/clusters4726lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)4727worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true4728worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="cached"} ' || true, in 0.04 seconds)4729(finished: subtest: repeat is answered Cached by the scheduler without building, in 1.10 seconds)4730subtest: two clients wanting the same drv build it once4731client: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4732client # [ 49.373658] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4733client # Running as unit: dedup1.service; invocation ID: 19d4630566dc449b93d6556be86af2f14734client: (finished: must succeed: systemd-run --unit dedup1 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 0.04 seconds)4735client: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup4736worker2 # [ 49.613191] nix-grpc-daemon[851]: ts=2026-09-20T07:58:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:460164737client # [ 49.537799] nix[939]: don't know how to build these paths:4738client # [ 49.538719] nix[939]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4739worker1 # [ 49.493677] nix-grpc-daemon[851]: ts=2026-09-20T07:58:08Z level=debug event=want client=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04740worker2 # [ 49.625836] nix-grpc-daemon[851]: ts=2026-09-20T07:58:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:460164741worker1 # [ 49.495890] nix-grpc-daemon[851]: ts=2026-09-20T07:58:08Z level=debug event=assigned drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv worker=192.168.1.4:50051 clients=14742worker2 # [ 49.635170] nix-grpc-daemon[851]: ts=2026-09-20T07:58:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:460164743client # [ 49.561882] nix[939]: copying 1 paths to 'lb:50051'...4744worker2 # [ 49.640381] nix-grpc-daemon[851]: ts=2026-09-20T07:58:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:460164745client # [ 49.562771] nix[939]: copying path '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' to 'lb:50051'...4746worker2 # [ 49.645826] nix-daemon[911]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4747worker2 # [ 49.662539] nix-grpc-daemon[851]: ts=2026-09-20T07:58:08Z level=info event=niks3_push_started pid=9354748worker2 # [ 50.099126] nix-daemon[911]: accepted connection from pid 947, user nix-grpc-daemon (trusted)4749worker2 # [ 50.114693] nix-daemon[911]: reaped child process 950, status = succeeded4750worker2 # [ 50.247592] nix-daemon[911]: accepted connection from pid 952, user nix-grpc-daemon (trusted)4751worker2 # [ 50.260828] nix-daemon[911]: reaped child process 955, status = succeeded4752lb # [ 50.255396] niks3-server[1114]: 2026/09/20 07:58:08 INFO Received uploads request method=POST path=/api/pending_closures4753worker2 # [ 50.283470] nix-grpc-daemon[935]: time=2026-09-20T07:58:09.174Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4754worker2 # [ 50.286481] nix-grpc-daemon[935]: time=2026-09-20T07:58:09.177Z level=INFO msg="Uploading k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv (432B)"4755lb # [ 50.297368] niks3-server[1114]: 2026/09/20 07:58:08 INFO Registered completed upload object_key=nar/1rprin71wk1rn18ghpyxh5nm1akxfkjivwxfnlzqzmri5xdvl2l0.nar.zst4756lb # [ 50.303870] niks3-server[1114]: 2026/09/20 07:58:08 INFO Received sign narinfos request method=POST path=/api/pending_closures/7/sign4757worker2 # [ 50.332138] nix-grpc-daemon[935]: time=2026-09-20T07:58:09.223Z level=INFO msg="Uploading 1 narinfos"4758lb # [ 50.313251] niks3-server[1114]: 2026/09/20 07:58:08 INFO Signed narinfos id=7 count=14759lb # [ 50.323865] niks3-server[1114]: 2026/09/20 07:58:08 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.ls4760lb # [ 50.329899] niks3-server[1114]: 2026/09/20 07:58:08 INFO Received complete upload request method=POST path=/api/pending_closures/7/complete4761worker2 # [ 50.355067] nix-grpc-daemon[935]: time=2026-09-20T07:58:09.246Z level=INFO msg="Upload complete. (418ms)"4762lb # [ 50.335356] niks3-server[1114]: 2026/09/20 07:58:08 INFO Completed upload id=74763worker2 # [ 50.358289] nix-grpc-daemon[851]: ts=2026-09-20T07:58:09Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46016 duration_s=0 paths=1 nar_bytes_in=4324764lb # [ 50.340750] niks3-server[1114]: 2026/09/20 07:58:08 INFO Registered completed upload object_key=k75hvg0drf5n5cgm1w4hms82xb1l5nmz.narinfo4765worker2 # [ 50.362730] nix-grpc-daemon[851]: ts=2026-09-20T07:58:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:460164766worker2 # [ 50.369428] nix-daemon[911]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4767worker2 # [ 50.370763] nix-daemon[911]: reaped child process 933, status = succeeded4768worker2 # [ 50.376721] nix-daemon[911]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4769client # [ 50.297706] nix[939]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4770lb # [ 50.482266] envoy[939]: conn peer=[2001:db8:1::1]:50786 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=749 tx=423 ms=24134771lb # [ 50.483757] envoy[939]: conn peer=[2001:db8:1::1]:50802 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=364 ms=824772lb # [ 50.485090] envoy[939]: conn peer=[2001:db8:1::1]:50814 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=84773lb # [ 50.486598] envoy[939]: conn peer=[2001:db8:1::1]:50820 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=144774lb # [ 50.489397] envoy[939]: conn peer=[2001:db8:1::1]:50824 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9355 tx=3774 ms=59524775lb # [ 50.492391] envoy[939]: conn peer=[2001:db8:1::1]:46812 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1158 tx=481 ms=484776client # [ 50.440627] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup.4777client # Running as unit: dedup2.service; invocation ID: 6348a8f6a9444cf583f9519864f6ac004778client: (finished: must succeed: sleep 1; systemd-run --unit dedup2 nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag dedup, in 1.07 seconds)4779client # [ 50.684501] nix[954]: don't know how to build these paths:4780worker1 # [ 50.630665] nix-grpc-daemon[851]: ts=2026-09-20T07:58:09Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:539364781client # [ 50.685394] nix[954]: /nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4782worker1 # [ 50.642923] nix-grpc-daemon[851]: ts=2026-09-20T07:58:09Z level=debug event=want client=4 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv cached=04783worker2 # [ 50.775974] nix-grpc-daemon[851]: ts=2026-09-20T07:58:09Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:460164784client # [ 50.700532] nix[954]: building '/nix/store/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv' on lb:50051...4785client: must succeed: sleep 24786client: (finished: must succeed: sleep 2, in 2.03 seconds)4787??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4788 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394789client: waiting for success: ! systemctl is-active dedup1 dedup24790??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.4791 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 394792worker2 # [ 53.995181] nix-daemon[911]: reaped child process 959, status = succeeded4793worker2 # [ 54.115954] nix-daemon[911]: accepted connection from pid 988, user nix-grpc-daemon (trusted)4794worker2 # [ 54.127683] nix-daemon[911]: reaped child process 991, status = succeeded4795lb # [ 54.122608] niks3-server[1114]: 2026/09/20 07:58:12 INFO Received uploads request method=POST path=/api/pending_closures4796worker2 # [ 54.150360] nix-grpc-daemon[935]: time=2026-09-20T07:58:13.041Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4797worker2 # [ 54.152153] nix-grpc-daemon[935]: time=2026-09-20T07:58:13.043Z level=INFO msg="Uploading pihyvyr6gd3qnm368ii42wvcpgsfv1di-slow-dedup (120B)"4798lb # [ 54.162121] niks3-server[1114]: 2026/09/20 07:58:12 INFO Registered completed upload object_key=log/k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv4799lb # [ 54.175136] niks3-server[1114]: 2026/09/20 07:58:12 INFO Registered completed upload object_key=nar/02xhr0h0sj1ji8m0s8995xzbbb8mhbqdpdl1ggx94yqqaykihvz7.nar.zst4800lb # [ 54.186135] niks3-server[1114]: 2026/09/20 07:58:12 INFO Received sign narinfos request method=POST path=/api/pending_closures/8/sign4801lb # [ 54.189666] niks3-server[1114]: 2026/09/20 07:58:12 INFO Signed narinfos id=8 count=14802worker2 # [ 54.212183] nix-grpc-daemon[935]: time=2026-09-20T07:58:13.103Z level=INFO msg="Uploading 1 narinfos"4803lb # [ 54.193418] niks3-server[1114]: 2026/09/20 07:58:12 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.ls4804lb # [ 54.204211] niks3-server[1114]: 2026/09/20 07:58:12 INFO Received complete upload request method=POST path=/api/pending_closures/8/complete4805lb # [ 54.209472] niks3-server[1114]: 2026/09/20 07:58:12 INFO Completed upload id=84806worker2 # [ 54.229175] nix-grpc-daemon[935]: time=2026-09-20T07:58:13.120Z level=INFO msg="Upload complete. (240ms)"4807lb # [ 54.211613] niks3-server[1114]: 2026/09/20 07:58:12 INFO Registered completed upload object_key=pihyvyr6gd3qnm368ii42wvcpgsfv1di.narinfo4808worker2 # [ 54.234889] nix-grpc-daemon[851]: ts=2026-09-20T07:58:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46016 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14809worker2 # [ 54.241249] nix-grpc-daemon[851]: ts=2026-09-20T07:58:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46016 duration_s=3 drv=k75hvg0drf5n5cgm1w4hms82xb1l5nmz-slow-dedup.drv assign_id=4 outputs=14810worker2 # [ 54.251272] nix-daemon[911]: reaped child process 957, status = succeeded4811client # [ 54.207301] systemd[1]: dedup2.service: Deactivated successfully.4812client # [ 54.212226] systemd[1]: dedup2.service: Consumed 141ms CPU time over 3.770s wall clock time, 33.1M memory peak, 7.4K incoming IP traffic, 6.5K outgoing IP traffic.4813client # [ 54.219618] systemd[1]: dedup1.service: Deactivated successfully.4814client # [ 54.221626] systemd[1]: dedup1.service: Consumed 114ms CPU time over 4.845s wall clock time, 39.1M memory peak, 8.4K incoming IP traffic, 8.9K outgoing IP traffic.4815client: (finished: waiting for success: ! systemctl is-active dedup1 dedup2, in 1.11 seconds)4816client: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }4817client: (finished: must succeed: systemctl show -p Result dedup1 dedup2 | grep -c success | grep -qx 2 || { journalctl -u dedup1 -u dedup2 >&2; false; }, in 0.05 seconds)4818worker1: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4819worker1: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.03 seconds)4820worker2: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true4821worker2: (finished: must succeed: journalctl -u nix-grpc-daemon -o cat | grep 'method=BuildDerivation.*slow-dedup' | grep -o 'assign_id=[0-9]*' || true, in 0.05 seconds)4822worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4823worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.04 seconds)4824worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true4825worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_events_total{kind="attached"} ' || true, in 0.05 seconds)4826(finished: subtest: two clients wanting the same drv build it once, in 5.84 seconds)4827subtest: build hook: nix-daemon with builders = grpc://lb4828client: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log4829client # [ 55.386735] systemd[1]: Started Nix Daemon.4830client # [ 55.554229] nix-daemon[995]: accepted connection from pid 992, user root (trusted)4831worker1 # [ 55.693274] nix-grpc-daemon[851]: ts=2026-09-20T07:58:14Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:539364832worker2 # [ 55.828855] nix-grpc-daemon[851]: ts=2026-09-20T07:58:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:460164833worker1 # [ 55.711218] nix-grpc-daemon[851]: ts=2026-09-20T07:58:14Z level=debug event=want client=5 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=04834worker1 # [ 55.715162] nix-grpc-daemon[851]: ts=2026-09-20T07:58:14Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=14835worker1 # [ 55.723390] nix-grpc-daemon[851]: ts=2026-09-20T07:58:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539364836worker1 # [ 55.736275] nix-grpc-daemon[851]: ts=2026-09-20T07:58:14Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:539364837worker1 # [ 55.747994] nix-grpc-daemon[851]: ts=2026-09-20T07:58:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:539364838worker1 # [ 55.759123] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4839worker1 # [ 55.928597] nix-daemon[915]: accepted connection from pid 1101, user nix-grpc-daemon (trusted)4840worker1 # [ 55.943597] nix-daemon[915]: reaped child process 1104, status = succeeded4841worker1 # [ 56.118282] nix-daemon[915]: accepted connection from pid 1106, user nix-grpc-daemon (trusted)4842worker1 # [ 56.131662] nix-daemon[915]: reaped child process 1109, status = succeeded4843lb # [ 56.256584] niks3-server[1114]: 2026/09/20 07:58:14 INFO Received uploads request method=POST path=/api/pending_closures4844worker1 # [ 56.226377] nix-grpc-daemon[928]: time=2026-09-20T07:58:15.447Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4845worker1 # [ 56.229171] nix-grpc-daemon[928]: time=2026-09-20T07:58:15.447Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)"4846lb # [ 56.355131] niks3-server[1114]: 2026/09/20 07:58:14 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst4847lb # [ 56.365942] niks3-server[1114]: 2026/09/20 07:58:14 INFO Received sign narinfos request method=POST path=/api/pending_closures/9/sign4848worker1 # [ 56.264288] nix-grpc-daemon[928]: time=2026-09-20T07:58:15.486Z level=INFO msg="Uploading 1 narinfos"4849lb # [ 56.374701] niks3-server[1114]: 2026/09/20 07:58:14 INFO Signed narinfos id=9 count=14850lb # [ 56.382871] niks3-server[1114]: 2026/09/20 07:58:14 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls4851lb # [ 56.393827] niks3-server[1114]: 2026/09/20 07:58:14 INFO Received complete upload request method=POST path=/api/pending_closures/9/complete4852worker1 # [ 56.290422] nix-grpc-daemon[928]: time=2026-09-20T07:58:15.512Z level=INFO msg="Upload complete. (520ms)"4853lb # [ 56.401391] niks3-server[1114]: 2026/09/20 07:58:14 INFO Completed upload id=94854worker1 # [ 56.292349] nix-grpc-daemon[851]: ts=2026-09-20T07:58:15Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=0 paths=1 nar_bytes_in=5124855lb # [ 56.405582] niks3-server[1114]: 2026/09/20 07:58:14 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo4856worker1 # [ 56.298863] nix-grpc-daemon[851]: ts=2026-09-20T07:58:15Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539364857worker1 # [ 56.300513] nix-daemon[915]: reaped child process 1099, status = succeeded4858worker1 # [ 56.307365] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4859worker1 # [ 56.317856] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4860worker1 # [ 56.734054] nix-daemon[915]: reaped child process 1113, status = succeeded4861worker1 # [ 56.881763] nix-daemon[915]: accepted connection from pid 1128, user nix-grpc-daemon (trusted)4862worker1 # [ 56.894731] nix-daemon[915]: reaped child process 1131, status = succeeded4863lb # [ 57.018839] niks3-server[1114]: 2026/09/20 07:58:15 INFO Received uploads request method=POST path=/api/pending_closures4864worker1 # [ 56.919170] nix-grpc-daemon[928]: time=2026-09-20T07:58:16.141Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"4865worker1 # [ 56.920764] nix-grpc-daemon[928]: time=2026-09-20T07:58:16.143Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)"4866lb # [ 57.049711] niks3-server[1114]: 2026/09/20 07:58:15 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv4867lb # [ 57.053156] niks3-server[1114]: 2026/09/20 07:58:15 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst4868lb # [ 57.056564] niks3-server[1114]: 2026/09/20 07:58:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/10/sign4869lb # [ 57.059749] niks3-server[1114]: 2026/09/20 07:58:15 INFO Signed narinfos id=10 count=14870worker1 # [ 56.949188] nix-grpc-daemon[928]: time=2026-09-20T07:58:16.171Z level=INFO msg="Uploading 1 narinfos"4871lb # [ 57.063855] niks3-server[1114]: 2026/09/20 07:58:15 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls4872lb # [ 57.068605] niks3-server[1114]: 2026/09/20 07:58:15 INFO Received complete upload request method=POST path=/api/pending_closures/10/complete4873lb # [ 57.071921] niks3-server[1114]: 2026/09/20 07:58:15 INFO Completed upload id=104874worker1 # [ 56.962832] nix-grpc-daemon[928]: time=2026-09-20T07:58:16.185Z level=INFO msg="Upload complete. (235ms)"4875lb # [ 57.074253] niks3-server[1114]: 2026/09/20 07:58:15 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo4876worker1 # [ 56.965844] nix-grpc-daemon[851]: ts=2026-09-20T07:58:16Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=0 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=5 outputs=14877worker1 # [ 56.973313] nix-daemon[915]: reaped child process 1111, status = succeeded4878worker1 # [ 57.012105] nix-grpc-daemon[851]: ts=2026-09-20T07:58:16Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:539364879worker1 # [ 57.022707] nix-grpc-daemon[851]: ts=2026-09-20T07:58:16Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:539364880worker1 # [ 57.025196] nix-grpc-daemon[851]: ts=2026-09-20T07:58:16Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=0 paths=1 nar_bytes_out=1284881worker1 # [ 57.269262] nix-grpc-daemon[851]: ts=2026-09-20T07:58:16Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:539364882worker2 # [ 57.409387] nix-grpc-daemon[851]: ts=2026-09-20T07:58:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:460164883worker1 # [ 57.305795] nix-grpc-daemon[851]: ts=2026-09-20T07:58:16Z level=debug event=want client=6 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=04884worker1 # [ 57.310500] nix-grpc-daemon[851]: ts=2026-09-20T07:58:16Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=14885worker1 # [ 57.315977] nix-grpc-daemon[851]: ts=2026-09-20T07:58:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539364886worker1 # [ 57.326757] nix-grpc-daemon[851]: ts=2026-09-20T07:58:16Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:539364887worker1 # [ 57.339509] nix-grpc-daemon[928]: time=2026-09-20T07:58:16.561Z level=INFO msg="All 1 paths already cached"4888worker1 # [ 57.346460] nix-grpc-daemon[851]: ts=2026-09-20T07:58:16Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:539364889worker1 # [ 57.354550] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4890worker1 # [ 57.525232] nix-daemon[915]: accepted connection from pid 1137, user nix-grpc-daemon (trusted)4891worker1 # [ 57.539741] nix-daemon[915]: reaped child process 1140, status = succeeded4892worker1 # [ 57.685980] nix-daemon[915]: accepted connection from pid 1142, user nix-grpc-daemon (trusted)4893worker1 # [ 57.700087] nix-daemon[915]: reaped child process 1145, status = succeeded4894lb # [ 57.822113] niks3-server[1114]: 2026/09/20 07:58:16 INFO Received uploads request method=POST path=/api/pending_closures4895worker1 # [ 57.716221] nix-grpc-daemon[928]: time=2026-09-20T07:58:16.938Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4896worker1 # [ 57.717909] nix-grpc-daemon[928]: time=2026-09-20T07:58:16.939Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)"4897lb # [ 57.840082] niks3-server[1114]: 2026/09/20 07:58:16 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst4898lb # [ 57.842640] niks3-server[1114]: 2026/09/20 07:58:16 INFO Received sign narinfos request method=POST path=/api/pending_closures/11/sign4899lb # [ 57.845582] niks3-server[1114]: 2026/09/20 07:58:16 INFO Signed narinfos id=11 count=14900worker1 # [ 57.736597] nix-grpc-daemon[928]: time=2026-09-20T07:58:16.958Z level=INFO msg="Uploading 1 narinfos"4901lb # [ 57.848582] niks3-server[1114]: 2026/09/20 07:58:16 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls4902lb # [ 57.854402] niks3-server[1114]: 2026/09/20 07:58:16 INFO Received complete upload request method=POST path=/api/pending_closures/11/complete4903lb # [ 57.856705] niks3-server[1114]: 2026/09/20 07:58:16 INFO Completed upload id=114904worker1 # [ 57.747296] nix-grpc-daemon[928]: time=2026-09-20T07:58:16.969Z level=INFO msg="Upload complete. (378ms)"4905lb # [ 57.858909] niks3-server[1114]: 2026/09/20 07:58:16 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo4906worker1 # [ 57.749200] nix-grpc-daemon[851]: ts=2026-09-20T07:58:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=0 paths=1 nar_bytes_in=6244907worker1 # [ 57.752354] nix-grpc-daemon[851]: ts=2026-09-20T07:58:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539364908worker1 # [ 57.758443] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4909worker1 # [ 57.762991] nix-daemon[915]: reaped child process 1135, status = succeeded4910worker1 # [ 57.768364] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4911worker1 # [ 58.781393] nix-daemon[915]: reaped child process 1149, status = succeeded4912worker1 # [ 58.935898] nix-daemon[915]: accepted connection from pid 1164, user nix-grpc-daemon (trusted)4913worker1 # [ 58.949325] nix-daemon[915]: reaped child process 1167, status = succeeded4914lb # [ 59.076353] niks3-server[1114]: 2026/09/20 07:58:17 INFO Received uploads request method=POST path=/api/pending_closures4915worker1 # [ 58.970288] nix-grpc-daemon[928]: time=2026-09-20T07:58:18.192Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"4916worker1 # [ 58.971832] nix-grpc-daemon[928]: time=2026-09-20T07:58:18.194Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)"4917lb # [ 59.102227] niks3-server[1114]: 2026/09/20 07:58:17 INFO Received sign narinfos request method=POST path=/api/pending_closures/12/sign4918lb # [ 59.104703] niks3-server[1114]: 2026/09/20 07:58:17 INFO Signed narinfos id=12 count=14919worker1 # [ 58.994158] nix-grpc-daemon[928]: time=2026-09-20T07:58:18.216Z level=INFO msg="Uploading 1 narinfos"4920lb # [ 59.109336] niks3-server[1114]: 2026/09/20 07:58:17 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls4921lb # [ 59.114923] niks3-server[1114]: 2026/09/20 07:58:17 INFO Received complete upload request method=POST path=/api/pending_closures/12/complete4922lb # [ 59.205498] niks3-server[1114]: 2026/09/20 07:58:17 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst4923lb # [ 59.214502] niks3-server[1114]: 2026/09/20 07:58:17 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv4924lb # [ 59.224916] niks3-server[1114]: 2026/09/20 07:58:17 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo4925worker1 # [ 59.119533] nix-grpc-daemon[928]: time=2026-09-20T07:58:18.341Z level=INFO msg="Upload complete. (344ms)"4926lb # [ 59.230261] niks3-server[1114]: 2026/09/20 07:58:17 INFO Completed upload id=124927worker1 # [ 59.123208] nix-grpc-daemon[851]: ts=2026-09-20T07:58:18Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=6 outputs=14928worker1 # [ 59.129874] nix-daemon[915]: reaped child process 1147, status = succeeded4929worker2 # [ 59.302350] nix-grpc-daemon[851]: ts=2026-09-20T07:58:18Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:460164930worker2 # [ 59.316411] nix-grpc-daemon[851]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'...4931worker2 # [ 59.328827] nix-grpc-daemon[851]: copying path '/nix/store/mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b' from 'http://lb:5751'...4932worker2 # [ 59.350775] nix-grpc-daemon[851]: ts=2026-09-20T07:58:18Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:460164933worker2 # [ 59.353547] nix-grpc-daemon[851]: ts=2026-09-20T07:58:18Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46016 duration_s=0 paths=1 nar_bytes_out=1764934worker1 # [ 59.476542] nix-grpc-daemon[851]: ts=2026-09-20T07:58:18Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:539364935worker1 # [ 59.478908] nix-grpc-daemon[851]: ts=2026-09-20T07:58:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:539364936worker1 # [ 59.485774] nix-grpc-daemon[928]: time=2026-09-20T07:58:18.708Z level=INFO msg="All 2 paths already cached"4937worker1 # [ 59.495226] nix-grpc-daemon[851]: ts=2026-09-20T07:58:18Z level=debug event=want client=7 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=04938worker1 # [ 59.498214] nix-grpc-daemon[851]: ts=2026-09-20T07:58:18Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=14939worker1 # [ 59.501186] nix-grpc-daemon[851]: ts=2026-09-20T07:58:18Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539364940worker1 # [ 59.506303] nix-grpc-daemon[851]: ts=2026-09-20T07:58:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:539364941worker1 # [ 59.514900] nix-grpc-daemon[928]: time=2026-09-20T07:58:18.737Z level=INFO msg="All 2 paths already cached"4942worker1 # [ 59.521550] nix-grpc-daemon[851]: ts=2026-09-20T07:58:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:539364943worker1 # [ 59.531131] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4944worker1 # [ 59.706714] nix-daemon[915]: accepted connection from pid 1173, user nix-grpc-daemon (trusted)4945worker1 # [ 59.723604] nix-daemon[915]: reaped child process 1176, status = succeeded4946worker1 # [ 59.887938] nix-daemon[915]: accepted connection from pid 1178, user nix-grpc-daemon (trusted)4947worker1 # [ 59.902631] nix-daemon[915]: reaped child process 1181, status = succeeded4948lb # [ 60.022729] niks3-server[1114]: 2026/09/20 07:58:18 INFO Received uploads request method=POST path=/api/pending_closures4949worker1 # [ 59.920727] nix-grpc-daemon[928]: time=2026-09-20T07:58:19.142Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4950worker1 # [ 59.922412] nix-grpc-daemon[928]: time=2026-09-20T07:58:19.144Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)"4951lb # [ 60.051584] niks3-server[1114]: 2026/09/20 07:58:18 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst4952lb # [ 60.065394] niks3-server[1114]: 2026/09/20 07:58:18 INFO Received sign narinfos request method=POST path=/api/pending_closures/13/sign4953lb # [ 60.070920] niks3-server[1114]: 2026/09/20 07:58:18 INFO Signed narinfos id=13 count=14954worker1 # [ 59.963526] nix-grpc-daemon[928]: time=2026-09-20T07:58:19.185Z level=INFO msg="Uploading 1 narinfos"4955lb # [ 60.078533] niks3-server[1114]: 2026/09/20 07:58:18 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls4956lb # [ 60.088530] niks3-server[1114]: 2026/09/20 07:58:18 INFO Received complete upload request method=POST path=/api/pending_closures/13/complete4957lb # [ 60.090799] niks3-server[1114]: 2026/09/20 07:58:18 INFO Completed upload id=134958worker1 # [ 59.981139] nix-grpc-daemon[928]: time=2026-09-20T07:58:19.202Z level=INFO msg="Upload complete. (439ms)"4959lb # [ 60.092883] niks3-server[1114]: 2026/09/20 07:58:18 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo4960worker1 # [ 59.986283] nix-grpc-daemon[851]: ts=2026-09-20T07:58:19Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=0 paths=1 nar_bytes_in=7524961worker1 # [ 59.990867] nix-grpc-daemon[851]: ts=2026-09-20T07:58:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539364962worker1 # [ 60.001541] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4963worker1 # [ 60.003212] nix-daemon[915]: reaped child process 1171, status = succeeded4964worker1 # [ 60.008798] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)4965lb # [ 60.482496] envoy[939]: conn peer=[2001:db8:1::1]:46820 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2955 tx=1330 ms=46334966lb # [ 60.486337] envoy[939]: conn peer=[2001:db8:1::1]:46836 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1440 tx=1085 ms=34974967lb # [ 60.490278] envoy[939]: conn peer=[2001:db8:1::1]:36384 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3354 tx=1615 ms=13834968lb # [ 60.493758] envoy[939]: conn peer=[2001:db8:1::1]:36394 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=333 ms=494969lb # [ 60.497335] envoy[939]: conn peer=[2001:db8:1::1]:36402 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3867 tx=1990 ms=20064970lb # [ 60.500976] envoy[939]: conn peer=[2001:db8:1::1]:36404 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=435 tx=378 ms=544971worker1 # [ 61.023689] nix-daemon[915]: reaped child process 1185, status = succeeded4972worker1 # [ 61.145548] nix-daemon[915]: accepted connection from pid 1200, user nix-grpc-daemon (trusted)4973worker1 # [ 61.158510] nix-daemon[915]: reaped child process 1203, status = succeeded4974lb # [ 61.282682] niks3-server[1114]: 2026/09/20 07:58:19 INFO Received uploads request method=POST path=/api/pending_closures4975worker1 # [ 61.181512] nix-grpc-daemon[928]: time=2026-09-20T07:58:20.403Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"4976worker1 # [ 61.184708] nix-grpc-daemon[928]: time=2026-09-20T07:58:20.405Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)"4977lb # [ 61.315668] niks3-server[1114]: 2026/09/20 07:58:19 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv4978lb # [ 61.329419] niks3-server[1114]: 2026/09/20 07:58:19 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst4979lb # [ 61.338913] niks3-server[1114]: 2026/09/20 07:58:19 INFO Received sign narinfos request method=POST path=/api/pending_closures/14/sign4980lb # [ 61.343627] niks3-server[1114]: 2026/09/20 07:58:19 INFO Signed narinfos id=14 count=14981worker1 # [ 61.235454] nix-grpc-daemon[928]: time=2026-09-20T07:58:20.457Z level=INFO msg="Uploading 1 narinfos"4982lb # [ 61.353962] niks3-server[1114]: 2026/09/20 07:58:19 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls4983lb # [ 61.360233] niks3-server[1114]: 2026/09/20 07:58:19 INFO Received complete upload request method=POST path=/api/pending_closures/14/complete4984lb # [ 61.363559] niks3-server[1114]: 2026/09/20 07:58:19 INFO Completed upload id=144985worker1 # [ 61.252780] nix-grpc-daemon[928]: time=2026-09-20T07:58:20.475Z level=INFO msg="Upload complete. (236ms)"4986lb # [ 61.365101] niks3-server[1114]: 2026/09/20 07:58:19 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo4987worker1 # [ 61.255197] nix-grpc-daemon[851]: ts=2026-09-20T07:58:20Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=7 outputs=14988worker1 # [ 61.262286] nix-daemon[915]: reaped child process 1183, status = succeeded4989worker1 # [ 61.302930] nix-grpc-daemon[851]: ts=2026-09-20T07:58:20Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:539364990worker2 # [ 61.455452] nix-grpc-daemon[851]: ts=2026-09-20T07:58:20Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:460164991worker2 # [ 61.464057] nix-grpc-daemon[851]: copying path '/nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top' from 'http://lb:5751'...4992worker2 # [ 61.473444] nix-grpc-daemon[851]: ts=2026-09-20T07:58:20Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46016 duration_s=0 paths=1 nar_bytes_out=2324993client # [ 61.491676] nix-daemon[995]: reaped child process 997, status = succeeded4994client: (finished: must succeed: NIX_REMOTE=daemon nix build --log-format internal-json --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --print-out-paths --no-link -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag hook 2>/tmp/hook.log, in 6.32 seconds)4995client: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top4996client: (finished: must succeed: grep farm-top-hook /nix/store/aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top, in 0.03 seconds)4997client: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }4998client: (finished: must succeed: grep -F 'LOG-farm-top-hook' /tmp/hook.log | grep -qF '"type":101' && grep -F 'farmPhase' /tmp/hook.log | grep -qF '"type":104' || { cat /tmp/hook.log >&2; false; }, in 0.04 seconds)4999client: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }5000client: (finished: must succeed: grep -F '"type":105' /tmp/hook.log | grep -F lb:50051 | grep -qF '"fields":["/nix/store/' || { grep -F '"type":105' /tmp/hook.log >&2; false; }, in 0.03 seconds)5001(finished: subtest: build hook: nix-daemon with builders = grpc://lb, in 6.41 seconds)5002subtest: an input only one worker has still reaches the builder5003client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only5004client # this derivation will be built:5005client # /nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv5006client # building '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv'...5007client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag w1only, in 0.39 seconds)5008client: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure5009client: (finished: must succeed: nix-store --export /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only > /tmp/shared/inp.closure, in 0.19 seconds)5010worker1: must succeed: nix-store --import < /tmp/shared/inp.closure5011worker1: (finished: must succeed: nix-store --import < /tmp/shared/inp.closure, in 0.19 seconds)5012worker2: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only5013worker2: (finished: must fail: test -e /nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only, in 0.03 seconds)5014client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&25015client # [ 62.606716] nix-daemon[995]: accepted connection from pid 1074, user root (trusted)5016client # this derivation will be built:5017client # /nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5018client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5019worker1 # [ 62.788922] nix-grpc-daemon[851]: ts=2026-09-20T07:58:22Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:539365020worker1 # [ 62.795389] nix-grpc-daemon[851]: ts=2026-09-20T07:58:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:539365021worker1 # [ 62.966632] nix-daemon[915]: accepted connection from pid 1210, user nix-grpc-daemon (trusted)5022worker1 # [ 62.980875] nix-daemon[915]: reaped child process 1213, status = succeeded5023lb # [ 63.101799] niks3-server[1114]: 2026/09/20 07:58:21 INFO Received uploads request method=POST path=/api/pending_closures5024worker1 # [ 62.996929] nix-grpc-daemon[928]: time=2026-09-20T07:58:22.218Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5025worker1 # [ 62.998850] nix-grpc-daemon[928]: time=2026-09-20T07:58:22.220Z level=INFO msg="Uploading gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only (120B)"5026lb # [ 63.120481] niks3-server[1114]: 2026/09/20 07:58:21 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst5027lb # [ 63.123783] niks3-server[1114]: 2026/09/20 07:58:21 INFO Received sign narinfos request method=POST path=/api/pending_closures/15/sign5028lb # [ 63.125548] niks3-server[1114]: 2026/09/20 07:58:21 INFO Signed narinfos id=15 count=15029worker1 # [ 63.016844] nix-grpc-daemon[928]: time=2026-09-20T07:58:22.238Z level=INFO msg="Uploading 1 narinfos"5030lb # [ 63.132061] niks3-server[1114]: 2026/09/20 07:58:21 INFO Received complete upload request method=POST path=/api/pending_closures/15/complete5031lb # [ 63.138341] niks3-server[1114]: 2026/09/20 07:58:21 INFO Completed upload id=155032worker1 # [ 63.027695] nix-grpc-daemon[928]: time=2026-09-20T07:58:22.249Z level=INFO msg="Upload complete. (233ms)"5033lb # [ 63.139760] niks3-server[1114]: 2026/09/20 07:58:21 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.ls5034lb # [ 63.141981] niks3-server[1114]: 2026/09/20 07:58:21 INFO Registered completed upload object_key=gycxa7jajm34fqsmi3xn0zjr3pvaya0x.narinfo5035worker1 # [ 63.039053] nix-grpc-daemon[851]: ts=2026-09-20T07:58:22Z level=debug event=want client=8 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv cached=05036worker1 # [ 63.040964] nix-grpc-daemon[851]: ts=2026-09-20T07:58:22Z level=debug event=assigned drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv worker=192.168.1.4:50051 clients=15037worker2 # [ 63.214230] nix-grpc-daemon[851]: ts=2026-09-20T07:58:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:460165038worker2 # [ 63.226370] nix-grpc-daemon[851]: ts=2026-09-20T07:58:22Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:460165039client # copying 2 paths to 'lb:50051'...5040client # copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' to 'lb:50051'...5041worker2 # [ 63.243317] nix-grpc-daemon[851]: ts=2026-09-20T07:58:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:460165042client # copying path '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' to 'lb:50051'...5043worker2 # [ 63.254575] nix-daemon[911]: accepted connection from pid 851, user nix-grpc-daemon (trusted)5044worker2 # [ 63.393204] nix-daemon[911]: accepted connection from pid 1012, user nix-grpc-daemon (trusted)5045worker2 # [ 63.407768] nix-daemon[911]: reaped child process 1015, status = succeeded5046worker2 # [ 63.532895] nix-daemon[911]: accepted connection from pid 1018, user nix-grpc-daemon (trusted)5047worker2 # [ 63.547273] nix-daemon[911]: reaped child process 1021, status = succeeded5048lb # [ 63.533609] niks3-server[1114]: 2026/09/20 07:58:22 INFO Received uploads request method=POST path=/api/pending_closures5049lb # [ 63.537679] niks3-server[1114]: 2026/09/20 07:58:22 INFO Received uploads request method=POST path=/api/pending_closures5050worker2 # [ 63.560415] nix-grpc-daemon[935]: time=2026-09-20T07:58:22.451Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5051worker2 # [ 63.562912] nix-grpc-daemon[935]: time=2026-09-20T07:58:22.453Z level=INFO msg="Uploading s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv (416B)"5052worker2 # [ 63.564515] nix-grpc-daemon[935]: time=2026-09-20T07:58:22.453Z level=INFO msg="Uploading k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv (560B)"5053lb # [ 63.554197] niks3-server[1114]: 2026/09/20 07:58:22 INFO Registered completed upload object_key=nar/0s7awvvc5phwxzwwzhl47kzq38pdgwj6jp3kwxf5w2xddnxnkl6h.nar.zst5054lb # [ 63.558567] niks3-server[1114]: 2026/09/20 07:58:22 INFO Registered completed upload object_key=nar/136ms4k64sfvy4m17vvd9w9yncq4zydv4cjbhchdcg4j7ccbx3b9.nar.zst5055lb # [ 63.563338] niks3-server[1114]: 2026/09/20 07:58:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/16/sign5056lb # [ 63.565719] niks3-server[1114]: 2026/09/20 07:58:22 INFO Signed narinfos id=16 count=15057lb # [ 63.567050] niks3-server[1114]: 2026/09/20 07:58:22 INFO Received sign narinfos request method=POST path=/api/pending_closures/17/sign5058lb # [ 63.568905] niks3-server[1114]: 2026/09/20 07:58:22 INFO Signed narinfos id=17 count=25059worker2 # [ 63.590171] nix-grpc-daemon[935]: time=2026-09-20T07:58:22.481Z level=INFO msg="Uploading 3 narinfos"5060lb # [ 63.572794] niks3-server[1114]: 2026/09/20 07:58:22 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.ls5061lb # [ 63.579700] niks3-server[1114]: 2026/09/20 07:58:22 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.ls5062lb # [ 63.586081] niks3-server[1114]: 2026/09/20 07:58:22 INFO Received complete upload request method=POST path=/api/pending_closures/16/complete5063lb # [ 63.591879] niks3-server[1114]: 2026/09/20 07:58:22 INFO Completed upload id=165064lb # [ 63.593704] niks3-server[1114]: 2026/09/20 07:58:22 INFO Received complete upload request method=POST path=/api/pending_closures/17/complete5065lb # [ 63.596385] niks3-server[1114]: 2026/09/20 07:58:22 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5066lb # [ 63.598661] niks3-server[1114]: 2026/09/20 07:58:22 INFO Registered completed upload object_key=s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr.narinfo5067lb # [ 63.600368] niks3-server[1114]: 2026/09/20 07:58:22 INFO Completed upload id=175068worker2 # [ 63.620944] nix-grpc-daemon[935]: time=2026-09-20T07:58:22.512Z level=INFO msg="Upload complete. (359ms)"5069lb # [ 63.601635] niks3-server[1114]: 2026/09/20 07:58:22 INFO Registered completed upload object_key=k9va03aiirjmgih65p90fpa9mr396d2b.narinfo5070worker2 # [ 63.623142] nix-grpc-daemon[851]: ts=2026-09-20T07:58:22Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46016 duration_s=0 paths=2 nar_bytes_in=9765071worker2 # [ 63.625854] nix-grpc-daemon[851]: ts=2026-09-20T07:58:22Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:460165072worker2 # [ 63.632431] nix-daemon[911]: accepted connection from pid 851, user nix-grpc-daemon (trusted)5073worker2 # [ 63.637143] nix-daemon[911]: reaped child process 1010, status = succeeded5074worker2 # [ 63.642376] nix-grpc-daemon[851]: copying path '/nix/store/gycxa7jajm34fqsmi3xn0zjr3pvaya0x-local-input-w1only' from 'http://lb:5751'...5075worker2 # [ 63.649237] nix-daemon[911]: accepted connection from pid 851, user nix-grpc-daemon (trusted)5076client # building '/nix/store/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv' on lb:50051...5077client # uses-input-w1onlya> worker2: building k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5078worker2 # [ 64.662775] nix-daemon[911]: reaped child process 1026, status = succeeded5079worker2 # [ 64.774761] nix-daemon[911]: accepted connection from pid 1041, user nix-grpc-daemon (trusted)5080worker2 # [ 64.786640] nix-daemon[911]: reaped child process 1044, status = succeeded5081lb # [ 64.774935] niks3-server[1114]: 2026/09/20 07:58:23 INFO Received uploads request method=POST path=/api/pending_closures5082worker2 # [ 64.798527] nix-grpc-daemon[935]: time=2026-09-20T07:58:23.690Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5083lb # [ 64.790414] niks3-server[1114]: 2026/09/20 07:58:23 INFO Received sign narinfos request method=POST path=/api/pending_closures/18/sign5084lb # [ 64.792829] niks3-server[1114]: 2026/09/20 07:58:23 INFO Signed narinfos id=18 count=15085worker2 # [ 64.812579] nix-grpc-daemon[935]: time=2026-09-20T07:58:23.704Z level=INFO msg="Uploading 1 narinfos"5086lb # [ 64.795799] niks3-server[1114]: 2026/09/20 07:58:23 INFO Registered completed upload object_key=log/k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv5087lb # [ 64.798371] niks3-server[1114]: 2026/09/20 07:58:23 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.ls5088lb # [ 64.802053] niks3-server[1114]: 2026/09/20 07:58:23 INFO Received complete upload request method=POST path=/api/pending_closures/18/complete5089lb # [ 64.804988] niks3-server[1114]: 2026/09/20 07:58:23 INFO Completed upload id=185090worker2 # [ 64.824474] nix-grpc-daemon[935]: time=2026-09-20T07:58:23.716Z level=INFO msg="Upload complete. (167ms)"5091lb # [ 64.807304] niks3-server[1114]: 2026/09/20 07:58:23 INFO Registered completed upload object_key=7fihpafywah8yif4mhbmz6i2i6adiqwj.narinfo5092worker2 # [ 64.826953] nix-grpc-daemon[851]: ts=2026-09-20T07:58:23Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46016 duration_s=1 drv=k9va03aiirjmgih65p90fpa9mr396d2b-uses-input-w1onlya.drv assign_id=8 outputs=15093worker2 # [ 64.833206] nix-daemon[911]: reaped child process 1023, status = succeeded5094client # copying 1 paths...5095worker1 # [ 64.741108] nix-grpc-daemon[851]: ts=2026-09-20T07:58:23Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:539365096worker1 # [ 64.749884] nix-grpc-daemon[851]: copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'http://lb:5751'...5097client # copying path '/nix/store/7fihpafywah8yif4mhbmz6i2i6adiqwj-uses-input-w1onlya' from 'grpc://lb:50051'...5098worker1 # [ 64.767776] nix-grpc-daemon[851]: ts=2026-09-20T07:58:23Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:539365099worker1 # [ 64.769798] nix-grpc-daemon[851]: ts=2026-09-20T07:58:23Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=0 paths=1 nar_bytes_out=1205100client # [ 64.929976] nix-daemon[995]: reaped child process 1077, status = succeeded5101client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt a >&2, in 2.53 seconds)5102client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&25103client # [ 65.079666] nix-daemon[995]: accepted connection from pid 1095, user root (trusted)5104client # this derivation will be built:5105client # /nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5106worker2 # [ 65.312292] nix-grpc-daemon[851]: ts=2026-09-20T07:58:24Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:460165107client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5108worker1 # [ 65.188390] nix-grpc-daemon[851]: ts=2026-09-20T07:58:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:539365109worker1 # [ 65.194896] nix-grpc-daemon[928]: time=2026-09-20T07:58:24.416Z level=INFO msg="All 1 paths already cached"5110worker1 # [ 65.204133] nix-grpc-daemon[851]: ts=2026-09-20T07:58:24Z level=debug event=want client=9 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv cached=05111worker1 # [ 65.206482] nix-grpc-daemon[851]: ts=2026-09-20T07:58:24Z level=debug event=assigned drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv worker=192.168.1.3:50051 clients=15112worker1 # [ 65.209074] nix-grpc-daemon[851]: ts=2026-09-20T07:58:24Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539365113worker1 # [ 65.215360] nix-grpc-daemon[851]: ts=2026-09-20T07:58:24Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:539365114client # copying 1 paths to 'lb:50051'...5115client # copying path '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' to 'lb:50051'...5116worker1 # [ 65.223646] nix-grpc-daemon[851]: ts=2026-09-20T07:58:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:539365117worker1 # [ 65.229506] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)5118worker1 # [ 65.237217] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 20 ms (attempt 1/5)5119worker1 # [ 65.259594] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 123 ms (attempt 2/5)5120worker1 # [ 65.385529] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 382 ms (attempt 3/5)5121worker1 # [ 65.774546] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 30 ms (attempt 4/5)5122worker1 # [ 65.807591] nix-grpc-daemon[851]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5123worker1 # [ 65.810267] nix-grpc-daemon[851]: copying path '/nix/store/s56ppgyv7qz2bls7ls2jsv2ni3g7fhhr-local-input-w1only.drv' from 'http://lb:5751'...5124worker1 # [ 65.973111] nix-daemon[915]: accepted connection from pid 1226, user nix-grpc-daemon (trusted)5125worker1 # [ 65.987558] nix-daemon[915]: reaped child process 1229, status = succeeded5126worker1 # [ 66.142376] nix-daemon[915]: accepted connection from pid 1231, user nix-grpc-daemon (trusted)5127worker1 # [ 66.162504] nix-daemon[915]: reaped child process 1234, status = succeeded5128lb # [ 66.286602] niks3-server[1114]: 2026/09/20 07:58:24 INFO Received uploads request method=POST path=/api/pending_closures5129worker1 # [ 66.184763] nix-grpc-daemon[928]: time=2026-09-20T07:58:25.406Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5130worker1 # [ 66.186575] nix-grpc-daemon[928]: time=2026-09-20T07:58:25.406Z level=INFO msg="Uploading 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv (560B)"5131lb # [ 66.314147] niks3-server[1114]: 2026/09/20 07:58:24 INFO Registered completed upload object_key=nar/0bp8pfsa12j91bab6f50rs7hh6sphjrig1zqlr7v80mn285qxax2.nar.zst5132lb # [ 66.322779] niks3-server[1114]: 2026/09/20 07:58:24 INFO Received sign narinfos request method=POST path=/api/pending_closures/19/sign5133lb # [ 66.327109] niks3-server[1114]: 2026/09/20 07:58:24 INFO Signed narinfos id=19 count=15134worker1 # [ 66.220156] nix-grpc-daemon[928]: time=2026-09-20T07:58:25.441Z level=INFO msg="Uploading 1 narinfos"5135lb # [ 66.336393] niks3-server[1114]: 2026/09/20 07:58:24 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.ls5136lb # [ 66.345152] niks3-server[1114]: 2026/09/20 07:58:24 INFO Received complete upload request method=POST path=/api/pending_closures/19/complete5137lb # [ 66.351085] niks3-server[1114]: 2026/09/20 07:58:24 INFO Completed upload id=195138worker1 # [ 66.240462] nix-grpc-daemon[928]: time=2026-09-20T07:58:25.462Z level=INFO msg="Upload complete. (420ms)"5139lb # [ 66.352703] niks3-server[1114]: 2026/09/20 07:58:24 INFO Registered completed upload object_key=2ign0w9nlrywl4qfkq5i314zinl1cxqs.narinfo5140worker1 # [ 66.242745] nix-grpc-daemon[851]: ts=2026-09-20T07:58:25Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=1 paths=1 nar_bytes_in=5605141worker1 # [ 66.246184] nix-grpc-daemon[851]: ts=2026-09-20T07:58:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:539365142worker1 # [ 66.253973] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)5143worker1 # [ 66.259908] nix-daemon[915]: reaped child process 1220, status = succeeded5144client # building '/nix/store/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv' on lb:50051...5145worker1 # [ 66.262988] nix-daemon[915]: accepted connection from pid 851, user nix-grpc-daemon (trusted)5146client # uses-input-w1onlyb> node-a: building 2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5147worker1 # [ 67.893421] nix-daemon[915]: reaped child process 1238, status = succeeded5148worker1 # [ 68.043702] nix-daemon[915]: accepted connection from pid 1253, user nix-grpc-daemon (trusted)5149worker1 # [ 68.058785] nix-daemon[915]: reaped child process 1256, status = succeeded5150lb # [ 68.184825] niks3-server[1114]: 2026/09/20 07:58:26 INFO Received uploads request method=POST path=/api/pending_closures5151worker1 # [ 68.081798] nix-grpc-daemon[928]: time=2026-09-20T07:58:27.303Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5152lb # [ 68.214391] niks3-server[1114]: 2026/09/20 07:58:26 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.ls5153lb # [ 68.220349] niks3-server[1114]: 2026/09/20 07:58:26 INFO Received sign narinfos request method=POST path=/api/pending_closures/20/sign5154worker1 # [ 68.113171] nix-grpc-daemon[928]: time=2026-09-20T07:58:27.335Z level=INFO msg="Uploading 1 narinfos"5155lb # [ 68.223903] niks3-server[1114]: 2026/09/20 07:58:26 INFO Signed narinfos id=20 count=15156lb # [ 68.233561] niks3-server[1114]: 2026/09/20 07:58:26 INFO Registered completed upload object_key=log/2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv5157lb # [ 68.241065] niks3-server[1114]: 2026/09/20 07:58:26 INFO Received complete upload request method=POST path=/api/pending_closures/20/complete5158lb # [ 68.244540] niks3-server[1114]: 2026/09/20 07:58:26 INFO Completed upload id=205159worker1 # [ 68.135239] nix-grpc-daemon[928]: time=2026-09-20T07:58:27.357Z level=INFO msg="Upload complete. (262ms)"5160lb # [ 68.246047] niks3-server[1114]: 2026/09/20 07:58:26 INFO Registered completed upload object_key=rs93p5yqksm4zlblqlsfa8kxl8lkhrbg.narinfo5161worker1 # [ 68.139176] nix-grpc-daemon[851]: ts=2026-09-20T07:58:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:53936 duration_s=1 drv=2ign0w9nlrywl4qfkq5i314zinl1cxqs-uses-input-w1onlyb.drv assign_id=9 outputs=15162worker1 # [ 68.146064] nix-daemon[915]: reaped child process 1236, status = succeeded5163client # copying 1 paths...5164worker2 # [ 68.313739] nix-grpc-daemon[851]: ts=2026-09-20T07:58:27Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:460165165worker2 # [ 68.324247] nix-grpc-daemon[851]: copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'http://lb:5751'...5166client # copying path '/nix/store/rs93p5yqksm4zlblqlsfa8kxl8lkhrbg-uses-input-w1onlyb' from 'grpc://lb:50051'...5167worker2 # [ 68.347232] nix-grpc-daemon[851]: ts=2026-09-20T07:58:27Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:460165168worker2 # [ 68.349210] nix-grpc-daemon[851]: ts=2026-09-20T07:58:27Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46016 duration_s=0 paths=1 nar_bytes_out=1205169client # [ 68.372271] nix-daemon[995]: reaped child process 1098, status = succeeded5170client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt b >&2, in 3.45 seconds)5171client: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&25172client # [ 68.547086] nix-daemon[995]: accepted connection from pid 1116, user root (trusted)5173client # this derivation will be built:5174client # /nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5175worker2 # [ 68.795875] nix-grpc-daemon[851]: ts=2026-09-20T07:58:27Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:460165176client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux'...5177worker2 # [ 68.801929] nix-grpc-daemon[851]: ts=2026-09-20T07:58:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:460165178worker2 # [ 68.809368] nix-grpc-daemon[935]: time=2026-09-20T07:58:27.700Z level=INFO msg="All 1 paths already cached"5179worker1 # [ 68.688251] nix-grpc-daemon[851]: ts=2026-09-20T07:58:27Z level=debug event=want client=10 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv cached=05180worker2 # [ 68.819767] nix-grpc-daemon[851]: ts=2026-09-20T07:58:27Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:460165181worker1 # [ 68.690278] nix-grpc-daemon[851]: ts=2026-09-20T07:58:27Z level=debug event=assigned drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv worker=192.168.1.4:50051 clients=15182worker2 # [ 68.827611] nix-grpc-daemon[851]: ts=2026-09-20T07:58:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:460165183worker2 # [ 68.834127] nix-grpc-daemon[935]: time=2026-09-20T07:58:27.725Z level=INFO msg="All 1 paths already cached"5184client # copying 1 paths to 'lb:50051'...5185client # copying path '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' to 'lb:50051'...5186worker2 # [ 68.837238] nix-grpc-daemon[851]: ts=2026-09-20T07:58:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:460165187worker2 # [ 68.843111] nix-daemon[911]: accepted connection from pid 851, user nix-grpc-daemon (trusted)5188worker2 # [ 68.976052] nix-daemon[911]: accepted connection from pid 1049, user nix-grpc-daemon (trusted)5189worker2 # [ 68.989342] nix-daemon[911]: reaped child process 1052, status = succeeded5190worker2 # [ 69.149802] nix-daemon[911]: accepted connection from pid 1054, user nix-grpc-daemon (trusted)5191worker2 # [ 69.162305] nix-daemon[911]: reaped child process 1057, status = succeeded5192lb # [ 69.156843] niks3-server[1114]: 2026/09/20 07:58:27 INFO Received uploads request method=POST path=/api/pending_closures5193worker2 # [ 69.184847] nix-grpc-daemon[935]: time=2026-09-20T07:58:28.076Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5194worker2 # [ 69.186304] nix-grpc-daemon[935]: time=2026-09-20T07:58:28.078Z level=INFO msg="Uploading ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv (560B)"5195lb # [ 69.187775] niks3-server[1114]: 2026/09/20 07:58:27 INFO Registered completed upload object_key=nar/1iq9qm6vw4b3p68mlkiw8nf0phmz21m8g79izsy14sydxmd4gmqa.nar.zst5196lb # [ 69.192719] niks3-server[1114]: 2026/09/20 07:58:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/21/sign5197lb # [ 69.194976] niks3-server[1114]: 2026/09/20 07:58:27 INFO Signed narinfos id=21 count=15198worker2 # [ 69.214272] nix-grpc-daemon[935]: time=2026-09-20T07:58:28.105Z level=INFO msg="Uploading 1 narinfos"5199lb # [ 69.198044] niks3-server[1114]: 2026/09/20 07:58:27 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.ls5200lb # [ 69.202299] niks3-server[1114]: 2026/09/20 07:58:27 INFO Received complete upload request method=POST path=/api/pending_closures/21/complete5201lb # [ 69.204987] niks3-server[1114]: 2026/09/20 07:58:27 INFO Completed upload id=215202worker2 # [ 69.224506] nix-grpc-daemon[935]: time=2026-09-20T07:58:28.116Z level=INFO msg="Upload complete. (376ms)"5203worker2 # [ 69.226383] nix-grpc-daemon[851]: ts=2026-09-20T07:58:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:46016 duration_s=0 paths=1 nar_bytes_in=5605204lb # [ 69.207899] niks3-server[1114]: 2026/09/20 07:58:27 INFO Registered completed upload object_key=ych53lrh5qfmdxlnx672apx2v80x3aan.narinfo5205worker2 # [ 69.229650] nix-grpc-daemon[851]: ts=2026-09-20T07:58:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:460165206worker2 # [ 69.235872] nix-daemon[911]: accepted connection from pid 851, user nix-grpc-daemon (trusted)5207worker2 # [ 69.239259] nix-daemon[911]: reaped child process 1047, status = succeeded5208client # building '/nix/store/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv' on lb:50051...5209worker2 # [ 69.244655] nix-daemon[911]: accepted connection from pid 851, user nix-grpc-daemon (trusted)5210client # uses-input-w1onlyc> worker2: building ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5211lb # [ 70.482727] envoy[939]: conn peer=[2001:db8:1::1]:36412 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=4302 tx=2083 ms=19195212lb # [ 70.486787] envoy[939]: conn peer=[2001:db8:1::1]:36418 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=725213lb # [ 70.490598] envoy[939]: conn peer=[2001:db8:1::1]:57474 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3838 tx=1878 ms=20335214lb # [ 70.494133] envoy[939]: conn peer=[2001:db8:1::1]:57490 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=505215lb # [ 70.497522] envoy[939]: conn peer=[2001:db8:1::1]:57498 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3711 tx=1912 ms=30865216lb # [ 70.500952] envoy[939]: conn peer=[2001:db8:1::1]:57502 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=505217worker2 # [ 70.873748] nix-daemon[911]: reaped child process 1061, status = succeeded5218worker2 # [ 71.016394] nix-daemon[911]: accepted connection from pid 1076, user nix-grpc-daemon (trusted)5219worker2 # [ 71.029133] nix-daemon[911]: reaped child process 1079, status = succeeded5220lb # [ 71.024619] niks3-server[1114]: 2026/09/20 07:58:29 INFO Received uploads request method=POST path=/api/pending_closures5221worker2 # [ 71.051667] nix-grpc-daemon[935]: time=2026-09-20T07:58:29.943Z level=INFO msg="Uploading 0 paths to lb (1 already cached)"5222lb # [ 71.053604] niks3-server[1114]: 2026/09/20 07:58:29 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.ls5223lb # [ 71.058604] niks3-server[1114]: 2026/09/20 07:58:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/22/sign5224lb # [ 71.062876] niks3-server[1114]: 2026/09/20 07:58:29 INFO Signed narinfos id=22 count=15225worker2 # [ 71.085339] nix-grpc-daemon[935]: time=2026-09-20T07:58:29.976Z level=INFO msg="Uploading 1 narinfos"5226lb # [ 71.072582] niks3-server[1114]: 2026/09/20 07:58:29 INFO Registered completed upload object_key=log/ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv5227lb # [ 71.082310] niks3-server[1114]: 2026/09/20 07:58:29 INFO Received complete upload request method=POST path=/api/pending_closures/22/complete5228lb # [ 71.087901] niks3-server[1114]: 2026/09/20 07:58:29 INFO Completed upload id=225229worker2 # [ 71.107400] nix-grpc-daemon[935]: time=2026-09-20T07:58:29.999Z level=INFO msg="Upload complete. (254ms)"5230lb # [ 71.091132] niks3-server[1114]: 2026/09/20 07:58:29 INFO Registered completed upload object_key=af2xkgzqdrcsfmk8dgmypxmxww9cx3rk.narinfo5231worker2 # [ 71.112385] nix-grpc-daemon[851]: ts=2026-09-20T07:58:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:46016 duration_s=1 drv=ych53lrh5qfmdxlnx672apx2v80x3aan-uses-input-w1onlyc.drv assign_id=10 outputs=15232worker2 # [ 71.122909] nix-daemon[911]: reaped child process 1059, status = succeeded5233client # copying 1 paths...5234worker1 # [ 71.026318] nix-grpc-daemon[851]: ts=2026-09-20T07:58:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:539365235worker1 # [ 71.035424] nix-grpc-daemon[851]: copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'http://lb:5751'...5236client # copying path '/nix/store/af2xkgzqdrcsfmk8dgmypxmxww9cx3rk-uses-input-w1onlyc' from 'grpc://lb:50051'...5237worker2 # [ 71.191152] nix-grpc-daemon[851]: ts=2026-09-20T07:58:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:460165238worker2 # [ 71.195923] nix-grpc-daemon[851]: ts=2026-09-20T07:58:30Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:46016 duration_s=0 paths=1 nar_bytes_out=1205239client # [ 71.218511] nix-daemon[995]: reaped child process 1119, status = succeeded5240client: (finished: must succeed: NIX_REMOTE=daemon nix build -L --max-jobs 0 --builders 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key&system=x86_64-linux x86_64-linux - 4' --no-link -f /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix job --argstr tag w1only --argstr salt c >&2, in 2.84 seconds)5241(finished: subtest: an input only one worker has still reaches the builder, in 9.63 seconds)5242subtest: upload whose reference the worker lacks is completed from the cache5243client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache5244client # this derivation will be built:5245client # /nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv5246client # building '/nix/store/zpv7g9hl0xcjhjz0g0hd92sv1sf580zh-local-input-viacache.drv'...5247client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A input --argstr tag viacache, in 0.38 seconds)5248client: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache5249client # this derivation will be built:5250client # /nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv5251client # building '/nix/store/8higgmxp1c6ag4yj6sk9g6z66n43x70l-refers-to-input-viacache.drv'...5252client: (finished: must succeed: nix-build --no-out-link /nix/store/c7y5zg34h61m4kmsb9zg0afqx5zqqhrd-dep.nix -A referrer --argstr tag viacache, in 0.34 seconds)5253client: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure5254client: (finished: must succeed: nix-store --export /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache > /tmp/shared/ref.closure, in 0.17 seconds)5255worker1: must succeed: nix-store --import < /tmp/shared/ref.closure5256worker1: (finished: must succeed: nix-store --import < /tmp/shared/ref.closure, in 0.21 seconds)5257worker2 # [ 72.443469] systemd[1]: Stopping Nix worker-protocol over gRPC...5258worker2 # [ 72.775849] nix-grpc-daemon[851]: ts=2026-09-20T07:58:31Z level=info event=signal_exit5259worker2 # [ 74.032883] nix-grpc-daemon[851]: ts=2026-09-20T07:58:32Z level=info event=scheduler_restarting5260worker1 # [ 73.908650] nix-grpc-daemon[851]: ts=2026-09-20T07:58:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:488465261worker1 # [ 73.910766] nix-grpc-daemon[851]: ts=2026-09-20T07:58:33Z level=info event=worker_gone addr=192.168.1.4:500515262worker2 # [ 74.041461] nix-grpc-daemon[851]: ts=2026-09-20T07:58:32Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5263worker2 # [ 74.052064] nix-daemon[911]: reaped child process 913, status = succeeded5264worker2 # [ 74.906097] nix-grpc-daemon[851]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5265worker2 # [ 74.907631] nix-grpc-daemon[851]: E0000 00:00:1789891113.797278 894 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 16, started true, shutdown true5266worker2 # [ 74.909556] nix-grpc-daemon[851]: E0000 00:00:1789891113.797752 894 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5267worker2 # [ 75.297480] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5268worker2 # [ 75.298510] systemd[1]: Stopped Nix worker-protocol over gRPC.5269worker2 # [ 75.301091] systemd[1]: nix-grpc-daemon.service: Consumed 1.310s CPU time over 54.804s wall clock time, 47.3M memory peak, 53.2K incoming IP traffic, 98.6K outgoing IP traffic.5270worker2 # [ 75.304907] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5271worker2 # [ 75.306649] systemd[1]: Closed Nix worker-protocol over gRPC.5272worker2 # [ 75.307919] systemd[1]: nix-grpc-daemon.socket: Consumed 493us CPU time over 1min 4.382s wall clock time, 256K memory peak, 93.9K incoming IP traffic, 75K outgoing IP traffic.5273lb: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy5274lb: must succeed: curl -sf localhost:9901/clusters5275lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5276lb: (finished: waiting until exactly ['worker2'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5277client: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&25278worker1 # [ 75.451908] nix-grpc-daemon[851]: ts=2026-09-20T07:58:34Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:539365279worker1 # [ 75.458747] nix-grpc-daemon[851]: ts=2026-09-20T07:58:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:539365280client # /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5281client: (finished: must succeed: nix path-info --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache >&2, in 0.24 seconds)5282worker2: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache5283worker2: (finished: must fail: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache, in 0.02 seconds)5284worker2 # [ 75.677819] systemd[1]: Listening on Nix worker-protocol over gRPC.5285worker1 # [ 75.602441] systemd[1]: Stopping Nix worker-protocol over gRPC...5286worker1 # [ 75.644555] nix-grpc-daemon[851]: ts=2026-09-20T07:58:34Z level=info event=signal_exit5287worker1 # [ 75.896936] nix-grpc-daemon[851]: ts=2026-09-20T07:58:35Z level=info event=scheduler_yield5288worker1 # [ 75.901352] nix-grpc-daemon[851]: ts=2026-09-20T07:58:35Z level=info event=scheduler_restarting addr=lb:500515289lb # [ 76.012364] niks3-server[1114]: 2026/09/20 07:58:34 INFO lead: released remote=192.168.1.3:469565290worker1 # [ 75.905868] nix-grpc-daemon[851]: ts=2026-09-20T07:58:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:488465291worker1 # [ 75.909269] nix-grpc-daemon[851]: ts=2026-09-20T07:58:35Z level=info event=worker_gone addr=192.168.1.3:500515292worker1 # [ 76.102315] nix-grpc-daemon[851]: ts=2026-09-20T07:58:35Z level=info event=scheduler_connected addr=lb:500515293worker1 # [ 76.111078] nix-grpc-daemon[851]: ts=2026-09-20T07:58:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5294worker2 # [ 76.291307] systemd[1]: Starting Nix worker-protocol over gRPC...5295worker2 # [ 76.436272] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:35Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5296worker2 # [ 76.439511] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:35Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15297worker1 # [ 76.311975] nix-grpc-daemon[851]: ts=2026-09-20T07:58:35Z level=info event=scheduler_connected addr=lb:500515298worker2 # [ 76.446616] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:35Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5299worker2 # [ 76.449526] systemd[1]: Started Nix worker-protocol over gRPC.5300lb # [ 76.436584] niks3-server[1114]: 2026/09/20 07:58:34 INFO lead: acquired remote=192.168.1.4:541145301worker2 # [ 76.456139] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:35Z level=info event=scheduler_take_over5302worker2 # [ 76.459430] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:35Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05303worker2 # [ 76.465528] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:35Z level=info event=scheduler_connected addr=lb:500515304worker2 # [ 76.467864] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:35Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5305worker2 # [ 76.668463] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:35Z level=info event=scheduler_connected addr=lb:500515306worker2 # [ 76.670489] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:35Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05307worker1 # [ 76.902283] nix-grpc-daemon[851]: ts=2026-09-20T07:58:36Z level=info event=scheduler_restarting5308worker2 # [ 77.037594] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:35Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:494245309worker2 # [ 77.041545] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:35Z level=info event=worker_gone addr=192.168.1.3:500515310worker1 # [ 76.915667] nix-grpc-daemon[851]: ts=2026-09-20T07:58:36Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5311worker1 # [ 76.930415] nix-daemon[915]: reaped child process 918, status = succeeded5312worker1 # [ 77.120560] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5313worker1 # [ 77.121752] systemd[1]: Stopped Nix worker-protocol over gRPC.5314worker1 # [ 77.123393] systemd[1]: nix-grpc-daemon.service: Consumed 2.518s CPU time over 56.761s wall clock time, 57.8M memory peak, 88K incoming IP traffic, 174.7K outgoing IP traffic.5315worker1 # [ 77.128205] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5316worker1 # [ 77.129963] systemd[1]: Closed Nix worker-protocol over gRPC.5317worker1 # [ 77.131361] systemd[1]: nix-grpc-daemon.socket: Consumed 521us CPU time over 1min 5.689s wall clock time, 256K memory peak, 121K incoming IP traffic, 97K outgoing IP traffic.5318lb: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy5319lb: must succeed: curl -sf localhost:9901/clusters5320lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5321lb: (finished: waiting until exactly ['worker1'] endpoints of x86_64-linux are unhealthy, in 0.07 seconds)5322client: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&25323worker2 # [ 77.505460] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:36Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:494385324worker2 # [ 77.516722] nix-daemon[911]: accepted connection from pid 1100, user nix-grpc-daemon (trusted)5325worker2 # [ 77.533656] nix-grpc-daemon[1100]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 74 ms (attempt 1/5)5326worker2 # [ 77.613739] nix-grpc-daemon[1100]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 88 ms (attempt 2/5)5327worker2 # [ 77.706414] nix-grpc-daemon[1100]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 5 ms (attempt 3/5)5328worker2 # [ 77.713766] nix-grpc-daemon[1100]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 184 ms (attempt 4/5)5329worker2 # [ 77.900938] nix-grpc-daemon[1100]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5330client # copying 2 paths...5331client # copying path '/nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache' to 'grpc://lb:50051'...5332worker2 # [ 77.921940] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:494385333client # copying path '/nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache' to 'grpc://lb:50051'...5334worker2 # [ 77.931891] nix-daemon[911]: accepted connection from pid 1100, user nix-grpc-daemon (trusted)5335worker2 # [ 77.941243] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:36Z level=info event=niks3_push_started pid=11565336worker2 # [ 78.224372] nix-daemon[911]: accepted connection from pid 1169, user nix-grpc-daemon (trusted)5337worker2 # [ 78.236282] nix-daemon[911]: reaped child process 1172, status = succeeded5338lb # [ 78.229134] niks3-server[1114]: 2026/09/20 07:58:36 INFO Received uploads request method=POST path=/api/pending_closures5339lb # [ 78.238819] niks3-server[1114]: 2026/09/20 07:58:36 INFO Received uploads request method=POST path=/api/pending_closures5340worker2 # [ 78.265175] nix-grpc-daemon[1156]: time=2026-09-20T07:58:37.156Z level=INFO msg="Uploading 2 paths to lb (0 already cached)"5341worker2 # [ 78.268056] nix-grpc-daemon[1156]: time=2026-09-20T07:58:37.158Z level=INFO msg="Uploading 6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache (184B)"5342worker2 # [ 78.269763] nix-grpc-daemon[1156]: time=2026-09-20T07:58:37.158Z level=INFO msg="Uploading cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache (128B)"5343lb # [ 78.288600] niks3-server[1114]: 2026/09/20 07:58:36 INFO Registered completed upload object_key=nar/15y5akaw5jxrf5q28c25cfgfdz5zw27ihvpagi1mmvpnaw9na2a5.nar.zst5344lb # [ 78.294855] niks3-server[1114]: 2026/09/20 07:58:36 INFO Registered completed upload object_key=nar/1kmnh5f2l7jjcgaq9b9988bjix6z8zjf6v350xllq5hlzgnb1f75.nar.zst5345lb # [ 78.301822] niks3-server[1114]: 2026/09/20 07:58:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/23/sign5346lb # [ 78.305411] niks3-server[1114]: 2026/09/20 07:58:36 INFO Signed narinfos id=23 count=15347lb # [ 78.310521] niks3-server[1114]: 2026/09/20 07:58:36 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.ls5348lb # [ 78.312818] niks3-server[1114]: 2026/09/20 07:58:36 INFO Received sign narinfos request method=POST path=/api/pending_closures/24/sign5349lb # [ 78.314752] niks3-server[1114]: 2026/09/20 07:58:36 INFO Signed narinfos id=24 count=25350worker2 # [ 78.335083] nix-grpc-daemon[1156]: time=2026-09-20T07:58:37.226Z level=INFO msg="Uploading 3 narinfos"5351lb # [ 78.316548] niks3-server[1114]: 2026/09/20 07:58:36 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.ls5352lb # [ 78.325815] niks3-server[1114]: 2026/09/20 07:58:36 INFO Registered completed upload object_key=6zp5fijxpjrd2vv7855sb0z7aag6mm8d.narinfo5353lb # [ 78.331152] niks3-server[1114]: 2026/09/20 07:58:36 INFO Received complete upload request method=POST path=/api/pending_closures/23/complete5354lb # [ 78.333816] niks3-server[1114]: 2026/09/20 07:58:36 INFO Completed upload id=235355lb # [ 78.335793] niks3-server[1114]: 2026/09/20 07:58:36 INFO Received complete upload request method=POST path=/api/pending_closures/24/complete5356lb # [ 78.338673] niks3-server[1114]: 2026/09/20 07:58:36 INFO Registered completed upload object_key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo5357lb # [ 78.340828] niks3-server[1114]: 2026/09/20 07:58:36 INFO Completed upload id=245358worker2 # [ 78.360062] nix-grpc-daemon[1156]: time=2026-09-20T07:58:37.251Z level=INFO msg="Upload complete. (267ms)"5359worker2 # [ 78.364243] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:37Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:49438 duration_s=0 paths=2 nar_bytes_in=3125360worker2 # [ 78.370330] nix-grpc-daemon[1156]: time=2026-09-20T07:58:37.260Z level=WARN msg="Failed to register uploaded object" key=cmsrl1s0jpx66sskcbsv9jgl7ryk8101.narinfo error="server returned 404: object is not pending upload\n"5361worker2 # [ 78.381829] nix-daemon[911]: reaped child process 1154, status = succeeded5362client: (finished: must succeed: nix copy --no-check-sigs --to 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache >&2, in 1.05 seconds)5363worker2: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache5364worker2: (finished: must succeed: test -e /nix/store/cmsrl1s0jpx66sskcbsv9jgl7ryk8101-local-input-viacache && test -e /nix/store/6zp5fijxpjrd2vv7855sb0z7aag6mm8d-refers-to-input-viacache, in 0.01 seconds)5365worker1 # [ 78.331750] systemd[1]: Listening on Nix worker-protocol over gRPC.5366worker1 # [ 78.341170] systemd[1]: Starting Nix worker-protocol over gRPC...5367worker1 # [ 78.512163] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:37Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5368worker1 # [ 78.514863] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:37Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15369worker1 # [ 78.521794] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:37Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5370worker1 # [ 78.523583] systemd[1]: Started Nix worker-protocol over gRPC.5371lb: waiting until exactly no endpoints of x86_64-linux are unhealthy5372lb: must succeed: curl -sf localhost:9901/clusters5373worker1 # [ 78.544974] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:37Z level=info event=scheduler_connected addr=lb:500515374worker2 # [ 78.678503] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:37Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05375lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5376lb: must succeed: curl -sf localhost:9901/clusters5377lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5378lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.09 seconds)5379(finished: subtest: upload whose reference the worker lacks is completed from the cache, in 8.45 seconds)5380subtest: scheduler down: the other node takes the lock and keeps it5381lb: must succeed: curl -sf localhost:9901/clusters5382lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5383lb: must succeed: curl -sf localhost:9901/clusters5384lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5385lb: must succeed: curl -sf localhost:9901/clusters5386lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5387lb: must succeed: curl -sf localhost:9901/clusters5388lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.03 seconds)5389worker2 # [ 79.906291] systemd[1]: Stopping Nix worker-protocol over gRPC...5390worker2 # [ 80.453668] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:39Z level=info event=signal_exit5391worker2 # [ 80.461461] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:39Z level=info event=scheduler_yield5392lb # [ 80.445186] niks3-server[1114]: 2026/09/20 07:58:38 INFO lead: released remote=192.168.1.4:541145393worker1 # [ 80.337308] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:39Z level=info event=scheduler_restarting addr=lb:500515394worker2 # [ 80.467845] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:494245395worker2 # [ 80.475604] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:39Z level=info event=worker_gone addr=192.168.1.3:500515396worker2 # [ 80.479398] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:39Z level=info event=scheduler_restarting addr=lb:500515397worker2 # [ 80.482510] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:39Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:494245398worker2 # [ 80.485919] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:39Z level=info event=worker_gone addr=192.168.1.4:500515399lb # [ 80.482578] envoy[939]: conn peer=[2001:db8:1::1]:57506 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3712 tx=1892 ms=24525400lb # [ 80.484077] envoy[939]: conn peer=[2001:db8:1::1]:57520 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=447 tx=328 ms=565401lb # [ 80.485486] envoy[939]: conn peer=[2001:db8:1::4]:45634 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=16070 tx=3013 ms=522945402lb # [ 80.486960] envoy[939]: conn peer=[2001:db8:1::1]:56344 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=591 tx=522 ms=225403lb # [ 80.488427] envoy[939]: conn peer=192.168.1.3:44114 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=17490 tx=3547 ms=553305404lb # [ 80.489973] envoy[939]: conn peer=[2001:db8:1::1]:56358 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="TLS_error:|33554464:system_library:OPENSSL_internal:Broken_pipe:TLS_error_end" rx=1005 tx=282 ms=8725405worker1 # [ 80.536992] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:39Z level=info event=scheduler_connected addr=lb:500515406worker2 # [ 80.676178] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:39Z level=info event=scheduler_connected addr=lb:500515407worker1 # [ 80.545710] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5408worker2 # [ 80.688397] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5409worker1 # [ 80.747223] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:39Z level=info event=scheduler_connected addr=lb:500515410worker1 # [ 80.754356] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5411worker2 # [ 80.889501] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:39Z level=info event=scheduler_connected addr=lb:500515412worker2 # [ 80.894713] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5413worker1 # [ 80.954772] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:40Z level=info event=scheduler_connected addr=lb:500515414worker1 # [ 80.957733] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5415worker2 # [ 81.095405] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:39Z level=info event=scheduler_connected addr=lb:500515416worker2 # [ 81.097601] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:39Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5417worker1 # [ 81.158986] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:40Z level=info event=scheduler_connected addr=lb:500515418worker1 # [ 81.164131] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5419worker2 # [ 81.298344] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:40Z level=info event=scheduler_connected addr=lb:500515420worker2 # [ 81.301834] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5421worker2 # [ 81.470871] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:40Z level=info event=scheduler_restarting5422worker2 # [ 81.474768] nix-grpc-daemon[1100]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5423worker2 # [ 81.477950] nix-grpc-daemon[1100]: E0000 00:00:1789891120.361214 1143 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5424worker2 # [ 81.482545] nix-grpc-daemon[1100]: E0000 00:00:1789891120.366157 1143 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true5425worker1 # [ 81.368227] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:40Z level=info event=scheduler_connected addr=lb:500515426worker2 # [ 81.500310] nix-daemon[911]: reaped child process 1149, status = succeeded5427worker1 # [ 81.371588] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:40Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5428worker2 # [ 81.511750] nix-grpc-daemon[1100]: ts=2026-09-20T07:58:40Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5429worker1 # [ 81.569073] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:40Z level=info event=scheduler_connected addr=lb:500515430worker2 # [ 81.701113] nix-grpc-daemon[1100]: E0000 00:00:1789891120.592667 1143 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 11, started true, shutdown true5431worker1 # [ 82.325050] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:41Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5432worker2 # [ 82.462664] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5433worker2 # [ 82.464586] systemd[1]: Stopped Nix worker-protocol over gRPC.5434worker2 # [ 82.466218] systemd[1]: nix-grpc-daemon.service: Consumed 313ms CPU time over 6.171s wall clock time, 30.6M memory peak, 17.5K incoming IP traffic, 22.3K outgoing IP traffic.5435worker2 # [ 82.469867] systemd[1]: nix-grpc-daemon.socket: Deactivated successfully.5436worker2 # [ 82.471574] systemd[1]: Closed Nix worker-protocol over gRPC.5437worker2 # [ 82.472950] systemd[1]: nix-grpc-daemon.socket: Consumed 299us CPU time over 6.796s wall clock time, 256K memory peak, 25.9K incoming IP traffic, 21.8K outgoing IP traffic.5438worker1: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over5439worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q event=scheduler_take_over, in 0.03 seconds)5440worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5441worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.03 seconds)5442worker1 # [ 82.525895] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:41Z level=info event=scheduler_connected addr=lb:500515443worker1 # [ 82.529185] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:41Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5444worker1 # [ 82.730324] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:41Z level=info event=scheduler_connected addr=lb:500515445worker1 # [ 82.732221] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:41Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5446worker1 # [ 82.933264] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:42Z level=info event=scheduler_connected addr=lb:500515447worker1 # [ 82.937944] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5448worker1 # [ 83.138827] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:42Z level=info event=scheduler_connected addr=lb:500515449worker1 # [ 83.142755] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:42Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5450worker1 # [ 83.343167] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:42Z level=info event=scheduler_connected addr=lb:500515451worker1 # [ 83.345715] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:42Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5452worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5453worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.03 seconds)5454lb # [ 83.643887] niks3-server[1114]: 2026/09/20 07:58:42 INFO lead: acquired remote=192.168.1.3:416925455worker1 # [ 83.536427] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:42Z level=info event=scheduler_take_over5456worker1 # [ 83.546224] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:42Z level=info event=scheduler_connected addr=lb:500515457worker1 # [ 83.549259] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:42Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: remote connection failure"5458worker1 # [ 83.749927] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:42Z level=info event=scheduler_connected addr=lb:500515459worker1 # [ 83.751752] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:42Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05460worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5461worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.03 seconds)5462client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&25463worker1 # [ 84.675634] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:43Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:504545464worker1 # [ 84.686931] nix-daemon[915]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5465client # don't know how to build these paths:5466client # /nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5467worker1 # [ 84.707807] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:43Z level=debug event=want client=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv cached=05468worker1 # [ 84.712230] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:43Z level=debug event=assigned drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv worker=192.168.1.3:50051 clients=15469worker1 # [ 84.760916] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:43Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504545470worker1 # [ 84.772396] nix-grpc-daemon[1282]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 47 ms (attempt 1/5)5471worker1 # [ 84.825265] nix-grpc-daemon[1282]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 197 ms (attempt 2/5)5472worker1 # [ 85.028282] nix-grpc-daemon[1282]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 48 ms (attempt 3/5)5473worker1 # [ 85.076659] nix-grpc-daemon[1282]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 749 ms (attempt 4/5)5474worker1 # [ 85.831757] nix-grpc-daemon[1282]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5475worker1 # [ 85.843899] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:45Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504545476client # copying 1 paths to 'lb:50051'...5477client # copying path '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' to 'lb:50051'...5478worker1 # [ 85.854372] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504545479worker1 # [ 85.865148] nix-daemon[915]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5480worker1 # [ 85.882386] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:45Z level=info event=niks3_push_started pid=13615481worker1 # [ 86.191815] nix-daemon[915]: accepted connection from pid 1374, user nix-grpc-daemon (trusted)5482worker1 # [ 86.203192] nix-daemon[915]: reaped child process 1377, status = succeeded5483worker1 # [ 86.363633] nix-daemon[915]: accepted connection from pid 1379, user nix-grpc-daemon (trusted)5484worker1 # [ 86.375766] nix-daemon[915]: reaped child process 1382, status = succeeded5485lb # [ 86.500469] niks3-server[1114]: 2026/09/20 07:58:45 INFO Received uploads request method=POST path=/api/pending_closures5486worker1 # [ 86.397596] nix-grpc-daemon[1361]: time=2026-09-20T07:58:45.619Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5487worker1 # [ 86.400760] nix-grpc-daemon[1361]: time=2026-09-20T07:58:45.621Z level=INFO msg="Uploading 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv (520B)"5488lb # [ 86.531491] niks3-server[1114]: 2026/09/20 07:58:45 INFO Registered completed upload object_key=nar/013ynk63lqgbvdpr2qqb6pflhzfcrl005f3zkvnag3x7hqxjhibs.nar.zst5489worker1 # [ 86.439202] nix-grpc-daemon[1361]: time=2026-09-20T07:58:45.661Z level=INFO msg="Uploading 1 narinfos"5490lb # [ 86.550190] niks3-server[1114]: 2026/09/20 07:58:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/25/sign5491lb # [ 86.553267] niks3-server[1114]: 2026/09/20 07:58:45 INFO Signed narinfos id=25 count=15492lb # [ 86.566493] niks3-server[1114]: 2026/09/20 07:58:45 INFO Received complete upload request method=POST path=/api/pending_closures/25/complete5493lb # [ 86.572835] niks3-server[1114]: 2026/09/20 07:58:45 INFO Registered completed upload object_key=0i80y1x9s0d06s86lhapa650pgsxgi0g.ls5494lb # [ 86.577622] niks3-server[1114]: 2026/09/20 07:58:45 INFO Completed upload id=255495worker1 # [ 86.467230] nix-grpc-daemon[1361]: time=2026-09-20T07:58:45.689Z level=INFO msg="Upload complete. (425ms)"5496worker1 # [ 86.472114] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:45Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50454 duration_s=0 paths=1 nar_bytes_in=5205497worker1 # [ 86.477037] nix-grpc-daemon[1361]: time=2026-09-20T07:58:45.698Z level=WARN msg="Failed to register uploaded object" key=0i80y1x9s0d06s86lhapa650pgsxgi0g.narinfo error="server returned 404: object is not pending upload\n"5498worker1 # [ 86.481434] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:45Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504545499worker1 # [ 86.487577] nix-daemon[915]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5500worker1 # [ 86.490933] nix-daemon[915]: reaped child process 1359, status = succeeded5501worker1 # [ 86.495766] nix-daemon[915]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5502client # building '/nix/store/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv' on lb:50051...5503client # farm-a> node-a: building 0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5504client # farm-a> LOG-farm-a-on-standby5505worker1 # [ 87.520419] nix-daemon[915]: reaped child process 1386, status = succeeded5506worker1 # [ 87.662517] nix-daemon[915]: accepted connection from pid 1401, user nix-grpc-daemon (trusted)5507worker1 # [ 87.673477] nix-daemon[915]: reaped child process 1404, status = succeeded5508lb # [ 87.799288] niks3-server[1114]: 2026/09/20 07:58:46 INFO Received uploads request method=POST path=/api/pending_closures5509worker1 # [ 87.698636] nix-grpc-daemon[1361]: time=2026-09-20T07:58:46.920Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5510worker1 # [ 87.700978] nix-grpc-daemon[1361]: time=2026-09-20T07:58:46.922Z level=INFO msg="Uploading fp54697jryq5rvfg8ml51wzkr9xjvhrg-farm-a (136B)"5511lb # [ 87.846080] niks3-server[1114]: 2026/09/20 07:58:46 INFO Registered completed upload object_key=log/0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv5512lb # [ 87.849393] niks3-server[1114]: 2026/09/20 07:58:46 INFO Registered completed upload object_key=nar/0x76wzgdd1nk8rm930z8l69v9961jpc8qhzmgganv0nhagq8lv9c.nar.zst5513lb # [ 87.856608] niks3-server[1114]: 2026/09/20 07:58:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/26/sign5514lb # [ 87.860216] niks3-server[1114]: 2026/09/20 07:58:46 INFO Signed narinfos id=26 count=15515worker1 # [ 87.751853] nix-grpc-daemon[1361]: time=2026-09-20T07:58:46.974Z level=INFO msg="Uploading 1 narinfos"5516lb # [ 87.867281] niks3-server[1114]: 2026/09/20 07:58:46 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.ls5517lb # [ 87.875568] niks3-server[1114]: 2026/09/20 07:58:46 INFO Received complete upload request method=POST path=/api/pending_closures/26/complete5518lb # [ 87.878351] niks3-server[1114]: 2026/09/20 07:58:46 INFO Completed upload id=265519worker1 # [ 87.767530] nix-grpc-daemon[1361]: time=2026-09-20T07:58:46.989Z level=INFO msg="Upload complete. (264ms)"5520lb # [ 87.881148] niks3-server[1114]: 2026/09/20 07:58:46 INFO Registered completed upload object_key=fp54697jryq5rvfg8ml51wzkr9xjvhrg.narinfo5521worker1 # [ 87.771827] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50454 duration_s=1 drv=0i80y1x9s0d06s86lhapa650pgsxgi0g-farm-a.drv assign_id=1 outputs=15522worker1 # [ 87.778489] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:47Z level=debug event=want client=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv cached=05523worker1 # [ 87.780808] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:47Z level=debug event=assigned drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv worker=192.168.1.3:50051 clients=15524worker1 # [ 87.786187] nix-daemon[915]: reaped child process 1384, status = succeeded5525worker1 # [ 87.821930] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504545526worker1 # [ 87.830501] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:47Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504545527worker1 # [ 87.837995] nix-grpc-daemon[1361]: time=2026-09-20T07:58:47.060Z level=INFO msg="All 1 paths already cached"5528client # copying 1 paths to 'lb:50051'...5529client # copying path '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' to 'lb:50051'...5530worker1 # [ 87.842223] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:47Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504545531worker1 # [ 87.847888] nix-daemon[915]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5532worker1 # [ 88.002574] nix-daemon[915]: accepted connection from pid 1410, user nix-grpc-daemon (trusted)5533worker1 # [ 88.014911] nix-daemon[915]: reaped child process 1413, status = succeeded5534worker1 # [ 88.180070] nix-daemon[915]: accepted connection from pid 1415, user nix-grpc-daemon (trusted)5535worker1 # [ 88.191983] nix-daemon[915]: reaped child process 1418, status = succeeded5536lb # [ 88.318133] niks3-server[1114]: 2026/09/20 07:58:46 INFO Received uploads request method=POST path=/api/pending_closures5537worker1 # [ 88.216176] nix-grpc-daemon[1361]: time=2026-09-20T07:58:47.438Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5538worker1 # [ 88.217533] nix-grpc-daemon[1361]: time=2026-09-20T07:58:47.438Z level=INFO msg="Uploading 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv (640B)"5539lb # [ 88.343059] niks3-server[1114]: 2026/09/20 07:58:46 INFO Registered completed upload object_key=nar/12kaxaz59hi3nqzgsxphwdpbajdwrfjqknsv96cnrhpibnnzjlg0.nar.zst5540lb # [ 88.355076] niks3-server[1114]: 2026/09/20 07:58:46 INFO Received sign narinfos request method=POST path=/api/pending_closures/27/sign5541worker1 # [ 88.251187] nix-grpc-daemon[1361]: time=2026-09-20T07:58:47.473Z level=INFO msg="Uploading 1 narinfos"5542lb # [ 88.361716] niks3-server[1114]: 2026/09/20 07:58:46 INFO Signed narinfos id=27 count=15543lb # [ 88.366631] niks3-server[1114]: 2026/09/20 07:58:46 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.ls5544lb # [ 88.376599] niks3-server[1114]: 2026/09/20 07:58:46 INFO Received complete upload request method=POST path=/api/pending_closures/27/complete5545worker1 # [ 88.276190] nix-grpc-daemon[1361]: time=2026-09-20T07:58:47.498Z level=INFO msg="Upload complete. (422ms)"5546lb # [ 88.386906] niks3-server[1114]: 2026/09/20 07:58:46 INFO Completed upload id=275547worker1 # [ 88.278153] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:47Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50454 duration_s=0 paths=1 nar_bytes_in=6405548lb # [ 88.390282] niks3-server[1114]: 2026/09/20 07:58:46 INFO Registered completed upload object_key=6532q0zszdl4cnys1gb39vpngyzd7y8j.narinfo5549worker1 # [ 88.283741] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:47Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504545550worker1 # [ 88.293619] nix-daemon[915]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5551worker1 # [ 88.295870] nix-daemon[915]: reaped child process 1408, status = succeeded5552worker1 # [ 88.301083] nix-daemon[915]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5553client # building '/nix/store/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv' on lb:50051...5554client # farm-b> node-a: building 6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5555client # farm-b> LOG-farm-b-on-standby5556worker1 # [ 89.516703] nix-daemon[915]: reaped child process 1422, status = succeeded5557worker1 # [ 89.642372] nix-daemon[915]: accepted connection from pid 1437, user nix-grpc-daemon (trusted)5558worker1 # [ 89.655376] nix-daemon[915]: reaped child process 1440, status = succeeded5559lb # [ 89.777696] niks3-server[1114]: 2026/09/20 07:58:48 INFO Received uploads request method=POST path=/api/pending_closures5560worker1 # [ 89.675558] nix-grpc-daemon[1361]: time=2026-09-20T07:58:48.897Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"5561worker1 # [ 89.677083] nix-grpc-daemon[1361]: time=2026-09-20T07:58:48.899Z level=INFO msg="Uploading 593ccq0xcckfsdii9xb4x5h0bapmahkp-farm-b (184B)"5562lb # [ 89.814676] niks3-server[1114]: 2026/09/20 07:58:48 INFO Registered completed upload object_key=log/6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv5563lb # [ 89.822623] niks3-server[1114]: 2026/09/20 07:58:48 INFO Registered completed upload object_key=nar/0k21bb46wfcxlq6p91pdvlzw7kkc20p87xpxr7zq5c5zr17k6rda.nar.zst5564lb # [ 89.833142] niks3-server[1114]: 2026/09/20 07:58:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/28/sign5565lb # [ 89.838528] niks3-server[1114]: 2026/09/20 07:58:48 INFO Signed narinfos id=28 count=15566worker1 # [ 89.730909] nix-grpc-daemon[1361]: time=2026-09-20T07:58:48.952Z level=INFO msg="Uploading 1 narinfos"5567lb # [ 89.845462] niks3-server[1114]: 2026/09/20 07:58:48 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.ls5568lb # [ 89.853742] niks3-server[1114]: 2026/09/20 07:58:48 INFO Received complete upload request method=POST path=/api/pending_closures/28/complete5569lb # [ 89.859146] niks3-server[1114]: 2026/09/20 07:58:48 INFO Completed upload id=285570lb # [ 89.862351] niks3-server[1114]: 2026/09/20 07:58:48 INFO Registered completed upload object_key=593ccq0xcckfsdii9xb4x5h0bapmahkp.narinfo5571worker1 # [ 89.750436] nix-grpc-daemon[1361]: time=2026-09-20T07:58:48.972Z level=INFO msg="Upload complete. (242ms)"5572worker1 # [ 89.758982] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:48Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50454 duration_s=1 drv=6532q0zszdl4cnys1gb39vpngyzd7y8j-farm-b.drv assign_id=2 outputs=15573worker1 # [ 89.767850] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:48Z level=debug event=want client=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv cached=05574worker1 # [ 89.772226] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:48Z level=debug event=assigned drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv worker=192.168.1.3:50051 clients=15575worker1 # [ 89.780946] nix-daemon[915]: reaped child process 1420, status = succeeded5576worker1 # [ 89.805373] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504545577worker1 # [ 89.817540] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504545578worker1 # [ 89.829402] nix-grpc-daemon[1361]: time=2026-09-20T07:58:49.051Z level=INFO msg="All 2 paths already cached"5579client # copying 1 paths to 'lb:50051'...5580client # copying path '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' to 'lb:50051'...5581worker1 # [ 89.837403] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504545582worker1 # [ 89.844303] nix-daemon[915]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5583worker1 # [ 89.992813] nix-daemon[915]: accepted connection from pid 1446, user nix-grpc-daemon (trusted)5584worker1 # [ 90.005975] nix-daemon[915]: reaped child process 1449, status = succeeded5585worker1 # [ 90.150564] nix-daemon[915]: accepted connection from pid 1451, user nix-grpc-daemon (trusted)5586worker1 # [ 90.165258] nix-daemon[915]: reaped child process 1454, status = succeeded5587lb # [ 90.290618] niks3-server[1114]: 2026/09/20 07:58:48 INFO Received uploads request method=POST path=/api/pending_closures5588worker1 # [ 90.188553] nix-grpc-daemon[1361]: time=2026-09-20T07:58:49.410Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5589worker1 # [ 90.189932] nix-grpc-daemon[1361]: time=2026-09-20T07:58:49.410Z level=INFO msg="Uploading bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv (768B)"5590lb # [ 90.315593] niks3-server[1114]: 2026/09/20 07:58:48 INFO Registered completed upload object_key=nar/0y5h6gmqp28k8bkzgrmc35pj8c8qhdi5bc0l17s14j217c1rzscm.nar.zst5591lb # [ 90.326786] niks3-server[1114]: 2026/09/20 07:58:48 INFO Received sign narinfos request method=POST path=/api/pending_closures/29/sign5592lb # [ 90.332092] niks3-server[1114]: 2026/09/20 07:58:48 INFO Signed narinfos id=29 count=15593worker1 # [ 90.224511] nix-grpc-daemon[1361]: time=2026-09-20T07:58:49.446Z level=INFO msg="Uploading 1 narinfos"5594lb # [ 90.338992] niks3-server[1114]: 2026/09/20 07:58:48 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.ls5595lb # [ 90.349505] niks3-server[1114]: 2026/09/20 07:58:48 INFO Received complete upload request method=POST path=/api/pending_closures/29/complete5596worker1 # [ 90.244925] nix-grpc-daemon[1361]: time=2026-09-20T07:58:49.467Z level=INFO msg="Upload complete. (390ms)"5597lb # [ 90.355743] niks3-server[1114]: 2026/09/20 07:58:48 INFO Completed upload id=295598worker1 # [ 90.248082] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:49Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50454 duration_s=0 paths=1 nar_bytes_in=7685599lb # [ 90.359229] niks3-server[1114]: 2026/09/20 07:58:48 INFO Registered completed upload object_key=bgavyqwkalx49wvzslr2znbhxfj7h1mb.narinfo5600worker1 # [ 90.252436] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504545601worker1 # [ 90.257829] nix-daemon[915]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5602worker1 # [ 90.260329] nix-daemon[915]: reaped child process 1444, status = succeeded5603client # building '/nix/store/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv' on lb:50051...5604client # farm-top> node-a: building bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5605worker1 # [ 90.265990] nix-daemon[915]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5606lb # [ 90.484116] envoy[939]: conn peer=[2001:db8:1::4]:51730 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1517 tx=413 ms=50445607client # farm-top> LOG-farm-top-on-standby5608worker1 # [ 91.491820] nix-daemon[915]: reaped child process 1458, status = succeeded5609worker1 # [ 91.642792] nix-daemon[915]: accepted connection from pid 1473, user nix-grpc-daemon (trusted)5610worker1 # [ 91.655367] nix-daemon[915]: reaped child process 1476, status = succeeded5611lb # [ 91.778135] niks3-server[1114]: 2026/09/20 07:58:50 INFO Received uploads request method=POST path=/api/pending_closures5612worker1 # [ 91.672271] nix-grpc-daemon[1361]: time=2026-09-20T07:58:50.894Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"5613worker1 # [ 91.673910] nix-grpc-daemon[1361]: time=2026-09-20T07:58:50.896Z level=INFO msg="Uploading bna0adh7g5jsp1sgpmaqnl7brapllfgc-farm-top (240B)"5614lb # [ 91.801391] niks3-server[1114]: 2026/09/20 07:58:50 INFO Registered completed upload object_key=log/bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv5615lb # [ 91.806529] niks3-server[1114]: 2026/09/20 07:58:50 INFO Registered completed upload object_key=nar/0bglib3l3asq436b8p5hj4yyk8c77b2qg09pcdiw1w2dfpvnd026.nar.zst5616lb # [ 91.810499] niks3-server[1114]: 2026/09/20 07:58:50 INFO Received sign narinfos request method=POST path=/api/pending_closures/30/sign5617lb # [ 91.813973] niks3-server[1114]: 2026/09/20 07:58:50 INFO Signed narinfos id=30 count=15618worker1 # [ 91.703239] nix-grpc-daemon[1361]: time=2026-09-20T07:58:50.925Z level=INFO msg="Uploading 1 narinfos"5619lb # [ 91.817966] niks3-server[1114]: 2026/09/20 07:58:50 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.ls5620lb # [ 91.822379] niks3-server[1114]: 2026/09/20 07:58:50 INFO Received complete upload request method=POST path=/api/pending_closures/30/complete5621lb # [ 91.826328] niks3-server[1114]: 2026/09/20 07:58:50 INFO Completed upload id=305622worker1 # [ 91.715547] nix-grpc-daemon[1361]: time=2026-09-20T07:58:50.937Z level=INFO msg="Upload complete. (241ms)"5623lb # [ 91.829120] niks3-server[1114]: 2026/09/20 07:58:50 INFO Registered completed upload object_key=bna0adh7g5jsp1sgpmaqnl7brapllfgc.narinfo5624worker1 # [ 91.719267] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:50Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50454 duration_s=1 drv=bgavyqwkalx49wvzslr2znbhxfj7h1mb-farm-top.drv assign_id=3 outputs=15625worker1 # [ 91.725297] nix-daemon[915]: reaped child process 1456, status = succeeded5626client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby >&2, in 7.27 seconds)5627client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath5628client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag on-standby outPath, in 0.19 seconds)5629worker2 # [ 92.133855] systemd[1]: Listening on Nix worker-protocol over gRPC.5630worker2 # [ 92.141676] systemd[1]: Starting Nix worker-protocol over gRPC...5631worker2 # [ 92.288602] nix-grpc-daemon[1193]: ts=2026-09-20T07:58:51Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5632worker2 # [ 92.290560] nix-grpc-daemon[1193]: ts=2026-09-20T07:58:51Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15633worker2 # [ 92.296667] nix-grpc-daemon[1193]: ts=2026-09-20T07:58:51Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5634worker2 # [ 92.300346] systemd[1]: Started Nix worker-protocol over gRPC.5635lb: must succeed: curl -sf localhost:9901/clusters5636worker2 # [ 92.318505] nix-grpc-daemon[1193]: ts=2026-09-20T07:58:51Z level=info event=scheduler_connected addr=lb:500515637worker1 # [ 92.191208] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:51Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05638lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5639worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5640worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5641lb: must succeed: curl -sf localhost:9901/clusters5642lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5643lb: must succeed: curl -sf localhost:9901/clusters5644lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5645worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5646worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.07 seconds)5647(finished: subtest: scheduler down: the other node takes the lock and keeps it, in 12.84 seconds)5648subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise5649client: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs5650client # [ 92.544195] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs.5651client # Running as unit: rs.service; invocation ID: c0d957a243f847b08fc3e74ca7412bb05652client: (finished: must succeed: systemd-run --unit rs nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag rs, in 0.04 seconds)5653worker1 # [ 92.684993] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:51Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:504545654client # [ 92.740485] nix[1217]: don't know how to build these paths:5655client # [ 92.741864] nix[1217]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5656worker1 # [ 92.697462] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:51Z level=debug event=want client=2 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv cached=05657worker1 # [ 92.701883] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:51Z level=debug event=assigned drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker=192.168.1.3:50051 clients=15658worker1 # [ 92.707487] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504545659worker1 # [ 92.718900] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:504545660client # [ 92.778983] nix[1217]: copying 1 paths to 'lb:50051'...5661client # [ 92.780409] nix[1217]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'...5662worker1 # [ 92.729873] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:504545663worker1 # [ 92.738837] nix-daemon[915]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5664worker1 # [ 92.903933] nix-daemon[915]: accepted connection from pid 1491, user nix-grpc-daemon (trusted)5665worker1 # [ 92.916636] nix-daemon[915]: reaped child process 1494, status = succeeded5666worker1 # [ 93.058952] nix-daemon[915]: accepted connection from pid 1496, user nix-grpc-daemon (trusted)5667worker1 # [ 93.071359] nix-daemon[915]: reaped child process 1499, status = succeeded5668lb # [ 93.197955] niks3-server[1114]: 2026/09/20 07:58:51 INFO Received uploads request method=POST path=/api/pending_closures5669worker1 # [ 93.096341] nix-grpc-daemon[1361]: time=2026-09-20T07:58:52.318Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5670worker1 # [ 93.098199] nix-grpc-daemon[1361]: time=2026-09-20T07:58:52.320Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)"5671lb # [ 93.227850] niks3-server[1114]: 2026/09/20 07:58:51 INFO Registered completed upload object_key=nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst5672lb # [ 93.247084] niks3-server[1114]: 2026/09/20 07:58:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/31/sign5673worker1 # [ 93.141174] nix-grpc-daemon[1361]: time=2026-09-20T07:58:52.363Z level=INFO msg="Uploading 1 narinfos"5674lb # [ 93.251682] niks3-server[1114]: 2026/09/20 07:58:51 INFO Signed narinfos id=31 count=15675lb # [ 93.260268] niks3-server[1114]: 2026/09/20 07:58:51 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.ls5676lb # [ 93.269256] niks3-server[1114]: 2026/09/20 07:58:51 INFO Received complete upload request method=POST path=/api/pending_closures/31/complete5677lb # [ 93.273100] niks3-server[1114]: 2026/09/20 07:58:51 INFO Completed upload id=315678worker1 # [ 93.162481] nix-grpc-daemon[1361]: time=2026-09-20T07:58:52.384Z level=INFO msg="Upload complete. (410ms)"5679lb # [ 93.276184] niks3-server[1114]: 2026/09/20 07:58:51 INFO Registered completed upload object_key=2765168rrfa4dbs7pfx66j88710jx2fm.narinfo5680worker1 # [ 93.164915] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:50454 duration_s=0 paths=1 nar_bytes_in=4165681worker1 # [ 93.170459] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:504545682worker1 # [ 93.182415] nix-daemon[915]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5683worker1 # [ 93.185945] nix-daemon[915]: reaped child process 1489, status = succeeded5684worker1 # [ 93.190913] nix-daemon[915]: accepted connection from pid 1282, user nix-grpc-daemon (trusted)5685client # [ 93.242551] nix[1217]: building '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' on lb:50051...5686lb: must succeed: curl -sf localhost:9901/clusters5687lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)5688lb: must succeed: curl -sf localhost:9901/clusters5689lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5690lb: must succeed: curl -sf localhost:9901/clusters5691lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5692lb: must succeed: curl -sf localhost:9901/clusters5693lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5694worker2: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true5695worker2 # [ 95.408495] systemd-journald[286]: Received client request to rotate journal, rotating.5696worker2 # [ 95.424079] systemd-journald[286]: Vacuuming done, freed 0B of archived journals from /var/log/journal/340992d458a34da7855dfa056f1556c1.5697worker2: (finished: must succeed: journalctl --rotate --vacuum-time=1s -u nix-grpc-daemon >/dev/null 2>&1 || true, in 0.05 seconds)5698worker1: must succeed: systemctl restart --no-block nix-grpc-daemon.service5699worker1 # [ 95.189595] systemd[1]: Stopping Nix worker-protocol over gRPC...5700worker1: (finished: must succeed: systemctl restart --no-block nix-grpc-daemon.service, in 0.04 seconds)5701??? Warning (UserWarning): sleep(): The 'secs' argument is deprecated. Use 'duration' instead.5702 File "/nix/store/3gycnalwgpix76jjky7ljgh88gwgdb0l-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 5735703client: must succeed: sleep 5.05704worker1 # [ 95.528272] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:54Z level=info event=draining5705client: (finished: must succeed: sleep 5.0, in 5.03 seconds)5706lb # [ 100.485499] envoy[939]: conn peer=[2001:db8:1::1]:38094 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9451 tx=3801 ms=70615707worker1 # [ 100.410454] nix-daemon[915]: reaped child process 1503, status = succeeded5708worker2: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr='5709worker1 # [ 100.582578] nix-daemon[915]: accepted connection from pid 1543, user nix-grpc-daemon (trusted)5710worker1 # [ 100.600642] nix-daemon[915]: reaped child process 1546, status = succeeded5711lb # [ 100.726578] niks3-server[1114]: 2026/09/20 07:58:59 INFO Received uploads request method=POST path=/api/pending_closures5712worker1 # [ 100.622363] nix-grpc-daemon[1361]: time=2026-09-20T07:58:59.844Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5713worker1 # [ 100.627076] nix-grpc-daemon[1361]: time=2026-09-20T07:58:59.846Z level=INFO msg="Uploading 6qby8qgv9vwglq2yryw4zqyixrizh5d2-slow-rs (120B)"5714lb # [ 100.763277] niks3-server[1114]: 2026/09/20 07:58:59 INFO Registered completed upload object_key=nar/19z3qdigvc4gggg31dgc0wi5w85pgaq9dk7bvngh0yhckpy55jgq.nar.zst5715lb # [ 100.767668] niks3-server[1114]: 2026/09/20 07:58:59 INFO Registered completed upload object_key=log/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv5716lb # [ 100.774066] niks3-server[1114]: 2026/09/20 07:58:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/32/sign5717lb # [ 100.776889] niks3-server[1114]: 2026/09/20 07:58:59 INFO Signed narinfos id=32 count=15718worker1 # [ 100.666779] nix-grpc-daemon[1361]: time=2026-09-20T07:58:59.888Z level=INFO msg="Uploading 1 narinfos"5719lb # [ 100.780763] niks3-server[1114]: 2026/09/20 07:58:59 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.ls5720lb # [ 100.789269] niks3-server[1114]: 2026/09/20 07:58:59 INFO Received complete upload request method=POST path=/api/pending_closures/32/complete5721lb # [ 100.794824] niks3-server[1114]: 2026/09/20 07:58:59 INFO Completed upload id=325722worker1 # [ 100.684403] nix-grpc-daemon[1361]: time=2026-09-20T07:58:59.906Z level=INFO msg="Upload complete. (280ms)"5723lb # [ 100.797360] niks3-server[1114]: 2026/09/20 07:58:59 INFO Registered completed upload object_key=6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo5724worker1 # [ 100.688414] nix-grpc-daemon[1282]: ts=2026-09-20T07:58:59Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:50454 duration_s=7 drv=2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv assign_id=4 outputs=15725worker1 # [ 100.698314] nix-daemon[915]: reaped child process 1501, status = succeeded5726client # [ 100.766883] systemd[1]: rs.service: Deactivated successfully.5727client # [ 100.768970] systemd[1]: rs.service: Consumed 103ms CPU time over 8.223s wall clock time, 39.1M memory peak, 8.5K incoming IP traffic, 8.9K outgoing IP traffic.5728worker1 # [ 101.529716] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:00Z level=info event=signal_exit5729worker1 # [ 101.556541] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:00Z level=info event=scheduler_yield5730lb # [ 101.671157] niks3-server[1114]: 2026/09/20 07:59:00 INFO lead: released remote=192.168.1.3:416925731worker2 # [ 101.689776] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:00Z level=info event=scheduler_restarting addr=lb:500515732worker1 # [ 101.563972] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:558825733worker1 # [ 101.565704] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:00Z level=info event=worker_gone addr=192.168.1.4:500515734worker1 # [ 101.567188] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:00Z level=info event=scheduler_restarting addr=lb:500515735worker1 # [ 101.568396] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:00Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:558825736worker1 # [ 101.569745] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:00Z level=info event=worker_gone addr=192.168.1.3:500515737worker2 # [ 101.890448] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:00Z level=info event=scheduler_connected addr=lb:500515738worker1 # [ 101.767145] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:00Z level=info event=scheduler_connected addr=lb:500515739worker1 # [ 101.768481] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5740worker2 # [ 101.895543] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5741worker2 # [ 102.096655] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:00Z level=info event=scheduler_connected addr=lb:500515742worker1 # [ 101.967998] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:01Z level=info event=scheduler_connected addr=lb:500515743worker2 # [ 102.104644] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:00Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5744worker1 # [ 101.978596] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5745worker2 # [ 102.305215] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:01Z level=info event=scheduler_connected addr=lb:500515746worker2 # [ 102.308236] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:01Z level=info event=scheduler_take_over5747lb # [ 102.289486] niks3-server[1114]: 2026/09/20 07:59:00 INFO lead: acquired remote=192.168.1.4:498885748worker1 # [ 102.179561] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:01Z level=info event=scheduler_connected addr=lb:500515749worker2 # [ 102.313236] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5750worker1 # [ 102.184839] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5751worker1 # [ 102.385271] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:01Z level=info event=scheduler_connected addr=lb:500515752worker2 # [ 102.514221] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:01Z level=info event=scheduler_connected addr=lb:500515753worker1 # [ 102.387951] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:01Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5754worker2 # [ 102.518469] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:01Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05755worker2: (finished: waiting for success: journalctl -u nix-grpc-daemon | grep -q 'event=scheduler_restarting addr=', in 2.12 seconds)5756worker1 # [ 102.557448] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:01Z level=info event=scheduler_restarting5757client: waiting for success: ! systemctl is-active rs5758worker1 # [ 102.571391] nix-daemon[915]: reaped child process 1352, status = succeeded5759client: (finished: waiting for success: ! systemctl is-active rs, in 0.03 seconds)5760client: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }5761worker1 # [ 102.593719] nix-grpc-daemon[1282]: ts=2026-09-20T07:59:01Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"5762client: (finished: must succeed: systemctl show -p Result --value rs | grep -qx success || { journalctl -u rs >&2; false; }, in 0.03 seconds)5763client: must fail: journalctl -u rs | grep -q 'reconnecting'5764client: (finished: must fail: journalctl -u rs | grep -q 'reconnecting', in 0.02 seconds)5765lb: must succeed: curl -sf localhost:9901/clusters5766lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5767worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5768worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5769worker1 # [ 102.816868] nix-grpc-daemon[1282]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR5770worker1 # [ 102.818289] nix-grpc-daemon[1282]: E0000 00:00:1789891142.038220 1325 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 10, started true, shutdown true5771worker1 # [ 102.820217] nix-grpc-daemon[1282]: E0000 00:00:1789891142.038743 1325 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true5772lb: must succeed: curl -sf localhost:9901/clusters5773lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.07 seconds)5774worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5775worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)5776worker1 # [ 104.331971] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.5777worker1 # [ 104.336108] systemd[1]: Stopped Nix worker-protocol over gRPC.5778worker1 # [ 104.338178] systemd[1]: nix-grpc-daemon.service: Consumed 1.273s CPU time over 25.991s wall clock time, 32.8M memory peak, 46.7K incoming IP traffic, 88.7K outgoing IP traffic.5779worker1 # [ 104.354138] systemd[1]: Starting Nix worker-protocol over gRPC...5780worker1 # [ 104.519930] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:03Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5781worker1 # [ 104.522188] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:03Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=15782worker1 # [ 104.528907] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:03Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5783worker1 # [ 104.530759] systemd[1]: Started Nix worker-protocol over gRPC.5784worker1 # [ 104.546197] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:03Z level=info event=scheduler_connected addr=lb:500515785worker2 # [ 104.678768] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:03Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05786lb: must succeed: curl -sf localhost:9901/clusters5787lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.06 seconds)5788worker2: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true5789worker2: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.04 seconds)5790(finished: subtest: clean scheduler restart: peers are told, running builds survive, no reconnect noise, in 12.48 seconds)5791subtest: scheduler restart mid-build: build finishes, no double build5792client: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid5793client # [ 105.026783] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid.5794client # Running as unit: mid.service; invocation ID: fb45d0258cc1415abc664630997ed2be5795client: (finished: must succeed: systemd-run --unit mid nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag mid, in 0.04 seconds)5796worker2 # [ 105.305970] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:04Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:414005797worker2 # [ 105.312736] nix-daemon[911]: accepted connection from pid 1193, user nix-grpc-daemon (trusted)5798client # [ 105.242344] nix[1252]: don't know how to build these paths:5799client # [ 105.243253] nix[1252]: /nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5800worker2 # [ 105.325093] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:04Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05801worker2 # [ 105.327634] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:04Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15802worker2 # [ 105.373270] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:414005803worker2 # [ 105.380500] nix-grpc-daemon[1193]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 33 ms (attempt 1/5)5804worker2 # [ 105.416651] nix-grpc-daemon[1193]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 18 ms (attempt 2/5)5805worker2 # [ 105.438284] nix-grpc-daemon[1193]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 267 ms (attempt 3/5)5806worker2 # [ 105.712586] nix-grpc-daemon[1193]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 749 ms (attempt 4/5)5807worker2 # [ 106.461400] nix-grpc-daemon[1193]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5808worker2 # [ 106.474964] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:05Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:414005809client # [ 106.403657] nix[1252]: copying 1 paths to 'lb:50051'...5810client # [ 106.405665] nix[1252]: copying path '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' to 'lb:50051'...5811worker2 # [ 106.484742] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:414005812worker2 # [ 106.492079] nix-daemon[911]: accepted connection from pid 1193, user nix-grpc-daemon (trusted)5813worker2 # [ 106.513909] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:05Z level=info event=niks3_push_started pid=13265814worker2 # [ 106.800722] nix-daemon[911]: accepted connection from pid 1339, user nix-grpc-daemon (trusted)5815worker2 # [ 106.814392] nix-daemon[911]: reaped child process 1342, status = succeeded5816worker2 # [ 106.966982] nix-daemon[911]: accepted connection from pid 1344, user nix-grpc-daemon (trusted)5817worker2 # [ 106.979647] nix-daemon[911]: reaped child process 1347, status = succeeded5818lb # [ 106.973326] niks3-server[1114]: 2026/09/20 07:59:05 INFO Received uploads request method=POST path=/api/pending_closures5819worker2 # [ 106.997241] nix-grpc-daemon[1326]: time=2026-09-20T07:59:05.888Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5820worker2 # [ 106.999710] nix-grpc-daemon[1326]: time=2026-09-20T07:59:05.890Z level=INFO msg="Uploading n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv (424B)"5821lb # [ 106.992367] niks3-server[1114]: 2026/09/20 07:59:05 INFO Registered completed upload object_key=nar/0pdyhjlvyi83rdx6rr15l7kj7a7hlcbqgllxm29xw3hvr3akprgq.nar.zst5822lb # [ 106.996766] niks3-server[1114]: 2026/09/20 07:59:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/33/sign5823lb # [ 106.998641] niks3-server[1114]: 2026/09/20 07:59:05 INFO Signed narinfos id=33 count=15824worker2 # [ 107.018261] nix-grpc-daemon[1326]: time=2026-09-20T07:59:05.909Z level=INFO msg="Uploading 1 narinfos"5825lb # [ 107.002253] niks3-server[1114]: 2026/09/20 07:59:05 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.ls5826lb # [ 107.007267] niks3-server[1114]: 2026/09/20 07:59:05 INFO Received complete upload request method=POST path=/api/pending_closures/33/complete5827lb # [ 107.010053] niks3-server[1114]: 2026/09/20 07:59:05 INFO Completed upload id=335828worker2 # [ 107.031236] nix-grpc-daemon[1326]: time=2026-09-20T07:59:05.922Z level=INFO msg="Upload complete. (359ms)"5829lb # [ 107.012500] niks3-server[1114]: 2026/09/20 07:59:05 INFO Registered completed upload object_key=n23kf6h4k511p0qpzsydmqrbq2qn9g5w.narinfo5830worker2 # [ 107.034249] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:05Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41400 duration_s=0 paths=1 nar_bytes_in=4245831worker2 # [ 107.037422] nix-grpc-daemon[1193]: ts=2026-09-20T07:59:05Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:414005832worker2 # [ 107.042558] nix-daemon[911]: accepted connection from pid 1193, user nix-grpc-daemon (trusted)5833worker2 # [ 107.047933] nix-daemon[911]: reaped child process 1324, status = succeeded5834client # [ 106.973899] nix[1252]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5835worker2 # [ 107.053248] nix-daemon[911]: accepted connection from pid 1193, user nix-grpc-daemon (trusted)5836lb: must succeed: curl -sf localhost:9901/clusters5837lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5838lb: must succeed: curl -sf localhost:9901/clusters5839lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)5840worker2: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service5841worker2 # [ 108.791991] systemd[1]: nix-grpc-daemon.service: Sent signal SIGKILL to main process 1193 (nix-grpc-daemon) on client request.5842worker2 # [ 108.795650] systemd[1]: nix-grpc-daemon.service: Killed unit cgroup '/system.slice/nix-grpc-daemon.service' with SIGKILL on client request.5843lb # [ 108.783555] niks3-server[1114]: 2026/09/20 07:59:07 INFO lead: released remote=192.168.1.4:498885844worker1 # [ 108.673094] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:07Z level=info event=scheduler_disconnected addr=lb:50051 error="upstream connect error or disconnect/reset before headers. reset reason: connection termination"5845client # [ 108.725838] nix[1252]: n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), asking the scheduler again5846client # [ 108.731606] nix[1252]: scheduler at lb:50051: Stream removed (RST_STREAM (Received RST_STREAM with error code 2)), reconnecting5847worker2: (finished: must succeed: systemctl kill -s KILL nix-grpc-daemon.service; systemctl start nix-grpc-daemon.service, in 0.06 seconds)5848client: must succeed: sleep 5.05849worker2 # [ 108.828646] systemd[1]: nix-grpc-daemon.service: Main process exited, code=killed, status=9/KILL5850worker2 # [ 108.830871] systemd[1]: nix-grpc-daemon.service: Failed with result 'signal'.5851worker2 # [ 108.832370] systemd[1]: nix-grpc-daemon.service: Consumed 432ms CPU time over 16.686s wall clock time, 30.8M memory peak, 14.1K incoming IP traffic, 21.9K outgoing IP traffic.5852worker2 # [ 108.837871] nix-daemon[911]: reaped child process 1349, status = succeeded5853worker2 # [ 108.838886] nix-daemon[911]: reaped child process 1313, status = succeeded5854worker2 # [ 108.846247] nix-daemon[1351]: unexpected Nix daemon error: error: interrupted by the user5855worker2 # [ 108.850485] nix-daemon[911]: reaped child process 1351, status = failed with exit code 15856worker1 # [ 108.872571] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:08Z level=info event=scheduler_connected addr=lb:500515857worker2 # [ 109.007117] systemd[1]: nix-grpc-daemon.service: Scheduled restart job, restart counter is at 1.5858worker2 # [ 109.016607] systemd[1]: Starting Nix worker-protocol over gRPC...5859worker2 # [ 109.174829] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:08Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc5860worker2 # [ 109.176734] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:08Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=15861worker2 # [ 109.183048] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:08Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket5862worker2 # [ 109.187139] systemd[1]: Started Nix worker-protocol over gRPC.5863lb # [ 109.174483] niks3-server[1114]: 2026/09/20 07:59:07 INFO lead: acquired remote=192.168.1.4:361325864worker2 # [ 109.197711] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:08Z level=info event=scheduler_take_over5865worker2 # [ 109.203117] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:08Z level=info event=scheduler_connected addr=lb:500515866worker1 # [ 109.071981] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:08Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"5867worker2 # [ 109.204877] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:08Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05868worker2 # [ 109.314808] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:08Z level=debug event=want client=1 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv cached=05869worker2 # [ 109.317422] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:08Z level=debug event=assigned drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv worker=192.168.1.4:50051 clients=15870worker2 # [ 109.364935] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:08Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:414185871worker2 # [ 109.375111] nix-daemon[911]: accepted connection from pid 1387, user nix-grpc-daemon (trusted)5872worker2 # [ 109.388748] nix-daemon[911]: accepted connection from pid 1387, user nix-grpc-daemon (trusted)5873client # [ 109.321925] nix[1252]: building '/nix/store/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv' on lb:50051...5874worker1 # [ 109.272452] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:08Z level=info event=scheduler_connected addr=lb:500515875worker2 # [ 109.402439] nix-daemon[911]: accepted connection from pid 1387, user nix-grpc-daemon (trusted)5876worker2 # [ 109.405577] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:08Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=05877lb # [ 110.485544] envoy[939]: conn peer=[2001:db8:1::1]:38106 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2917 tx=1307 ms=80195878lb # [ 110.487154] envoy[939]: conn peer=[2001:db8:1::3]:54956 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=4772 tx=1263 ms=240525879lb # [ 110.488638] envoy[939]: conn peer=[2001:db8:1::4]:55608 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1366 tx=445 ms=164895880client: (finished: must succeed: sleep 5.0, in 5.05 seconds)5881client: waiting for success: ! systemctl is-active mid5882worker2 # [ 114.225960] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:13Z level=info event=niks3_push_started pid=14665883worker2 # [ 114.256496] nix-daemon[911]: reaped child process 1442, status = succeeded5884worker2 # [ 114.557272] nix-daemon[911]: accepted connection from pid 1479, user nix-grpc-daemon (trusted)5885worker2 # [ 114.570798] nix-daemon[911]: reaped child process 1482, status = succeeded5886lb # [ 114.561915] niks3-server[1114]: 2026/09/20 07:59:13 INFO Received uploads request method=POST path=/api/pending_closures5887worker2 # [ 114.586906] nix-grpc-daemon[1466]: time=2026-09-20T07:59:13.478Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5888worker2 # [ 114.591817] nix-grpc-daemon[1466]: time=2026-09-20T07:59:13.480Z level=INFO msg="Uploading cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj-slow-mid (120B)"5889lb # [ 114.590076] niks3-server[1114]: 2026/09/20 07:59:13 INFO Registered completed upload object_key=log/n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv5890lb # [ 114.599396] niks3-server[1114]: 2026/09/20 07:59:13 INFO Received sign narinfos request method=POST path=/api/pending_closures/34/sign5891lb # [ 114.602961] niks3-server[1114]: 2026/09/20 07:59:13 INFO Signed narinfos id=34 count=15892worker2 # [ 114.623037] nix-grpc-daemon[1466]: time=2026-09-20T07:59:13.513Z level=INFO msg="Uploading 1 narinfos"5893lb # [ 114.621752] niks3-server[1114]: 2026/09/20 07:59:13 INFO Registered completed upload object_key=nar/0462jb7zwy2d73k3q6v09xnk3bx318v8ik5ckmp32w2hzvwj4k2d.nar.zst5894lb # [ 114.624609] niks3-server[1114]: 2026/09/20 07:59:13 INFO Received complete upload request method=POST path=/api/pending_closures/34/complete5895lb # [ 114.630037] niks3-server[1114]: 2026/09/20 07:59:13 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.ls5896lb # [ 114.634644] niks3-server[1114]: 2026/09/20 07:59:13 INFO Completed upload id=345897worker2 # [ 114.654394] nix-grpc-daemon[1466]: time=2026-09-20T07:59:13.546Z level=INFO msg="Upload complete. (241ms)"5898lb # [ 114.637079] niks3-server[1114]: 2026/09/20 07:59:13 INFO Registered completed upload object_key=cz6wmnnj5y0qn84jrv9qb9sj0dv1iylj.narinfo5899worker2 # [ 114.658146] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:13Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41418 duration_s=5 drv=n23kf6h4k511p0qpzsydmqrbq2qn9g5w-slow-mid.drv assign_id=1 outputs=15900worker2 # [ 114.669497] nix-daemon[911]: reaped child process 1440, status = succeeded5901client # [ 114.604506] systemd[1]: mid.service: Deactivated successfully.5902client # [ 114.606227] systemd[1]: mid.service: Consumed 126ms CPU time over 9.579s wall clock time, 39.2M memory peak, 9.6K incoming IP traffic, 10.6K outgoing IP traffic.5903client: (finished: waiting for success: ! systemctl is-active mid, in 1.10 seconds)5904client: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }5905client: (finished: must succeed: systemctl show -p Result --value mid | grep -qx success || { journalctl -u mid >&2; false; }, in 0.04 seconds)5906(finished: subtest: scheduler restart mid-build: build finishes, no double build, in 10.14 seconds)5907subtest: interrupting the client stops the build on the worker5908client: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr5909client # [ 115.155844] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr.5910client # Running as unit: intr.service; invocation ID: 885ea0a3ade749599feb7511eadee94d5911client: (finished: must succeed: systemd-run --unit intr nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag intr, in 0.04 seconds)5912worker2 # [ 115.407497] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:14Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:414185913client # [ 115.333842] nix[1287]: don't know how to build these paths:5914client # [ 115.334736] nix[1287]: /nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv5915worker2 # [ 115.420897] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:14Z level=debug event=want client=2 drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv cached=05916worker2 # [ 115.423611] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:14Z level=debug event=assigned drv=x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv worker=192.168.1.3:50051 clients=15917worker1 # [ 115.344351] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:14Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592705918worker1 # [ 115.356874] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)5919worker1 # [ 115.373724] nix-grpc-daemon[1553]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 1 ms (attempt 1/5)5920worker1 # [ 115.380847] nix-grpc-daemon[1553]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 89 ms (attempt 2/5)5921worker1 # [ 115.476174] nix-grpc-daemon[1553]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 349 ms (attempt 3/5)5922worker1 # [ 115.828380] nix-grpc-daemon[1553]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 325 ms (attempt 4/5)5923worker1 # [ 116.156929] nix-grpc-daemon[1553]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5924worker1 # [ 116.178987] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592705925client # [ 116.242815] nix[1287]: copying 1 paths to 'lb:50051'...5926client # [ 116.247167] nix[1287]: copying path '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' to 'lb:50051'...5927worker1 # [ 116.196157] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592705928worker1 # [ 116.205399] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)5929worker1 # [ 116.225251] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:15Z level=info event=niks3_push_started pid=16445930worker1 # [ 116.539586] nix-daemon[915]: accepted connection from pid 1658, user nix-grpc-daemon (trusted)5931worker1 # [ 116.552676] nix-daemon[915]: reaped child process 1661, status = succeeded5932worker1 # [ 116.722670] nix-daemon[915]: accepted connection from pid 1663, user nix-grpc-daemon (trusted)5933worker1 # [ 116.737134] nix-daemon[915]: reaped child process 1666, status = succeeded5934lb # [ 116.865129] niks3-server[1114]: 2026/09/20 07:59:15 INFO Received uploads request method=POST path=/api/pending_closures5935worker1 # [ 116.766173] nix-grpc-daemon[1644]: time=2026-09-20T07:59:15.986Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5936worker1 # [ 116.767606] nix-grpc-daemon[1644]: time=2026-09-20T07:59:15.987Z level=INFO msg="Uploading x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv (424B)"5937lb # [ 116.901176] niks3-server[1114]: 2026/09/20 07:59:15 INFO Registered completed upload object_key=nar/0dw6lfdicxarqmcw4m9j94irjhgkdvc1nww51zwj454yj03v5iri.nar.zst5938lb # [ 116.912995] niks3-server[1114]: 2026/09/20 07:59:15 INFO Received sign narinfos request method=POST path=/api/pending_closures/35/sign5939lb # [ 116.919239] niks3-server[1114]: 2026/09/20 07:59:15 INFO Signed narinfos id=35 count=15940worker1 # [ 116.811131] nix-grpc-daemon[1644]: time=2026-09-20T07:59:16.032Z level=INFO msg="Uploading 1 narinfos"5941lb # [ 116.925904] niks3-server[1114]: 2026/09/20 07:59:15 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.ls5942lb # [ 116.930078] niks3-server[1114]: 2026/09/20 07:59:15 INFO Received complete upload request method=POST path=/api/pending_closures/35/complete5943lb # [ 116.935196] niks3-server[1114]: 2026/09/20 07:59:15 INFO Completed upload id=355944worker1 # [ 116.824349] nix-grpc-daemon[1644]: time=2026-09-20T07:59:16.046Z level=INFO msg="Upload complete. (429ms)"5945lb # [ 116.937801] niks3-server[1114]: 2026/09/20 07:59:15 INFO Registered completed upload object_key=x43jxvh618x0k4fbhc2wyxhr1lymdssr.narinfo5946worker1 # [ 116.827250] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:16Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=0 paths=1 nar_bytes_in=4245947worker1 # [ 116.831296] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:16Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592705948worker1 # [ 116.835883] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)5949worker1 # [ 116.843168] nix-daemon[915]: reaped child process 1641, status = succeeded5950worker1 # [ 116.847746] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)5951client # [ 116.899444] nix[1287]: building '/nix/store/x43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv' on lb:50051...5952client: must succeed: systemctl kill -s INT intr5953client # [ 118.617662] systemd[1]: intr.service: Sent signal SIGINT to main process 1287 (nix) on client request.5954client # [ 118.621931] nix[1287]: shutting downx43jxvh618x0k4fbhc2wyxhr1lymdssr-slow-intr.drv: error: gRPC BuildDerivation on 'lb:50051' failed: Stream removed (CANCELLED)5955client: (finished: must succeed: systemctl kill -s INT intr, in 0.05 seconds)5956client # [ 118.629658] nix[1287]: error: interrupted by the user5957client # [ 118.660537] systemd[1]: intr.service: Main process exited, code=exited, status=1/FAILURE5958client # [ 118.662114] systemd[1]: intr.service: Failed with result 'exit-code'.5959client # [ 118.664161] systemd[1]: intr.service: Consumed 112ms CPU time over 3.507s wall clock time, 39.1M memory peak, 7.7K incoming IP traffic, 8.7K outgoing IP traffic.5960worker1 # [ 118.668424] nix-daemon[915]: reaped child process 1668, status = succeeded5961worker1 # [ 118.673336] nix-daemon[1670]: unexpected Nix daemon error: error: interrupted by the user5962worker1 # [ 118.678140] nix-daemon[915]: reaped child process 1670, status = failed with exit code 15963(finished: subtest: interrupting the client stops the build on the worker, in 4.73 seconds)5964subtest: a deploy mid-build drains: the build finishes, the new generation takes over5965client: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw5966client # [ 119.896678] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key" --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw.5967client # Running as unit: sw.service; invocation ID: e04746e381c749b188dfb6ddf00e49805968client: (finished: must succeed: systemd-run --unit sw nix build --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/yggfr0llgkhpsm4k92sg65ggxk04755p-slow.nix --argstr tag sw, in 0.05 seconds)5969worker1 # [ 120.066649] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:19Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592705970client # [ 120.125460] nix[1307]: don't know how to build these paths:5971client # [ 120.126548] nix[1307]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv5972worker2 # [ 120.214882] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:19Z level=debug event=want client=3 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=05973worker2 # [ 120.220573] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:19Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=15974worker2 # [ 120.264083] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:19Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:414185975worker2 # [ 120.271035] nix-grpc-daemon[1387]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 1/5)5976worker2 # [ 120.349670] nix-grpc-daemon[1387]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 2/5)5977worker2 # [ 120.378655] nix-grpc-daemon[1387]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 356 ms (attempt 3/5)5978lb # [ 120.486629] envoy[939]: conn peer=[2001:db8:1::1]:33618 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3848 tx=1658 ms=93685979lb # [ 120.490749] envoy[939]: conn peer=[2001:db8:1::1]:53320 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2924 tx=755 ms=33125980worker2 # [ 120.738151] nix-grpc-daemon[1387]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 728 ms (attempt 4/5)5981worker2 # [ 121.473771] nix-grpc-daemon[1387]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org5982worker2 # [ 121.487406] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:20Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:414185983client # [ 121.417534] nix[1307]: copying 1 paths to 'lb:50051'...5984worker2 # [ 121.499684] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:20Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:414185985client # [ 121.422144] nix[1307]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'...5986worker2 # [ 121.506553] nix-daemon[911]: accepted connection from pid 1387, user nix-grpc-daemon (trusted)5987worker2 # [ 121.674382] nix-daemon[911]: accepted connection from pid 1525, user nix-grpc-daemon (trusted)5988worker2 # [ 121.692873] nix-daemon[911]: reaped child process 1528, status = succeeded5989worker2 # [ 121.850483] nix-daemon[911]: accepted connection from pid 1530, user nix-grpc-daemon (trusted)5990worker2 # [ 121.864830] nix-daemon[911]: reaped child process 1533, status = succeeded5991lb # [ 121.858274] niks3-server[1114]: 2026/09/20 07:59:20 INFO Received uploads request method=POST path=/api/pending_closures5992worker2 # [ 121.887415] nix-grpc-daemon[1466]: time=2026-09-20T07:59:20.778Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"5993worker2 # [ 121.888845] nix-grpc-daemon[1466]: time=2026-09-20T07:59:20.778Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)"5994lb # [ 121.884122] niks3-server[1114]: 2026/09/20 07:59:20 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst5995lb # [ 121.897917] niks3-server[1114]: 2026/09/20 07:59:20 INFO Received sign narinfos request method=POST path=/api/pending_closures/36/sign5996lb # [ 121.904380] niks3-server[1114]: 2026/09/20 07:59:20 INFO Signed narinfos id=36 count=15997worker2 # [ 121.927274] nix-grpc-daemon[1466]: time=2026-09-20T07:59:20.818Z level=INFO msg="Uploading 1 narinfos"5998lb # [ 121.912082] niks3-server[1114]: 2026/09/20 07:59:20 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls5999lb # [ 121.923495] niks3-server[1114]: 2026/09/20 07:59:20 INFO Received complete upload request method=POST path=/api/pending_closures/36/complete6000worker2 # [ 121.949167] nix-grpc-daemon[1466]: time=2026-09-20T07:59:20.840Z level=INFO msg="Upload complete. (436ms)"6001lb # [ 121.929513] niks3-server[1114]: 2026/09/20 07:59:20 INFO Completed upload id=366002worker2 # [ 121.952088] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:20Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:41418 duration_s=0 paths=1 nar_bytes_in=4166003lb # [ 121.934172] niks3-server[1114]: 2026/09/20 07:59:20 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo6004worker2 # [ 121.956657] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:20Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:414186005worker2 # [ 121.966885] nix-daemon[911]: accepted connection from pid 1387, user nix-grpc-daemon (trusted)6006worker2 # [ 121.968843] nix-daemon[911]: reaped child process 1523, status = succeeded6007worker2 # [ 121.974635] nix-daemon[911]: accepted connection from pid 1387, user nix-grpc-daemon (trusted)6008client # [ 121.895634] nix[1307]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051...6009worker2: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&26010worker2 # Checking switch inhibitors... done6011worker2 # [ 124.042648] nixos[1568]: switching to system configuration /nix/store/l3f4z5g5ps546kcmw3y8ff7l6rg0qn81-nixos-system-worker2-test6012worker2 # activating the configuration...6013worker2 # [ 124.045934] systemd[1]: Stopped target Remote File Systems.6014worker2 # [ 124.047393] systemd[1]: Stopped target Local File Systems.6015worker2 # setting up /etc...6016worker2 # [ 124.666391] systemd[1]: Reload requested from client PID 1568 ('.switch-to-conf') (unit backdoor.service)...6017worker2 # [ 124.670134] systemd[1]: Reloading...6018worker2 # [ 125.360330] systemd[1]: Reloading finished in 688 ms.6019worker2 # restarting sysinit-reactivation.target6020worker2 # [ 125.421541] systemd[1]: Starting Re-setup tmpfiles on a system that is already running....6021worker2 # [ 125.566463] systemd[1]: Finished Re-setup tmpfiles on a system that is already running..6022worker2 # [ 125.569639] systemd[1]: Reached target Reactivate sysinit units.6023worker2 # reloading the following units: dbus-broker.service, nix-grpc-daemon.service6024worker2 # [ 125.576111] systemd[1]: Reloading D-Bus System Message Bus...6025worker2 # [ 125.577212] dbus-broker-launch[578]: Caught SIGHUP, trigger reload.6026worker2 # [ 125.581766] systemd[1]: Reloading Nix worker-protocol over gRPC...6027worker2 # [ 125.608223] dbus-broker-launch[578]: Looking up NSS user entry for 'systemd-timesync'...6028worker2 # [ 125.615454] dbus-broker-launch[578]: NSS returned no entry for 'systemd-timesync'6029worker2 # [ 125.616587] dbus-broker-launch[578]: Invalid user-name in /nix/store/nl02z4vnl25dc1df60lqifjnw6c89zpg-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"6030worker2 # [ 125.630658] systemd[1]: Reloaded Nix worker-protocol over gRPC.6031worker2 # [ 125.646516] systemd[1]: Reloaded D-Bus System Message Bus.6032worker2 # [ 125.652408] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os6033worker2 # [ 125.653689] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki6034worker2 # [ 125.655269] systemd[1]: Reached target Remote File Systems.6035worker2 # [ 125.665174] systemd[1]: Starting linger-users.service...6036worker2 # [ 125.673802] systemd[1]: Reached target Local File Systems.6037worker2 # [ 125.678726] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore6038worker2 # [ 125.684084] systemd[1]: Starting Create SUID/SGID Wrappers...6039worker2 # [ 125.685197] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.6040worker2 # [ 125.686609] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc676041worker2 # [ 125.689673] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore6042worker2 # [ 125.692360] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6043worker2 # [ 125.694132] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os6044worker2 # [ 125.738474] systemd[1]: linger-users.service: Deactivated successfully.6045worker2 # [ 125.740192] systemd[1]: Finished linger-users.service.6046worker2 # [ 126.095193] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.6047worker2 # [ 126.097599] systemd[1]: Finished Create SUID/SGID Wrappers.6048worker2 # [ 126.188718] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:25Z level=info event=draining6049worker2 # the following new units were started: sysinit-reactivation.target, systemd-tmpfiles-resetup.service6050worker2 # [ 126.354407] nixos[1568]: finished switching to system configuration /nix/store/l3f4z5g5ps546kcmw3y8ff7l6rg0qn81-nixos-system-worker2-test6051worker2: (finished: must succeed: timeout 20 /run/current-system/specialisation/next/bin/switch-to-configuration test >&2, in 2.91 seconds)6052worker2: must succeed: pgrep -f 'read -t [9]0 x'6053worker2: (finished: must succeed: pgrep -f 'read -t [9]0 x', in 0.05 seconds)6054client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&26055worker1 # [ 126.467771] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:25Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592706056client # don't know how to build these paths:6057client # /nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6058worker2 # [ 126.609132] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:25Z level=debug event=want client=4 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=06059worker2 # [ 126.612167] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:25Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=16060worker1 # [ 126.525753] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:25Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706061worker1 # [ 126.534083] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:25Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592706062client # copying 1 paths to 'lb:50051'...6063worker1 # [ 126.541068] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592706064client # copying path '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' to 'lb:50051'...6065worker1 # [ 126.553623] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6066worker1 # [ 126.692557] nix-daemon[915]: accepted connection from pid 1724, user nix-grpc-daemon (trusted)6067worker1 # [ 126.707550] nix-daemon[915]: reaped child process 1727, status = succeeded6068worker1 # [ 126.884429] nix-daemon[915]: accepted connection from pid 1729, user nix-grpc-daemon (trusted)6069worker1 # [ 126.906334] nix-daemon[915]: reaped child process 1732, status = succeeded6070lb # [ 127.030982] niks3-server[1114]: 2026/09/20 07:59:25 INFO Received uploads request method=POST path=/api/pending_closures6071worker1 # [ 126.929593] nix-grpc-daemon[1644]: time=2026-09-20T07:59:26.151Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6072worker1 # [ 126.932265] nix-grpc-daemon[1644]: time=2026-09-20T07:59:26.153Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)"6073lb # [ 127.058807] niks3-server[1114]: 2026/09/20 07:59:25 INFO Received sign narinfos request method=POST path=/api/pending_closures/37/sign6074lb # [ 127.061385] niks3-server[1114]: 2026/09/20 07:59:25 INFO Signed narinfos id=37 count=16075worker1 # [ 126.953309] nix-grpc-daemon[1644]: time=2026-09-20T07:59:26.175Z level=INFO msg="Uploading 1 narinfos"6076lb # [ 127.065537] niks3-server[1114]: 2026/09/20 07:59:25 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst6077lb # [ 127.074824] niks3-server[1114]: 2026/09/20 07:59:25 INFO Received complete upload request method=POST path=/api/pending_closures/37/complete6078lb # [ 127.093422] niks3-server[1114]: 2026/09/20 07:59:25 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls6079lb # [ 127.157037] niks3-server[1114]: 2026/09/20 07:59:25 INFO Completed upload id=376080worker1 # [ 127.046943] nix-grpc-daemon[1644]: time=2026-09-20T07:59:26.269Z level=INFO msg="Upload complete. (487ms)"6081worker1 # [ 127.050390] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:26Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=0 paths=1 nar_bytes_in=5286082worker1 # [ 127.054639] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:26Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706083worker1 # [ 127.064435] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6084worker1 # [ 127.072691] nix-daemon[915]: reaped child process 1722, status = succeeded6085client # building '/nix/store/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv' on lb:50051...6086lb # [ 127.189212] niks3-server[1114]: 2026/09/20 07:59:25 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo6087client # farm-a> node-a: building s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6088worker1 # [ 127.079446] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6089client # farm-a> LOG-farm-a-during-drain6090worker1 # [ 128.502729] nix-daemon[915]: reaped child process 1736, status = succeeded6091worker1 # [ 128.660114] nix-daemon[915]: accepted connection from pid 1751, user nix-grpc-daemon (trusted)6092worker1 # [ 128.674241] nix-daemon[915]: reaped child process 1754, status = succeeded6093lb # [ 128.801228] niks3-server[1114]: 2026/09/20 07:59:27 INFO Received uploads request method=POST path=/api/pending_closures6094worker1 # [ 128.698449] nix-grpc-daemon[1644]: time=2026-09-20T07:59:27.920Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6095worker1 # [ 128.702267] nix-grpc-daemon[1644]: time=2026-09-20T07:59:27.922Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)"6096lb # [ 128.830957] niks3-server[1114]: 2026/09/20 07:59:27 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst6097lb # [ 128.836382] niks3-server[1114]: 2026/09/20 07:59:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/38/sign6098lb # [ 128.840517] niks3-server[1114]: 2026/09/20 07:59:27 INFO Signed narinfos id=38 count=16099worker1 # [ 128.730419] nix-grpc-daemon[1644]: time=2026-09-20T07:59:27.952Z level=INFO msg="Uploading 1 narinfos"6100lb # [ 128.845543] niks3-server[1114]: 2026/09/20 07:59:27 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv6101lb # [ 128.848626] niks3-server[1114]: 2026/09/20 07:59:27 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls6102lb # [ 128.854890] niks3-server[1114]: 2026/09/20 07:59:27 INFO Received complete upload request method=POST path=/api/pending_closures/38/complete6103lb # [ 128.858376] niks3-server[1114]: 2026/09/20 07:59:27 INFO Completed upload id=386104worker1 # [ 128.749233] nix-grpc-daemon[1644]: time=2026-09-20T07:59:27.971Z level=INFO msg="Upload complete. (257ms)"6105lb # [ 128.860408] niks3-server[1114]: 2026/09/20 07:59:27 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo6106worker1 # [ 128.753435] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:27Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=4 outputs=16107worker2 # [ 128.887727] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:27Z level=debug event=want client=4 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=06108worker2 # [ 128.889729] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:27Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=16109worker1 # [ 128.761032] nix-daemon[915]: reaped child process 1734, status = succeeded6110worker1 # [ 128.804820] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706111worker1 # [ 128.817203] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592706112worker1 # [ 128.832157] nix-grpc-daemon[1644]: time=2026-09-20T07:59:28.054Z level=INFO msg="All 1 paths already cached"6113client # copying 1 paths to 'lb:50051'...6114client # copying path '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' to 'lb:50051'...6115worker1 # [ 128.840129] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592706116worker1 # [ 128.853196] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6117worker1 # [ 129.032262] nix-daemon[915]: accepted connection from pid 1758, user nix-grpc-daemon (trusted)6118worker1 # [ 129.052301] nix-daemon[915]: reaped child process 1761, status = succeeded6119worker1 # [ 129.235501] nix-daemon[915]: accepted connection from pid 1763, user nix-grpc-daemon (trusted)6120worker1 # [ 129.251902] nix-daemon[915]: reaped child process 1766, status = succeeded6121lb # [ 129.375786] niks3-server[1114]: 2026/09/20 07:59:27 INFO Received uploads request method=POST path=/api/pending_closures6122worker1 # [ 129.271143] nix-grpc-daemon[1644]: time=2026-09-20T07:59:28.492Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6123worker1 # [ 129.272770] nix-grpc-daemon[1644]: time=2026-09-20T07:59:28.492Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)"6124lb # [ 129.398052] niks3-server[1114]: 2026/09/20 07:59:27 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst6125lb # [ 129.408874] niks3-server[1114]: 2026/09/20 07:59:27 INFO Received sign narinfos request method=POST path=/api/pending_closures/39/sign6126worker1 # [ 129.304102] nix-grpc-daemon[1644]: time=2026-09-20T07:59:28.526Z level=INFO msg="Uploading 1 narinfos"6127lb # [ 129.414512] niks3-server[1114]: 2026/09/20 07:59:27 INFO Signed narinfos id=39 count=16128lb # [ 129.418310] niks3-server[1114]: 2026/09/20 07:59:27 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls6129lb # [ 129.429847] niks3-server[1114]: 2026/09/20 07:59:27 INFO Received complete upload request method=POST path=/api/pending_closures/39/complete6130worker1 # [ 129.325382] nix-grpc-daemon[1644]: time=2026-09-20T07:59:28.547Z level=INFO msg="Upload complete. (460ms)"6131lb # [ 129.436347] niks3-server[1114]: 2026/09/20 07:59:27 INFO Completed upload id=396132worker1 # [ 129.328084] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=0 paths=1 nar_bytes_in=6406133lb # [ 129.439752] niks3-server[1114]: 2026/09/20 07:59:27 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo6134worker1 # [ 129.331946] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706135worker1 # [ 129.339573] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6136worker1 # [ 129.342209] nix-daemon[915]: reaped child process 1756, status = succeeded6137worker1 # [ 129.348459] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6138client # building '/nix/store/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv' on lb:50051...6139client # farm-b> node-a: building pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6140client # farm-b> LOG-farm-b-during-drain6141worker1 # [ 130.570116] nix-daemon[915]: reaped child process 1770, status = succeeded6142worker1 # [ 130.720114] nix-daemon[915]: accepted connection from pid 1785, user nix-grpc-daemon (trusted)6143worker1 # [ 130.734112] nix-daemon[915]: reaped child process 1788, status = succeeded6144lb # [ 130.858890] niks3-server[1114]: 2026/09/20 07:59:29 INFO Received uploads request method=POST path=/api/pending_closures6145worker1 # [ 130.759210] nix-grpc-daemon[1644]: time=2026-09-20T07:59:29.981Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6146worker1 # [ 130.762068] nix-grpc-daemon[1644]: time=2026-09-20T07:59:29.983Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)"6147lb # [ 130.890264] niks3-server[1114]: 2026/09/20 07:59:29 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst6148lb # [ 130.893911] niks3-server[1114]: 2026/09/20 07:59:29 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv6149lb # [ 130.901159] niks3-server[1114]: 2026/09/20 07:59:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/40/sign6150worker1 # [ 130.794421] nix-grpc-daemon[1644]: time=2026-09-20T07:59:30.016Z level=INFO msg="Uploading 1 narinfos"6151lb # [ 130.906096] niks3-server[1114]: 2026/09/20 07:59:29 INFO Signed narinfos id=40 count=16152lb # [ 130.912811] niks3-server[1114]: 2026/09/20 07:59:29 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls6153lb # [ 130.919029] niks3-server[1114]: 2026/09/20 07:59:29 INFO Received complete upload request method=POST path=/api/pending_closures/40/complete6154lb # [ 130.925801] niks3-server[1114]: 2026/09/20 07:59:29 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo6155lb # [ 130.930321] niks3-server[1114]: 2026/09/20 07:59:29 INFO Completed upload id=406156worker1 # [ 130.820106] nix-grpc-daemon[1644]: time=2026-09-20T07:59:30.042Z level=INFO msg="Upload complete. (262ms)"6157worker1 # [ 130.825582] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=5 outputs=16158worker2 # [ 130.961170] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:29Z level=debug event=want client=4 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=06159worker2 # [ 130.963096] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:29Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=16160worker1 # [ 130.838224] nix-daemon[915]: reaped child process 1768, status = succeeded6161worker1 # [ 130.875979] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706162worker1 # [ 130.885245] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592706163worker1 # [ 130.893923] nix-grpc-daemon[1644]: time=2026-09-20T07:59:30.116Z level=INFO msg="All 2 paths already cached"6164client # copying 1 paths to 'lb:50051'...6165worker1 # [ 130.901080] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592706166client # copying path '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' to 'lb:50051'...6167worker1 # [ 130.919414] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6168worker1 # [ 131.076894] nix-daemon[915]: accepted connection from pid 1792, user nix-grpc-daemon (trusted)6169worker1 # [ 131.092443] nix-daemon[915]: reaped child process 1795, status = succeeded6170worker1 # [ 131.262055] nix-daemon[915]: accepted connection from pid 1797, user nix-grpc-daemon (trusted)6171worker1 # [ 131.278309] nix-daemon[915]: reaped child process 1800, status = succeeded6172lb # [ 131.401684] niks3-server[1114]: 2026/09/20 07:59:29 INFO Received uploads request method=POST path=/api/pending_closures6173worker1 # [ 131.300206] nix-grpc-daemon[1644]: time=2026-09-20T07:59:30.522Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6174worker1 # [ 131.301941] nix-grpc-daemon[1644]: time=2026-09-20T07:59:30.522Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)"6175lb # [ 131.429617] niks3-server[1114]: 2026/09/20 07:59:29 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst6176lb # [ 131.438291] niks3-server[1114]: 2026/09/20 07:59:29 INFO Received sign narinfos request method=POST path=/api/pending_closures/41/sign6177lb # [ 131.441915] niks3-server[1114]: 2026/09/20 07:59:29 INFO Signed narinfos id=41 count=16178worker1 # [ 131.337762] nix-grpc-daemon[1644]: time=2026-09-20T07:59:30.559Z level=INFO msg="Uploading 1 narinfos"6179lb # [ 131.457540] niks3-server[1114]: 2026/09/20 07:59:30 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls6180lb # [ 131.463161] niks3-server[1114]: 2026/09/20 07:59:30 INFO Received complete upload request method=POST path=/api/pending_closures/41/complete6181lb # [ 131.467082] niks3-server[1114]: 2026/09/20 07:59:30 INFO Completed upload id=416182lb # [ 131.468952] niks3-server[1114]: 2026/09/20 07:59:30 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo6183worker1 # [ 131.358054] nix-grpc-daemon[1644]: time=2026-09-20T07:59:30.580Z level=INFO msg="Upload complete. (430ms)"6184worker1 # [ 131.364166] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=0 paths=1 nar_bytes_in=7686185worker1 # [ 131.367581] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:30Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706186worker1 # [ 131.376893] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6187worker1 # [ 131.379913] nix-daemon[915]: reaped child process 1790, status = succeeded6188client # building '/nix/store/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv' on lb:50051...6189worker1 # [ 131.386577] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6190client # farm-top> node-a: building w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6191client # farm-top> LOG-farm-top-during-drain6192worker1 # [ 132.606908] nix-daemon[915]: reaped child process 1804, status = succeeded6193worker1 # [ 132.770771] nix-daemon[915]: accepted connection from pid 1819, user nix-grpc-daemon (trusted)6194worker1 # [ 132.786919] nix-daemon[915]: reaped child process 1822, status = succeeded6195lb # [ 132.910325] niks3-server[1114]: 2026/09/20 07:59:31 INFO Received uploads request method=POST path=/api/pending_closures6196worker1 # [ 132.808844] nix-grpc-daemon[1644]: time=2026-09-20T07:59:32.030Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6197worker1 # [ 132.813385] nix-grpc-daemon[1644]: time=2026-09-20T07:59:32.032Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)"6198lb # [ 132.940138] niks3-server[1114]: 2026/09/20 07:59:31 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv6199lb # [ 132.944130] niks3-server[1114]: 2026/09/20 07:59:31 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst6200lb # [ 132.951787] niks3-server[1114]: 2026/09/20 07:59:31 INFO Received sign narinfos request method=POST path=/api/pending_closures/42/sign6201lb # [ 132.955072] niks3-server[1114]: 2026/09/20 07:59:31 INFO Signed narinfos id=42 count=16202worker1 # [ 132.844646] nix-grpc-daemon[1644]: time=2026-09-20T07:59:32.066Z level=INFO msg="Uploading 1 narinfos"6203lb # [ 132.958883] niks3-server[1114]: 2026/09/20 07:59:31 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls6204lb # [ 132.966381] niks3-server[1114]: 2026/09/20 07:59:31 INFO Received complete upload request method=POST path=/api/pending_closures/42/complete6205lb # [ 132.971158] niks3-server[1114]: 2026/09/20 07:59:31 INFO Completed upload id=426206worker1 # [ 132.860831] nix-grpc-daemon[1644]: time=2026-09-20T07:59:32.082Z level=INFO msg="Upload complete. (265ms)"6207lb # [ 132.973168] niks3-server[1114]: 2026/09/20 07:59:31 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo6208worker1 # [ 132.864714] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=6 outputs=16209worker1 # [ 132.874244] nix-daemon[915]: reaped child process 1802, status = succeeded6210client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain >&2, in 6.61 seconds)6211client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath6212client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag during-drain outPath, in 0.22 seconds)6213worker2: must succeed: pkill -f 'read -t [9]0 x'6214worker2: (finished: must succeed: pkill -f 'read -t [9]0 x', in 0.06 seconds)6215client: waiting for success: ! systemctl is-active sw6216worker2 # [ 133.410759] nix-daemon[911]: reaped child process 1537, status = succeeded6217worker2 # [ 133.567102] nix-daemon[911]: accepted connection from pid 1714, user nix-grpc-daemon (trusted)6218worker2 # [ 133.585539] nix-daemon[911]: reaped child process 1717, status = succeeded6219lb # [ 133.573728] niks3-server[1114]: 2026/09/20 07:59:32 INFO Received uploads request method=POST path=/api/pending_closures6220worker2 # [ 133.599385] nix-grpc-daemon[1466]: time=2026-09-20T07:59:32.490Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6221worker2 # [ 133.601372] nix-grpc-daemon[1466]: time=2026-09-20T07:59:32.492Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)"6222lb # [ 133.604611] niks3-server[1114]: 2026/09/20 07:59:32 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv6223lb # [ 133.608225] niks3-server[1114]: 2026/09/20 07:59:32 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst6224lb # [ 133.613068] niks3-server[1114]: 2026/09/20 07:59:32 INFO Received sign narinfos request method=POST path=/api/pending_closures/43/sign6225lb # [ 133.615956] niks3-server[1114]: 2026/09/20 07:59:32 INFO Signed narinfos id=43 count=16226worker2 # [ 133.638226] nix-grpc-daemon[1466]: time=2026-09-20T07:59:32.529Z level=INFO msg="Uploading 1 narinfos"6227lb # [ 133.622209] niks3-server[1114]: 2026/09/20 07:59:32 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls6228lb # [ 133.631371] niks3-server[1114]: 2026/09/20 07:59:32 INFO Received complete upload request method=POST path=/api/pending_closures/43/complete6229lb # [ 133.636167] niks3-server[1114]: 2026/09/20 07:59:32 INFO Completed upload id=436230worker2 # [ 133.655922] nix-grpc-daemon[1466]: time=2026-09-20T07:59:32.547Z level=INFO msg="Upload complete. (256ms)"6231worker2 # [ 133.660497] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:41418 duration_s=11 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=3 outputs=16232lb # [ 133.645810] niks3-server[1114]: 2026/09/20 07:59:32 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo6233worker2 # [ 133.669737] nix-daemon[911]: reaped child process 1535, status = succeeded6234client # [ 133.616073] systemd[1]: sw.service: Deactivated successfully.6235client # [ 133.618711] systemd[1]: sw.service: Consumed 138ms CPU time over 13.721s wall clock time, 37.1M memory peak, 8.7K incoming IP traffic, 9K outgoing IP traffic.6236worker2 # [ 134.192726] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:33Z level=info event=signal_exit6237worker2 # [ 134.195702] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:33Z level=info event=scheduler_yield6238lb # [ 134.176639] niks3-server[1114]: 2026/09/20 07:59:32 INFO lead: released remote=192.168.1.4:361326239worker1 # [ 134.069856] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:33Z level=info event=scheduler_restarting addr=lb:500516240worker2 # [ 134.200251] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:414106241worker2 # [ 134.202298] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:33Z level=info event=worker_gone addr=192.168.1.3:500516242worker2 # [ 134.205272] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:33Z level=info event=scheduler_restarting addr=lb:500516243worker2 # [ 134.207085] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:33Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:414106244worker2 # [ 134.208930] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:33Z level=info event=worker_gone addr=192.168.1.4:500516245client: (finished: waiting for success: ! systemctl is-active sw, in 1.07 seconds)6246client: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }6247worker1 # [ 134.270297] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:33Z level=info event=scheduler_connected addr=lb:500516248worker1 # [ 134.274210] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6249worker2 # [ 134.405702] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:33Z level=info event=scheduler_connected addr=lb:500516250worker2 # [ 134.410404] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6251client: (finished: must succeed: systemctl show -p Result --value sw | grep -qx success || { journalctl -u sw >&2; false; }, in 0.04 seconds)6252worker2: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service6253worker1 # [ 134.475042] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:33Z level=info event=scheduler_connected addr=lb:500516254worker2 # [ 134.611033] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:33Z level=info event=scheduler_connected addr=lb:500516255worker1 # [ 134.480238] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6256worker2 # [ 134.621034] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6257lb # [ 134.648987] niks3-server[1114]: 2026/09/20 07:59:33 INFO lead: acquired remote=192.168.1.3:407486258worker1 # [ 134.542067] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:33Z level=info event=scheduler_take_over6259worker1 # [ 134.681062] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:33Z level=info event=scheduler_connected addr=lb:500516260worker1 # [ 134.684384] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:33Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6261worker2 # [ 134.822265] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:33Z level=info event=scheduler_connected addr=lb:500516262worker1 # [ 134.693246] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:33Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=0 running=06263worker1 # [ 134.885622] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:34Z level=info event=scheduler_connected addr=lb:500516264worker1 # [ 134.889489] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:34Z level=info event=scheduler_disconnected addr=lb:50051 error="scheduler passive, another node serves"6265worker2 # [ 135.195080] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:34Z level=info event=scheduler_restarting6266worker1 # [ 135.071283] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:34Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:569926267worker1 # [ 135.074138] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:34Z level=info event=worker_gone addr=192.168.1.4:500516268worker2 # [ 135.205906] nix-grpc-daemon[1387]: ts=2026-09-20T07:59:34Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited"6269worker1 # [ 135.090292] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:34Z level=info event=scheduler_connected addr=lb:500516270worker2 # [ 135.224181] nix-daemon[911]: reaped child process 1438, status = succeeded6271worker1 # [ 135.093139] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:34Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06272worker2 # [ 135.560172] nix-grpc-daemon[1387]: WARNING: All log messages before absl::InitializeLog() is called are written to STDERR6273worker2 # [ 135.562267] nix-grpc-daemon[1387]: E0000 00:00:1789891174.451622 1430 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 9, started true, shutdown true6274worker2 # [ 135.564641] nix-grpc-daemon[1387]: E0000 00:00:1789891174.451752 1430 external_connection_acceptor_impl.cc:72] NOT handling external connection with fd 7, started true, shutdown true6275worker2 # [ 137.222421] systemd[1]: nix-grpc-daemon.service: Deactivated successfully.6276worker2 # [ 137.224476] systemd[1]: nix-grpc-daemon.service: Consumed 735ms CPU time over 28.394s wall clock time, 31.4M memory peak, 23.9K incoming IP traffic, 32.7K outgoing IP traffic.6277worker2 # [ 137.232326] systemd[1]: Starting Nix worker-protocol over gRPC...6278worker2 # [ 137.395374] nix-grpc-daemon[1731]: ts=2026-09-20T07:59:36Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc6279worker2 # [ 137.399074] nix-grpc-daemon[1731]: ts=2026-09-20T07:59:36Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=16280worker2 # [ 137.407419] nix-grpc-daemon[1731]: ts=2026-09-20T07:59:36Z level=info event=startup listen=systemd proxy_socket=/nix/var/nix/daemon-socket/socket6281worker2 # [ 137.409514] systemd[1]: Started Nix worker-protocol over gRPC.6282worker2: (finished: waiting for success: systemctl is-active nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service, in 3.00 seconds)6283lb: waiting until exactly no endpoints of x86_64-linux are unhealthy6284lb: must succeed: curl -sf localhost:9901/clusters6285worker2 # [ 137.427727] nix-grpc-daemon[1731]: ts=2026-09-20T07:59:36Z level=info event=scheduler_connected addr=lb:500516286worker1 # [ 137.300081] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:36Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=06287lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6288lb: must succeed: curl -sf localhost:9901/clusters6289lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.05 seconds)6290lb: (finished: waiting until exactly no endpoints of x86_64-linux are unhealthy, in 1.11 seconds)6291lb: must succeed: curl -sf localhost:9901/clusters6292lb: (finished: must succeed: curl -sf localhost:9901/clusters, in 0.04 seconds)6293worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true6294worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -F 'nix_grpc_sched{kind="workers"} ' || true, in 0.05 seconds)6295(finished: subtest: a deploy mid-build drains: the build finishes, the new generation takes over, in 18.68 seconds)6296subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does6297client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&16298worker1 # [ 138.748050] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:37Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592706299worker1 # [ 138.758140] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:37Z level=debug event=want client=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv cached=06300worker1 # [ 138.761414] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:37Z level=debug event=assigned drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv worker=192.168.1.3:50051 clients=16301worker1 # [ 138.764742] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:37Z level=debug event=want client=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv cached=06302worker1 # [ 138.766931] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:37Z level=debug event=want client=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv cached=06303worker1 # [ 138.806811] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706304worker1 # [ 138.817289] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:38Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592706305worker1 # [ 138.829804] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592706306worker1 # [ 138.836583] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6307worker1 # [ 139.061922] nix-daemon[915]: accepted connection from pid 1833, user nix-grpc-daemon (trusted)6308worker1 # [ 139.085243] nix-daemon[915]: reaped child process 1836, status = succeeded6309worker1 # [ 139.314445] nix-daemon[915]: accepted connection from pid 1838, user nix-grpc-daemon (trusted)6310worker1 # [ 139.336750] nix-daemon[915]: reaped child process 1841, status = succeeded6311lb # [ 139.463047] niks3-server[1114]: 2026/09/20 07:59:38 INFO Received uploads request method=POST path=/api/pending_closures6312worker1 # [ 139.370647] nix-grpc-daemon[1644]: time=2026-09-20T07:59:38.592Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6313worker1 # [ 139.375299] nix-grpc-daemon[1644]: time=2026-09-20T07:59:38.595Z level=INFO msg="Uploading cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv (504B)"6314lb # [ 139.513382] niks3-server[1114]: 2026/09/20 07:59:38 INFO Received sign narinfos request method=POST path=/api/pending_closures/44/sign6315lb # [ 139.519815] niks3-server[1114]: 2026/09/20 07:59:38 INFO Registered completed upload object_key=nar/1ifhv0ll3mnj6a2hrp33fzwnm2yl2zjxwqfrqjriibhs5cbnyiwi.nar.zst6316lb # [ 139.535236] niks3-server[1114]: 2026/09/20 07:59:38 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.ls6317lb # [ 139.539045] niks3-server[1114]: 2026/09/20 07:59:38 INFO Signed narinfos id=44 count=16318worker1 # [ 139.428893] nix-grpc-daemon[1644]: time=2026-09-20T07:59:38.650Z level=INFO msg="Uploading 1 narinfos"6319lb # [ 139.548904] niks3-server[1114]: 2026/09/20 07:59:38 INFO Received complete upload request method=POST path=/api/pending_closures/44/complete6320lb # [ 139.566343] niks3-server[1114]: 2026/09/20 07:59:38 INFO Registered completed upload object_key=cv151lgjr4lv54sqzb49xk9w1ak9xsm9.narinfo6321lb # [ 139.575046] niks3-server[1114]: 2026/09/20 07:59:38 INFO Completed upload id=446322worker1 # [ 139.464675] nix-grpc-daemon[1644]: time=2026-09-20T07:59:38.686Z level=INFO msg="Upload complete. (621ms)"6323worker1 # [ 139.467774] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:38Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=0 paths=1 nar_bytes_in=5046324worker1 # [ 139.472307] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:38Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706325worker1 # [ 139.483102] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6326worker1 # [ 139.489170] nix-daemon[915]: reaped child process 1831, status = succeeded6327worker1 # [ 139.498154] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6328lb # [ 140.489370] envoy[939]: conn peer=[2001:db8:1::1]:42656 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=9459 tx=3751 ms=64126329lb # [ 140.491270] envoy[939]: conn peer=[2001:db8:1::1]:53334 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2949 tx=1376 ms=134796330lb # [ 140.494142] envoy[939]: conn peer=[2001:db8:1::4]:60184 tls=TLSv1.3 subject="CN=worker-1" sni=- flags=- tls_fail="-" rx=1585 tx=578 ms=260026331worker1 # [ 140.520827] nix-daemon[915]: reaped child process 1845, status = succeeded6332worker1 # [ 140.700125] nix-daemon[915]: accepted connection from pid 1860, user nix-grpc-daemon (trusted)6333worker1 # [ 140.722478] nix-daemon[915]: reaped child process 1863, status = succeeded6334lb # [ 140.849253] niks3-server[1114]: 2026/09/20 07:59:39 INFO Received uploads request method=POST path=/api/pending_closures6335worker1 # [ 140.746287] nix-grpc-daemon[1644]: time=2026-09-20T07:59:39.968Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6336worker1 # [ 140.750887] nix-grpc-daemon[1644]: time=2026-09-20T07:59:39.970Z level=INFO msg="Uploading wfziwgf0gxmjhy17lyfmn47628s166p7-farm-a (128B)"6337lb # [ 140.888241] niks3-server[1114]: 2026/09/20 07:59:39 INFO Received sign narinfos request method=POST path=/api/pending_closures/45/sign6338lb # [ 140.893544] niks3-server[1114]: 2026/09/20 07:59:39 INFO Signed narinfos id=45 count=16339worker1 # [ 140.786532] nix-grpc-daemon[1644]: time=2026-09-20T07:59:40.008Z level=INFO msg="Uploading 1 narinfos"6340lb # [ 140.907831] niks3-server[1114]: 2026/09/20 07:59:39 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.ls6341lb # [ 140.917863] niks3-server[1114]: 2026/09/20 07:59:39 INFO Received complete upload request method=POST path=/api/pending_closures/45/complete6342lb # [ 141.051495] niks3-server[1114]: 2026/09/20 07:59:39 INFO Registered completed upload object_key=nar/05i7ka1qa7vmhiys96ln3pp3nj3rfdlslnbydrxdqj40cmvmqcwf.nar.zst6343lb # [ 141.061823] niks3-server[1114]: 2026/09/20 07:59:39 INFO Registered completed upload object_key=log/cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv6344lb # [ 141.068345] niks3-server[1114]: 2026/09/20 07:59:39 INFO Registered completed upload object_key=wfziwgf0gxmjhy17lyfmn47628s166p7.narinfo6345lb # [ 141.079119] niks3-server[1114]: 2026/09/20 07:59:39 INFO Completed upload id=456346worker1 # [ 140.968684] nix-grpc-daemon[1644]: time=2026-09-20T07:59:40.190Z level=INFO msg="Upload complete. (459ms)"6347worker1 # [ 140.978119] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:40Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=1 drv=cv151lgjr4lv54sqzb49xk9w1ak9xsm9-farm-a.drv assign_id=1 outputs=16348worker1 # [ 140.981989] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:40Z level=debug event=assigned drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv worker=192.168.1.3:50051 clients=16349worker1 # [ 140.985046] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706350worker1 # [ 140.987180] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:40Z level=debug event=want client=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv cached=06351worker1 # [ 140.997225] nix-daemon[915]: reaped child process 1843, status = succeeded6352worker1 # [ 141.001288] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592706353worker1 # [ 141.011454] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592706354worker1 # [ 141.017097] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6355worker1 # [ 141.264393] nix-daemon[915]: accepted connection from pid 1869, user nix-grpc-daemon (trusted)6356worker1 # [ 141.293398] nix-daemon[915]: reaped child process 1872, status = succeeded6357worker1 # [ 141.473191] nix-daemon[915]: accepted connection from pid 1874, user nix-grpc-daemon (trusted)6358worker1 # [ 141.489057] nix-daemon[915]: reaped child process 1877, status = succeeded6359lb # [ 141.608895] niks3-server[1114]: 2026/09/20 07:59:40 INFO Received uploads request method=POST path=/api/pending_closures6360worker1 # [ 141.503368] nix-grpc-daemon[1644]: time=2026-09-20T07:59:40.725Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6361worker1 # [ 141.505058] nix-grpc-daemon[1644]: time=2026-09-20T07:59:40.725Z level=INFO msg="Uploading fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv (504B)"6362lb # [ 141.624510] niks3-server[1114]: 2026/09/20 07:59:40 INFO Registered completed upload object_key=nar/170l67nd7hvasq2l36jibfpivx7r9ssdy0wlzifggpplhcgf2rk0.nar.zst6363lb # [ 141.630032] niks3-server[1114]: 2026/09/20 07:59:40 INFO Received sign narinfos request method=POST path=/api/pending_closures/46/sign6364lb # [ 141.633625] niks3-server[1114]: 2026/09/20 07:59:40 INFO Signed narinfos id=46 count=16365worker1 # [ 141.523402] nix-grpc-daemon[1644]: time=2026-09-20T07:59:40.745Z level=INFO msg="Uploading 1 narinfos"6366lb # [ 141.637455] niks3-server[1114]: 2026/09/20 07:59:40 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.ls6367lb # [ 141.642584] niks3-server[1114]: 2026/09/20 07:59:40 INFO Received complete upload request method=POST path=/api/pending_closures/46/complete6368lb # [ 141.647933] niks3-server[1114]: 2026/09/20 07:59:40 INFO Completed upload id=466369worker1 # [ 141.537179] nix-grpc-daemon[1644]: time=2026-09-20T07:59:40.759Z level=INFO msg="Upload complete. (511ms)"6370lb # [ 141.649562] niks3-server[1114]: 2026/09/20 07:59:40 INFO Registered completed upload object_key=fggw0ziag6jlrc830j6x1b6qw68kybhf.narinfo6371worker1 # [ 141.539975] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:40Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=0 paths=1 nar_bytes_in=5046372worker1 # [ 141.543568] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:40Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706373worker1 # [ 141.553439] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6374worker1 # [ 141.557345] nix-daemon[915]: reaped child process 1867, status = succeeded6375worker1 # [ 141.562316] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6376worker1 # [ 142.983466] nix-daemon[915]: reaped child process 1881, status = succeeded6377worker1 # [ 143.135521] nix-daemon[915]: accepted connection from pid 1896, user nix-grpc-daemon (trusted)6378worker1 # [ 143.148971] nix-daemon[915]: reaped child process 1899, status = succeeded6379lb # [ 143.271596] niks3-server[1114]: 2026/09/20 07:59:41 INFO Received uploads request method=POST path=/api/pending_closures6380worker1 # [ 143.166911] nix-grpc-daemon[1644]: time=2026-09-20T07:59:42.388Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6381worker1 # [ 143.170660] nix-grpc-daemon[1644]: time=2026-09-20T07:59:42.390Z level=INFO msg="Uploading 63zyaryk3r1ikmmzi1w30vadf20kdw3y-farm-a (128B)"6382lb # [ 143.295498] niks3-server[1114]: 2026/09/20 07:59:41 INFO Registered completed upload object_key=log/fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv6383lb # [ 143.302160] niks3-server[1114]: 2026/09/20 07:59:41 INFO Registered completed upload object_key=nar/09na6djn66dpys8h08gqw39p0vw7vxqsdzbiw55rknyna8s239bm.nar.zst6384lb # [ 143.305782] niks3-server[1114]: 2026/09/20 07:59:41 INFO Received sign narinfos request method=POST path=/api/pending_closures/47/sign6385lb # [ 143.309499] niks3-server[1114]: 2026/09/20 07:59:41 INFO Signed narinfos id=47 count=16386worker1 # [ 143.199263] nix-grpc-daemon[1644]: time=2026-09-20T07:59:42.421Z level=INFO msg="Uploading 1 narinfos"6387lb # [ 143.314561] niks3-server[1114]: 2026/09/20 07:59:41 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.ls6388lb # [ 143.321384] niks3-server[1114]: 2026/09/20 07:59:41 INFO Received complete upload request method=POST path=/api/pending_closures/47/complete6389lb # [ 143.325243] niks3-server[1114]: 2026/09/20 07:59:41 INFO Completed upload id=476390worker1 # [ 143.214694] nix-grpc-daemon[1644]: time=2026-09-20T07:59:42.436Z level=INFO msg="Upload complete. (242ms)"6391lb # [ 143.329355] niks3-server[1114]: 2026/09/20 07:59:41 INFO Registered completed upload object_key=63zyaryk3r1ikmmzi1w30vadf20kdw3y.narinfo6392worker1 # [ 143.219146] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:42Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=1 drv=fggw0ziag6jlrc830j6x1b6qw68kybhf-farm-a.drv assign_id=2 outputs=16393worker1 # [ 143.222424] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:42Z level=debug event=assigned drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv worker=192.168.1.3:50051 clients=16394worker1 # [ 143.227063] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706395worker1 # [ 143.231966] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:42Z level=debug event=want client=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv cached=06396worker1 # [ 143.239232] nix-daemon[915]: reaped child process 1879, status = succeeded6397worker1 # [ 143.241331] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:42Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592706398worker1 # [ 143.249143] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:42Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592706399worker1 # [ 143.255703] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6400worker1 # [ 143.416150] nix-daemon[915]: accepted connection from pid 1905, user nix-grpc-daemon (trusted)6401worker1 # [ 143.431675] nix-daemon[915]: reaped child process 1908, status = succeeded6402worker1 # [ 143.591698] nix-daemon[915]: accepted connection from pid 1910, user nix-grpc-daemon (trusted)6403worker1 # [ 143.605743] nix-daemon[915]: reaped child process 1913, status = succeeded6404lb # [ 143.728118] niks3-server[1114]: 2026/09/20 07:59:42 INFO Received uploads request method=POST path=/api/pending_closures6405worker1 # [ 143.623738] nix-grpc-daemon[1644]: time=2026-09-20T07:59:42.845Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6406worker1 # [ 143.625197] nix-grpc-daemon[1644]: time=2026-09-20T07:59:42.845Z level=INFO msg="Uploading j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv (504B)"6407lb # [ 143.746305] niks3-server[1114]: 2026/09/20 07:59:42 INFO Registered completed upload object_key=nar/0qr7hdc916yrqpvqx2bwc5l0rwy3zm6rsdlcf8rk9iid53b80xsn.nar.zst6408lb # [ 143.752512] niks3-server[1114]: 2026/09/20 07:59:42 INFO Received sign narinfos request method=POST path=/api/pending_closures/48/sign6409lb # [ 143.755299] niks3-server[1114]: 2026/09/20 07:59:42 INFO Signed narinfos id=48 count=16410worker1 # [ 143.644893] nix-grpc-daemon[1644]: time=2026-09-20T07:59:42.866Z level=INFO msg="Uploading 1 narinfos"6411lb # [ 143.759565] niks3-server[1114]: 2026/09/20 07:59:42 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.ls6412lb # [ 143.766122] niks3-server[1114]: 2026/09/20 07:59:42 INFO Received complete upload request method=POST path=/api/pending_closures/48/complete6413lb # [ 143.769369] niks3-server[1114]: 2026/09/20 07:59:42 INFO Completed upload id=486414worker1 # [ 143.658802] nix-grpc-daemon[1644]: time=2026-09-20T07:59:42.881Z level=INFO msg="Upload complete. (396ms)"6415lb # [ 143.773101] niks3-server[1114]: 2026/09/20 07:59:42 INFO Registered completed upload object_key=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz.narinfo6416worker1 # [ 143.662086] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:42Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=0 paths=1 nar_bytes_in=5046417worker1 # [ 143.665171] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:42Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706418worker1 # [ 143.671846] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6419worker1 # [ 143.674468] nix-daemon[915]: reaped child process 1903, status = succeeded6420worker1 # [ 143.680275] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6421worker1 # [ 144.701324] nix-daemon[915]: reaped child process 1917, status = succeeded6422worker1 # [ 144.851235] nix-daemon[915]: accepted connection from pid 1932, user nix-grpc-daemon (trusted)6423worker1 # [ 144.866148] nix-daemon[915]: reaped child process 1935, status = succeeded6424lb # [ 144.992256] niks3-server[1114]: 2026/09/20 07:59:43 INFO Received uploads request method=POST path=/api/pending_closures6425worker1 # [ 144.888497] nix-grpc-daemon[1644]: time=2026-09-20T07:59:44.110Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6426worker1 # [ 144.890201] nix-grpc-daemon[1644]: time=2026-09-20T07:59:44.112Z level=INFO msg="Uploading pnim4ls33hwi0fl1wv96w4yj4afz9w4m-farm-a (128B)"6427lb # [ 145.021048] niks3-server[1114]: 2026/09/20 07:59:43 INFO Registered completed upload object_key=nar/1j2671k9mycq8lxyfx5k6a66d5narfqw2wqwlpwxgwzi93vnvbdn.nar.zst6428lb # [ 145.023968] niks3-server[1114]: 2026/09/20 07:59:43 INFO Received sign narinfos request method=POST path=/api/pending_closures/49/sign6429lb # [ 145.026964] niks3-server[1114]: 2026/09/20 07:59:43 INFO Signed narinfos id=49 count=16430worker1 # [ 144.917977] nix-grpc-daemon[1644]: time=2026-09-20T07:59:44.140Z level=INFO msg="Uploading 1 narinfos"6431lb # [ 145.031612] niks3-server[1114]: 2026/09/20 07:59:43 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.ls6432lb # [ 145.037803] niks3-server[1114]: 2026/09/20 07:59:43 INFO Registered completed upload object_key=log/j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv6433lb # [ 145.042950] niks3-server[1114]: 2026/09/20 07:59:43 INFO Received complete upload request method=POST path=/api/pending_closures/49/complete6434lb # [ 145.047741] niks3-server[1114]: 2026/09/20 07:59:43 INFO Completed upload id=496435worker1 # [ 144.937194] nix-grpc-daemon[1644]: time=2026-09-20T07:59:44.159Z level=INFO msg="Upload complete. (250ms)"6436lb # [ 145.050469] niks3-server[1114]: 2026/09/20 07:59:43 INFO Registered completed upload object_key=pnim4ls33hwi0fl1wv96w4yj4afz9w4m.narinfo6437worker1 # [ 144.941356] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:44Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=1 drv=j7ssjgj9yiiadgfwc3qmhbma7i6ylnrz-farm-a.drv assign_id=3 outputs=16438worker1 # [ 144.945111] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:44Z level=debug event=assigned drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv worker=192.168.1.3:50051 clients=16439worker1 # [ 144.950450] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706440worker1 # [ 144.955953] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:44Z level=debug event=want client=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv cached=06441worker1 # [ 144.961555] nix-daemon[915]: reaped child process 1915, status = succeeded6442worker1 # [ 144.995083] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:44Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592706443worker1 # [ 145.009553] nix-grpc-daemon[1644]: time=2026-09-20T07:59:44.231Z level=INFO msg="All 1 paths already cached"6444worker1 # [ 145.016738] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592706445worker1 # [ 145.024900] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6446worker1 # [ 145.170867] nix-daemon[915]: accepted connection from pid 1941, user nix-grpc-daemon (trusted)6447worker1 # [ 145.185091] nix-daemon[915]: reaped child process 1944, status = succeeded6448worker1 # [ 145.350229] nix-daemon[915]: accepted connection from pid 1946, user nix-grpc-daemon (trusted)6449worker1 # [ 145.365085] nix-daemon[915]: reaped child process 1949, status = succeeded6450lb # [ 145.492719] niks3-server[1114]: 2026/09/20 07:59:44 INFO Received uploads request method=POST path=/api/pending_closures6451worker1 # [ 145.392366] nix-grpc-daemon[1644]: time=2026-09-20T07:59:44.614Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6452worker1 # [ 145.394447] nix-grpc-daemon[1644]: time=2026-09-20T07:59:44.616Z level=INFO msg="Uploading 6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv (624B)"6453lb # [ 145.526282] niks3-server[1114]: 2026/09/20 07:59:44 INFO Registered completed upload object_key=nar/06n0qn8haxwg1vfa3qwa7h14mzz5fz7nizpv8bn995f4gddci6y6.nar.zst6454lb # [ 145.536714] niks3-server[1114]: 2026/09/20 07:59:44 INFO Received sign narinfos request method=POST path=/api/pending_closures/50/sign6455lb # [ 145.540508] niks3-server[1114]: 2026/09/20 07:59:44 INFO Signed narinfos id=50 count=16456worker1 # [ 145.433125] nix-grpc-daemon[1644]: time=2026-09-20T07:59:44.655Z level=INFO msg="Uploading 1 narinfos"6457lb # [ 145.546738] niks3-server[1114]: 2026/09/20 07:59:44 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.ls6458lb # [ 145.552926] niks3-server[1114]: 2026/09/20 07:59:44 INFO Received complete upload request method=POST path=/api/pending_closures/50/complete6459lb # [ 145.556609] niks3-server[1114]: 2026/09/20 07:59:44 INFO Completed upload id=506460worker1 # [ 145.446026] nix-grpc-daemon[1644]: time=2026-09-20T07:59:44.668Z level=INFO msg="Upload complete. (415ms)"6461lb # [ 145.559880] niks3-server[1114]: 2026/09/20 07:59:44 INFO Registered completed upload object_key=6cjjd3vbzygfms2ccxvnmabbgq5pv310.narinfo6462worker1 # [ 145.449206] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:44Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=0 paths=1 nar_bytes_in=6246463worker1 # [ 145.452158] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:44Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706464worker1 # [ 145.459560] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6465worker1 # [ 145.463157] nix-daemon[915]: reaped child process 1939, status = succeeded6466worker1 # [ 145.468941] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6467worker1 # [ 146.490396] nix-daemon[915]: reaped child process 1953, status = succeeded6468worker1 # [ 146.655109] nix-daemon[915]: accepted connection from pid 1968, user nix-grpc-daemon (trusted)6469worker1 # [ 146.668584] nix-daemon[915]: reaped child process 1971, status = succeeded6470lb # [ 146.793855] niks3-server[1114]: 2026/09/20 07:59:45 INFO Received uploads request method=POST path=/api/pending_closures6471worker1 # [ 146.693365] nix-grpc-daemon[1644]: time=2026-09-20T07:59:45.915Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6472worker1 # [ 146.697346] nix-grpc-daemon[1644]: time=2026-09-20T07:59:45.917Z level=INFO msg="Uploading 7gfg490kigdqainqjk27vmks1h3wpv5q-farm-b (176B)"6473lb # [ 146.841236] niks3-server[1114]: 2026/09/20 07:59:45 INFO Registered completed upload object_key=nar/07q9c11jk9djv06znvadbhgp1j3kwqf4z0z60kwx2sjqjkpssnf0.nar.zst6474lb # [ 146.848607] niks3-server[1114]: 2026/09/20 07:59:45 INFO Registered completed upload object_key=log/6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv6475lb # [ 146.861124] niks3-server[1114]: 2026/09/20 07:59:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/51/sign6476lb # [ 146.867628] niks3-server[1114]: 2026/09/20 07:59:45 INFO Signed narinfos id=51 count=16477worker1 # [ 146.760170] nix-grpc-daemon[1644]: time=2026-09-20T07:59:45.982Z level=INFO msg="Uploading 1 narinfos"6478lb # [ 146.872609] niks3-server[1114]: 2026/09/20 07:59:45 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.ls6479lb # [ 146.882822] niks3-server[1114]: 2026/09/20 07:59:45 INFO Received complete upload request method=POST path=/api/pending_closures/51/complete6480lb # [ 146.886409] niks3-server[1114]: 2026/09/20 07:59:45 INFO Completed upload id=516481worker1 # [ 146.775434] nix-grpc-daemon[1644]: time=2026-09-20T07:59:45.997Z level=INFO msg="Upload complete. (295ms)"6482lb # [ 146.889362] niks3-server[1114]: 2026/09/20 07:59:45 INFO Registered completed upload object_key=7gfg490kigdqainqjk27vmks1h3wpv5q.narinfo6483worker1 # [ 146.786959] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:46Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=1 drv=6cjjd3vbzygfms2ccxvnmabbgq5pv310-farm-b.drv assign_id=4 outputs=16484worker1 # [ 146.792802] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:46Z level=debug event=assigned drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv worker=192.168.1.3:50051 clients=16485worker1 # [ 146.797308] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706486worker1 # [ 146.801177] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:46Z level=debug event=want client=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv cached=06487worker1 # [ 146.811276] nix-daemon[915]: reaped child process 1951, status = succeeded6488worker1 # [ 146.813726] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:46Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592706489worker1 # [ 146.821379] nix-grpc-daemon[1644]: time=2026-09-20T07:59:46.043Z level=INFO msg="All 1 paths already cached"6490worker1 # [ 146.826262] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592706491worker1 # [ 146.830195] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6492worker1 # [ 146.990189] nix-daemon[915]: accepted connection from pid 1977, user nix-grpc-daemon (trusted)6493worker1 # [ 147.004884] nix-daemon[915]: reaped child process 1980, status = succeeded6494worker1 # [ 147.148837] nix-daemon[915]: accepted connection from pid 1982, user nix-grpc-daemon (trusted)6495worker1 # [ 147.163070] nix-daemon[915]: reaped child process 1985, status = succeeded6496lb # [ 147.290349] niks3-server[1114]: 2026/09/20 07:59:45 INFO Received uploads request method=POST path=/api/pending_closures6497worker1 # [ 147.189412] nix-grpc-daemon[1644]: time=2026-09-20T07:59:46.411Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6498worker1 # [ 147.190853] nix-grpc-daemon[1644]: time=2026-09-20T07:59:46.411Z level=INFO msg="Uploading 6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv (624B)"6499lb # [ 147.325687] niks3-server[1114]: 2026/09/20 07:59:45 INFO Received sign narinfos request method=POST path=/api/pending_closures/52/sign6500worker1 # [ 147.222498] nix-grpc-daemon[1644]: time=2026-09-20T07:59:46.444Z level=INFO msg="Uploading 1 narinfos"6501lb # [ 147.334159] niks3-server[1114]: 2026/09/20 07:59:45 INFO Signed narinfos id=52 count=16502lb # [ 147.337204] niks3-server[1114]: 2026/09/20 07:59:45 INFO Registered completed upload object_key=nar/0w4dmpczwycj1p7ngvcwdynpk5hh6r5ivyz44k3lx2gh5vpk4l0i.nar.zst6503lb # [ 147.347217] niks3-server[1114]: 2026/09/20 07:59:45 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.ls6504lb # [ 147.359486] niks3-server[1114]: 2026/09/20 07:59:45 INFO Received complete upload request method=POST path=/api/pending_closures/52/complete6505lb # [ 147.367033] niks3-server[1114]: 2026/09/20 07:59:45 INFO Completed upload id=526506worker1 # [ 147.256438] nix-grpc-daemon[1644]: time=2026-09-20T07:59:46.478Z level=INFO msg="Upload complete. (419ms)"6507lb # [ 147.368386] niks3-server[1114]: 2026/09/20 07:59:45 INFO Registered completed upload object_key=6cs4w0lyx4kldp39y5k29p7c0234cffw.narinfo6508worker1 # [ 147.259120] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:46Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=0 paths=1 nar_bytes_in=6246509worker1 # [ 147.262953] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:46Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706510worker1 # [ 147.269782] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6511worker1 # [ 147.272328] nix-daemon[915]: reaped child process 1975, status = succeeded6512worker1 # [ 147.278200] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6513worker1 # [ 148.493953] nix-daemon[915]: reaped child process 1989, status = succeeded6514worker1 # [ 148.647099] nix-daemon[915]: accepted connection from pid 2004, user nix-grpc-daemon (trusted)6515worker1 # [ 148.661292] nix-daemon[915]: reaped child process 2007, status = succeeded6516lb # [ 148.789990] niks3-server[1114]: 2026/09/20 07:59:47 INFO Received uploads request method=POST path=/api/pending_closures6517worker1 # [ 148.688370] nix-grpc-daemon[1644]: time=2026-09-20T07:59:47.910Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6518worker1 # [ 148.690908] nix-grpc-daemon[1644]: time=2026-09-20T07:59:47.912Z level=INFO msg="Uploading xxjh88rg0bhdcm1c6b12clv7l5hfbaa9-farm-b (176B)"6519lb # [ 148.834713] niks3-server[1114]: 2026/09/20 07:59:47 INFO Registered completed upload object_key=log/6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv6520lb # [ 148.851774] niks3-server[1114]: 2026/09/20 07:59:47 INFO Registered completed upload object_key=nar/1a8ws2jbn6nqpggi64yfgxvlwny3nffvyw6svm59is55hih5ppq4.nar.zst6521lb # [ 148.858729] niks3-server[1114]: 2026/09/20 07:59:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/53/sign6522worker1 # [ 148.754597] nix-grpc-daemon[1644]: time=2026-09-20T07:59:47.976Z level=INFO msg="Uploading 1 narinfos"6523lb # [ 148.865561] niks3-server[1114]: 2026/09/20 07:59:47 INFO Signed narinfos id=53 count=16524lb # [ 148.870041] niks3-server[1114]: 2026/09/20 07:59:47 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.ls6525lb # [ 148.879725] niks3-server[1114]: 2026/09/20 07:59:47 INFO Received complete upload request method=POST path=/api/pending_closures/53/complete6526lb # [ 148.882960] niks3-server[1114]: 2026/09/20 07:59:47 INFO Completed upload id=536527worker1 # [ 148.772638] nix-grpc-daemon[1644]: time=2026-09-20T07:59:47.994Z level=INFO msg="Upload complete. (286ms)"6528lb # [ 148.885852] niks3-server[1114]: 2026/09/20 07:59:47 INFO Registered completed upload object_key=xxjh88rg0bhdcm1c6b12clv7l5hfbaa9.narinfo6529worker1 # [ 148.781542] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:47Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=1 drv=6cs4w0lyx4kldp39y5k29p7c0234cffw-farm-b.drv assign_id=5 outputs=16530worker1 # [ 148.786156] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:48Z level=debug event=assigned drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv worker=192.168.1.3:50051 clients=16531worker1 # [ 148.788557] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706532worker1 # [ 148.790261] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:48Z level=debug event=want client=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv cached=06533worker1 # [ 148.797243] nix-daemon[915]: reaped child process 1987, status = succeeded6534worker1 # [ 148.798735] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:48Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592706535worker1 # [ 148.806102] nix-grpc-daemon[1644]: time=2026-09-20T07:59:48.028Z level=INFO msg="All 1 paths already cached"6536worker1 # [ 148.810852] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592706537worker1 # [ 148.815139] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6538worker1 # [ 148.980484] nix-daemon[915]: accepted connection from pid 2013, user nix-grpc-daemon (trusted)6539worker1 # [ 148.994529] nix-daemon[915]: reaped child process 2016, status = succeeded6540worker1 # [ 149.166694] nix-daemon[915]: accepted connection from pid 2018, user nix-grpc-daemon (trusted)6541worker1 # [ 149.180577] nix-daemon[915]: reaped child process 2021, status = succeeded6542lb # [ 149.302933] niks3-server[1114]: 2026/09/20 07:59:47 INFO Received uploads request method=POST path=/api/pending_closures6543worker1 # [ 149.201356] nix-grpc-daemon[1644]: time=2026-09-20T07:59:48.423Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6544worker1 # [ 149.202857] nix-grpc-daemon[1644]: time=2026-09-20T07:59:48.423Z level=INFO msg="Uploading 8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv (624B)"6545lb # [ 149.330375] niks3-server[1114]: 2026/09/20 07:59:47 INFO Registered completed upload object_key=nar/1dh50s9lbv3zd84hw5q9axrhfi7ms38cl3gyrb9gas00gni4siz2.nar.zst6546lb # [ 149.341344] niks3-server[1114]: 2026/09/20 07:59:47 INFO Received sign narinfos request method=POST path=/api/pending_closures/54/sign6547lb # [ 149.346263] niks3-server[1114]: 2026/09/20 07:59:47 INFO Signed narinfos id=54 count=16548worker1 # [ 149.239310] nix-grpc-daemon[1644]: time=2026-09-20T07:59:48.461Z level=INFO msg="Uploading 1 narinfos"6549lb # [ 149.355699] niks3-server[1114]: 2026/09/20 07:59:47 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.ls6550lb # [ 149.361081] niks3-server[1114]: 2026/09/20 07:59:47 INFO Received complete upload request method=POST path=/api/pending_closures/54/complete6551lb # [ 149.365376] niks3-server[1114]: 2026/09/20 07:59:47 INFO Completed upload id=546552worker1 # [ 149.254723] nix-grpc-daemon[1644]: time=2026-09-20T07:59:48.476Z level=INFO msg="Upload complete. (432ms)"6553worker1 # [ 149.256968] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:48Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=0 paths=1 nar_bytes_in=6246554lb # [ 149.368790] niks3-server[1114]: 2026/09/20 07:59:47 INFO Registered completed upload object_key=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz.narinfo6555worker1 # [ 149.260906] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:48Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706556worker1 # [ 149.267321] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6557worker1 # [ 149.270682] nix-daemon[915]: reaped child process 2011, status = succeeded6558worker1 # [ 149.276140] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6559worker1 # [ 150.492834] nix-daemon[915]: reaped child process 2025, status = succeeded6560worker1 # [ 150.637976] nix-daemon[915]: accepted connection from pid 2040, user nix-grpc-daemon (trusted)6561worker1 # [ 150.654183] nix-daemon[915]: reaped child process 2043, status = succeeded6562lb # [ 150.773925] niks3-server[1114]: 2026/09/20 07:59:49 INFO Received uploads request method=POST path=/api/pending_closures6563worker1 # [ 150.669224] nix-grpc-daemon[1644]: time=2026-09-20T07:59:49.891Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6564worker1 # [ 150.673972] nix-grpc-daemon[1644]: time=2026-09-20T07:59:49.893Z level=INFO msg="Uploading wha0h9jdcpcy0srjm92hg7pyknwdqp6h-farm-b (176B)"6565lb # [ 150.799615] niks3-server[1114]: 2026/09/20 07:59:49 INFO Registered completed upload object_key=log/8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv6566lb # [ 150.803551] niks3-server[1114]: 2026/09/20 07:59:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/55/sign6567lb # [ 150.806275] niks3-server[1114]: 2026/09/20 07:59:49 INFO Signed narinfos id=55 count=16568worker1 # [ 150.695941] nix-grpc-daemon[1644]: time=2026-09-20T07:59:49.917Z level=INFO msg="Uploading 1 narinfos"6569lb # [ 150.808507] niks3-server[1114]: 2026/09/20 07:59:49 INFO Registered completed upload object_key=nar/1xpjwixqgm25ifjqv3ldg9cbq2njxf26272sngvq3zhy6zr1mvwg.nar.zst6570lb # [ 150.815083] niks3-server[1114]: 2026/09/20 07:59:49 INFO Received complete upload request method=POST path=/api/pending_closures/55/complete6571lb # [ 150.817790] niks3-server[1114]: 2026/09/20 07:59:49 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.ls6572lb # [ 150.819611] niks3-server[1114]: 2026/09/20 07:59:49 INFO Completed upload id=556573worker1 # [ 150.708882] nix-grpc-daemon[1644]: time=2026-09-20T07:59:49.931Z level=INFO msg="Upload complete. (225ms)"6574lb # [ 150.822851] niks3-server[1114]: 2026/09/20 07:59:49 INFO Registered completed upload object_key=wha0h9jdcpcy0srjm92hg7pyknwdqp6h.narinfo6575worker1 # [ 150.711550] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:49Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=1 drv=8pwrbica5d7v9bivkz2fiy3z2fjlj9dz-farm-b.drv assign_id=6 outputs=16576worker1 # [ 150.716045] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:49Z level=debug event=assigned drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv worker=192.168.1.3:50051 clients=16577worker1 # [ 150.721824] nix-daemon[915]: reaped child process 2023, status = succeeded6578worker1 # [ 150.756229] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:49Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706579worker1 # [ 150.758717] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:49Z level=debug event=want client=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv cached=06580worker1 # [ 150.764636] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:49Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592706581worker1 # [ 150.771049] nix-grpc-daemon[1644]: time=2026-09-20T07:59:49.993Z level=INFO msg="All 2 paths already cached"6582worker1 # [ 150.774942] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:49Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592706583worker1 # [ 150.780085] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6584worker1 # [ 150.935509] nix-daemon[915]: accepted connection from pid 2049, user nix-grpc-daemon (trusted)6585worker1 # [ 150.953378] nix-daemon[915]: reaped child process 2052, status = succeeded6586worker1 # [ 151.105133] nix-daemon[915]: accepted connection from pid 2054, user nix-grpc-daemon (trusted)6587worker1 # [ 151.119947] nix-daemon[915]: reaped child process 2057, status = succeeded6588lb # [ 151.241705] niks3-server[1114]: 2026/09/20 07:59:49 INFO Received uploads request method=POST path=/api/pending_closures6589worker1 # [ 151.138886] nix-grpc-daemon[1644]: time=2026-09-20T07:59:50.361Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6590worker1 # [ 151.140651] nix-grpc-daemon[1644]: time=2026-09-20T07:59:50.362Z level=INFO msg="Uploading 2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv (752B)"6591lb # [ 151.271737] niks3-server[1114]: 2026/09/20 07:59:49 INFO Registered completed upload object_key=nar/10gk7wwjbmc835pm215qvrdyjshy6nblydlws97ya3kcny5wz30c.nar.zst6592lb # [ 151.282958] niks3-server[1114]: 2026/09/20 07:59:49 INFO Received sign narinfos request method=POST path=/api/pending_closures/56/sign6593lb # [ 151.289069] niks3-server[1114]: 2026/09/20 07:59:49 INFO Signed narinfos id=56 count=16594worker1 # [ 151.181461] nix-grpc-daemon[1644]: time=2026-09-20T07:59:50.403Z level=INFO msg="Uploading 1 narinfos"6595lb # [ 151.296693] niks3-server[1114]: 2026/09/20 07:59:49 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.ls6596lb # [ 151.308479] niks3-server[1114]: 2026/09/20 07:59:49 INFO Received complete upload request method=POST path=/api/pending_closures/56/complete6597lb # [ 151.312501] niks3-server[1114]: 2026/09/20 07:59:49 INFO Completed upload id=566598worker1 # [ 151.201878] nix-grpc-daemon[1644]: time=2026-09-20T07:59:50.424Z level=INFO msg="Upload complete. (416ms)"6599worker1 # [ 151.204225] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=0 paths=1 nar_bytes_in=7526600lb # [ 151.315382] niks3-server[1114]: 2026/09/20 07:59:49 INFO Registered completed upload object_key=2gb1j4yk6j00fr2sscj3nqixv67k9b9g.narinfo6601worker1 # [ 151.207524] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706602worker1 # [ 151.214577] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6603worker1 # [ 151.217863] nix-daemon[915]: reaped child process 2047, status = succeeded6604worker1 # [ 151.224025] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6605worker1 # [ 152.252528] nix-daemon[915]: reaped child process 2061, status = succeeded6606worker1 # [ 152.408109] nix-daemon[915]: accepted connection from pid 2076, user nix-grpc-daemon (trusted)6607worker1 # [ 152.422921] nix-daemon[915]: reaped child process 2079, status = succeeded6608lb # [ 152.549161] niks3-server[1114]: 2026/09/20 07:59:51 INFO Received uploads request method=POST path=/api/pending_closures6609worker1 # [ 152.444268] nix-grpc-daemon[1644]: time=2026-09-20T07:59:51.666Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6610worker1 # [ 152.447064] nix-grpc-daemon[1644]: time=2026-09-20T07:59:51.668Z level=INFO msg="Uploading 78nhq5a8myvxam7sxfszi5ihz2rlq2gs-farm-top (232B)"6611lb # [ 152.573745] niks3-server[1114]: 2026/09/20 07:59:51 INFO Registered completed upload object_key=log/2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv6612lb # [ 152.577226] niks3-server[1114]: 2026/09/20 07:59:51 INFO Registered completed upload object_key=nar/1gsz81ckdr6lfkhhqmxw3bg6xqqnlz2wx6dzhpycascv9pq13fg7.nar.zst6613lb # [ 152.583668] niks3-server[1114]: 2026/09/20 07:59:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/57/sign6614lb # [ 152.586827] niks3-server[1114]: 2026/09/20 07:59:51 INFO Signed narinfos id=57 count=16615worker1 # [ 152.475991] nix-grpc-daemon[1644]: time=2026-09-20T07:59:51.698Z level=INFO msg="Uploading 1 narinfos"6616lb # [ 152.590648] niks3-server[1114]: 2026/09/20 07:59:51 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.ls6617lb # [ 152.596328] niks3-server[1114]: 2026/09/20 07:59:51 INFO Received complete upload request method=POST path=/api/pending_closures/57/complete6618lb # [ 152.599386] niks3-server[1114]: 2026/09/20 07:59:51 INFO Completed upload id=576619worker1 # [ 152.488688] nix-grpc-daemon[1644]: time=2026-09-20T07:59:51.710Z level=INFO msg="Upload complete. (255ms)"6620lb # [ 152.602611] niks3-server[1114]: 2026/09/20 07:59:51 INFO Registered completed upload object_key=78nhq5a8myvxam7sxfszi5ihz2rlq2gs.narinfo6621worker1 # [ 152.492054] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:51Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=1 drv=2gb1j4yk6j00fr2sscj3nqixv67k9b9g-farm-top.drv assign_id=7 outputs=16622worker1 # [ 152.495155] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:51Z level=debug event=assigned drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv worker=192.168.1.3:50051 clients=16623worker1 # [ 152.497590] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:51Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706624worker1 # [ 152.504624] nix-daemon[915]: reaped child process 2059, status = succeeded6625worker1 # [ 152.541246] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:51Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592706626worker1 # [ 152.549788] nix-grpc-daemon[1644]: time=2026-09-20T07:59:51.772Z level=INFO msg="All 2 paths already cached"6627worker1 # [ 152.554025] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:51Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592706628worker1 # [ 152.558985] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6629worker1 # [ 152.711495] nix-daemon[915]: accepted connection from pid 2083, user nix-grpc-daemon (trusted)6630worker1 # [ 152.725060] nix-daemon[915]: reaped child process 2086, status = succeeded6631worker1 # [ 152.888548] nix-daemon[915]: accepted connection from pid 2088, user nix-grpc-daemon (trusted)6632worker1 # [ 152.901914] nix-daemon[915]: reaped child process 2091, status = succeeded6633lb # [ 153.028994] niks3-server[1114]: 2026/09/20 07:59:51 INFO Received uploads request method=POST path=/api/pending_closures6634worker1 # [ 152.926584] nix-grpc-daemon[1644]: time=2026-09-20T07:59:52.148Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6635worker1 # [ 152.928262] nix-grpc-daemon[1644]: time=2026-09-20T07:59:52.150Z level=INFO msg="Uploading yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv (752B)"6636lb # [ 153.060097] niks3-server[1114]: 2026/09/20 07:59:51 INFO Registered completed upload object_key=nar/1ibq19fcqq0l9xim9ly5lzg1pk7qh90qsbpya453vnh8p619zvbs.nar.zst6637lb # [ 153.073200] niks3-server[1114]: 2026/09/20 07:59:51 INFO Received sign narinfos request method=POST path=/api/pending_closures/58/sign6638worker1 # [ 152.968216] nix-grpc-daemon[1644]: time=2026-09-20T07:59:52.190Z level=INFO msg="Uploading 1 narinfos"6639lb # [ 153.078709] niks3-server[1114]: 2026/09/20 07:59:51 INFO Signed narinfos id=58 count=16640lb # [ 153.084643] niks3-server[1114]: 2026/09/20 07:59:51 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.ls6641lb # [ 153.096343] niks3-server[1114]: 2026/09/20 07:59:51 INFO Received complete upload request method=POST path=/api/pending_closures/58/complete6642worker1 # [ 152.992381] nix-grpc-daemon[1644]: time=2026-09-20T07:59:52.214Z level=INFO msg="Upload complete. (428ms)"6643lb # [ 153.103396] niks3-server[1114]: 2026/09/20 07:59:51 INFO Completed upload id=586644lb # [ 153.107116] niks3-server[1114]: 2026/09/20 07:59:51 INFO Registered completed upload object_key=yjsciba0gpd99p30v1win6wnqyd4v7b6.narinfo6645worker1 # [ 152.995077] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:52Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=0 paths=1 nar_bytes_in=7526646worker1 # [ 152.999538] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706647worker1 # [ 153.009907] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6648worker1 # [ 153.014183] nix-daemon[915]: reaped child process 2081, status = succeeded6649worker1 # [ 153.019403] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6650worker1 # [ 154.237407] nix-daemon[915]: reaped child process 2095, status = succeeded6651worker1 # [ 154.407586] nix-daemon[915]: accepted connection from pid 2110, user nix-grpc-daemon (trusted)6652worker1 # [ 154.424560] nix-daemon[915]: reaped child process 2113, status = succeeded6653lb # [ 154.550349] niks3-server[1114]: 2026/09/20 07:59:53 INFO Received uploads request method=POST path=/api/pending_closures6654worker1 # [ 154.444679] nix-grpc-daemon[1644]: time=2026-09-20T07:59:53.666Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6655worker1 # [ 154.449326] nix-grpc-daemon[1644]: time=2026-09-20T07:59:53.668Z level=INFO msg="Uploading qc1853riggbxq0nbn4qjdymnhx5pncg8-farm-top (232B)"6656lb # [ 154.572299] niks3-server[1114]: 2026/09/20 07:59:53 INFO Registered completed upload object_key=nar/1k6m6033nbrw39zmvqlrbvmg39ygyn710za2hl2fkpsxfx40hl13.nar.zst6657lb # [ 154.575411] niks3-server[1114]: 2026/09/20 07:59:53 INFO Registered completed upload object_key=log/yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv6658lb # [ 154.579760] niks3-server[1114]: 2026/09/20 07:59:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/59/sign6659lb # [ 154.581477] niks3-server[1114]: 2026/09/20 07:59:53 INFO Signed narinfos id=59 count=16660worker1 # [ 154.472389] nix-grpc-daemon[1644]: time=2026-09-20T07:59:53.694Z level=INFO msg="Uploading 1 narinfos"6661lb # [ 154.588391] niks3-server[1114]: 2026/09/20 07:59:53 INFO Received complete upload request method=POST path=/api/pending_closures/59/complete6662lb # [ 154.591944] niks3-server[1114]: 2026/09/20 07:59:53 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.ls6663lb # [ 154.594374] niks3-server[1114]: 2026/09/20 07:59:53 INFO Completed upload id=596664worker1 # [ 154.484975] nix-grpc-daemon[1644]: time=2026-09-20T07:59:53.707Z level=INFO msg="Upload complete. (257ms)"6665lb # [ 154.596778] niks3-server[1114]: 2026/09/20 07:59:53 INFO Registered completed upload object_key=qc1853riggbxq0nbn4qjdymnhx5pncg8.narinfo6666worker1 # [ 154.488991] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=1 drv=yjsciba0gpd99p30v1win6wnqyd4v7b6-farm-top.drv assign_id=8 outputs=16667worker1 # [ 154.493253] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:53Z level=debug event=assigned drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv worker=192.168.1.3:50051 clients=16668worker1 # [ 154.495389] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706669worker1 # [ 154.502427] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:53Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:592706670worker1 # [ 154.505938] nix-daemon[915]: reaped child process 2093, status = succeeded6671worker1 # [ 154.509757] nix-grpc-daemon[1644]: time=2026-09-20T07:59:53.732Z level=INFO msg="All 2 paths already cached"6672worker1 # [ 154.514029] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:53Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:592706673worker1 # [ 154.518093] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6674worker1 # [ 154.674405] nix-daemon[915]: accepted connection from pid 2117, user nix-grpc-daemon (trusted)6675worker1 # [ 154.691457] nix-daemon[915]: reaped child process 2120, status = succeeded6676worker1 # [ 154.882750] nix-daemon[915]: accepted connection from pid 2122, user nix-grpc-daemon (trusted)6677worker1 # [ 154.898337] nix-daemon[915]: reaped child process 2125, status = succeeded6678lb # [ 155.024862] niks3-server[1114]: 2026/09/20 07:59:53 INFO Received uploads request method=POST path=/api/pending_closures6679worker1 # [ 154.919860] nix-grpc-daemon[1644]: time=2026-09-20T07:59:54.141Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6680worker1 # [ 154.922131] nix-grpc-daemon[1644]: time=2026-09-20T07:59:54.141Z level=INFO msg="Uploading yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv (752B)"6681lb # [ 155.044467] niks3-server[1114]: 2026/09/20 07:59:53 INFO Registered completed upload object_key=nar/1msrgzhylalg20dw693shbnzf48k8pvzp85llwgrnc970rnrliy7.nar.zst6682lb # [ 155.046366] niks3-server[1114]: 2026/09/20 07:59:53 INFO Received sign narinfos request method=POST path=/api/pending_closures/60/sign6683lb # [ 155.048633] niks3-server[1114]: 2026/09/20 07:59:53 INFO Signed narinfos id=60 count=16684worker1 # [ 154.939530] nix-grpc-daemon[1644]: time=2026-09-20T07:59:54.161Z level=INFO msg="Uploading 1 narinfos"6685lb # [ 155.053334] niks3-server[1114]: 2026/09/20 07:59:53 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.ls6686lb # [ 155.061377] niks3-server[1114]: 2026/09/20 07:59:53 INFO Received complete upload request method=POST path=/api/pending_closures/60/complete6687lb # [ 155.067390] niks3-server[1114]: 2026/09/20 07:59:53 INFO Completed upload id=606688worker1 # [ 154.956852] nix-grpc-daemon[1644]: time=2026-09-20T07:59:54.179Z level=INFO msg="Upload complete. (431ms)"6689lb # [ 155.070314] niks3-server[1114]: 2026/09/20 07:59:53 INFO Registered completed upload object_key=yym31x3l626nfpm249qapx1iw7y15mqb.narinfo6690worker1 # [ 154.959550] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:54Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=0 paths=1 nar_bytes_in=7526691worker1 # [ 154.965243] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:54Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:592706692worker1 # [ 154.972569] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6693worker1 # [ 154.975398] nix-daemon[915]: reaped child process 2115, status = succeeded6694worker1 # [ 154.984418] nix-daemon[915]: accepted connection from pid 1553, user nix-grpc-daemon (trusted)6695worker1 # [ 156.200510] nix-daemon[915]: reaped child process 2129, status = succeeded6696worker1 # [ 156.381071] nix-daemon[915]: accepted connection from pid 2144, user nix-grpc-daemon (trusted)6697worker1 # [ 156.396146] nix-daemon[915]: reaped child process 2147, status = succeeded6698lb # [ 156.523088] niks3-server[1114]: 2026/09/20 07:59:55 INFO Received uploads request method=POST path=/api/pending_closures6699worker1 # [ 156.419670] nix-grpc-daemon[1644]: time=2026-09-20T07:59:55.641Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6700worker1 # [ 156.422426] nix-grpc-daemon[1644]: time=2026-09-20T07:59:55.643Z level=INFO msg="Uploading 0y5v4dgfslb2x47r2h6j0zjvpzg6frg6-farm-top (232B)"6701lb # [ 156.550597] niks3-server[1114]: 2026/09/20 07:59:55 INFO Received sign narinfos request method=POST path=/api/pending_closures/61/sign6702lb # [ 156.553298] niks3-server[1114]: 2026/09/20 07:59:55 INFO Signed narinfos id=61 count=16703worker1 # [ 156.442838] nix-grpc-daemon[1644]: time=2026-09-20T07:59:55.664Z level=INFO msg="Uploading 1 narinfos"6704lb # [ 156.560735] niks3-server[1114]: 2026/09/20 07:59:55 INFO Registered completed upload object_key=log/yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv6705lb # [ 156.563975] niks3-server[1114]: 2026/09/20 07:59:55 INFO Registered completed upload object_key=nar/1h7kcfflb8hb0ylxshiprrirnrs580cwzkz50cz6il8jag61wy50.nar.zst6706lb # [ 156.569414] niks3-server[1114]: 2026/09/20 07:59:55 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.ls6707lb # [ 156.571739] niks3-server[1114]: 2026/09/20 07:59:55 INFO Received complete upload request method=POST path=/api/pending_closures/61/complete6708lb # [ 156.580135] niks3-server[1114]: 2026/09/20 07:59:55 INFO Completed upload id=616709worker1 # [ 156.471460] nix-grpc-daemon[1644]: time=2026-09-20T07:59:55.693Z level=INFO msg="Upload complete. (279ms)"6710lb # [ 156.582873] niks3-server[1114]: 2026/09/20 07:59:55 INFO Registered completed upload object_key=0y5v4dgfslb2x47r2h6j0zjvpzg6frg6.narinfo6711worker1 # [ 156.475547] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:59270 duration_s=1 drv=yym31x3l626nfpm249qapx1iw7y15mqb-farm-top.drv assign_id=9 outputs=16712worker1 # [ 156.483814] nix-daemon[915]: reaped child process 2127, status = succeeded6713client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto --expr 'map (tag: import /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix { inherit tag; features = ["vip"]; }) ["f1" "f2" "f3"]' --impure 2>&1, in 18.03 seconds)6714worker1: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1'6715worker1: (finished: must succeed: curl -sf http://127.0.0.1:9464/metrics | grep -E 'nix_grpc_build_info\{.*features="[^"]*vip[^"]*".*worker="node-a"\} 1', in 0.06 seconds)6716client: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&16717worker2 # [ 156.873090] nix-grpc-daemon[1731]: ts=2026-09-20T07:59:55Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:576506718worker2 # [ 156.879653] nix-daemon[911]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6719worker1 # [ 156.764180] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:55Z level=debug event=want client=2 drv=z5cr5v9sb2xcx4fmgc48vvwyl2m8rzzs-farm-a.drv cached=06720client: (finished: must fail: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag f5 --arg features '["gpu"]' 2>&1, in 0.21 seconds)6721(finished: subtest: requiredSystemFeatures: placed on the worker that has them, refused when none does, in 18.30 seconds)6722subtest: low disk drains a worker and builds go to the other6723worker1: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill6724worker1: (finished: must succeed: fallocate -l $(( $(df --output=avail -B1 /nix/store | tail -1) - 100*1024*1024 )) /nix/.rw-store/fill, in 1.02 seconds)6725worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free'6726worker1 # [ 158.551980] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:57Z level=info event=unhealthy reason=min_free6727worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=unhealthy reason=min_free', in 1.09 seconds)6728client: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&26729client # don't know how to build these paths:6730client # /nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6731worker1 # [ 159.057400] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:58Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:592706732worker1 # [ 159.067832] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:58Z level=debug event=want client=3 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv cached=06733worker1 # [ 159.072501] nix-grpc-daemon[1553]: ts=2026-09-20T07:59:58Z level=debug event=assigned drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv worker=192.168.1.4:50051 clients=16734worker2 # [ 159.243259] nix-grpc-daemon[1731]: ts=2026-09-20T07:59:58Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576506735worker2 # [ 159.251129] nix-grpc-daemon[1731]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 71 ms (attempt 1/5)6736worker2 # [ 159.325159] nix-grpc-daemon[1731]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 11 ms (attempt 2/5)6737worker2 # [ 159.339825] nix-grpc-daemon[1731]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 369 ms (attempt 3/5)6738worker2 # [ 159.712297] nix-grpc-daemon[1731]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 691 ms (attempt 4/5)6739worker2 # [ 160.407929] nix-grpc-daemon[1731]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org6740worker2 # [ 160.420462] nix-grpc-daemon[1731]: ts=2026-09-20T07:59:59Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576506741client # copying 1 paths to 'lb:50051'...6742client # copying path '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' to 'lb:50051'...6743worker2 # [ 160.428801] nix-grpc-daemon[1731]: ts=2026-09-20T07:59:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:576506744worker2 # [ 160.438266] nix-daemon[911]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6745lb # [ 160.490380] envoy[939]: conn peer=[2001:db8:1::1]:34716 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=26847 tx=10583 ms=177516746lb # [ 160.492206] envoy[939]: conn peer=[2001:db8:1::1]:47384 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=708 tx=439 ms=386747worker2 # [ 160.729312] nix-grpc-daemon[1731]: ts=2026-09-20T07:59:59Z level=info event=niks3_push_started pid=17876748worker2 # [ 161.038129] nix-daemon[911]: accepted connection from pid 1800, user nix-grpc-daemon (trusted)6749worker2 # [ 161.054451] nix-daemon[911]: reaped child process 1803, status = succeeded6750worker2 # [ 161.210662] nix-daemon[911]: accepted connection from pid 1805, user nix-grpc-daemon (trusted)6751worker2 # [ 161.227387] nix-daemon[911]: reaped child process 1808, status = succeeded6752lb # [ 161.221822] niks3-server[1114]: 2026/09/20 07:59:59 INFO Received uploads request method=POST path=/api/pending_closures6753worker2 # [ 161.248443] nix-grpc-daemon[1787]: time=2026-09-20T08:00:00.139Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6754worker2 # [ 161.252773] nix-grpc-daemon[1787]: time=2026-09-20T08:00:00.141Z level=INFO msg="Uploading a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv (512B)"6755lb # [ 161.249112] niks3-server[1114]: 2026/09/20 07:59:59 INFO Registered completed upload object_key=nar/1qxv3rw2cwpq06kampqz63l69ci673kh4xz41xmflqybqycfk573.nar.zst6756lb # [ 161.255190] niks3-server[1114]: 2026/09/20 07:59:59 INFO Received sign narinfos request method=POST path=/api/pending_closures/62/sign6757lb # [ 161.258120] niks3-server[1114]: 2026/09/20 07:59:59 INFO Signed narinfos id=62 count=16758worker2 # [ 161.279677] nix-grpc-daemon[1787]: time=2026-09-20T08:00:00.171Z level=INFO msg="Uploading 1 narinfos"6759lb # [ 161.265385] niks3-server[1114]: 2026/09/20 07:59:59 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.ls6760lb # [ 161.271177] niks3-server[1114]: 2026/09/20 07:59:59 INFO Received complete upload request method=POST path=/api/pending_closures/62/complete6761lb # [ 161.278197] niks3-server[1114]: 2026/09/20 07:59:59 INFO Completed upload id=626762worker2 # [ 161.297954] nix-grpc-daemon[1787]: time=2026-09-20T08:00:00.189Z level=INFO msg="Upload complete. (400ms)"6763lb # [ 161.279948] niks3-server[1114]: 2026/09/20 07:59:59 INFO Registered completed upload object_key=a33ymyck2p14d34j7jl4zc8zvry6cysy.narinfo6764worker2 # [ 161.301075] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:00Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57650 duration_s=0 paths=1 nar_bytes_in=5126765worker2 # [ 161.305289] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:00Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576506766worker2 # [ 161.311428] nix-daemon[911]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6767worker2 # [ 161.315537] nix-daemon[911]: reaped child process 1785, status = succeeded6768worker2 # [ 161.321605] nix-daemon[911]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6769client # building '/nix/store/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv' on lb:50051...6770client # farm-a> worker2-next: building a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6771client # farm-a> LOG-farm-a-drain6772worker2 # [ 162.537958] nix-daemon[911]: reaped child process 1812, status = succeeded6773worker2 # [ 162.661694] nix-daemon[911]: accepted connection from pid 1827, user nix-grpc-daemon (trusted)6774worker2 # [ 162.675046] nix-daemon[911]: reaped child process 1830, status = succeeded6775lb # [ 162.663949] niks3-server[1114]: 2026/09/20 08:00:01 INFO Received uploads request method=POST path=/api/pending_closures6776worker2 # [ 162.694344] nix-grpc-daemon[1787]: time=2026-09-20T08:00:01.584Z level=INFO msg="Uploading 1 paths to lb (0 already cached)"6777worker2 # [ 162.695777] nix-grpc-daemon[1787]: time=2026-09-20T08:00:01.584Z level=INFO msg="Uploading rjdc0hf9mcchhia9m3zkqy1q586i3z3r-farm-a (128B)"6778lb # [ 162.696824] niks3-server[1114]: 2026/09/20 08:00:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/63/sign6779lb # [ 162.699052] niks3-server[1114]: 2026/09/20 08:00:01 INFO Signed narinfos id=63 count=16780worker2 # [ 162.720421] nix-grpc-daemon[1787]: time=2026-09-20T08:00:01.611Z level=INFO msg="Uploading 1 narinfos"6781lb # [ 162.705615] niks3-server[1114]: 2026/09/20 08:00:01 INFO Received complete upload request method=POST path=/api/pending_closures/63/complete6782lb # [ 162.915932] niks3-server[1114]: 2026/09/20 08:00:01 INFO Registered completed upload object_key=log/a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv6783lb # [ 162.941981] niks3-server[1114]: 2026/09/20 08:00:01 INFO Registered completed upload object_key=nar/1bf9z7y0ikx07b4zjag42zyrv2pq1ycw4461s579kfpmni9kz4dw.nar.zst6784lb # [ 162.950631] niks3-server[1114]: 2026/09/20 08:00:01 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.ls6785lb # [ 162.954835] niks3-server[1114]: 2026/09/20 08:00:01 INFO Completed upload id=636786worker2 # [ 162.977214] nix-grpc-daemon[1787]: time=2026-09-20T08:00:01.868Z level=INFO msg="Upload complete. (446ms)"6787lb # [ 162.962704] niks3-server[1114]: 2026/09/20 08:00:01 INFO Registered completed upload object_key=rjdc0hf9mcchhia9m3zkqy1q586i3z3r.narinfo6788worker2 # [ 162.981398] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:01Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57650 duration_s=1 drv=a33ymyck2p14d34j7jl4zc8zvry6cysy-farm-a.drv assign_id=10 outputs=16789worker2 # [ 162.990490] nix-daemon[911]: reaped child process 1810, status = succeeded6790worker1 # [ 162.858350] nix-grpc-daemon[1553]: ts=2026-09-20T08:00:02Z level=debug event=want client=3 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv cached=06791worker1 # [ 162.862563] nix-grpc-daemon[1553]: ts=2026-09-20T08:00:02Z level=debug event=assigned drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv worker=192.168.1.4:50051 clients=16792worker2 # [ 163.032511] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:01Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576506793worker2 # [ 163.041331] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576506794worker2 # [ 163.049526] nix-grpc-daemon[1787]: time=2026-09-20T08:00:01.941Z level=INFO msg="All 1 paths already cached"6795client # copying 1 paths to 'lb:50051'...6796client # copying path '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' to 'lb:50051'...6797worker2 # [ 163.056435] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:01Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:576506798worker2 # [ 163.063978] nix-daemon[911]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6799worker2 # [ 163.216238] nix-daemon[911]: accepted connection from pid 1834, user nix-grpc-daemon (trusted)6800worker2 # [ 163.230265] nix-daemon[911]: reaped child process 1837, status = succeeded6801worker2 # [ 163.399635] nix-daemon[911]: accepted connection from pid 1839, user nix-grpc-daemon (trusted)6802worker2 # [ 163.412864] nix-daemon[911]: reaped child process 1842, status = succeeded6803lb # [ 163.408506] niks3-server[1114]: 2026/09/20 08:00:01 INFO Received uploads request method=POST path=/api/pending_closures6804worker2 # [ 163.436157] nix-grpc-daemon[1787]: time=2026-09-20T08:00:02.327Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6805worker2 # [ 163.438274] nix-grpc-daemon[1787]: time=2026-09-20T08:00:02.329Z level=INFO msg="Uploading xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv (624B)"6806lb # [ 163.436353] niks3-server[1114]: 2026/09/20 08:00:01 INFO Registered completed upload object_key=nar/06skgfsii1iysx6lv8hy20iyys0q28pmz13rs51634x6bgrlvs7k.nar.zst6807lb # [ 163.447145] niks3-server[1114]: 2026/09/20 08:00:01 INFO Received sign narinfos request method=POST path=/api/pending_closures/64/sign6808lb # [ 163.451536] niks3-server[1114]: 2026/09/20 08:00:02 INFO Signed narinfos id=64 count=16809worker2 # [ 163.475092] nix-grpc-daemon[1787]: time=2026-09-20T08:00:02.366Z level=INFO msg="Uploading 1 narinfos"6810lb # [ 163.458725] niks3-server[1114]: 2026/09/20 08:00:02 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.ls6811lb # [ 163.469925] niks3-server[1114]: 2026/09/20 08:00:02 INFO Received complete upload request method=POST path=/api/pending_closures/64/complete6812lb # [ 163.476481] niks3-server[1114]: 2026/09/20 08:00:02 INFO Completed upload id=646813worker2 # [ 163.495939] nix-grpc-daemon[1787]: time=2026-09-20T08:00:02.387Z level=INFO msg="Upload complete. (426ms)"6814lb # [ 163.478621] niks3-server[1114]: 2026/09/20 08:00:02 INFO Registered completed upload object_key=xihm5w957gm8bh55zxlc6dnczbbl387q.narinfo6815worker2 # [ 163.500129] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:02Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57650 duration_s=0 paths=1 nar_bytes_in=6246816worker2 # [ 163.505684] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:02Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576506817worker2 # [ 163.514682] nix-daemon[911]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6818worker2 # [ 163.523111] nix-daemon[911]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6819client # building '/nix/store/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv' on lb:50051...6820worker2 # [ 163.525479] nix-daemon[911]: reaped child process 1832, status = succeeded6821client # farm-b> worker2-next: building xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6822client # farm-b> LOG-farm-b-drain6823worker2 # [ 164.953938] nix-daemon[911]: reaped child process 1846, status = succeeded6824worker2 # [ 165.100272] nix-daemon[911]: accepted connection from pid 1861, user nix-grpc-daemon (trusted)6825worker2 # [ 165.117374] nix-daemon[911]: reaped child process 1864, status = succeeded6826lb # [ 165.113272] niks3-server[1114]: 2026/09/20 08:00:03 INFO Received uploads request method=POST path=/api/pending_closures6827worker2 # [ 165.161215] nix-grpc-daemon[1787]: time=2026-09-20T08:00:04.052Z level=INFO msg="Uploading 1 paths to lb (1 already cached)"6828worker2 # [ 165.163147] nix-grpc-daemon[1787]: time=2026-09-20T08:00:04.054Z level=INFO msg="Uploading pmvxn7ymjj8pdn6gb65j5kqb45n38x0p-farm-b (176B)"6829lb # [ 165.173533] niks3-server[1114]: 2026/09/20 08:00:03 INFO Registered completed upload object_key=log/xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv6830lb # [ 165.178842] niks3-server[1114]: 2026/09/20 08:00:03 INFO Registered completed upload object_key=nar/17gyl0zgiivck81rhv539x50216ksc3nsf369ismwd4j1zwsdqrb.nar.zst6831lb # [ 165.188607] niks3-server[1114]: 2026/09/20 08:00:03 INFO Received sign narinfos request method=POST path=/api/pending_closures/65/sign6832lb # [ 165.195691] niks3-server[1114]: 2026/09/20 08:00:03 INFO Signed narinfos id=65 count=16833worker2 # [ 165.218452] nix-grpc-daemon[1787]: time=2026-09-20T08:00:04.109Z level=INFO msg="Uploading 1 narinfos"6834lb # [ 165.201080] niks3-server[1114]: 2026/09/20 08:00:03 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.ls6835lb # [ 165.211661] niks3-server[1114]: 2026/09/20 08:00:03 INFO Received complete upload request method=POST path=/api/pending_closures/65/complete6836lb # [ 165.217294] niks3-server[1114]: 2026/09/20 08:00:03 INFO Completed upload id=656837lb # [ 165.219302] niks3-server[1114]: 2026/09/20 08:00:03 INFO Registered completed upload object_key=pmvxn7ymjj8pdn6gb65j5kqb45n38x0p.narinfo6838worker2 # [ 165.238381] nix-grpc-daemon[1787]: time=2026-09-20T08:00:04.129Z level=INFO msg="Upload complete. (303ms)"6839worker2 # [ 165.246751] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:04Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57650 duration_s=1 drv=xihm5w957gm8bh55zxlc6dnczbbl387q-farm-b.drv assign_id=11 outputs=16840worker1 # [ 165.121882] nix-grpc-daemon[1553]: ts=2026-09-20T08:00:04Z level=debug event=want client=3 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv cached=06841worker1 # [ 165.126534] nix-grpc-daemon[1553]: ts=2026-09-20T08:00:04Z level=debug event=assigned drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv worker=192.168.1.4:50051 clients=16842worker2 # [ 165.262187] nix-daemon[911]: reaped child process 1844, status = succeeded6843worker2 # [ 165.300863] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576506844worker2 # [ 165.313924] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:04Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:576506845worker2 # [ 165.326256] nix-grpc-daemon[1787]: time=2026-09-20T08:00:04.217Z level=INFO msg="All 2 paths already cached"6846client # copying 1 paths to 'lb:50051'...6847client # copying path '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' to 'lb:50051'...6848worker2 # [ 165.335086] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:576506849worker2 # [ 165.345132] nix-daemon[911]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6850worker2 # [ 165.477064] nix-daemon[911]: accepted connection from pid 1868, user nix-grpc-daemon (trusted)6851worker2 # [ 165.490657] nix-daemon[911]: reaped child process 1871, status = succeeded6852worker2 # [ 165.624162] nix-daemon[911]: accepted connection from pid 1873, user nix-grpc-daemon (trusted)6853worker2 # [ 165.637099] nix-daemon[911]: reaped child process 1876, status = succeeded6854lb # [ 165.629232] niks3-server[1114]: 2026/09/20 08:00:04 INFO Received uploads request method=POST path=/api/pending_closures6855worker2 # [ 165.652426] nix-grpc-daemon[1787]: time=2026-09-20T08:00:04.544Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6856worker2 # [ 165.654437] nix-grpc-daemon[1787]: time=2026-09-20T08:00:04.545Z level=INFO msg="Uploading q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv (752B)"6857lb # [ 165.643942] niks3-server[1114]: 2026/09/20 08:00:04 INFO Received sign narinfos request method=POST path=/api/pending_closures/66/sign6858lb # [ 165.646650] niks3-server[1114]: 2026/09/20 08:00:04 INFO Signed narinfos id=66 count=16859worker2 # [ 165.666363] nix-grpc-daemon[1787]: time=2026-09-20T08:00:04.558Z level=INFO msg="Uploading 1 narinfos"6860lb # [ 165.650525] niks3-server[1114]: 2026/09/20 08:00:04 INFO Registered completed upload object_key=nar/1m4vpncprrwddjpk4qry79vzd9g39s9pjs6874i2aarpm7ax0ykq.nar.zst6861lb # [ 165.652429] niks3-server[1114]: 2026/09/20 08:00:04 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.ls6862lb # [ 165.657573] niks3-server[1114]: 2026/09/20 08:00:04 INFO Received complete upload request method=POST path=/api/pending_closures/66/complete6863lb # [ 165.660920] niks3-server[1114]: 2026/09/20 08:00:04 INFO Completed upload id=666864worker2 # [ 165.681664] nix-grpc-daemon[1787]: time=2026-09-20T08:00:04.573Z level=INFO msg="Upload complete. (325ms)"6865lb # [ 165.662893] niks3-server[1114]: 2026/09/20 08:00:04 INFO Registered completed upload object_key=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s.narinfo6866worker2 # [ 165.683626] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:04Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:57650 duration_s=0 paths=1 nar_bytes_in=7526867worker2 # [ 165.686791] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:04Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:576506868worker2 # [ 165.692256] nix-daemon[911]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6869worker2 # [ 165.696696] nix-daemon[911]: reaped child process 1866, status = succeeded6870worker2 # [ 165.701686] nix-daemon[911]: accepted connection from pid 1731, user nix-grpc-daemon (trusted)6871client # building '/nix/store/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv' on lb:50051...6872client # farm-top> worker2-next: building q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6873worker2 # [ 166.716625] nix-daemon[911]: reaped child process 1880, status = succeeded6874client # farm-top> LOG-farm-top-drain6875worker2 # [ 166.855562] nix-daemon[911]: accepted connection from pid 1895, user nix-grpc-daemon (trusted)6876worker2 # [ 166.868928] nix-daemon[911]: reaped child process 1898, status = succeeded6877lb # [ 166.863213] niks3-server[1114]: 2026/09/20 08:00:05 INFO Received uploads request method=POST path=/api/pending_closures6878worker2 # [ 166.887254] nix-grpc-daemon[1787]: time=2026-09-20T08:00:05.778Z level=INFO msg="Uploading 1 paths to lb (2 already cached)"6879worker2 # [ 166.889062] nix-grpc-daemon[1787]: time=2026-09-20T08:00:05.780Z level=INFO msg="Uploading hgmfp1yw6m31jn6cpma19ikl6dy1b17r-farm-top (232B)"6880lb # [ 166.885319] niks3-server[1114]: 2026/09/20 08:00:05 INFO Registered completed upload object_key=log/q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv6881lb # [ 166.887792] niks3-server[1114]: 2026/09/20 08:00:05 INFO Registered completed upload object_key=nar/1xin0j0xlljjqnd952hnxy8yw45d9j9qpj7m241vv6cckfq8kk4p.nar.zst6882lb # [ 166.893505] niks3-server[1114]: 2026/09/20 08:00:05 INFO Received sign narinfos request method=POST path=/api/pending_closures/67/sign6883lb # [ 166.895850] niks3-server[1114]: 2026/09/20 08:00:05 INFO Signed narinfos id=67 count=16884worker2 # [ 166.915443] nix-grpc-daemon[1787]: time=2026-09-20T08:00:05.807Z level=INFO msg="Uploading 1 narinfos"6885lb # [ 166.898720] niks3-server[1114]: 2026/09/20 08:00:05 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.ls6886lb # [ 166.904141] niks3-server[1114]: 2026/09/20 08:00:05 INFO Received complete upload request method=POST path=/api/pending_closures/67/complete6887lb # [ 166.907381] niks3-server[1114]: 2026/09/20 08:00:05 INFO Completed upload id=676888worker2 # [ 166.926962] nix-grpc-daemon[1787]: time=2026-09-20T08:00:05.818Z level=INFO msg="Upload complete. (218ms)"6889lb # [ 166.909863] niks3-server[1114]: 2026/09/20 08:00:05 INFO Registered completed upload object_key=hgmfp1yw6m31jn6cpma19ikl6dy1b17r.narinfo6890worker2 # [ 166.929746] nix-grpc-daemon[1731]: ts=2026-09-20T08:00:05Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:57650 duration_s=1 drv=q6a73jmqx0c0v5nlki9f1fnmcls5gx5s-farm-top.drv assign_id=12 outputs=16891worker2 # [ 166.936527] nix-daemon[911]: reaped child process 1878, status = succeeded6892client: (finished: must succeed: nix build -L --store 'grpc://lb:50051?ca-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ca.pem&client-cert=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.pem&client-key=/nix/store/hh35p8dmc1g9fk16aw3d6myi3l612ls9-farm-certs/ci.key' --eval-store auto -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain >&2, in 7.95 seconds)6893client: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath6894client: (finished: must succeed: nix eval --raw -f /nix/store/ds1pbvns9yfiwin6gyw68m5d6l6a7x29-job.nix --argstr tag drain outPath, in 0.20 seconds)6895worker1: must succeed: rm /nix/.rw-store/fill6896worker1: (finished: must succeed: rm /nix/.rw-store/fill, in 0.12 seconds)6897worker1: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free'6898worker1 # [ 167.559787] nix-grpc-daemon[1553]: ts=2026-09-20T08:00:06Z level=info event=healthy reason=min_free6899worker1: (finished: waiting for success: journalctl -u nix-grpc-daemon -o cat | grep -q 'event=healthy reason=min_free', in 1.10 seconds)6900(finished: subtest: low disk drains a worker and builds go to the other, in 11.53 seconds)6901(finished: run the VM test script, in 169.48 seconds)6902test script finished in 169.89s6903cleanup6904kill QemuMachine (pid 49)6905client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6906kill QemuMachine (pid 50)6907lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6908kill QemuMachine (pid 51)6909worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6910kill QemuMachine (pid 52)6911worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/b5bpi6zfajzzrwwpgba2q6li3nnya4bs-python3-3.14.7/bin/python3.14)6912(finished: cleanup, in 1.02 seconds)6913additionally exposed symbols:6914 client, lb, worker1, worker2,6915 vlan1,6916 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh