tribuchet: building on jamie Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) start vhost-device-vsock (finished: start vhost-device-vsock, in 0.00 seconds) Test will time out and terminate in 900.0 seconds run the VM test script start all VMs client: starting vm lb: starting vm worker1: starting vm worker2: starting vm lb # Disk image does not exist, creating the virtualisation disk image... lb # Formatting '/build/vm-state-lb/tmp.jRrOsYtwze', fmt=raw size=2147483648 lb: QEMU running (pid 62) lb # mke2fs 1.47.4 (6-Mar-2025) lb # Discarding device blocks: 0/524288 done lb # Creating filesystem with 524288 4k blocks and 131072 inodes lb # Filesystem UUID: 2eb9dacd-9e83-4f0a-8b16-2d67256501ad lb # Superblock backups stored on blocks: lb # 32768, 98304, 163840, 229376, 294912 lb # worker1: QEMU running (pid 65) worker1 # Disk image does not exist, creating the virtualisation disk image... lb # Allocating group tables: 0/16 done worker1 # Formatting '/build/vm-state-worker1/tmp.nTDAPAY95T', fmt=raw size=1073741824 lb # Writing inode tables: 0/16 done worker1 # mke2fs 1.47.4 (6-Mar-2025) lb # Creating journal (16384 blocks): done worker1 # Discarding device blocks: 0/262144 done lb # Writing superblocks and filesystem accounting information: 0/16 done worker1 # Creating filesystem with 262144 4k blocks and 65536 inodes lb # worker1 # Filesystem UUID: 7a4fbbbc-552f-4516-a20e-5ddf5733ab05 lb # Virtualisation disk image created. client # Disk image does not exist, creating the virtualisation disk image... worker1 # Superblock backups stored on blocks: worker2 # Disk image does not exist, creating the virtualisation disk image... worker2: QEMU running (pid 64) client: QEMU running (pid 63) lb # Starting virtiofs daemons... client # Formatting '/build/vm-state-client/tmp.mw1FVNy59v', fmt=raw size=1073741824 worker2 # Formatting '/build/vm-state-worker2/tmp.yjCWOQLI0p', fmt=raw size=1073741824 worker1 # 32768, 98304, 163840, 229376 lb # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # mke2fs 1.47.4 (6-Mar-2025) worker1 # lb # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # Discarding device blocks: 0/262144 done worker1 # Allocating group tables: 0/8 done client # mke2fs 1.47.4 (6-Mar-2025) worker2 # Creating filesystem with 262144 4k blocks and 65536 inodes worker1 # Writing inode tables: 0/8 done (finished: start all VMs, in 0.24 seconds) lb # [2026-11-07T15:07:35Z INFO virtiofsd] Waiting for vhost-user socket connection... client # Discarding device blocks: 0/262144 done worker2 # Filesystem UUID: 7eafd21b-271c-4496-b06d-1827da5cb4a1 worker1 # Creating journal (8192 blocks): done client # Creating filesystem with 262144 4k blocks and 65536 inodes worker2 # Superblock backups stored on blocks: worker1 # Writing superblocks and filesystem accounting information: 0/8 done client # Filesystem UUID: 811e8090-b889-4354-ba7b-fd324bde1ffe worker2 # 32768, 98304, 163840, 229376 worker1 # client # Superblock backups stored on blocks: worker2 # worker1 # Virtualisation disk image created. client # 32768, 98304, 163840, 229376 worker2 # Allocating group tables: 0/8 done worker1 # Starting virtiofs daemons... client # worker2 # Writing inode tables: 0/8 done worker1 # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # Allocating group tables: 0/8 done worker2 # Creating journal (8192 blocks): done worker1 # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # Writing inode tables: 0/8 done worker2 # Writing superblocks and filesystem accounting information: 0/8 done worker1 # [2026-11-07T15:07:35Z INFO virtiofsd] Waiting for vhost-user socket connection... client # Creating journal (8192 blocks): done worker2 # worker1 # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # Writing superblocks and filesystem accounting information: 0/8 done worker2 # Virtualisation disk image created. worker1 # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # worker2 # Starting virtiofs daemons... worker1 # [2026-11-07T15:07:35Z INFO virtiofsd] Waiting for vhost-user socket connection... client # Virtualisation disk image created. worker2 # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # Starting virtiofs daemons... worker2 # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-11-07T15:07:35Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-11-07T15:07:35Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker1 # [2026-11-07T15:07:35Z INFO virtiofsd] Client connected, servicing requests client # [2026-11-07T15:07:35Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker1 # [2026-11-07T15:07:35Z INFO virtiofsd] Client connected, servicing requests client # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) worker2 # [2026-11-07T15:07:35Z INFO virtiofsd] Waiting for vhost-user socket connection... worker1 # [2026-11-07T15:07:35Z INFO virtiofsd] Client connected, servicing requests client # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client: waiting for unit network-addresses-eth1.service client # [2026-11-07T15:07:35Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) lb # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether client # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] Failed to open file handle for the root node: Operation not permitted (os error 1) client # [2026-11-07T15:07:35Z INFO virtiofsd] Waiting for vhost-user socket connection... client # [2026-11-07T15:07:35Z INFO virtiofsd] Client connected, servicing requests client # [2026-11-07T15:07:35Z INFO virtiofsd] Client connected, servicing requests client: waiting for the VM to finish booting client # [2026-11-07T15:07:35Z INFO virtiofsd] Client connected, servicing requests lb # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether worker2 # [2026-11-07T15:07:35Z WARN virtiofsd::passthrough] File handles do not appear safe to use, disabling file handles altogether lb # [2026-11-07T15:07:35Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-11-07T15:07:35Z INFO virtiofsd] Waiting for vhost-user socket connection... lb # [2026-11-07T15:07:35Z INFO virtiofsd] Waiting for vhost-user socket connection... worker2 # [2026-11-07T15:07:35Z INFO virtiofsd] Client connected, servicing requests lb # [2026-11-07T15:07:35Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-11-07T15:07:35Z INFO virtiofsd] Client connected, servicing requests lb # [2026-11-07T15:07:35Z INFO virtiofsd] Client connected, servicing requests worker2 # [2026-11-07T15:07:35Z INFO virtiofsd] Client connected, servicing requests lb # [2026-11-07T15:07:35Z INFO virtiofsd] Client connected, servicing requests worker1 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) lb # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker2 # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) client # SeaBIOS (version rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org) worker1 # worker1 # worker1 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC690+5EF2C690 CA00 lb # lb # lb # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC690+5EF2C690 CA00 worker2 # worker2 # client # client # worker2 # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC690+5EF2C690 CA00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker1 # worker1 # worker1 # worker1 # client # iPXE (http://ipxe.org) 00:02.0 CA00 PCI2.10 PnP PMM+5EFCC690+5EF2C690 CA00 lb # Press Ctrl-B to configure iPXE (PCI 00:02.0)... lb # lb # lb # lb # worker1 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC690 5EF2C690 CB00 lb # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC690 5EF2C690 CB00 worker2 # Press Ctrl-B to configure iPXE (PCI 00:02.0)... worker2 # worker2 # worker2 # worker2 # client # Press Ctrl-B to configure iPXE (PCI 00:02.0)... client # client # client # client # worker2 # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC690 5EF2C690 CB00 client # iPXE (http://ipxe.org) 00:05.0 CB00 PCI2.10 PnP PMM 5EFCC690 5EF2C690 CB00 worker1 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker1 # worker1 # lb # Press Ctrl-B to configure iPXE (PCI 00:05.0)... lb # lb # worker2 # Press Ctrl-B to configure iPXE (PCI 00:05.0)... worker2 # worker2 # client # Press Ctrl-B to configure iPXE (PCI 00:05.0)... client # client # worker1 # Booting from ROM... lb # Booting from ROM... worker2 # Booting from ROM... client # Booting from ROM... lb # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.59 (nixbld@localhost) (gcc (GCC) 16.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC @1793027368 worker1 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.59 (nixbld@localhost) (gcc (GCC) 16.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC @1793027368 client # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.59 (nixbld@localhost) (gcc (GCC) 16.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC @1793027368 worker2 # Probing EDD (edd=off to disable)... ok[ 0.000000] Linux version 6.18.59 (nixbld@localhost) (gcc (GCC) 16.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT_DYNAMIC @1793027368 lb # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/s1sdlq7kf1sljabp27xmqpmiignlamvy-nixos-system-lb-test/init regInfo=/nix/.ro-store/03cw8l3nbwgif29pbggmq2dzr1ly2wlq-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6h4yi05k4c0fkhyw0rk1hkcdcrzgjp91-nixos-system-worker1-test/init regInfo=/nix/.ro-store/xnlmznsmbdi821fmk1i5ks6zzf4g0cvp-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] BIOS-provided physical RAM map: worker1 # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3xd6dbxz1qssv249bz933ccxrijwf6j8-nixos-system-client-test/init regInfo=/nix/.ro-store/6zrvcbahq47p1a771jj98lh9wbfgwk6h-closure-info/registration console=ttyS0,115200n8 console=tty0 worker2 # [ 0.000000] Command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qz56dc5qp6pffwrpdfhrqjhrkj2mzhvf-nixos-system-worker2-test/init regInfo=/nix/.ro-store/whbda1s07lip7igndcgbwv6waj9mbidc-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved worker2 # [ 0.000000] BIOS-provided physical RAM map: client # [ 0.000000] BIOS-provided physical RAM map: lb # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable client # [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable lb # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker1 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable worker2 # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable client # [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005ffd7fff] usable lb # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x000000005ffd8000-0x000000005fffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved lb # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker1 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved lb # [ 0.000000] NX (Execute Disable) protection: active worker1 # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved worker1 # [ 0.000000] APIC: Static calls initialized client # [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved lb # [ 0.000000] SMBIOS 2.8 present. worker1 # [ 0.000000] SMBIOS 2.8 present. client # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved worker2 # [ 0.000000] BIOS-e820: [mem 0x000000fd00000000-0x000000ffffffffff] reserved client # [ 0.000000] NX (Execute Disable) protection: active worker2 # [ 0.000000] NX (Execute Disable) protection: active lb # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker1 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 client # [ 0.000000] APIC: Static calls initialized worker2 # [ 0.000000] APIC: Static calls initialized lb # [ 0.000000] DMI: Memory slots populated: 1/1 worker1 # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.000000] SMBIOS 2.8 present. client # [ 0.000000] SMBIOS 2.8 present. lb # [ 0.000000] Hypervisor detected: KVM worker1 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 worker2 # [ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014 lb # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 client # [ 0.000000] DMI: Memory slots populated: 1/1 worker2 # [ 0.000000] DMI: Memory slots populated: 1/1 client # [ 0.000000] Hypervisor detected: KVM worker2 # [ 0.000000] Hypervisor detected: KVM lb # [ 0.000001] kvm-clock: using sched offset of 555437598 cycles worker1 # [ 0.000000] kvm-clock: using sched offset of 537452911 cycles client # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker2 # [ 0.000000] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 lb # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 worker1 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000006] tsc: Detected 2400.010 MHz processor worker1 # [ 0.000005] tsc: Detected 2400.010 MHz processor client # [ 0.000001] kvm-clock: using sched offset of 544709997 cycles worker2 # [ 0.000000] kvm-clock: using sched offset of 527100656 cycles worker1 # [ 0.000768] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000763] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 client # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns worker2 # [ 0.000002] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns lb # [ 0.000789] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker1 # [ 0.000795] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs client # [ 0.000005] tsc: Detected 2400.010 MHz processor worker2 # [ 0.000005] tsc: Detected 2400.010 MHz processor client # [ 0.000764] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 lb # [ 0.000792] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.000798] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker2 # [ 0.000766] last_pfn = 0x5ffd8 max_arch_pfn = 0x10000000000 worker1 # [ 0.002711] found SMP MP-table at [mem 0x000f5450-0x000f545f] lb # [ 0.002681] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.000792] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs worker2 # [ 0.000793] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs lb # [ 0.002694] Using GB pages for direct mapping worker1 # [ 0.002725] Using GB pages for direct mapping client # [ 0.000794] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.002874] RAMDISK: [mem 0x5e41c000-0x5ffcffff] lb # [ 0.002825] RAMDISK: [mem 0x5e41c000-0x5ffcffff] worker2 # [ 0.000795] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT worker1 # [ 0.002884] ACPI: Early table checksum verification disabled lb # [ 0.002835] ACPI: Early table checksum verification disabled client # [ 0.002692] found SMP MP-table at [mem 0x000f5450-0x000f545f] worker2 # [ 0.002688] found SMP MP-table at [mem 0x000f5450-0x000f545f] client # [ 0.002704] Using GB pages for direct mapping worker1 # [ 0.002888] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.002699] Using GB pages for direct mapping lb # [ 0.002839] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) client # [ 0.002857] RAMDISK: [mem 0x5e41c000-0x5ffcffff] worker2 # [ 0.002819] RAMDISK: [mem 0x5e41b000-0x5ffcffff] lb # [ 0.002843] ACPI: RSDT 0x000000005FFE2433 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002892] ACPI: RSDT 0x000000005FFE2433 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002865] ACPI: Early table checksum verification disabled worker2 # [ 0.002828] ACPI: Early table checksum verification disabled client # [ 0.002868] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker2 # [ 0.002831] ACPI: RSDP 0x00000000000F5270 000014 (v00 BOCHS ) worker1 # [ 0.002897] ACPI: FACP 0x000000005FFE222B 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002848] ACPI: FACP 0x000000005FFE222B 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002871] ACPI: RSDT 0x000000005FFE2433 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002835] ACPI: RSDT 0x000000005FFE2433 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002905] ACPI: DSDT 0x000000005FFE0040 0021EB (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002856] ACPI: DSDT 0x000000005FFE0040 0021EB (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002908] ACPI: FACS 0x000000005FFE0000 000040 lb # [ 0.002858] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.002876] ACPI: FACP 0x000000005FFE222B 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002839] ACPI: FACP 0x000000005FFE222B 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002860] ACPI: APIC 0x000000005FFE231F 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002909] ACPI: APIC 0x000000005FFE231F 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002883] ACPI: DSDT 0x000000005FFE0040 0021EB (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002846] ACPI: DSDT 0x000000005FFE0040 0021EB (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002885] ACPI: FACS 0x000000005FFE0000 000040 worker1 # [ 0.002911] ACPI: HPET 0x000000005FFE2397 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002861] ACPI: HPET 0x000000005FFE2397 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002848] ACPI: FACS 0x000000005FFE0000 000040 client # [ 0.002887] ACPI: APIC 0x000000005FFE231F 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002849] ACPI: APIC 0x000000005FFE231F 000078 (v03 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002912] ACPI: MCFG 0x000000005FFE23CF 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002863] ACPI: MCFG 0x000000005FFE23CF 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002888] ACPI: HPET 0x000000005FFE2397 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002851] ACPI: HPET 0x000000005FFE2397 000038 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002914] ACPI: WAET 0x000000005FFE240B 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) lb # [ 0.002864] ACPI: WAET 0x000000005FFE240B 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002890] ACPI: MCFG 0x000000005FFE23CF 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002915] ACPI: Reserving FACP table memory at [mem 0x5ffe222b-0x5ffe231e] lb # [ 0.002866] ACPI: Reserving FACP table memory at [mem 0x5ffe222b-0x5ffe231e] worker2 # [ 0.002853] ACPI: MCFG 0x000000005FFE23CF 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001) worker1 # [ 0.002916] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe222a] lb # [ 0.002866] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe222a] client # [ 0.002891] ACPI: WAET 0x000000005FFE240B 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) worker2 # [ 0.002854] ACPI: WAET 0x000000005FFE240B 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001) client # [ 0.002893] ACPI: Reserving FACP table memory at [mem 0x5ffe222b-0x5ffe231e] lb # [ 0.002867] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.002917] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.002856] ACPI: Reserving FACP table memory at [mem 0x5ffe222b-0x5ffe231e] client # [ 0.002894] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe222a] worker1 # [ 0.002917] ACPI: Reserving APIC table memory at [mem 0x5ffe231f-0x5ffe2396] lb # [ 0.002868] ACPI: Reserving APIC table memory at [mem 0x5ffe231f-0x5ffe2396] worker2 # [ 0.002856] ACPI: Reserving DSDT table memory at [mem 0x5ffe0040-0x5ffe222a] lb # [ 0.002868] ACPI: Reserving HPET table memory at [mem 0x5ffe2397-0x5ffe23ce] worker1 # [ 0.002918] ACPI: Reserving HPET table memory at [mem 0x5ffe2397-0x5ffe23ce] client # [ 0.002894] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker2 # [ 0.002857] ACPI: Reserving FACS table memory at [mem 0x5ffe0000-0x5ffe003f] worker1 # [ 0.002918] ACPI: Reserving MCFG table memory at [mem 0x5ffe23cf-0x5ffe240a] client # [ 0.002895] ACPI: Reserving APIC table memory at [mem 0x5ffe231f-0x5ffe2396] lb # [ 0.002868] ACPI: Reserving MCFG table memory at [mem 0x5ffe23cf-0x5ffe240a] worker2 # [ 0.002858] ACPI: Reserving APIC table memory at [mem 0x5ffe231f-0x5ffe2396] worker1 # [ 0.002919] ACPI: Reserving WAET table memory at [mem 0x5ffe240b-0x5ffe2432] client # [ 0.002895] ACPI: Reserving HPET table memory at [mem 0x5ffe2397-0x5ffe23ce] lb # [ 0.002869] ACPI: Reserving WAET table memory at [mem 0x5ffe240b-0x5ffe2432] worker2 # [ 0.002858] ACPI: Reserving HPET table memory at [mem 0x5ffe2397-0x5ffe23ce] worker1 # [ 0.003158] No NUMA configuration found lb # [ 0.003090] No NUMA configuration found client # [ 0.002896] ACPI: Reserving MCFG table memory at [mem 0x5ffe23cf-0x5ffe240a] worker2 # [ 0.002858] ACPI: Reserving MCFG table memory at [mem 0x5ffe23cf-0x5ffe240a] worker1 # [ 0.003159] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] lb # [ 0.003091] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.002896] ACPI: Reserving WAET table memory at [mem 0x5ffe240b-0x5ffe2432] worker1 # [ 0.003162] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.003094] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker2 # [ 0.002859] ACPI: Reserving WAET table memory at [mem 0x5ffe240b-0x5ffe2432] client # [ 0.003122] No NUMA configuration found worker1 # [ 0.005474] Zone ranges: lb # [ 0.005732] Zone ranges: worker2 # [ 0.003084] No NUMA configuration found client # [ 0.003123] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] worker1 # [ 0.005475] DMA [mem 0x0000000000001000-0x0000000000ffffff] lb # [ 0.005733] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker2 # [ 0.003084] Faking a node at [mem 0x0000000000000000-0x000000005ffd7fff] client # [ 0.003125] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] worker1 # [ 0.005477] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.005735] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.005919] Zone ranges: worker2 # [ 0.003087] NODE_DATA(0) allocated [mem 0x5ffd2780-0x5ffd7cff] lb # [ 0.005736] Normal empty worker1 # [ 0.005478] Normal empty worker2 # [ 0.005318] Zone ranges: lb # [ 0.005737] Device empty worker1 # [ 0.005479] Device empty client # [ 0.005920] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.005479] Movable zone start for each node lb # [ 0.005738] Movable zone start for each node worker2 # [ 0.005319] DMA [mem 0x0000000000001000-0x0000000000ffffff] worker1 # [ 0.005480] Early memory node ranges client # [ 0.005921] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] lb # [ 0.005738] Early memory node ranges client # [ 0.005923] Normal empty worker2 # [ 0.005321] DMA32 [mem 0x0000000001000000-0x000000005ffd7fff] client # [ 0.005923] Device empty worker1 # [ 0.005480] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.005739] node 0: [mem 0x0000000000001000-0x000000000009efff] worker2 # [ 0.005322] Normal empty client # [ 0.005924] Movable zone start for each node worker2 # [ 0.005323] Device empty worker1 # [ 0.005481] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.005740] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker2 # [ 0.005324] Movable zone start for each node client # [ 0.005925] Early memory node ranges worker2 # [ 0.005324] Early memory node ranges worker1 # [ 0.005482] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] client # [ 0.005925] node 0: [mem 0x0000000000001000-0x000000000009efff] lb # [ 0.005741] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.005325] node 0: [mem 0x0000000000001000-0x000000000009efff] worker1 # [ 0.005503] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.005926] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] lb # [ 0.005762] On node 0, zone DMA: 1 pages in unavailable ranges worker2 # [ 0.005326] node 0: [mem 0x0000000000100000-0x000000005ffd7fff] worker1 # [ 0.005768] On node 0, zone DMA: 97 pages in unavailable ranges lb # [ 0.006027] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.005927] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker2 # [ 0.005327] Initmem setup node 0 [mem 0x0000000000001000-0x000000005ffd7fff] worker1 # [ 0.033743] On node 0, zone DMA32: 40 pages in unavailable ranges lb # [ 0.033545] On node 0, zone DMA32: 40 pages in unavailable ranges client # [ 0.005947] On node 0, zone DMA: 1 pages in unavailable ranges worker1 # [ 0.034216] ACPI: PM-Timer IO Port: 0x608 lb # [ 0.034017] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.005346] On node 0, zone DMA: 1 pages in unavailable ranges client # [ 0.006219] On node 0, zone DMA: 97 pages in unavailable ranges worker1 # [ 0.034229] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.034030] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker2 # [ 0.005599] On node 0, zone DMA: 97 pages in unavailable ranges client # [ 0.034791] On node 0, zone DMA32: 40 pages in unavailable ranges worker1 # [ 0.034259] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.034057] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 client # [ 0.035254] ACPI: PM-Timer IO Port: 0x608 worker2 # [ 0.033393] On node 0, zone DMA32: 40 pages in unavailable ranges worker2 # [ 0.033853] ACPI: PM-Timer IO Port: 0x608 client # [ 0.035265] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) lb # [ 0.034060] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.034262] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker2 # [ 0.033864] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) worker1 # [ 0.034264] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.035297] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 lb # [ 0.034062] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) worker2 # [ 0.033890] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 worker1 # [ 0.034265] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.035300] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) lb # [ 0.034063] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker2 # [ 0.033893] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) worker1 # [ 0.034266] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) client # [ 0.035301] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) lb # [ 0.034064] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker2 # [ 0.033895] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) client # [ 0.035302] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) worker1 # [ 0.034267] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) lb # [ 0.034065] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker2 # [ 0.033896] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) client # [ 0.035303] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.034270] ACPI: Using ACPI (MADT) for SMP configuration information lb # [ 0.034067] ACPI: Using ACPI (MADT) for SMP configuration information worker2 # [ 0.033897] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) worker1 # [ 0.034270] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.034069] ACPI: HPET id: 0x8086a201 base: 0xfed00000 client # [ 0.035304] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) worker1 # [ 0.034274] TSC deadline timer available lb # [ 0.034072] TSC deadline timer available worker2 # [ 0.033897] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) client # [ 0.035307] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.034279] CPU topo: Max. logical packages: 1 lb # [ 0.034077] CPU topo: Max. logical packages: 1 worker2 # [ 0.033900] ACPI: Using ACPI (MADT) for SMP configuration information worker1 # [ 0.034279] CPU topo: Max. logical dies: 1 client # [ 0.035308] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.034078] CPU topo: Max. logical dies: 1 client # [ 0.035311] TSC deadline timer available worker1 # [ 0.034280] CPU topo: Max. dies per package: 1 worker2 # [ 0.033901] ACPI: HPET id: 0x8086a201 base: 0xfed00000 lb # [ 0.034078] CPU topo: Max. dies per package: 1 client # [ 0.035315] CPU topo: Max. logical packages: 1 worker1 # [ 0.034283] CPU topo: Max. threads per core: 1 worker2 # [ 0.033904] TSC deadline timer available lb # [ 0.034082] CPU topo: Max. threads per core: 1 client # [ 0.035316] CPU topo: Max. logical dies: 1 worker2 # [ 0.033908] CPU topo: Max. logical packages: 1 worker1 # [ 0.034284] CPU topo: Num. cores per package: 1 lb # [ 0.034082] CPU topo: Num. cores per package: 1 client # [ 0.035316] CPU topo: Max. dies per package: 1 worker2 # [ 0.033909] CPU topo: Max. logical dies: 1 worker1 # [ 0.034284] CPU topo: Num. threads per package: 1 lb # [ 0.034083] CPU topo: Num. threads per package: 1 client # [ 0.035320] CPU topo: Max. threads per core: 1 worker2 # [ 0.033909] CPU topo: Max. dies per package: 1 worker1 # [ 0.034285] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs lb # [ 0.034083] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker2 # [ 0.033913] CPU topo: Max. threads per core: 1 client # [ 0.035320] CPU topo: Num. cores per package: 1 client # [ 0.035321] CPU topo: Num. threads per package: 1 worker1 # [ 0.034305] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.033913] CPU topo: Num. cores per package: 1 lb # [ 0.034103] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker2 # [ 0.033914] CPU topo: Num. threads per package: 1 client # [ 0.035321] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs worker1 # [ 0.034398] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.034192] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker2 # [ 0.033914] CPU topo: Allowing 1 present CPUs plus 0 hotplug CPUs client # [ 0.035340] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() worker1 # [ 0.034400] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] lb # [ 0.034193] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.033931] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write() client # [ 0.035427] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] worker1 # [ 0.034401] [mem 0x60000000-0xafffffff] available for PCI devices lb # [ 0.034195] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.034403] Booting paravirtualized kernel on KVM worker2 # [ 0.034011] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] lb # [ 0.034197] Booting paravirtualized kernel on KVM client # [ 0.035428] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] worker2 # [ 0.034013] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x000fffff] client # [ 0.035429] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.034406] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns lb # [ 0.034200] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns client # [ 0.035431] Booting paravirtualized kernel on KVM worker2 # [ 0.034014] [mem 0x60000000-0xafffffff] available for PCI devices worker1 # [ 0.039068] setup_percpu: NR_CPUS:512 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 worker2 # [ 0.034015] Booting paravirtualized kernel on KVM lb # [ 0.038873] setup_percpu: NR_CPUS:512 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.035434] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.041307] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 lb # [ 0.041100] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.034018] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns worker1 # [ 0.041350] kvm-guest: PV spinlocks disabled, single CPU client # [ 0.040091] setup_percpu: NR_CPUS:512 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 lb # [ 0.041141] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.038697] setup_percpu: NR_CPUS:512 nr_cpumask_bits:1 nr_cpu_ids:1 nr_node_ids:1 client # [ 0.042371] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 client # [ 0.042430] kvm-guest: PV spinlocks disabled, single CPU worker2 # [ 0.041326] percpu: Embedded 98 pages/cpu s278528 r8192 d114688 u2097152 worker2 # [ 0.041369] kvm-guest: PV spinlocks disabled, single CPU worker1 # [ 0.041352] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/6h4yi05k4c0fkhyw0rk1hkcdcrzgjp91-nixos-system-worker1-test/init regInfo=/nix/.ro-store/xnlmznsmbdi821fmk1i5ks6zzf4g0cvp-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.041143] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/s1sdlq7kf1sljabp27xmqpmiignlamvy-nixos-system-lb-test/init regInfo=/nix/.ro-store/03cw8l3nbwgif29pbggmq2dzr1ly2wlq-closure-info/registration console=ttyS0,115200n8 console=tty0 client # [ 0.042431] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3xd6dbxz1qssv249bz933ccxrijwf6j8-nixos-system-client-test/init regInfo=/nix/.ro-store/6zrvcbahq47p1a771jj98lh9wbfgwk6h-closure-info/registration console=ttyS0,115200n8 console=tty0 worker1 # [ 0.041449] Unknown kernel command line parameters "regInfo=/nix/.ro-store/xnlmznsmbdi821fmk1i5ks6zzf4g0cvp-closure-info/registration", will be passed to user space. lb # [ 0.041242] Unknown kernel command line parameters "regInfo=/nix/.ro-store/03cw8l3nbwgif29pbggmq2dzr1ly2wlq-closure-info/registration", will be passed to user space. worker1 # [ 0.041462] random: crng init done worker2 # [ 0.041370] Kernel command line: console=ttyS0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/qz56dc5qp6pffwrpdfhrqjhrkj2mzhvf-nixos-system-worker2-test/init regInfo=/nix/.ro-store/whbda1s07lip7igndcgbwv6waj9mbidc-closure-info/registration console=ttyS0,115200n8 console=tty0 lb # [ 0.041255] random: crng init done worker1 # [ 0.041462] printk: log buffer data + meta data: 1048576 + 3670016 = 4718592 bytes lb # [ 0.041255] printk: log buffer data + meta data: 1048576 + 3670016 = 4718592 bytes client # [ 0.042524] Unknown kernel command line parameters "regInfo=/nix/.ro-store/6zrvcbahq47p1a771jj98lh9wbfgwk6h-closure-info/registration", will be passed to user space. client # [ 0.042536] random: crng init done worker1 # [ 0.044026] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.041464] Unknown kernel command line parameters "regInfo=/nix/.ro-store/whbda1s07lip7igndcgbwv6waj9mbidc-closure-info/registration", will be passed to user space. lb # [ 0.043472] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) worker2 # [ 0.041476] random: crng init done client # [ 0.042537] printk: log buffer data + meta data: 1048576 + 3670016 = 4718592 bytes worker1 # [ 0.044052] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.043495] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker2 # [ 0.041477] printk: log buffer data + meta data: 1048576 + 3670016 = 4718592 bytes worker1 # [ 0.044085] Fallback order for Node 0: 0 client # [ 0.044768] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) lb # [ 0.043528] Fallback order for Node 0: 0 worker1 # [ 0.044088] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.043708] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear) client # [ 0.044792] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) lb # [ 0.043531] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.044089] Policy zone: DMA32 lb # [ 0.043532] Policy zone: DMA32 client # [ 0.044825] Fallback order for Node 0: 0 worker2 # [ 0.043732] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) worker1 # [ 0.046396] mem auto-init: stack:all(zero), heap alloc:on, heap free:off lb # [ 0.045797] mem auto-init: stack:all(zero), heap alloc:on, heap free:off client # [ 0.044828] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker2 # [ 0.043765] Fallback order for Node 0: 0 client # [ 0.044829] Policy zone: DMA32 worker1 # [ 0.050033] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.049430] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.043768] Built 1 zonelists, mobility grouping on. Total pages: 393078 worker1 # [ 0.053517] allocated 3145728 bytes of page_ext client # [ 0.047088] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker2 # [ 0.043769] Policy zone: DMA32 lb # [ 0.053175] allocated 3145728 bytes of page_ext worker1 # [ 0.063874] ftrace: allocating 48996 entries in 192 pages lb # [ 0.063668] ftrace: allocating 48996 entries in 192 pages client # [ 0.050303] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 worker2 # [ 0.045970] mem auto-init: stack:all(zero), heap alloc:on, heap free:off worker1 # [ 0.063877] ftrace: allocated 192 pages with 2 groups client # [ 0.054134] allocated 3145728 bytes of page_ext lb # [ 0.063670] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.064822] Dynamic Preempt: lazy worker2 # [ 0.049268] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 lb # [ 0.064610] Dynamic Preempt: lazy client # [ 0.064332] ftrace: allocating 48996 entries in 192 pages worker1 # [ 0.064946] rcu: Preemptible hierarchical RCU implementation. worker2 # [ 0.052950] allocated 3145728 bytes of page_ext lb # [ 0.064773] rcu: Preemptible hierarchical RCU implementation. client # [ 0.064334] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.064947] rcu: RCU event tracing is enabled. worker2 # [ 0.063200] ftrace: allocating 48996 entries in 192 pages lb # [ 0.064773] rcu: RCU event tracing is enabled. client # [ 0.065195] Dynamic Preempt: lazy worker2 # [ 0.063202] ftrace: allocated 192 pages with 2 groups worker1 # [ 0.064948] rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=1. client # [ 0.065299] rcu: Preemptible hierarchical RCU implementation. lb # [ 0.064774] rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=1. worker2 # [ 0.064050] Dynamic Preempt: lazy worker1 # [ 0.064950] Trampoline variant of Tasks RCU enabled. client # [ 0.065299] rcu: RCU event tracing is enabled. lb # [ 0.064776] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.064206] rcu: Preemptible hierarchical RCU implementation. worker1 # [ 0.064950] Rude variant of Tasks RCU enabled. lb # [ 0.064777] Rude variant of Tasks RCU enabled. client # [ 0.065300] rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=1. worker2 # [ 0.064206] rcu: RCU event tracing is enabled. worker1 # [ 0.064950] Tracing variant of Tasks RCU enabled. lb # [ 0.064777] Tracing variant of Tasks RCU enabled. client # [ 0.065302] Trampoline variant of Tasks RCU enabled. worker2 # [ 0.064207] rcu: RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=1. worker1 # [ 0.064951] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. client # [ 0.065302] Rude variant of Tasks RCU enabled. lb # [ 0.064778] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker2 # [ 0.064209] Trampoline variant of Tasks RCU enabled. client # [ 0.065302] Tracing variant of Tasks RCU enabled. worker1 # [ 0.064952] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.064209] Rude variant of Tasks RCU enabled. lb # [ 0.064778] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.064209] Tracing variant of Tasks RCU enabled. client # [ 0.065303] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.065003] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.064796] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.065304] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 worker2 # [ 0.064210] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. worker1 # [ 0.065005] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.064211] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1 lb # [ 0.064798] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.065359] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.065006] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker2 # [ 0.064228] RCU Tasks: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. lb # [ 0.064798] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.065360] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.069681] NR_IRQS: 33024, nr_irqs: 256, preallocated irqs: 16 lb # [ 0.069149] NR_IRQS: 33024, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.064229] RCU Tasks Rude: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. client # [ 0.065361] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.069961] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.069453] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.069696] NR_IRQS: 33024, nr_irqs: 256, preallocated irqs: 16 worker2 # [ 0.064230] RCU Tasks Trace: Setting shift to 0 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=1. worker1 # [ 0.069966] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns client # [ 0.069982] rcu: srcu_init: Setting srcu_struct sizes based on contention. lb # [ 0.069461] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns worker2 # [ 0.068532] NR_IRQS: 33024, nr_irqs: 256, preallocated irqs: 16 worker1 # [ 0.070071] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker2 # [ 0.068805] rcu: srcu_init: Setting srcu_struct sizes based on contention. client # [ 0.069990] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.069566] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.073568] Console: colour VGA+ 80x25 lb # [ 0.073085] Console: colour VGA+ 80x25 worker1 # [ 0.073572] printk: legacy console [tty0] enabled worker2 # [ 0.068811] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns lb # [ 0.073088] printk: legacy console [tty0] enabled client # [ 0.070086] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) worker1 # [ 0.103056] printk: legacy console [ttyS0] enabled client # [ 0.073614] Console: colour VGA+ 80x25 lb # [ 0.102528] printk: legacy console [ttyS0] enabled worker1 # [ 0.197309] ACPI: Core revision 20250807 client # [ 0.073617] printk: legacy console [tty0] enabled worker2 # [ 0.068910] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) lb # [ 0.197178] ACPI: Core revision 20250807 worker2 # [ 0.072430] Console: colour VGA+ 80x25 client # [ 0.103088] printk: legacy console [ttyS0] enabled worker2 # [ 0.072433] printk: legacy console [tty0] enabled client # [ 0.196953] ACPI: Core revision 20250807 worker1 # [ 0.198177] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker2 # [ 0.101882] printk: legacy console [ttyS0] enabled lb # [ 0.198028] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker2 # [ 0.196719] ACPI: Core revision 20250807 worker1 # [ 0.199650] APIC: Switch to symmetric I/O mode setup lb # [ 0.199515] APIC: Switch to symmetric I/O mode setup client # [ 0.197788] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.200594] x2apic enabled lb # [ 0.200460] x2apic enabled client # [ 0.199301] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.197598] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns worker1 # [ 0.201336] APIC: Switched APIC routing to: physical x2apic client # [ 0.200271] x2apic enabled lb # [ 0.201207] APIC: Switched APIC routing to: physical x2apic worker2 # [ 0.199119] APIC: Switch to symmetric I/O mode setup worker2 # [ 0.200122] x2apic enabled client # [ 0.201077] APIC: Switched APIC routing to: physical x2apic worker1 # [ 0.203282] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 lb # [ 0.203020] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker2 # [ 0.200862] APIC: Switched APIC routing to: physical x2apic client # [ 0.202988] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.204253] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns lb # [ 0.204012] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns worker2 # [ 0.202695] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 worker1 # [ 0.205892] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010) client # [ 0.203989] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns lb # [ 0.205671] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010) worker2 # [ 0.203664] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns worker1 # [ 0.206977] x86/cpu: User Mode Instruction Prevention (UMIP) activated lb # [ 0.206753] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.205617] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010) worker1 # [ 0.208056] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 lb # [ 0.207792] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.205293] Calibrating delay loop (skipped) preset value.. 4800.02 BogoMIPS (lpj=2400010) client # [ 0.206701] x86/cpu: User Mode Instruction Prevention (UMIP) activated worker1 # [ 0.209568] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 lb # [ 0.208669] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker2 # [ 0.206377] x86/cpu: User Mode Instruction Prevention (UMIP) activated client # [ 0.208508] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 worker2 # [ 0.207403] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 client # [ 0.209287] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.209893] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.209672] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto worker2 # [ 0.208290] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 worker1 # [ 0.211889] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.210366] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.211668] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.212890] Transient Scheduler Attacks: Vulnerable: No microcode worker2 # [ 0.209294] mitigations: Enabled attack vectors: user_kernel, user_user, guest_host, guest_guest, SMT mitigations: auto lb # [ 0.212668] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.211615] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl worker1 # [ 0.213889] Spectre V2 : Mitigation: Enhanced / Automatic IBRS lb # [ 0.213668] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.211290] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl client # [ 0.212615] Transient Scheduler Attacks: Vulnerable: No microcode worker1 # [ 0.214889] Speculative Return Stack Overflow: Mitigation: Safe RET lb # [ 0.214668] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.212291] Transient Scheduler Attacks: Vulnerable: No microcode client # [ 0.214336] Spectre V2 : Mitigation: Enhanced / Automatic IBRS worker2 # [ 0.213290] Spectre V2 : Mitigation: Enhanced / Automatic IBRS client # [ 0.214614] Speculative Return Stack Overflow: Mitigation: Safe RET worker2 # [ 0.214290] Speculative Return Stack Overflow: Mitigation: Safe RET worker1 # [ 0.215889] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.215668] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.217897] Spectre V2 : Enabling IBPB for BPF lb # [ 0.217675] Spectre V2 : Enabling IBPB for BPF client # [ 0.215614] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization worker1 # [ 0.218890] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.217622] Spectre V2 : Enabling IBPB for BPF worker2 # [ 0.215290] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization lb # [ 0.218669] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.219896] active return thunk: srso_alias_return_thunk worker2 # [ 0.217299] Spectre V2 : Enabling IBPB for BPF lb # [ 0.219668] active return thunk: srso_alias_return_thunk client # [ 0.218615] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier worker1 # [ 0.220910] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker2 # [ 0.218291] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier client # [ 0.219615] active return thunk: srso_alias_return_thunk lb # [ 0.220688] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.221889] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker2 # [ 0.219291] active return thunk: srso_alias_return_thunk lb # [ 0.221668] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' client # [ 0.220635] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' worker1 # [ 0.222889] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker2 # [ 0.220311] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' lb # [ 0.222668] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' client # [ 0.221614] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' worker1 # [ 0.223889] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker2 # [ 0.221290] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' lb # [ 0.223668] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' client # [ 0.222614] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' worker1 # [ 0.224889] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker2 # [ 0.222290] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' lb # [ 0.224668] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.223614] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' worker1 # [ 0.225889] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' worker2 # [ 0.223290] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask' lb # [ 0.225668] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' client # [ 0.224614] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' worker1 # [ 0.226889] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker2 # [ 0.224290] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256' client # [ 0.225614] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.226668] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.227890] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker2 # [ 0.225290] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256' lb # [ 0.227668] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 client # [ 0.226614] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' worker1 # [ 0.228889] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker2 # [ 0.226290] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers' lb # [ 0.229379] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 client # [ 0.228529] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 worker1 # [ 0.229889] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker2 # [ 0.227291] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 lb # [ 0.229668] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 client # [ 0.229324] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 worker1 # [ 0.230889] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker2 # [ 0.228290] x86/fpu: xstate_offset[5]: 832, xstate_sizes[5]: 64 lb # [ 0.230668] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.230340] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 worker1 # [ 0.231889] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 worker2 # [ 0.229290] x86/fpu: xstate_offset[6]: 896, xstate_sizes[6]: 512 lb # [ 0.231668] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 client # [ 0.231326] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 worker1 # [ 0.232889] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.230290] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024 client # [ 0.231614] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 lb # [ 0.232668] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.231290] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]: 8 client # [ 0.232614] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker2 # [ 0.232290] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format. worker1 # [ 0.267448] Freeing SMP alternatives memory: 48K worker1 # [ 0.267892] pid_max: default: 32768 minimum: 301 lb # [ 0.266858] Freeing SMP alternatives memory: 48K client # [ 0.267136] Freeing SMP alternatives memory: 48K lb # [ 0.267667] pid_max: default: 32768 minimum: 301 worker1 # [ 0.268990] LSM: initializing lsm=lockdown,capability,landlock,yama,bpf,ima client # [ 0.267617] pid_max: default: 32768 minimum: 301 worker2 # [ 0.266644] Freeing SMP alternatives memory: 48K worker1 # [ 0.270015] landlock: Up and running. lb # [ 0.268326] LSM: initializing lsm=lockdown,capability,landlock,yama,bpf,ima worker2 # [ 0.267294] pid_max: default: 32768 minimum: 301 worker1 # [ 0.270890] Yama: becoming mindful. client # [ 0.268736] LSM: initializing lsm=lockdown,capability,landlock,yama,bpf,ima lb # [ 0.269764] landlock: Up and running. client # [ 0.269709] landlock: Up and running. worker1 # [ 0.271683] LSM support for eBPF active worker2 # [ 0.268296] LSM: initializing lsm=lockdown,capability,landlock,yama,bpf,ima lb # [ 0.270380] Yama: becoming mindful. client # [ 0.270306] Yama: becoming mindful. worker2 # [ 0.269388] landlock: Up and running. lb # [ 0.270916] LSM support for eBPF active worker1 # [ 0.272454] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.269993] Yama: becoming mindful. client # [ 0.271248] LSM support for eBPF active worker2 # [ 0.270515] LSM support for eBPF active lb # [ 0.271801] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.272925] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.271719] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.271412] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) lb # [ 0.272710] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) client # [ 0.272663] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker2 # [ 0.272333] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear) worker1 # [ 0.275851] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) lb # [ 0.275587] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) client # [ 0.275745] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.276477] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker2 # [ 0.275150] smpboot: CPU0: AMD EPYC 9654 96-Core Processor (family: 0x19, model: 0x11, stepping: 0x1) worker1 # [ 0.276894] ... version: 2 lb # [ 0.276235] Performance Events: Fam17h+ core perfctr, AMD PMU driver. worker1 # [ 0.277586] ... bit width: 48 client # [ 0.277235] Performance Events: Fam17h+ core perfctr, AMD PMU driver. lb # [ 0.276673] ... version: 2 worker1 # [ 0.277891] ... generic counters: 6 worker2 # [ 0.275816] Performance Events: Fam17h+ core perfctr, AMD PMU driver. client # [ 0.277624] ... version: 2 lb # [ 0.277374] ... bit width: 48 worker2 # [ 0.276295] ... version: 2 client # [ 0.278285] ... bit width: 48 worker1 # [ 0.278554] ... generic bitmap: 000000000000003f lb # [ 0.277671] ... generic counters: 6 worker2 # [ 0.276976] ... bit width: 48 worker1 # [ 0.278902] ... fixed-purpose counters: 0 client # [ 0.278617] ... generic counters: 6 worker2 # [ 0.277293] ... generic counters: 6 lb # [ 0.278379] ... generic bitmap: 000000000000003f worker1 # [ 0.279574] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.279310] ... generic bitmap: 000000000000003f lb # [ 0.278720] ... fixed-purpose counters: 0 worker2 # [ 0.277958] ... generic bitmap: 000000000000003f client # [ 0.279616] ... fixed-purpose counters: 0 worker1 # [ 0.279891] ... value mask: 0000ffffffffffff worker2 # [ 0.278338] ... fixed-purpose counters: 0 lb # [ 0.279400] ... fixed-purpose bitmap: 0000000000000000 client # [ 0.280273] ... fixed-purpose bitmap: 0000000000000000 worker1 # [ 0.280717] ... max period: 00007fffffffffff worker2 # [ 0.279035] ... fixed-purpose bitmap: 0000000000000000 lb # [ 0.279671] ... value mask: 0000ffffffffffff client # [ 0.280617] ... value mask: 0000ffffffffffff worker1 # [ 0.281520] ... global_ctrl mask: 000000000000003f worker2 # [ 0.279292] ... value mask: 0000ffffffffffff worker1 # [ 0.282006] signal: max sigframe size: 3376 client # [ 0.281480] ... max period: 00007fffffffffff lb # [ 0.280551] ... max period: 00007fffffffffff worker2 # [ 0.280162] ... max period: 00007fffffffffff worker1 # [ 0.282747] rcu: Hierarchical SRCU implementation. lb # [ 0.281339] ... global_ctrl mask: 000000000000003f client # [ 0.282273] ... global_ctrl mask: 000000000000003f worker2 # [ 0.280958] ... global_ctrl mask: 000000000000003f worker1 # [ 0.283443] rcu: Max phase no-delay instances is 400. client # [ 0.282729] signal: max sigframe size: 3376 lb # [ 0.281801] signal: max sigframe size: 3376 worker2 # [ 0.281415] signal: max sigframe size: 3376 client # [ 0.283481] rcu: Hierarchical SRCU implementation. lb # [ 0.282639] rcu: Hierarchical SRCU implementation. worker2 # [ 0.282176] rcu: Hierarchical SRCU implementation. client # [ 0.284181] rcu: Max phase no-delay instances is 400. lb # [ 0.283267] rcu: Max phase no-delay instances is 400. worker2 # [ 0.282866] rcu: Max phase no-delay instances is 400. worker1 # [ 0.288608] smp: Bringing up secondary CPUs ... worker1 # [ 0.288906] smp: Brought up 1 node, 1 CPU client # [ 0.289261] smp: Bringing up secondary CPUs ... worker1 # [ 0.289574] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.288502] smp: Bringing up secondary CPUs ... client # [ 0.289632] smp: Brought up 1 node, 1 CPU worker2 # [ 0.288038] smp: Bringing up secondary CPUs ... lb # [ 0.289266] smp: Brought up 1 node, 1 CPU worker2 # [ 0.288306] smp: Brought up 1 node, 1 CPU client # [ 0.290287] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) lb # [ 0.289672] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.290089] Memory: 1449160K/1572312K available (18190K kernel code, 5432K rwdata, 13716K rodata, 6720K init, 3992K bss, 114760K reserved, 0K cma-reserved) worker2 # [ 0.288958] smpboot: Total of 1 processors activated (4800.02 BogoMIPS) worker1 # [ 0.291138] devtmpfs: initialized client # [ 0.290794] Memory: 1449180K/1572312K available (18190K kernel code, 5432K rwdata, 13716K rodata, 6720K init, 3992K bss, 114760K reserved, 0K cma-reserved) worker1 # [ 0.291949] x86/mm: Memory block size: 128MB lb # [ 0.290824] Memory: 1449156K/1572312K available (18190K kernel code, 5432K rwdata, 13716K rodata, 6720K init, 3992K bss, 114760K reserved, 0K cma-reserved) client # [ 0.291864] devtmpfs: initialized worker2 # [ 0.289513] Memory: 1449152K/1572312K available (18190K kernel code, 5432K rwdata, 13716K rodata, 6720K init, 3992K bss, 114764K reserved, 0K cma-reserved) lb # [ 0.291947] devtmpfs: initialized worker2 # [ 0.290557] devtmpfs: initialized client # [ 0.292637] x86/mm: Memory block size: 128MB lb # [ 0.292688] x86/mm: Memory block size: 128MB worker1 # [ 0.293694] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker2 # [ 0.291346] x86/mm: Memory block size: 128MB worker1 # [ 0.294770] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.294427] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) lb # [ 0.294492] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) worker1 # [ 0.295974] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.293142] posixtimers hash table entries: 512 (order: 1, 8192 bytes, linear) client # [ 0.295540] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker1 # [ 0.297060] PM: RTC time: 15:07:35, date: 2026-11-07 lb # [ 0.295578] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). worker2 # [ 0.294169] futex hash table entries: 256 (16384 bytes on 1 NUMA nodes, total 16 KiB, linear). client # [ 0.296718] pinctrl core: initialized pinctrl subsystem lb # [ 0.296761] pinctrl core: initialized pinctrl subsystem worker2 # [ 0.295373] pinctrl core: initialized pinctrl subsystem client # [ 0.297833] PM: RTC time: 15:07:35, date: 2026-11-07 lb # [ 0.297954] PM: RTC time: 15:07:35, date: 2026-11-07 worker2 # [ 0.296538] PM: RTC time: 15:07:35, date: 2026-11-07 worker1 # [ 0.300555] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.301417] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations client # [ 0.301852] NET: Registered PF_NETLINK/PF_ROUTE protocol family lb # [ 0.301623] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker2 # [ 0.300087] NET: Registered PF_NETLINK/PF_ROUTE protocol family worker1 # [ 0.301916] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations client # [ 0.303120] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations lb # [ 0.302870] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker2 # [ 0.301499] DMA: preallocated 256 KiB GFP_KERNEL pool for atomic allocations worker1 # [ 0.303174] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations client # [ 0.303640] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.303900] audit: initializing netlink subsys (disabled) lb # [ 0.303696] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker2 # [ 0.302317] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations worker1 # [ 0.305019] thermal_sys: Registered thermal governor 'fair_share' client # [ 0.304906] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations lb # [ 0.304952] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker2 # [ 0.303589] DMA: preallocated 256 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations worker1 # [ 0.305021] thermal_sys: Registered thermal governor 'bang_bang' client # [ 0.305626] audit: initializing netlink subsys (disabled) lb # [ 0.305682] audit: initializing netlink subsys (disabled) worker2 # [ 0.304303] audit: initializing netlink subsys (disabled) worker1 # [ 0.305892] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.306744] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.306796] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.307073] thermal_sys: Registered thermal governor 'fair_share' worker2 # [ 0.305295] audit: type=2000 audit(1794064056.479:1): state=initialized audit_enabled=0 res=1 client # [ 0.306746] thermal_sys: Registered thermal governor 'bang_bang' lb # [ 0.307076] thermal_sys: Registered thermal governor 'bang_bang' worker2 # [ 0.306439] thermal_sys: Registered thermal governor 'fair_share' worker1 # [ 0.307586] audit: type=2000 audit(1794064056.476:1): state=initialized audit_enabled=0 res=1 client # [ 0.307618] thermal_sys: Registered thermal governor 'step_wise' worker2 # [ 0.306441] thermal_sys: Registered thermal governor 'bang_bang' worker1 # [ 0.308894] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.307675] audit: type=2000 audit(1794064056.479:1): state=initialized audit_enabled=0 res=1 client # [ 0.308537] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.308908] cpuidle: using governor menu worker2 # [ 0.307293] thermal_sys: Registered thermal governor 'step_wise' lb # [ 0.309672] thermal_sys: Registered thermal governor 'step_wise' client # [ 0.309330] audit: type=2000 audit(1794064056.481:1): state=initialized audit_enabled=0 res=1 worker2 # [ 0.308196] thermal_sys: Registered thermal governor 'user_space' lb # [ 0.309673] thermal_sys: Registered thermal governor 'user_space' worker1 # [ 0.310904] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 client # [ 0.310620] thermal_sys: Registered thermal governor 'power_allocator' worker2 # [ 0.308988] thermal_sys: Registered thermal governor 'power_allocator' lb # [ 0.310587] thermal_sys: Registered thermal governor 'power_allocator' client # [ 0.310634] cpuidle: using governor menu worker2 # [ 0.309314] cpuidle: using governor menu lb # [ 0.311382] cpuidle: using governor menu worker1 # [ 0.312090] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] client # [ 0.312626] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.312894] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.311476] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 lb # [ 0.312877] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 worker1 # [ 0.313903] PCI: Using configuration type 1 for base access client # [ 0.313855] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] lb # [ 0.313908] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker2 # [ 0.312889] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff] worker1 # [ 0.314964] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. client # [ 0.314620] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry lb # [ 0.314674] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry worker2 # [ 0.313296] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry client # [ 0.315628] PCI: Using configuration type 1 for base access lb # [ 0.315682] PCI: Using configuration type 1 for base access worker2 # [ 0.314305] PCI: Using configuration type 1 for base access client # [ 0.316735] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. lb # [ 0.316806] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker2 # [ 0.315381] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. worker1 # [ 0.322187] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages client # [ 0.321890] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker1 # [ 0.322892] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page client # [ 0.322618] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page lb # [ 0.323687] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages worker2 # [ 0.322307] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages lb # [ 0.324671] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker2 # [ 0.323293] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page worker1 # [ 0.327893] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages client # [ 0.327618] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker1 # [ 0.328892] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page client # [ 0.328617] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page lb # [ 0.329672] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages worker2 # [ 0.328293] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages lb # [ 0.330671] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker2 # [ 0.329293] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page worker1 # [ 0.337469] ACPI: Added _OSI(Module Device) worker1 # [ 0.337893] ACPI: Added _OSI(Processor Device) worker1 # [ 0.338627] ACPI: Added _OSI(Processor Aggregator Device) client # [ 0.338976] ACPI: Added _OSI(Module Device) client # [ 0.339619] ACPI: Added _OSI(Processor Device) client # [ 0.340366] ACPI: Added _OSI(Processor Aggregator Device) lb # [ 0.341927] ACPI: Added _OSI(Module Device) worker2 # [ 0.340565] ACPI: Added _OSI(Module Device) lb # [ 0.342659] ACPI: Added _OSI(Processor Device) worker2 # [ 0.341284] ACPI: Added _OSI(Processor Device) lb # [ 0.343244] ACPI: Added _OSI(Processor Aggregator Device) worker2 # [ 0.341840] ACPI: Added _OSI(Processor Aggregator Device) worker1 # [ 0.345446] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.348841] ACPI: Interpreter enabled worker1 # [ 0.349363] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.347762] ACPI: 1 ACPI AML tables successfully acquired and loaded client # [ 0.349198] ACPI: 1 ACPI AML tables successfully acquired and loaded lb # [ 0.349353] ACPI: 1 ACPI AML tables successfully acquired and loaded worker1 # [ 0.349892] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.350707] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.351694] ACPI: Interpreter enabled client # [ 0.352977] ACPI: Interpreter enabled lb # [ 0.353086] ACPI: Interpreter enabled worker2 # [ 0.352308] ACPI: PM: (supports S0 S3 S4 S5) client # [ 0.353621] ACPI: PM: (supports S0 S3 S4 S5) lb # [ 0.353686] ACPI: PM: (supports S0 S3 S4 S5) worker2 # [ 0.353014] ACPI: Using IOAPIC for interrupt routing client # [ 0.354324] ACPI: Using IOAPIC for interrupt routing lb # [ 0.354368] ACPI: Using IOAPIC for interrupt routing worker1 # [ 0.355892] PCI: Using E820 reservations for host bridge windows client # [ 0.354681] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker1 # [ 0.356974] ACPI: Enabled 2 GPEs in block 00 to 3F client # [ 0.355619] PCI: Using E820 reservations for host bridge windows worker2 # [ 0.355362] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug lb # [ 0.356734] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug worker2 # [ 0.356293] PCI: Using E820 reservations for host bridge windows lb # [ 0.357672] PCI: Using E820 reservations for host bridge windows client # [ 0.358740] ACPI: Enabled 2 GPEs in block 00 to 3F worker2 # [ 0.359376] ACPI: Enabled 2 GPEs in block 00 to 3F lb # [ 0.360762] ACPI: Enabled 2 GPEs in block 00 to 3F worker1 # [ 0.364697] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.365647] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.366969] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] client # [ 0.366463] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker2 # [ 0.365391] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) lb # [ 0.366681] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) worker1 # [ 0.368018] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] client # [ 0.367368] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.369267] PCI host bridge to bus 0000:00 worker2 # [ 0.366298] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] lb # [ 0.367649] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] worker1 # [ 0.369896] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.368702] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker2 # [ 0.367372] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] lb # [ 0.368749] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR] worker1 # [ 0.370892] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] client # [ 0.369741] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker2 # [ 0.368415] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] lb # [ 0.369794] acpi PNP0A08:00: _OSC: OS now controls [PME AER PCIeCapability] worker1 # [ 0.371891] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] client # [ 0.370974] PCI host bridge to bus 0000:00 worker2 # [ 0.369676] PCI host bridge to bus 0000:00 lb # [ 0.371074] PCI host bridge to bus 0000:00 worker1 # [ 0.372892] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] client # [ 0.371621] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] worker2 # [ 0.370297] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] lb # [ 0.371676] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] client # [ 0.372617] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker2 # [ 0.371293] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] lb # [ 0.372671] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] worker1 # [ 0.373891] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.373617] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.374892] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.373654] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker2 # [ 0.372292] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] worker1 # [ 0.375892] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.374617] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker2 # [ 0.373293] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] lb # [ 0.374515] pci_bus 0000:00: root bus resource [mem 0x60000000-0xafffffff window] worker1 # [ 0.376805] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint client # [ 0.375617] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.374292] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] lb # [ 0.375547] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] client # [ 0.376617] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.375293] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] lb # [ 0.376560] pci_bus 0000:00: root bus resource [mem 0x100000000-0x8ffffffff window] worker1 # [ 0.378290] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.377617] pci_bus 0000:00: root bus resource [bus 00-ff] worker2 # [ 0.376293] pci_bus 0000:00: root bus resource [bus 00-ff] lb # [ 0.377621] pci_bus 0000:00: root bus resource [bus 00-ff] client # [ 0.378558] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.377235] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint lb # [ 0.378406] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint worker2 # [ 0.378715] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint client # [ 0.380018] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint lb # [ 0.380118] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint worker1 # [ 0.380957] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.381904] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker1 # [ 0.383053] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] lb # [ 0.382752] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker2 # [ 0.381358] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] worker1 # [ 0.384065] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.382690] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref] lb # [ 0.383683] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] worker2 # [ 0.382305] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] client # [ 0.383629] pci 0000:00:01.0: BAR 2 [mem 0xfebd0000-0xfebd0fff] lb # [ 0.384620] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker1 # [ 0.385617] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.383241] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] client # [ 0.384704] pci 0000:00:01.0: ROM [mem 0xfebc0000-0xfebcffff pref] worker2 # [ 0.384183] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] lb # [ 0.385875] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] client # [ 0.385975] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] worker1 # [ 0.387945] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] lb # [ 0.387375] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.386074] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.388778] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] client # [ 0.387327] pci 0000:00:02.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.389607] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker1 # [ 0.389898] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] lb # [ 0.390703] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] worker2 # [ 0.389311] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] client # [ 0.389638] pci 0000:00:02.0: BAR 0 [io 0xc100-0xc11f] lb # [ 0.391544] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker2 # [ 0.390167] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] worker1 # [ 0.391609] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.390490] pci 0000:00:02.0: BAR 1 [mem 0xfebd1000-0xfebd1fff] lb # [ 0.392391] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] worker2 # [ 0.391021] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] client # [ 0.391351] pci 0000:00:02.0: BAR 4 [mem 0xfe000000-0xfe003fff 64bit pref] lb # [ 0.392676] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker2 # [ 0.391298] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] client # [ 0.391623] pci 0000:00:02.0: ROM [mem 0xfeb40000-0xfeb7ffff pref] worker1 # [ 0.393899] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.394714] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] lb # [ 0.394377] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.393019] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.393179] pci 0000:00:03.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.395614] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] lb # [ 0.396686] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker1 # [ 0.396429] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint lb # [ 0.397536] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.394636] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] worker2 # [ 0.396333] pci 0000:00:03.0: BAR 0 [io 0xc120-0xc13f] lb # [ 0.398413] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] client # [ 0.395471] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] worker2 # [ 0.397248] pci 0000:00:03.0: BAR 1 [mem 0xfebd2000-0xfebd2fff] client # [ 0.396379] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker2 # [ 0.398049] pci 0000:00:03.0: BAR 4 [mem 0xfe004000-0xfe007fff 64bit pref] worker1 # [ 0.398899] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] lb # [ 0.399204] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.399732] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.397174] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker2 # [ 0.398868] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint worker1 # [ 0.400621] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] lb # [ 0.401685] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker1 # [ 0.401438] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint lb # [ 0.402552] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.399638] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] worker2 # [ 0.401330] pci 0000:00:04.0: BAR 0 [io 0xc000-0xc07f] client # [ 0.400501] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] worker1 # [ 0.402900] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.403418] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker2 # [ 0.402174] pci 0000:00:04.0: BAR 1 [mem 0xfebd3000-0xfebd3fff] client # [ 0.401350] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.403708] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] lb # [ 0.404254] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.402974] pci 0000:00:04.0: BAR 4 [mem 0xfe008000-0xfe00bfff 64bit pref] worker1 # [ 0.404603] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] client # [ 0.402153] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker2 # [ 0.403879] pci 0000:00:05.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint worker1 # [ 0.405114] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] lb # [ 0.405687] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] client # [ 0.403638] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.406547] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.406486] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint client # [ 0.404467] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker2 # [ 0.406330] pci 0000:00:05.0: BAR 0 [io 0xc140-0xc15f] lb # [ 0.407400] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] worker1 # [ 0.407773] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] client # [ 0.405348] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.407678] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.407269] pci 0000:00:05.0: BAR 1 [mem 0xfebd4000-0xfebd4fff] worker1 # [ 0.408588] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.405624] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker2 # [ 0.408315] pci 0000:00:05.0: BAR 4 [mem 0xfe00c000-0xfe00ffff 64bit pref] lb # [ 0.409231] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker2 # [ 0.409298] pci 0000:00:05.0: ROM [mem 0xfeb80000-0xfebbffff pref] worker1 # [ 0.409449] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.407157] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint lb # [ 0.410568] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] worker2 # [ 0.410803] pci 0000:00:06.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint worker1 # [ 0.410904] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] client # [ 0.408478] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.411424] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.409355] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] worker1 # [ 0.411825] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.412314] pci 0000:00:06.0: BAR 1 [mem 0xfebd5000-0xfebd5fff] lb # [ 0.412242] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.413248] pci 0000:00:06.0: BAR 4 [mem 0xfe010000-0xfe013fff 64bit pref] client # [ 0.410151] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.413425] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.413684] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker2 # [ 0.414650] pci 0000:00:07.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.414739] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] client # [ 0.411642] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] lb # [ 0.414693] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker1 # [ 0.415603] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] client # [ 0.412584] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] worker2 # [ 0.416987] pci 0000:00:07.0: BAR 1 [mem 0xfebd6000-0xfebd6fff] worker1 # [ 0.416426] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint lb # [ 0.416208] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint client # [ 0.414230] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.417314] pci 0000:00:07.0: BAR 4 [mem 0xfe014000-0xfe017fff 64bit pref] lb # [ 0.417532] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.417845] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] client # [ 0.415457] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] lb # [ 0.418409] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] worker2 # [ 0.418867] pci 0000:00:08.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.418619] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.416336] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.419222] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.420315] pci 0000:00:08.0: BAR 1 [mem 0xfebd7000-0xfebd7fff] worker1 # [ 0.419870] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.417160] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker2 # [ 0.421238] pci 0000:00:08.0: BAR 4 [mem 0xfe018000-0xfe01bfff 64bit pref] lb # [ 0.420684] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] worker1 # [ 0.421899] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] client # [ 0.418564] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.421670] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker2 # [ 0.422750] pci 0000:00:09.0: [1af4:105a] type 00 class 0x018000 conventional PCI endpoint worker1 # [ 0.422734] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.419371] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] worker1 # [ 0.423583] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.423206] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint client # [ 0.420166] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint worker1 # [ 0.424422] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker2 # [ 0.424997] pci 0000:00:09.0: BAR 1 [mem 0xfebd8000-0xfebd8fff] lb # [ 0.424687] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.425319] pci 0000:00:09.0: BAR 4 [mem 0xfe01c000-0xfe01ffff 64bit pref] client # [ 0.421625] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] lb # [ 0.425555] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] client # [ 0.422480] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker2 # [ 0.426850] pci 0000:00:0a.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.426438] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.425900] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.423338] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] worker1 # [ 0.426899] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] lb # [ 0.427206] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint client # [ 0.424181] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint worker1 # [ 0.427840] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker2 # [ 0.429294] pci 0000:00:0a.0: BAR 0 [io 0xc080-0xc0bf] worker2 # [ 0.430107] pci 0000:00:0a.0: BAR 1 [mem 0xfebd9000-0xfebd9fff] worker1 # [ 0.429245] pci 0000:00:0c.0: [1af4:1053] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.431043] pci 0000:00:0a.0: BAR 4 [mem 0xfe020000-0xfe023fff 64bit pref] lb # [ 0.428866] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.425639] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] worker1 # [ 0.430726] pci 0000:00:0c.0: BAR 1 [mem 0xfebdb000-0xfebdbfff] lb # [ 0.429677] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] client # [ 0.426623] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.431613] pci 0000:00:0c.0: BAR 4 [mem 0xfe028000-0xfe02bfff 64bit pref] worker2 # [ 0.431885] pci 0000:00:0b.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint lb # [ 0.430625] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] client # [ 0.427547] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] worker1 # [ 0.432439] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.432036] pci 0000:00:0c.0: [1af4:1053] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.434076] pci 0000:00:0b.0: BAR 0 [io 0xc160-0xc17f] client # [ 0.429007] pci 0000:00:0c.0: [1af4:1053] type 00 class 0x078000 conventional PCI endpoint worker2 # [ 0.434300] pci 0000:00:0b.0: BAR 1 [mem 0xfebda000-0xfebdafff] worker1 # [ 0.433445] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] lb # [ 0.433506] pci 0000:00:0c.0: BAR 1 [mem 0xfebdb000-0xfebdbfff] client # [ 0.430423] pci 0000:00:0c.0: BAR 1 [mem 0xfebdb000-0xfebdbfff] worker2 # [ 0.435258] pci 0000:00:0b.0: BAR 4 [mem 0xfe024000-0xfe027fff 64bit pref] lb # [ 0.434403] pci 0000:00:0c.0: BAR 4 [mem 0xfe028000-0xfe02bfff 64bit pref] worker1 # [ 0.434139] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.431327] pci 0000:00:0c.0: BAR 4 [mem 0xfe028000-0xfe02bfff 64bit pref] worker2 # [ 0.436667] pci 0000:00:0c.0: [1af4:1053] type 00 class 0x078000 conventional PCI endpoint lb # [ 0.435229] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.432176] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.436677] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.438316] pci 0000:00:0c.0: BAR 1 [mem 0xfebdb000-0xfebdbfff] client # [ 0.433177] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] lb # [ 0.437761] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.439292] pci 0000:00:0c.0: BAR 4 [mem 0xfe028000-0xfe02bfff 64bit pref] client # [ 0.434476] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.440845] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint worker2 # [ 0.442152] pci 0000:00:1d.0: BAR 4 [io 0xc180-0xc19f] worker2 # [ 0.443174] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.435463] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.436743] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.438459] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.439100] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint lb # [ 0.439235] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] client # [ 0.436128] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] worker1 # [ 0.440416] pci 0000:00:1d.7: BAR 0 [mem 0xfebdc000-0xfebdcfff] lb # [ 0.440613] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint client # [ 0.437477] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint worker1 # [ 0.441127] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.442290] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] client # [ 0.439152] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.442171] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.442890] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.439883] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint worker1 # [ 0.443139] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker2 # [ 0.445044] pci 0000:00:1d.1: BAR 4 [io 0xc1a0-0xc1bf] lb # [ 0.444214] pci 0000:00:1d.7: BAR 0 [mem 0xfebdc000-0xfebdcfff] client # [ 0.441163] pci 0000:00:1d.7: BAR 0 [mem 0xfebdc000-0xfebdcfff] worker1 # [ 0.444791] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker2 # [ 0.446151] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint lb # [ 0.444888] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint worker1 # [ 0.445523] pci 0000:00:1f.2: BAR 5 [mem 0xfebdd000-0xfebddfff] client # [ 0.441908] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.445960] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker2 # [ 0.448249] pci 0000:00:1d.2: BAR 4 [io 0xc1c0-0xc1df] worker1 # [ 0.446217] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.442898] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO lb # [ 0.446916] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.447655] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker2 # [ 0.449147] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint client # [ 0.443890] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint lb # [ 0.448522] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker2 # [ 0.450915] pci 0000:00:1d.7: BAR 0 [mem 0xfebdc000-0xfebdcfff] client # [ 0.445464] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] lb # [ 0.449294] pci 0000:00:1f.2: BAR 5 [mem 0xfebdd000-0xfebddfff] client # [ 0.446267] pci 0000:00:1f.2: BAR 5 [mem 0xfebdd000-0xfebddfff] worker2 # [ 0.451543] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint lb # [ 0.449983] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker1 # [ 0.451280] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.446932] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint worker2 # [ 0.452574] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO worker1 # [ 0.451996] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 lb # [ 0.451586] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker2 # [ 0.453545] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint worker1 # [ 0.452988] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.448330] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] worker1 # [ 0.453990] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.454990] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker2 # [ 0.455779] pci 0000:00:1f.2: BAR 4 [io 0xc1e0-0xc1ff] worker1 # [ 0.455986] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker2 # [ 0.456299] pci 0000:00:1f.2: BAR 5 [mem 0xfebdd000-0xfebddfff] lb # [ 0.455539] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 worker1 # [ 0.456990] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 client # [ 0.451855] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 lb # [ 0.456499] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker2 # [ 0.457562] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint client # [ 0.452721] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.457989] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 lb # [ 0.457513] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 client # [ 0.453715] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.458929] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.459139] pci 0000:00:1f.3: BAR 4 [io 0x0700-0x073f] lb # [ 0.458504] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 worker1 # [ 0.459899] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.454719] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.459484] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 worker1 # [ 0.460851] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 client # [ 0.455721] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.460493] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.461619] ACPI: PCI: Interrupt link GSID configured for IRQ 19 client # [ 0.456721] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 lb # [ 0.461655] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.461903] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.463067] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 client # [ 0.457720] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.462835] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.462520] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 client # [ 0.458716] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker2 # [ 0.463397] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 worker1 # [ 0.463596] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.463426] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 client # [ 0.459655] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker2 # [ 0.464395] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 worker1 # [ 0.463904] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.463683] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 client # [ 0.460617] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker2 # [ 0.465393] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 lb # [ 0.464603] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.465807] iommu: Default domain type: Translated client # [ 0.461599] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker2 # [ 0.466401] ACPI: PCI: Interrupt link LNKE configured for IRQ 10 lb # [ 0.465394] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.466463] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.462348] ACPI: PCI: Interrupt link GSID configured for IRQ 19 lb # [ 0.465685] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 worker2 # [ 0.467392] ACPI: PCI: Interrupt link LNKF configured for IRQ 10 worker1 # [ 0.467157] ACPI: bus type USB registered client # [ 0.462628] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 lb # [ 0.466610] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 worker2 # [ 0.468393] ACPI: PCI: Interrupt link LNKG configured for IRQ 11 worker1 # [ 0.467872] usbcore: registered new interface driver usbfs client # [ 0.463572] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 lb # [ 0.467403] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 worker2 # [ 0.469391] ACPI: PCI: Interrupt link LNKH configured for IRQ 11 worker1 # [ 0.468543] usbcore: registered new interface driver hub client # [ 0.464341] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 lb # [ 0.467686] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.470329] ACPI: PCI: Interrupt link GSIA configured for IRQ 16 worker1 # [ 0.468906] usbcore: registered new device driver usb client # [ 0.464633] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 worker2 # [ 0.471259] ACPI: PCI: Interrupt link GSIB configured for IRQ 17 worker1 # [ 0.470556] NetLabel: Initializing lb # [ 0.469689] iommu: Default domain type: Translated worker2 # [ 0.472087] ACPI: PCI: Interrupt link GSIC configured for IRQ 18 worker1 # [ 0.470893] NetLabel: domain hash size = 128 client # [ 0.466635] iommu: Default domain type: Translated lb # [ 0.470485] iommu: DMA domain TLB invalidation policy: lazy mode worker2 # [ 0.473016] ACPI: PCI: Interrupt link GSID configured for IRQ 19 worker1 # [ 0.471586] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO client # [ 0.467402] iommu: DMA domain TLB invalidation policy: lazy mode lb # [ 0.471663] ACPI: bus type USB registered worker1 # [ 0.471930] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.473305] ACPI: PCI: Interrupt link GSIE configured for IRQ 20 client # [ 0.468617] ACPI: bus type USB registered lb # [ 0.472409] usbcore: registered new interface driver usbfs worker1 # [ 0.472786] PCI: Using ACPI for IRQ routing worker2 # [ 0.474239] ACPI: PCI: Interrupt link GSIF configured for IRQ 21 client # [ 0.469321] usbcore: registered new interface driver usbfs lb # [ 0.472699] usbcore: registered new interface driver hub worker2 # [ 0.475012] ACPI: PCI: Interrupt link GSIG configured for IRQ 22 client # [ 0.469657] usbcore: registered new interface driver hub lb # [ 0.473550] usbcore: registered new device driver usb client # [ 0.470509] usbcore: registered new device driver usb worker2 # [ 0.475308] ACPI: PCI: Interrupt link GSIH configured for IRQ 23 lb # [ 0.475130] NetLabel: Initializing client # [ 0.472061] NetLabel: Initializing lb # [ 0.475672] NetLabel: domain hash size = 128 worker2 # [ 0.477302] iommu: Default domain type: Translated client # [ 0.472618] NetLabel: domain hash size = 128 lb # [ 0.476378] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.478106] iommu: DMA domain TLB invalidation policy: lazy mode client # [ 0.473323] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO lb # [ 0.476728] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.479324] ACPI: bus type USB registered client # [ 0.473686] NetLabel: unlabeled traffic allowed by default lb # [ 0.477645] PCI: Using ACPI for IRQ routing client # [ 0.474577] PCI: Using ACPI for IRQ routing worker2 # [ 0.480060] usbcore: registered new interface driver usbfs worker2 # [ 0.480323] usbcore: registered new interface driver hub worker2 # [ 0.481234] usbcore: registered new device driver usb worker2 # [ 0.483042] NetLabel: Initializing worker2 # [ 0.483294] NetLabel: domain hash size = 128 worker2 # [ 0.484110] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO worker2 # [ 0.485077] NetLabel: unlabeled traffic allowed by default worker2 # [ 0.485308] PCI: Using ACPI for IRQ routing worker1 # [ 0.515623] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.515888] pci 0000:00:01.0: vgaarb: bridge control possible worker1 # [ 0.515888] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.515896] vgaarb: loaded worker1 # [ 0.516619] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.516894] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.521298] pci 0000:00:01.0: vgaarb: setting as boot VGA device worker1 # [ 0.518980] clocksource: Switched to clocksource kvm-clock lb # [ 0.521667] pci 0000:00:01.0: vgaarb: bridge control possible client # [ 0.518380] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.521667] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none worker1 # [ 0.520673] VFS: Disk quotas dquot_6.6.0 client # [ 0.518613] pci 0000:00:01.0: vgaarb: bridge control possible lb # [ 0.521676] vgaarb: loaded lb # [ 0.522386] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.518613] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.518623] vgaarb: loaded lb # [ 0.522671] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.523192] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) client # [ 0.519336] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 worker1 # [ 0.524499] pnp: PnP ACPI init client # [ 0.519619] hpet0: 3 comparators, 64-bit 100.000000 MHz counter worker1 # [ 0.525275] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.526230] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker2 # [ 0.529077] pci 0000:00:01.0: vgaarb: setting as boot VGA device lb # [ 0.525758] clocksource: Switched to clocksource kvm-clock worker1 # [ 0.527705] pnp: PnP ACPI: found 5 devices worker2 # [ 0.529289] pci 0000:00:01.0: vgaarb: bridge control possible worker2 # [ 0.529289] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none client # [ 0.523703] clocksource: Switched to clocksource kvm-clock worker2 # [ 0.529298] vgaarb: loaded lb # [ 0.529257] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.530037] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0 client # [ 0.525411] VFS: Disk quotas dquot_6.6.0 lb # [ 0.529985] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.530293] hpet0: 3 comparators, 64-bit 100.000000 MHz counter lb # [ 0.531305] pnp: PnP ACPI init lb # [ 0.532103] ACPI: IRQ 4 override to edge(!), high(!) client # [ 0.527955] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) lb # [ 0.533099] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved client # [ 0.529356] pnp: PnP ACPI init lb # [ 0.534666] pnp: PnP ACPI: found 5 devices worker1 # [ 0.535261] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns client # [ 0.530148] ACPI: IRQ 4 override to edge(!), high(!) worker1 # [ 0.536679] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.534386] clocksource: Switched to clocksource kvm-clock client # [ 0.531110] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved worker1 # [ 0.537615] NET: Registered PF_INET protocol family client # [ 0.532611] pnp: PnP ACPI: found 5 devices worker1 # [ 0.538761] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.538027] VFS: Disk quotas dquot_6.6.0 worker2 # [ 0.538779] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) worker2 # [ 0.540165] pnp: PnP ACPI init worker2 # [ 0.541000] ACPI: IRQ 4 override to edge(!), high(!) lb # [ 0.542253] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.542004] system 00:04: [mem 0xb0000000-0xbfffffff window] has been reserved lb # [ 0.543717] clocksource: Switched to clocksource acpi_pm lb # [ 0.544675] NET: Registered PF_INET protocol family worker2 # [ 0.543574] pnp: PnP ACPI: found 5 devices client # [ 0.540381] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns lb # [ 0.545839] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) client # [ 0.541823] clocksource: Switched to clocksource acpi_pm client # [ 0.542791] NET: Registered PF_INET protocol family client # [ 0.543967] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker2 # [ 0.551159] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns worker2 # [ 0.552716] clocksource: Switched to clocksource acpi_pm worker2 # [ 0.553733] NET: Registered PF_INET protocol family worker1 # [ 0.555774] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.557295] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker2 # [ 0.554992] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear) worker1 # [ 0.558562] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.559867] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.561109] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.562205] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.563431] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.562620] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) worker1 # [ 0.564483] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.565664] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.564150] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.566592] NET: Registered PF_XDP protocol family lb # [ 0.565469] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.567410] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.561084] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.566796] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.568374] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.562598] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) lb # [ 0.568033] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.569344] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] client # [ 0.563899] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) worker1 # [ 0.570385] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] lb # [ 0.569200] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.565234] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) worker1 # [ 0.571437] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] lb # [ 0.570527] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.566452] TCP: Hash tables configured (established 16384 bind 16384) worker1 # [ 0.572482] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.571671] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) client # [ 0.567569] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) worker1 # [ 0.574140] ACPI: \_SB_.GSIA: Enabled at IRQ 16 lb # [ 0.572903] NET: Registered PF_UNIX/PF_LOCAL protocol family client # [ 0.568825] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.573829] NET: Registered PF_XDP protocol family worker2 # [ 0.571979] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear) lb # [ 0.574626] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] client # [ 0.569854] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker2 # [ 0.573515] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) worker1 # [ 0.576629] ACPI: \_SB_.GSIB: Enabled at IRQ 17 lb # [ 0.575579] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.571035] NET: Registered PF_UNIX/PF_LOCAL protocol family worker2 # [ 0.574807] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear) client # [ 0.571935] NET: Registered PF_XDP protocol family lb # [ 0.576534] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] worker1 # [ 0.578853] ACPI: \_SB_.GSIC: Enabled at IRQ 18 client # [ 0.572742] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] worker2 # [ 0.576125] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear) lb # [ 0.577578] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.573688] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] worker2 # [ 0.577316] TCP: Hash tables configured (established 16384 bind 16384) lb # [ 0.578608] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker1 # [ 0.580743] ACPI: \_SB_.GSID: Enabled at IRQ 19 client # [ 0.574670] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.579663] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.578397] MPTCP token hash table entries: 2048 (order: 4, 49152 bytes, linear) client # [ 0.575722] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] worker1 # [ 0.582410] PCI: CLS 0 bytes, default 64 worker2 # [ 0.579647] UDP hash table entries: 1024 (order: 4, 65536 bytes, linear) lb # [ 0.581338] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.576786] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.580717] UDP-Lite hash table entries: 1024 (order: 4, 65536 bytes, linear) worker1 # [ 0.583306] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns client # [ 0.577832] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] worker2 # [ 0.581915] NET: Registered PF_UNIX/PF_LOCAL protocol family lb # [ 0.583794] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker1 # [ 0.584979] Trying to unpack rootfs image as initramfs... worker2 # [ 0.582890] NET: Registered PF_XDP protocol family client # [ 0.579527] ACPI: \_SB_.GSIA: Enabled at IRQ 16 worker2 # [ 0.583750] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] lb # [ 0.585683] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.584809] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] client # [ 0.582320] ACPI: \_SB_.GSIB: Enabled at IRQ 17 worker2 # [ 0.585840] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] lb # [ 0.587617] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.586935] pci_bus 0000:00: resource 7 [mem 0x60000000-0xafffffff window] client # [ 0.584304] ACPI: \_SB_.GSIC: Enabled at IRQ 18 lb # [ 0.589259] PCI: CLS 0 bytes, default 64 worker2 # [ 0.588079] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window] worker2 # [ 0.589192] pci_bus 0000:00: resource 9 [mem 0x100000000-0x8ffffffff window] lb # [ 0.590083] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns client # [ 0.586371] ACPI: \_SB_.GSID: Enabled at IRQ 19 lb # [ 0.591755] Trying to unpack rootfs image as initramfs... worker2 # [ 0.590945] ACPI: \_SB_.GSIA: Enabled at IRQ 16 client # [ 0.588102] PCI: CLS 0 bytes, default 64 client # [ 0.588963] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns worker2 # [ 0.593425] ACPI: \_SB_.GSIB: Enabled at IRQ 17 client # [ 0.590714] Trying to unpack rootfs image as initramfs... worker2 # [ 0.595583] ACPI: \_SB_.GSIC: Enabled at IRQ 18 worker2 # [ 0.597904] ACPI: \_SB_.GSID: Enabled at IRQ 19 worker2 # [ 0.599675] PCI: CLS 0 bytes, default 64 worker2 # [ 0.600623] Trying to unpack rootfs image as initramfs... worker2 # [ 0.606707] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229840d1729, max_idle_ns: 440795276167 ns worker1 # [ 0.629630] Initialise system trusted keyrings worker1 # [ 0.630450] Key type blacklist registered worker1 # [ 0.633117] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.636147] integrity: Platform Keyring initialized lb # [ 0.635322] Initialise system trusted keyrings worker1 # [ 0.636974] integrity: Machine keyring initialized lb # [ 0.636099] Key type blacklist registered lb # [ 0.638405] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.636062] Initialise system trusted keyrings lb # [ 0.641566] integrity: Platform Keyring initialized client # [ 0.636899] Key type blacklist registered lb # [ 0.642383] integrity: Machine keyring initialized client # [ 0.639697] workingset: timestamp_bits=40 max_order=19 bucket_order=0 client # [ 0.642933] integrity: Platform Keyring initialized client # [ 0.643779] integrity: Machine keyring initialized worker2 # [ 0.648114] Initialise system trusted keyrings worker2 # [ 0.648963] Key type blacklist registered worker2 # [ 0.651675] workingset: timestamp_bits=40 max_order=19 bucket_order=0 worker1 # [ 0.657335] Key type asymmetric registered worker2 # [ 0.654884] integrity: Platform Keyring initialized worker2 # [ 0.655726] integrity: Machine keyring initialized worker1 # [ 0.660966] Asymmetric key parser 'x509' registered worker1 # [ 0.661795] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) lb # [ 0.662784] Key type asymmetric registered worker1 # [ 0.665064] io scheduler mq-deadline registered worker1 # [ 0.665844] io scheduler kyber registered lb # [ 0.667267] Asymmetric key parser 'x509' registered worker1 # [ 0.669510] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.668260] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) client # [ 0.664191] Key type asymmetric registered worker1 # [ 0.670777] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A lb # [ 0.672386] io scheduler mq-deadline registered client # [ 0.667985] Asymmetric key parser 'x509' registered lb # [ 0.673229] io scheduler kyber registered worker1 # [ 0.674728] Linux agpgart interface v0.103 client # [ 0.668829] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.675495] ACPI: bus type drm_connector registered client # [ 0.670204] io scheduler mq-deadline registered lb # [ 0.676987] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled worker2 # [ 0.676079] Key type asymmetric registered worker1 # [ 0.678388] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.679408] usbserial: USB Serial support registered for generic client # [ 0.673649] io scheduler kyber registered client # [ 0.674996] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.680236] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A client # [ 0.676296] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker2 # [ 0.680508] Asymmetric key parser 'x509' registered lb # [ 0.682302] Linux agpgart interface v0.103 worker1 # [ 0.682946] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.681334] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248) worker1 # [ 0.682946] Please enable it if your BIOS has the CPPC option. lb # [ 0.683041] ACPI: bus type drm_connector registered worker2 # [ 0.682649] io scheduler mq-deadline registered worker1 # [ 0.685052] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.683390] io scheduler kyber registered client # [ 0.680929] Linux agpgart interface v0.103 client # [ 0.681718] ACPI: bus type drm_connector registered lb # [ 0.687750] usbcore: registered new interface driver usbserial_generic worker1 # [ 0.689083] drop_monitor: Initializing network drop monitor service worker2 # [ 0.687413] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled lb # [ 0.688786] usbserial: USB Serial support registered for generic worker1 # [ 0.690248] NET: Registered PF_INET6 protocol family client # [ 0.685062] usbcore: registered new interface driver usbserial_generic lb # [ 0.689735] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. lb # [ 0.689735] Please enable it if your BIOS has the CPPC option. client # [ 0.686145] usbserial: USB Serial support registered for generic lb # [ 0.691855] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker2 # [ 0.690682] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A worker1 # [ 0.694361] Segment Routing with IPv6 worker1 # [ 0.695024] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.696070] IPI shorthand broadcast: enabled client # [ 0.689649] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. worker2 # [ 0.694269] Linux agpgart interface v0.103 client # [ 0.689649] Please enable it if your BIOS has the CPPC option. worker2 # [ 0.695049] ACPI: bus type drm_connector registered client # [ 0.691855] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled lb # [ 0.697425] drop_monitor: Initializing network drop monitor service lb # [ 0.698582] NET: Registered PF_INET6 protocol family worker2 # [ 0.697973] usbcore: registered new interface driver usbserial_generic worker2 # [ 0.699069] usbserial: USB Serial support registered for generic client # [ 0.695768] drop_monitor: Initializing network drop monitor service lb # [ 0.701846] Segment Routing with IPv6 client # [ 0.696908] NET: Registered PF_INET6 protocol family lb # [ 0.702507] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.704298] sched_clock: Marking stable (572016001, 131922527)->(778047344, -74108816) worker2 # [ 0.702502] amd_pstate: The CPPC feature is supported but currently disabled by the BIOS. client # [ 0.700185] Segment Routing with IPv6 worker2 # [ 0.702502] Please enable it if your BIOS has the CPPC option. lb # [ 0.705573] IPI shorthand broadcast: enabled worker2 # [ 0.704741] amd_pstate: the _CPC object is not present in SBIOS or ACPI disabled worker1 # [ 0.709146] registered taskstats version 1 client # [ 0.703658] In-situ OAM (IOAM) with IPv6 worker1 # [ 0.710114] Loading compiled-in X.509 certificates client # [ 0.704831] IPI shorthand broadcast: enabled worker2 # [ 0.708635] drop_monitor: Initializing network drop monitor service worker2 # [ 0.709812] NET: Registered PF_INET6 protocol family worker2 # [ 0.713021] Segment Routing with IPv6 lb # [ 0.713903] sched_clock: Marking stable (581013894, 132206476)->(788102198, -74881828) lb # [ 0.717486] registered taskstats version 1 worker2 # [ 0.716512] In-situ OAM (IOAM) with IPv6 lb # [ 0.718493] Loading compiled-in X.509 certificates client # [ 0.713147] sched_clock: Marking stable (582014597, 130623728)->(791025344, -78387019) worker2 # [ 0.717554] IPI shorthand broadcast: enabled client # [ 0.717730] registered taskstats version 1 client # [ 0.718731] Loading compiled-in X.509 certificates worker2 # [ 0.725887] sched_clock: Marking stable (593014895, 132477925)->(799108868, -73616048) worker1 # [ 0.729951] Demotion targets for Node 0: null worker1 # [ 0.732003] Key type .fscrypt registered worker2 # [ 0.730608] registered taskstats version 1 worker1 # [ 0.732671] Key type fscrypt-provisioning registered worker1 # [ 0.733897] ima: No TPM chip found, activating TPM-bypass! worker2 # [ 0.731555] Loading compiled-in X.509 certificates worker1 # [ 0.736957] ima: Allocated hash algorithm: sha1 worker1 # [ 0.737735] ima: No architecture policies found lb # [ 0.738440] Demotion targets for Node 0: null worker1 # [ 0.741957] PM: Magic number: 2:213:133 lb # [ 0.741284] Key type .fscrypt registered worker1 # [ 0.742674] acpi device:08: hash matches lb # [ 0.741952] Key type fscrypt-provisioning registered client # [ 0.738165] Demotion targets for Node 0: null lb # [ 0.743018] ima: No TPM chip found, activating TPM-bypass! worker1 # [ 0.746273] RAS: Correctable Errors collector initialized. lb # [ 0.745241] ima: Allocated hash algorithm: sha1 lb # [ 0.746036] ima: No architecture policies found client # [ 0.741694] Key type .fscrypt registered client # [ 0.742392] Key type fscrypt-provisioning registered lb # [ 0.748234] PM: Magic number: 2:213:133 client # [ 0.743368] ima: No TPM chip found, activating TPM-bypass! lb # [ 0.749003] acpi device:08: hash matches client # [ 0.745665] ima: Allocated hash algorithm: sha1 worker2 # [ 0.749675] Demotion targets for Node 0: null client # [ 0.746485] ima: No architecture policies found worker2 # [ 0.751548] Key type .fscrypt registered lb # [ 0.752754] RAS: Correctable Errors collector initialized. client # [ 0.748652] PM: Magic number: 2:213:133 worker2 # [ 0.752199] Key type fscrypt-provisioning registered worker1 # [ 0.754998] clk: Disabling unused clocks client # [ 0.749372] acpi device:08: hash matches worker1 # [ 0.755664] PM: genpd: Disabling unused power domains worker2 # [ 0.753171] ima: No TPM chip found, activating TPM-bypass! client # [ 0.752931] RAS: Correctable Errors collector initialized. worker2 # [ 0.757519] ima: Allocated hash algorithm: sha1 worker2 # [ 0.758319] ima: No architecture policies found lb # [ 0.761594] clk: Disabling unused clocks worker2 # [ 0.760506] PM: Magic number: 2:213:133 worker2 # [ 0.761207] acpi device:08: hash matches worker2 # [ 0.764863] RAS: Correctable Errors collector initialized. lb # [ 0.766250] PM: genpd: Disabling unused power domains client # [ 0.763667] clk: Disabling unused clocks client # [ 0.764380] PM: genpd: Disabling unused power domains worker2 # [ 0.773619] clk: Disabling unused clocks worker2 # [ 0.774328] PM: genpd: Disabling unused power domains worker1 # [ 0.910307] Freeing initrd memory: 28368K worker1 # [ 0.913658] Freeing unused decrypted memory: 2028K worker1 # [ 0.918234] Freeing unused kernel image (initmem) memory: 6720K worker1 # [ 0.919300] Write protecting the kernel read-only data: 32768k worker1 # [ 0.920553] Freeing unused kernel image (text/rodata gap) memory: 240K worker1 # [ 0.922041] Freeing unused kernel image (rodata/data gap) memory: 620K client # [ 0.918078] Freeing initrd memory: 28368K client # [ 0.921362] Freeing unused decrypted memory: 2028K worker2 # [ 0.927955] Freeing initrd memory: 28372K client # [ 0.925859] Freeing unused kernel image (initmem) memory: 6720K client # [ 0.926935] Write protecting the kernel read-only data: 32768k worker2 # [ 0.931264] Freeing unused decrypted memory: 2028K client # [ 0.928257] Freeing unused kernel image (text/rodata gap) memory: 240K client # [ 0.929739] Freeing unused kernel image (rodata/data gap) memory: 620K worker2 # [ 0.935837] Freeing unused kernel image (initmem) memory: 6720K worker2 # [ 0.936946] Write protecting the kernel read-only data: 32768k worker2 # [ 0.938259] Freeing unused kernel image (text/rodata gap) memory: 240K worker2 # [ 0.939787] Freeing unused kernel image (rodata/data gap) memory: 620K lb # [ 0.941986] Freeing initrd memory: 28368K lb # [ 0.945542] Freeing unused decrypted memory: 2028K lb # [ 0.950460] Freeing unused kernel image (initmem) memory: 6720K lb # [ 0.951586] Write protecting the kernel read-only data: 32768k lb # [ 0.952961] Freeing unused kernel image (text/rodata gap) memory: 240K lb # [ 0.954565] Freeing unused kernel image (rodata/data gap) memory: 620K worker1 # [ 0.972232] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker1 # [ 0.973274] Run /init as init process worker1 # [ 0.983455] autofs4: module verification failed: signature and/or required key missing - tainting kernel worker1 # [ 0.985966] systemd[1]: Inserted module 'autofs4' client # [ 0.980025] x86/mm: Checked W+X mappings: passed, no W+X pages found. client # [ 0.981112] Run /init as init process worker2 # [ 0.990132] x86/mm: Checked W+X mappings: passed, no W+X pages found. worker2 # [ 0.991232] Run /init as init process worker1 # [ 0.996221] NET: Registered PF_VSOCK protocol family client # [ 0.990940] autofs4: module verification failed: signature and/or required key missing - tainting kernel client # [ 0.993479] systemd[1]: Inserted module 'autofs4' worker2 # [ 1.001322] autofs4: module verification failed: signature and/or required key missing - tainting kernel worker2 # [ 1.003940] systemd[1]: Inserted module 'autofs4' lb # [ 1.004957] x86/mm: Checked W+X mappings: passed, no W+X pages found. lb # [ 1.006067] Run /init as init process client # [ 1.003785] NET: Registered PF_VSOCK protocol family worker1 # [ 1.012052] fuse: init (API version 7.45) worker2 # [ 1.014240] NET: Registered PF_VSOCK protocol family worker1 # [ 1.019140] ACPI: \_SB_.GSIG: Enabled at IRQ 22 lb # [ 1.017086] autofs4: module verification failed: signature and/or required key missing - tainting kernel lb # [ 1.019804] systemd[1]: Inserted module 'autofs4' worker1 # [ 1.021567] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.024393] ACPI: \_SB_.GSIE: Enabled at IRQ 20 client # [ 1.019471] fuse: init (API version 7.45) worker1 # [ 1.026288] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker1 # [ 1.031335] virtiofs virtio5: discovered new tag: nix-store lb # [ 1.030366] NET: Registered PF_VSOCK protocol family worker2 # [ 1.029984] fuse: init (API version 7.45) client # [ 1.026533] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.032814] virtiofs virtio5: virtio_fs_setup_dax: No cache capability client # [ 1.029310] ACPI: \_SB_.GSIH: Enabled at IRQ 23 client # [ 1.033073] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.039307] virtiofs virtio6: discovered new tag: shared worker2 # [ 1.037029] ACPI: \_SB_.GSIG: Enabled at IRQ 22 worker1 # [ 1.040726] virtiofs virtio6: virtio_fs_setup_dax: No cache capability client # [ 1.035240] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.039631] ACPI: \_SB_.GSIH: Enabled at IRQ 23 worker1 # [ 1.043809] virtiofs virtio7: discovered new tag: xchg worker2 # [ 1.042615] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker1 # [ 1.045226] virtiofs virtio7: virtio_fs_setup_dax: No cache capability client # [ 1.040701] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.044526] ACPI: \_SB_.GSIF: Enabled at IRQ 21 lb # [ 1.046348] fuse: init (API version 7.45) client # [ 1.042262] virtiofs virtio5: virtio_fs_setup_dax: No cache capability worker2 # [ 1.050168] virtiofs virtio5: discovered new tag: nix-store worker2 # [ 1.051829] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.053670] ACPI: \_SB_.GSIG: Enabled at IRQ 22 client # [ 1.049416] virtiofs virtio6: discovered new tag: shared client # [ 1.050966] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.056623] ACPI: \_SB_.GSIH: Enabled at IRQ 23 client # [ 1.054489] virtiofs virtio7: discovered new tag: xchg lb # [ 1.060183] ACPI: \_SB_.GSIE: Enabled at IRQ 20 worker2 # [ 1.059021] virtiofs virtio6: discovered new tag: shared client # [ 1.056027] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker2 # [ 1.060745] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.062503] ACPI: \_SB_.GSIF: Enabled at IRQ 21 worker2 # [ 1.063917] virtiofs virtio7: discovered new tag: xchg worker1 # [ 1.067672] systemd[1]: Successfully made /usr/ read-only. worker2 # [ 1.065316] virtiofs virtio7: virtio_fs_setup_dax: No cache capability lb # [ 1.068336] virtiofs virtio5: discovered new tag: nix-store lb # [ 1.069986] virtiofs virtio5: virtio_fs_setup_dax: No cache capability lb # [ 1.077364] virtiofs virtio6: discovered new tag: shared lb # [ 1.079107] virtiofs virtio6: virtio_fs_setup_dax: No cache capability lb # [ 1.082920] virtiofs virtio7: discovered new tag: xchg client # [ 1.079331] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.084489] virtiofs virtio7: virtio_fs_setup_dax: No cache capability worker2 # [ 1.090282] systemd[1]: Successfully made /usr/ read-only. lb # [ 1.147164] systemd[1]: Successfully made /usr/ read-only. worker1 # [ 1.403202] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 1.407852] systemd[1]: Detected virtualization kvm. worker1 # [ 1.408678] systemd[1]: Detected architecture x86-64. worker1 # [ 1.409555] systemd[1]: Running in initrd. worker1 # [ 1.410579] systemd[1]: Initializing machine ID from random generator. worker1 # [ 1.411741] systemd[1]: Hostname set to . client # [ 1.414945] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 1.419891] systemd[1]: Detected virtualization kvm. client # [ 1.420751] systemd[1]: Detected architecture x86-64. client # [ 1.421616] systemd[1]: Running in initrd. client # [ 1.422767] systemd[1]: Initializing machine ID from random generator. client # [ 1.423944] systemd[1]: Hostname set to . worker2 # [ 1.425968] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 1.430565] systemd[1]: Detected virtualization kvm. worker2 # [ 1.431359] systemd[1]: Detected architecture x86-64. worker2 # [ 1.432190] systemd[1]: Running in initrd. worker2 # [ 1.433219] systemd[1]: Initializing machine ID from random generator. worker2 # [ 1.434356] systemd[1]: Hostname set to . worker1 # [ 1.483056] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.483894] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) lb # [ 1.495408] systemd[1]: Detected virtualization kvm. lb # [ 1.497473] systemd[1]: Detected architecture x86-64. lb # [ 1.499558] systemd[1]: Running in initrd. client # [ 1.495418] systemd[1]: bpf-restrict-fs: LSM BPF program attached lb # [ 1.501917] systemd[1]: Initializing machine ID from random generator. lb # [ 1.504772] systemd[1]: Hostname set to . worker2 # [ 1.505466] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 1.518402] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.522282] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.523417] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.524777] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.525839] systemd[1]: Reached target Path Units. client # [ 1.531229] systemd[1]: Queued start job for default target Initrd Default Target. worker1 # [ 1.526687] systemd[1]: Reached target Slice Units. worker1 # [ 1.538630] systemd[1]: Reached target Swaps. worker1 # [ 1.539432] systemd[1]: Reached target Timer Units. worker1 # [ 1.540393] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 1.534941] systemd[1]: Created slice Slice /system/modprobe. worker1 # [ 1.541591] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.536100] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 1.542717] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.543654] systemd[1]: Listening on udev Kernel Socket. client # [ 1.537506] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker2 # [ 1.541365] systemd[1]: Queued start job for default target Initrd Default Target. client # [ 1.538581] systemd[1]: Reached target Path Units. worker1 # [ 1.544659] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 1.545577] systemd[1]: Reached target Socket Units. worker1 # [ 1.547344] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.545794] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.547000] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.548434] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.551021] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.549516] systemd[1]: Reached target Path Units. client # [ 1.539410] systemd[1]: Reached target Slice Units. client # [ 1.551507] systemd[1]: Reached target Swaps. client # [ 1.552328] systemd[1]: Reached target Timer Units. client # [ 1.553326] systemd[1]: Listening on D-Bus System Message Bus Socket. worker1 # [ 1.560015] systemd[1]: Starting Journal Service... client # [ 1.554562] systemd[1]: Listening on Journal Socket (/dev/log). client # [ 1.555776] systemd[1]: Listening on Journal Sockets. client # [ 1.556731] systemd[1]: Listening on udev Kernel Socket. client # [ 1.557793] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 1.550363] systemd[1]: Reached target Slice Units. client # [ 1.558750] systemd[1]: Reached target Socket Units. worker2 # [ 1.562683] systemd[1]: Reached target Swaps. worker2 # [ 1.563451] systemd[1]: Reached target Timer Units. client # [ 1.560507] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 1.564522] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.565730] systemd[1]: Listening on Journal Socket (/dev/log). worker2 # [ 1.566942] systemd[1]: Listening on Journal Sockets. worker1 # [ 1.569675] systemd[1]: Starting Load Kernel Modules... worker2 # [ 1.567959] systemd[1]: Listening on udev Kernel Socket. client # [ 1.564480] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.569035] systemd[1]: Listening on udev Varlink Socket. worker2 # [ 1.570048] systemd[1]: Reached target Socket Units. worker2 # [ 1.571938] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.573984] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 1.571263] systemd[1]: Starting Journal Service... worker2 # [ 1.577584] systemd[1]: Starting Load Kernel Module configfs... worker1 # [ 1.580139] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.584571] systemd[1]: Starting Journal Service... client # [ 1.582349] systemd[1]: Starting Load Kernel Modules... worker1 # [ 1.592330] systemd[1]: Finished Create List of Static Device Nodes. client # [ 1.586516] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.596574] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 1.595733] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 1.595595] systemd[1]: Starting Load Kernel Modules... client # [ 1.592303] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 1.599289] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 1.604339] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.607638] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.604728] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 1.611393] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config worker1 # [ 1.614086] systemd-journald[65]: Collecting audit messages is disabled. client # [ 1.610563] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.622067] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.616993] systemd[1]: Finished Load Kernel Module configfs. worker2 # [ 1.622021] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.625214] systemd[1]: modprobe@configfs.service: Deactivated successfully. client # [ 1.622069] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.626672] systemd-journald[65]: Collecting audit messages is disabled. worker1 # [ 1.632490] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.632686] systemd[1]: Queued start job for default target Initrd Default Target. lb # [ 1.636546] systemd[1]: Created slice Slice /system/modprobe. worker2 # [ 1.635552] systemd[1]: Finished Load Kernel Module configfs. lb # [ 1.637735] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 1.637431] systemd-journald[65]: Collecting audit messages is disabled. lb # [ 1.639170] systemd[1]: Expecting device /dev/disk/by-label/nixos... worker1 # [ 1.640009] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.640249] systemd[1]: Reached target Path Units. client # [ 1.635734] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 1.639972] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config lb # [ 1.641115] systemd[1]: Reached target Slice Units. lb # [ 1.653224] systemd[1]: Reached target Swaps. client # [ 1.647923] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. lb # [ 1.654004] systemd[1]: Reached target Timer Units. lb # [ 1.655007] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 1.653571] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... lb # [ 1.656286] systemd[1]: Listening on Journal Socket (/dev/log). lb # [ 1.657472] systemd[1]: Listening on Journal Sockets. lb # [ 1.658449] systemd[1]: Listening on udev Kernel Socket. lb # [ 1.659505] systemd[1]: Listening on udev Varlink Socket. lb # [ 1.660490] systemd[1]: Reached target Socket Units. worker2 # [ 1.658414] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.655670] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev lb # [ 1.662295] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 1.664497] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.666118] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 1.668660] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev worker1 # [ 1.674142] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 1.676770] systemd[1]: Starting Journal Service... client # [ 1.675218] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 1.684502] systemd[1]: Finished Load Kernel Modules. lb # [ 1.688316] systemd[1]: Starting Load Kernel Modules... client # [ 1.684823] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 1.692318] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.691328] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 1.694598] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 1.696461] systemd[1]: Starting Coldplug All udev Devices... client # [ 1.696720] systemd[1]: Finished Load Kernel Modules. worker2 # [ 1.703706] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.703837] systemd[1]: Starting Apply Kernel Variables... worker1 # [ 1.711186] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.712348] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 1.714584] systemd[1]: Finished Load Kernel Modules. worker1 # [ 1.717143] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.717902] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 1.722108] systemd[1]: Reached target Local File Systems. worker2 # [ 1.724205] systemd[1]: Starting Apply Kernel Variables... lb # [ 1.726634] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 1.729151] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.725721] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.731543] systemd-journald[65]: Collecting audit messages is disabled. lb # [ 1.733175] systemd[1]: Kernel Configuration File System skipped, unmet condition check ConditionPathExists=/sys/kernel/config client # [ 1.729841] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 1.603252] systemd-modules-load[66]: Inserted module 'dm_mod' worker1 # [ 1.605269] systemd-modules-load[66]: Inserted module 'virtio_balloon' worker1 # [ 1.607302] systemd-modules-load[66]: Inserted module 'virtio_gpu' client # [ 1.734716] systemd[1]: Reached target Local File Systems. worker1 # [ 1.742245] systemd[1]: Started Journal Service. lb # [ 1.744316] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 1.741848] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 1.745575] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 1.617196] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.749714] systemd[1]: Reached target Preparation for Local File Systems. client # [ 1.617426] systemd-modules-load[66]: Inserted module 'dm_mod'[ 1.750919] systemd[1]: Started Journal Service. client # client # [ 1.621286] systemd-modules-load[66]: Inserted module 'virtio_balloon' worker2 # [ 1.755577] systemd[1]: Reached target Local File Systems. lb # [ 1.756229] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. client # [ 1.622282] systemd-modules-load[66]: Inserted module 'virtio_gpu' worker1 # [ 1.629121] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.762225] systemd[1]: Starting Rule-based Manager for Device Events and Files... lb # [ 1.763403] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev client # [ 1.630236] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 1.631699] systemd-modules-load[66]: Inserted module 'dm_mod' worker2 # [ 1.633882] systemd-modules-load[66]: Inserted module 'virtio_balloon' worker2 # [ 1.634946] systemd-modules-load[66]: Inserted module 'virtio_gpu' worker2 # [ 1.773804] systemd[1]: Started Journal Service. client # [ 1.642660] systemd[1]: Starting Create System Files and Directories... worker2 # [ 1.648119] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 1.654408] systemd[1]: Finished Create System Files and Directories. lb # [ 1.790815] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 1.659548] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.663939] systemd-udevd[73]: Using default interface naming scheme 'v261'. lb # [ 1.799430] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 1.669580] systemd[1]: Finished Create System Files and Directories. lb # [ 1.809761] systemd[1]: Finished Load Kernel Modules. client # [ 1.677260] systemd-udevd[74]: Using default interface naming scheme 'v261'. worker1 # [ 1.687416] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 1.687418] systemd[1]: Finished Create System Files and Directories. lb # [ 1.822352] systemd[1]: Starting Apply Kernel Variables... worker2 # [ 1.696445] systemd-udevd[73]: Using default interface naming scheme 'v261'. client # [ 1.701067] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.848825] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 1.719602] systemd-modules-load[66]: Inserted module 'dm_mod'[ 1.854556] systemd[1]: Started Journal Service. worker2 # [ 1.720924] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # lb # [ 1.724312] systemd-modules-load[66]: Inserted module 'virtio_balloon' lb # [ 1.725413] systemd-modules-load[66]: Inserted module 'virtio_gpu' lb # [ 1.731174] systemd[1]: Finished Apply Kernel Variables. lb # [ 1.736131] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 1.738084] systemd[1]: Reached target Local File Systems. worker1 # [ 1.741695] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.741066] systemd[1]: Starting Create System Files and Directories... worker1 # [ 1.744638] systemd[1]: Reached target System Initialization. worker1 # [ 1.745530] systemd[1]: Reached target Basic System. lb # [ 1.746068] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 1.756614] systemd[1]: Finished Coldplug All udev Devices. client # [ 1.759577] systemd[1]: Reached target System Initialization. client # [ 1.760486] systemd[1]: Reached target Basic System. lb # [ 1.774167] systemd[1]: Finished Create System Files and Directories. worker2 # [ 1.775756] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 1.778656] systemd[1]: Reached target System Initialization. worker2 # [ 1.779628] systemd[1]: Reached target Basic System. lb # [ 1.797677] systemd-udevd[80]: Using default interface naming scheme 'v261'. lb # [ 1.821615] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 1.865078] systemd[1]: Finished Coldplug All udev Devices. lb # [ 1.865958] systemd[1]: Reached target System Initialization. lb # [ 1.867396] systemd[1]: Reached target Basic System. worker1 # [ 2.054704] virtio_blk virtio2: 1/0/0 default/read/poll queues worker1 # [ 2.063906] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.072953] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.074693] serio: i8042 KBD port at 0x60,0x64 irq 1 client # [ 2.069379] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.081414] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) worker1 # [ 2.088830] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.089580] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.091340] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdc000 worker1 # [ 2.093058] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.097954] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker1 # [ 2.098820] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 client # [ 2.093180] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.100339] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.103051] usb usb1: Product: EHCI Host Controller worker1 # [ 2.103726] usb usb1: Manufacturer: Linux 6.18.59 ehci_hcd worker2 # [ 2.101133] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.104600] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.099362] ehci-pci 0000:00:1d.7: EHCI Host Controller worker1 # [ 2.106537] hub 1-0:1.0: USB hub found client # [ 2.100172] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker2 # [ 2.105136] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.107964] hub 1-0:1.0: 6 ports detected client # [ 2.101964] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdc000 worker2 # [ 2.106715] virtio_blk virtio2: 1/0/0 default/read/poll queues client # [ 2.104498] serio: i8042 KBD port at 0x60,0x64 irq 1 worker1 # [ 2.111225] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.108661] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.112691] virtio_blk virtio2: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) client # [ 2.109510] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.114159] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.110828] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 client # [ 2.112317] usb usb1: Product: EHCI Host Controller client # [ 2.113491] usb usb1: Manufacturer: Linux 6.18.59 ehci_hcd client # [ 2.114376] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.115137] serio: i8042 AUX port at 0x60,0x64 irq 12 client # [ 2.116024] hub 1-0:1.0: USB hub found worker1 # [ 2.122737] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.117661] hub 1-0:1.0: 6 ports detected worker2 # [ 2.122152] ehci-pci 0000:00:1d.7: EHCI Host Controller worker2 # [ 2.122938] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.126258] uhci_hcd 0000:00:1d.0: detected 2 ports worker1 # [ 2.127071] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker2 # [ 2.124693] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdc000 client # [ 2.125355] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.132513] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 worker2 # [ 2.133793] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 worker2 # [ 2.134925] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.138517] usb usb1: Product: EHCI Host Controller worker2 # [ 2.139211] usb usb1: Manufacturer: Linux 6.18.59 ehci_hcd worker1 # [ 2.144159] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.142217] usb usb1: SerialNumber: 0000:00:1d.7 client # [ 2.139154] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 worker1 # [ 2.145300] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.143579] hub 1-0:1.0: USB hub found worker2 # [ 2.144775] hub 1-0:1.0: 6 ports detected worker2 # [ 2.149830] uhci_hcd 0000:00:1d.0: UHCI Host Controller worker2 # [ 2.150608] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.147764] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.148511] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.032582] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.163783] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.159786] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.169660] usb usb2: Product: UHCI Host Controller worker2 # [ 2.169575] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 client # [ 2.170207] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.045796] (udev-worker)[86]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.178929] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.180067] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.186002] usb usb2: Manufacturer: Linux 6.18.59 uhci_hcd worker1 # [ 2.186847] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.182130] SCSI subsystem initialized client # [ 2.184034] usb usb2: Product: UHCI Host Controller worker1 # [ 2.191462] SCSI subsystem initialized client # [ 2.055626] systemd[1]: Starting Virtual Console Setup... client # [ 2.187728] usb usb2: Manufacturer: Linux 6.18.59 uhci_hcd client # [ 2.188460] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.061127] (udev-worker)[89]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.065948] systemd-vconsole-setup[97]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.198077] virtio_blk virtio2: 1/0/0 default/read/poll queues worker2 # [ 2.065736] systemd[1]: Starting Virtual Console Setup... worker1 # [ 2.068924] (udev-worker)[93]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 2.201092] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 worker1 # [ 2.071417] (udev-worker)[93]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.073067] systemd[1]: Finished Virtual Console Setup. client # [ 2.198613] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker2 # [ 2.202933] usb usb2: Product: UHCI Host Controller lb # [ 2.208082] serio: i8042 KBD port at 0x60,0x64 irq 1 worker2 # [ 2.208848] usb usb2: Manufacturer: Linux 6.18.59 uhci_hcd worker1 # [ 2.212307] hub 2-0:1.0: USB hub found worker2 # [ 2.210328] SCSI subsystem initialized worker1 # [ 2.214455] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 lb # [ 2.214155] serio: i8042 AUX port at 0x60,0x64 irq 12 worker1 # [ 2.216111] hub 2-0:1.0: 2 ports detected lb # [ 2.216845] virtio_blk virtio2: [vda] 4194304 512-byte logical blocks (2.15 GB/2.00 GiB) client # [ 2.085623] (udev-worker)[88]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 2.088387] (udev-worker)[84]: Network interface NamePolicy= disabled on kernel command line. client # [ 2.088165] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. lb # [ 2.226692] ehci-pci 0000:00:1d.7: EHCI Host Controller lb # [ 2.227428] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1 worker1 # [ 2.229304] uhci_hcd 0000:00:1d.1: UHCI Host Controller lb # [ 2.229161] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfebdc000 worker2 # [ 2.228110] usb usb2: SerialNumber: 0000:00:1d.0 client # [ 2.095360] systemd-vconsole-setup[98]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 2.229407] hub 2-0:1.0: USB hub found worker2 # [ 2.101218] systemd-vconsole-setup[97]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 2.236249] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00 client # [ 2.234067] hub 2-0:1.0: 2 ports detected worker2 # [ 2.105432] systemd[1]: Finished Virtual Console Setup. lb # [ 2.238947] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.18 lb # [ 2.240071] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.109991] systemd[1]: Found device /dev/disk/by-label/nixos. worker1 # [ 2.110826] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.106862] (udev-worker)[88]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.111777] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.108880] (udev-worker)[88]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 2.244679] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.243960] usb usb1: Product: EHCI Host Controller worker1 # [ 2.245714] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.109733] systemd[1]: Finished Virtual Console Setup. lb # [ 2.246224] usb usb1: Manufacturer: Linux 6.18.59 ehci_hcd lb # [ 2.246999] usb usb1: SerialNumber: 0000:00:1d.7 worker2 # [ 2.247037] hub 2-0:1.0: USB hub found lb # [ 2.248361] hub 1-0:1.0: USB hub found lb # [ 2.249872] hub 1-0:1.0: 6 ports detected worker1 # [ 2.251799] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.249715] hub 2-0:1.0: 2 ports detected worker1 # [ 2.253139] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.254325] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.253764] uhci_hcd 0000:00:1d.0: UHCI Host Controller client # [ 2.250280] uhci_hcd 0000:00:1d.1: UHCI Host Controller client # [ 2.251061] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 worker2 # [ 2.255671] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.262951] usb usb3: Product: UHCI Host Controller worker1 # [ 2.263626] usb usb3: Manufacturer: Linux 6.18.59 uhci_hcd client # [ 2.128136] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.263799] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2 client # [ 2.129714] systemd[1]: Reached target Initrd Root Device. client # [ 2.261173] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.261969] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker1 # [ 2.268442] usb usb3: SerialNumber: 0000:00:1d.1 worker1 # [ 2.269842] hub 3-0:1.0: USB hub found client # [ 2.133299] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.271068] hub 3-0:1.0: 2 ports detected worker2 # [ 2.269107] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.269860] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 lb # [ 2.273647] uhci_hcd 0000:00:1d.0: detected 2 ports client # [ 2.269045] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.274563] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c180 worker1 # [ 2.276360] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.277126] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.142834] systemd[1]: Found device /dev/disk/by-label/nixos. client # [ 2.271953] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.145216] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.146664] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker1 # [ 2.283101] uhci_hcd 0000:00:1d.2: detected 2 ports worker1 # [ 2.283860] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.278650] usb usb3: Product: UHCI Host Controller client # [ 2.279380] usb usb3: Manufacturer: Linux 6.18.59 uhci_hcd worker1 # [ 2.153753] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks worker2 # [ 2.284205] uhci_hcd 0000:00:1d.1: detected 2 ports client # [ 2.283969] usb usb3: SerialNumber: 0000:00:1d.1 worker2 # [ 2.287602] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker1 # [ 2.290878] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 client # [ 2.285567] hub 3-0:1.0: USB hub found client # [ 2.286809] hub 3-0:1.0: 2 ports detected lb # [ 2.291349] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.290549] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker1 # [ 2.161327] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.292468] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.291682] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.294270] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.297086] usb usb4: Product: UHCI Host Controller client # [ 2.291747] uhci_hcd 0000:00:1d.2: UHCI Host Controller worker1 # [ 2.297823] usb usb4: Manufacturer: Linux 6.18.59 uhci_hcd client # [ 2.292454] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker1 # [ 2.302078] usb usb4: SerialNumber: 0000:00:1d.2 worker2 # [ 2.301749] usb usb3: Product: UHCI Host Controller worker2 # [ 2.302449] usb usb3: Manufacturer: Linux 6.18.59 uhci_hcd client # [ 2.299229] uhci_hcd 0000:00:1d.2: detected 2 ports worker2 # [ 2.303412] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.172591] (udev-worker)[89]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.304792] hub 3-0:1.0: USB hub found worker1 # [ 2.307249] hub 4-0:1.0: USB hub found client # [ 2.170293] systemd-fsck[105]: nixos: clean, 12/65536 files, 13019/262144 blocks worker1 # [ 2.308842] hub 4-0:1.0: 2 ports detected client # [ 2.302760] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 worker2 # [ 2.306556] hub 3-0:1.0: 2 ports detected lb # [ 2.311664] usb usb2: Product: UHCI Host Controller client # [ 2.177307] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.308947] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.315168] SCSI subsystem initialized client # [ 2.310113] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.315648] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.185292] systemd[1]: Starting Virtual Console Setup... worker2 # [ 2.316368] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 worker2 # [ 2.185516] systemd-fsck[104]: nixos: clean, 12/65536 files, 13019/262144 blocks client # [ 2.316687] usb usb4: Product: UHCI Host Controller client # [ 2.317416] usb usb4: Manufacturer: Linux 6.18.59 uhci_hcd lb # [ 2.324247] usb usb2: Manufacturer: Linux 6.18.59 uhci_hcd worker2 # [ 2.190433] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. client # [ 2.320265] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.325018] usb usb2: SerialNumber: 0000:00:1d.0 worker2 # [ 2.324638] uhci_hcd 0000:00:1d.2: detected 2 ports client # [ 2.322043] hub 4-0:1.0: USB hub found worker2 # [ 2.325387] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 client # [ 2.323963] hub 4-0:1.0: 2 ports detected worker2 # [ 2.328666] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.330523] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker1 # [ 2.334314] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker2 # [ 2.332540] usb usb4: Product: UHCI Host Controller worker1 # [ 2.335422] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) worker2 # [ 2.333224] usb usb4: Manufacturer: Linux 6.18.59 uhci_hcd worker2 # [ 2.337272] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.206530] (udev-worker)[91]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 2.342798] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.209646] (udev-worker)[91]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 2.341192] hub 4-0:1.0: USB hub found worker1 # [ 2.345948] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.339978] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode worker1 # [ 2.347182] scsi host0: ahci worker2 # [ 2.344654] hub 4-0:1.0: 2 ports detected worker1 # [ 2.348995] scsi host1: ahci lb # [ 2.348451] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0 worker1 # [ 2.350968] scsi host2: ahci worker1 # [ 2.352544] scsi host3: ahci lb # [ 2.352589] hub 2-0:1.0: USB hub found worker1 # [ 2.353866] scsi host4: ahci worker1 # [ 2.355734] scsi host5: ahci client # [ 2.349547] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) client # [ 2.350977] ahci 0000:00:1f.2: flags: 64bit ncq only worker1 # [ 2.356668] ata1: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd100 irq 49 lpm-pol 1 worker1 # [ 2.358418] ata2: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd180 irq 49 lpm-pol 1 lb # [ 2.225097] systemd-vconsole-setup[97]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 2.359606] ata3: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd200 irq 49 lpm-pol 1 worker1 # [ 2.360732] ata4: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd280 irq 49 lpm-pol 1 worker1 # [ 2.361859] ata5: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd300 irq 49 lpm-pol 1 lb # [ 2.229360] systemd[1]: Finished Virtual Console Setup. worker1 # [ 2.362997] ata6: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd380 irq 49 lpm-pol 1 lb # [ 2.363485] hub 2-0:1.0: 2 ports detected client # [ 2.360771] scsi host0: ahci client # [ 2.361654] usb 1-1: new high-speed USB device number 2 using ehci-pci client # [ 2.364831] scsi host1: ahci worker2 # [ 2.369040] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode client # [ 2.366764] scsi host2: ahci client # [ 2.368727] scsi host3: ahci client # [ 2.370415] scsi host4: ahci client # [ 2.372169] scsi host5: ahci client # [ 2.373212] ata1: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd100 irq 49 lpm-pol 1 lb # [ 2.378726] uhci_hcd 0000:00:1d.1: UHCI Host Controller worker2 # [ 2.377898] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.379468] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3 client # [ 2.374919] ata2: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd180 irq 49 lpm-pol 1 worker2 # [ 2.379315] ahci 0000:00:1f.2: flags: 64bit ncq only client # [ 2.376146] ata3: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd200 irq 49 lpm-pol 1 client # [ 2.377313] ata4: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd280 irq 49 lpm-pol 1 worker2 # [ 2.382589] scsi host0: ahci client # [ 2.378465] ata5: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd300 irq 49 lpm-pol 1 client # [ 2.379650] ata6: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd380 irq 49 lpm-pol 1 worker2 # [ 2.384404] scsi host1: ahci worker2 # [ 2.385511] usb 1-1: new high-speed USB device number 2 using ehci-pci worker2 # [ 2.386626] scsi host2: ahci lb # [ 2.256039] systemd[1]: Found device /dev/disk/by-label/nixos. lb # [ 2.256905] systemd[1]: Reached target Initrd Root Device. worker2 # [ 2.388911] scsi host3: ahci lb # [ 2.258055] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... worker2 # [ 2.390581] scsi host4: ahci lb # [ 2.392326] uhci_hcd 0000:00:1d.1: detected 2 ports lb # [ 2.393102] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c1a0 worker2 # [ 2.392121] scsi host5: ahci worker2 # [ 2.393219] ata1: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd100 irq 49 lpm-pol 1 worker2 # [ 2.395030] ata2: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd180 irq 49 lpm-pol 1 worker2 # [ 2.396231] ata3: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd200 irq 49 lpm-pol 1 lb # [ 2.398428] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 worker2 # [ 2.397364] ata4: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd280 irq 49 lpm-pol 1 lb # [ 2.399664] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 worker2 # [ 2.398515] ata5: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd300 irq 49 lpm-pol 1 worker2 # [ 2.399698] ata6: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd380 irq 49 lpm-pol 1 lb # [ 2.406234] usb usb3: Product: UHCI Host Controller lb # [ 2.406933] usb usb3: Manufacturer: Linux 6.18.59 uhci_hcd lb # [ 2.413237] usb usb3: SerialNumber: 0000:00:1d.1 lb # [ 2.414801] hub 3-0:1.0: USB hub found lb # [ 2.416548] hub 3-0:1.0: 2 ports detected lb # [ 2.422611] uhci_hcd 0000:00:1d.2: UHCI Host Controller lb # [ 2.425976] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4 lb # [ 2.428377] uhci_hcd 0000:00:1d.2: detected 2 ports lb # [ 2.429142] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c1c0 lb # [ 2.298543] systemd-fsck[104]: nixos: clean, 12/131072 files, 26284/524288 blocks lb # [ 2.434311] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.18 lb # [ 2.306168] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. lb # [ 2.440225] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 lb # [ 2.443322] usb usb4: Product: UHCI Host Controller lb # [ 2.444008] usb usb4: Manufacturer: Linux 6.18.59 uhci_hcd lb # [ 2.445272] usb usb4: SerialNumber: 0000:00:1d.2 lb # [ 2.451690] hub 4-0:1.0: USB hub found lb # [ 2.455318] hub 4-0:1.0: 2 ports detected worker1 # [ 2.476559] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.479394] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker1 # [ 2.482551] usb 1-1: Product: QEMU USB Tablet worker1 # [ 2.484338] usb 1-1: Manufacturer: QEMU worker1 # [ 2.485896] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.486076] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode lb # [ 2.488182] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f) lb # [ 2.489041] ahci 0000:00:1f.2: flags: 64bit ncq only lb # [ 2.490241] usb 1-1: new high-speed USB device number 2 using ehci-pci lb # [ 2.494395] scsi host0: ahci lb # [ 2.496087] scsi host1: ahci client # [ 2.490932] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 client # [ 2.492119] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.497801] scsi host2: ahci client # [ 2.493416] usb 1-1: Product: QEMU USB Tablet client # [ 2.494159] usb 1-1: Manufacturer: QEMU lb # [ 2.499541] scsi host3: ahci client # [ 2.494781] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.501111] scsi host4: ahci lb # [ 2.502737] scsi host5: ahci lb # [ 2.503870] ata1: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd100 irq 49 lpm-pol 1 lb # [ 2.504972] ata2: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd180 irq 49 lpm-pol 1 lb # [ 2.506435] ata3: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd200 irq 49 lpm-pol 1 lb # [ 2.507595] ata4: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd280 irq 49 lpm-pol 1 lb # [ 2.508739] ata5: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd300 irq 49 lpm-pol 1 lb # [ 2.509894] ata6: SATA max UDMA/133 abar m4096@0xfebdd000 port 0xfebdd380 irq 49 lpm-pol 1 client # [ 2.508842] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.515872] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker1 # [ 2.520510] hid: raw HID events driver (C) Jiri Kosina worker2 # [ 2.518797] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 worker2 # [ 2.522020] usb 1-1: Product: QEMU USB Tablet worker2 # [ 2.523857] usb 1-1: Manufacturer: QEMU worker2 # [ 2.525575] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 worker2 # [ 2.558530] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.457525] systemd[1]: Mounting /sysroot... client # [ 2.470065] systemd[1]: Mounting /sysroot... lb # [ 2.620157] usb 1-1: New USB device found, idVendor=0627, idProduct=0001, bcdDevice= 0.00 worker2 # [ 2.486370] systemd[1]: Mounting /sysroot... lb # [ 2.621344] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10 lb # [ 2.622611] usb 1-1: Product: QEMU USB Tablet lb # [ 2.623295] usb 1-1: Manufacturer: QEMU lb # [ 2.623846] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1 lb # [ 2.639993] hid: raw HID events driver (C) Jiri Kosina worker1 # [ 2.671268] ata6: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.673364] ata2: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.675753] ata5: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.678058] ata1: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.680280] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker1 # [ 2.682451] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.684631] ata3.00: applying bridge limits worker1 # [ 2.686501] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.688646] ata3.00: configured for UDMA/100 worker1 # [ 2.690898] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 client # [ 2.687315] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.688239] ata2: SATA link down (SStatus 0 SControl 300) client # [ 2.689294] ata4: SATA link down (SStatus 0 SControl 300) client # [ 2.690217] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) client # [ 2.691209] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 client # [ 2.692070] ata3.00: applying bridge limits client # [ 2.692794] ata5: SATA link down (SStatus 0 SControl 300) client # [ 2.693591] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.694568] ata3.00: configured for UDMA/100 client # [ 2.695585] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 lb # [ 2.573384] systemd[1]: Mounting /sysroot... worker2 # [ 2.710810] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.713021] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker2 # [ 2.715365] ata3.00: applying bridge limits worker2 # [ 2.717215] ata3.00: configured for UDMA/100 worker2 # [ 2.719185] ata1: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.721458] ata6: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.723819] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.726105] ata4: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.728425] ata5: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.731159] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker1 # [ 2.753612] usbcore: registered new interface driver usbhid worker1 # [ 2.754422] usbhid: USB HID core driver client # [ 2.755863] usbcore: registered new interface driver usbhid client # [ 2.758976] usbhid: USB HID core driver worker1 # [ 2.768113] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 worker1 # [ 2.772213] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 2.772771] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray client # [ 2.788161] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 client # [ 2.789958] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 client # [ 2.792558] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 2.805146] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.807725] usbcore: registered new interface driver usbhid worker2 # [ 2.808647] usbhid: USB HID core driver client # [ 2.805136] EXT4-fs (vda): mounted filesystem 811e8090-b889-4354-ba7b-fd324bde1ffe r/w with ordered data mode. Quota mode: none. worker1 # [ 2.811300] EXT4-fs (vda): mounted filesystem 7a4fbbbc-552f-4516-a20e-5ddf5733ab05 r/w with ordered data mode. Quota mode: none. worker1 # [ 2.814124] cdrom: Uniform CD-ROM driver Revision: 3.20 worker1 # [ 2.684156] systemd[1]: Mounted /sysroot. worker1 # [ 2.685203] systemd[1]: Reached target Initrd Root File System. client # [ 2.681245] systemd[1]: Mounted /sysroot. client # [ 2.681915] systemd[1]: Reached target Initrd Root File System. worker1 # [ 2.686976] systemd[1]: Starting Mountpoints Configured in the Real Root... client # [ 2.685055] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 2.819961] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 2.825929] ata2: SATA link down (SStatus 0 SControl 300) worker2 # [ 2.825563] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 2.828300] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300) worker2 # [ 2.829552] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray lb # [ 2.830510] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100 worker1 # [ 2.701503] systemd-sysroot-fstab-check[137]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 2.832908] ata3.00: applying bridge limits worker1 # [ 2.704497] systemd[1]: Reload requested from client PID 137 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.834840] ata1: SATA link down (SStatus 0 SControl 300) client # [ 2.701510] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 2.837167] ata4: SATA link down (SStatus 0 SControl 300) worker1 # [ 2.708065] systemd[1]: Reloading... client # [ 2.704451] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.839522] ata6: SATA link down (SStatus 0 SControl 300) client # [ 2.706127] systemd[1]: Reloading... lb # [ 2.841767] ata5: SATA link down (SStatus 0 SControl 300) lb # [ 2.844004] ata3.00: configured for UDMA/100 lb # [ 2.846387] scsi 2:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5 worker2 # [ 2.850494] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.867836] EXT4-fs (vda): mounted filesystem 7eafd21b-271c-4496-b06d-1827da5cb4a1 r/w with ordered data mode. Quota mode: none. worker2 # [ 2.740969] systemd[1]: Mounted /sysroot. worker2 # [ 2.742383] systemd[1]: Reached target Initrd Root File System. worker2 # [ 2.744555] systemd[1]: Starting Mountpoints Configured in the Real Root... worker2 # [ 2.757534] systemd-sysroot-fstab-check[138]: /sysroot should be mounted in the initrd, will request daemon-reload. worker2 # [ 2.762072] systemd[1]: Reload requested from client PID 138 ('systemd-sysroot') (unit initrd-parse-etc.service)... worker2 # [ 2.763495] systemd[1]: Reloading... worker1 # [ 2.783829] systemd[1]: Reloading finished in 77 ms. client # [ 2.779652] systemd[1]: Reloading finished in 72 ms. worker1 # [ 2.792563] systemd-sysroot-fstab-check[137]: Requesting initrd-fs.target/start/replace... client # [ 2.788522] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... worker1 # [ 2.795153] systemd-sysroot-fstab-check[137]: Requesting swap.target/start/replace... lb # [ 2.926462] usbcore: registered new interface driver usbhid client # [ 2.792186] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... worker1 # [ 2.799784] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 2.930793] usbhid: USB HID core driver client # [ 2.795692] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker1 # [ 2.801186] systemd[1]: Finished Mountpoints Configured in the Real Root. client # [ 2.797099] systemd[1]: Finished Mountpoints Configured in the Real Root. worker1 # [ 2.802233] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. client # [ 2.798188] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 2.937934] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input2 lb # [ 2.943471] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0 lb # [ 2.948430] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray worker2 # [ 2.831809] systemd[1]: Reloading finished in 70 ms. lb # [ 2.966137] cdrom: Uniform CD-ROM driver Revision: 3.20 worker2 # [ 2.839982] systemd-sysroot-fstab-check[138]: Requesting initrd-fs.target/start/replace... worker2 # [ 2.842029] systemd-sysroot-fstab-check[138]: Requesting swap.target/start/replace... worker2 # [ 2.846960] systemd[1]: initrd-parse-etc.service: Deactivated successfully. worker2 # [ 2.848375] systemd[1]: Finished Mountpoints Configured in the Real Root. worker2 # [ 2.849389] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. lb # [ 2.986061] EXT4-fs (vda): mounted filesystem 2eb9dacd-9e83-4f0a-8b16-2d67256501ad r/w with ordered data mode. Quota mode: none. lb # [ 2.859190] systemd[1]: Mounted /sysroot. lb # [ 2.862083] systemd[1]: Reached target Initrd Root File System. lb # [ 2.863441] systemd[1]: Starting Mountpoints Configured in the Real Root... lb # [ 2.877246] systemd-sysroot-fstab-check[140]: /sysroot should be mounted in the initrd, will request daemon-reload. lb # [ 2.883092] systemd[1]: Reload requested from client PID 140 ('systemd-sysroot') (unit initrd-parse-etc.service)... lb # [ 2.884544] systemd[1]: Reloading... lb # [ 2.954345] systemd[1]: Reloading finished in 71 ms. lb # [ 2.962073] systemd-sysroot-fstab-check[140]: Requesting initrd-fs.target/start/replace... lb # [ 2.966160] systemd-sysroot-fstab-check[140]: Requesting swap.target/start/replace... lb # [ 2.969817] systemd[1]: initrd-parse-etc.service: Deactivated successfully. lb # [ 2.971283] systemd[1]: Finished Mountpoints Configured in the Real Root. lb # [ 2.972337] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. worker1 # [ 3.459182] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.465170] systemd[1]: Mounting /sysroot/nix/.rw-store... worker1 # [ 3.473164] systemd[1]: Mounting /sysroot/run... client # [ 3.473203] systemd[1]: Mounting /sysroot/nix/.ro-store... worker1 # [ 3.484174] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.480161] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.487187] systemd[1]: Mounting /sysroot/nix/.ro-store... client # [ 3.487169] systemd[1]: Mounting /sysroot/run... worker1 # [ 3.495932] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.493203] systemd[1]: Mounting /sysroot/nix/.rw-store... client # [ 3.497312] systemd[1]: Mounting /sysroot/tmp/shared... worker2 # [ 3.501302] systemd[1]: Mounting /sysroot/run... worker2 # [ 3.510178] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.509274] systemd[1]: Mounting /sysroot/tmp/xchg... worker2 # [ 3.521653] systemd[1]: Mounting /sysroot/tmp/xchg... worker1 # [ 3.526626] systemd[1]: Mounted /sysroot/nix/.ro-store. worker1 # [ 3.530966] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.536136] systemd[1]: Mounted /sysroot/run. worker1 # [ 3.536778] systemd[1]: Mounted /sysroot/tmp/shared. worker1 # [ 3.538821] systemd[1]: Mounted /sysroot/tmp/xchg. worker1 # [ 3.542784] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.545443] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.547929] systemd[1]: Mounted /sysroot/nix/.rw-store. worker1 # [ 3.553520] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 3.554905] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.553647] systemd[1]: Mounted /sysroot/run. client # [ 3.555651] systemd[1]: Mounted /sysroot/tmp/shared. client # [ 3.556641] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.560720] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.560516] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.563847] systemd[1]: Mounted /sysroot/nix/.rw-store. worker2 # [ 3.566857] systemd[1]: Mounted /sysroot/run. worker2 # [ 3.570095] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.571519] systemd[1]: Mounted /sysroot/tmp/xchg. client # [ 3.570302] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. client # [ 3.571790] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.574304] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.573873] systemd[1]: Mounting /sysroot/nix/store... lb # [ 3.576172] systemd[1]: Mounting /sysroot/nix/.ro-store... lb # [ 3.582328] systemd[1]: Mounting /sysroot/nix/.rw-store... worker2 # [ 3.585089] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.586047] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.587814] systemd[1]: Mounting /sysroot/nix/store... lb # [ 3.589216] systemd[1]: Mounting /sysroot/run... client # [ 3.595585] systemd[1]: Mounted /sysroot/nix/store. client # [ 3.596686] systemd[1]: Reached target Initrd File Systems. lb # [ 3.599103] systemd[1]: Mounting /sysroot/tmp/shared... client # [ 3.598228] systemd[1]: Starting Find NixOS closure... client # [ 3.600807] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker2 # [ 3.608259] systemd[1]: Mounted /sysroot/nix/store. worker2 # [ 3.610110] systemd[1]: Reached target Initrd File Systems. worker2 # [ 3.611092] systemd[1]: Starting Find NixOS closure... worker2 # [ 3.613606] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... lb # [ 3.615328] systemd[1]: Mounting /sysroot/tmp/xchg... client # [ 3.618963] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. client # [ 3.626207] systemd[1]: Finished Find NixOS closure. client # [ 3.627831] systemd[1]: Reached target Initrd Default Target. client # [ 3.628969] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker2 # [ 3.631974] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker2 # [ 3.639198] systemd[1]: Finished Find NixOS closure. worker2 # [ 3.640227] systemd[1]: Reached target Initrd Default Target. worker2 # [ 3.641865] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... client # [ 3.642516] systemd[1]: Stopped target Initrd Default Target. client # [ 3.643619] systemd[1]: Stopped target Basic System. client # [ 3.644463] systemd[1]: Stopped target Initrd Root Device. client # [ 3.645494] systemd[1]: Stopped target Path Units. lb # [ 3.648810] systemd[1]: Mounted /sysroot/nix/.ro-store. client # [ 3.647109] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 3.648179] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. client # [ 3.649271] systemd[1]: Stopped target Slice Units. client # [ 3.650143] systemd[1]: Stopped target Socket Units. lb # [ 3.653974] systemd[1]: Mounted /sysroot/nix/.rw-store. client # [ 3.650920] systemd[1]: Stopped target System Initialization. client # [ 3.651728] systemd[1]: Stopped target Swaps. client # [ 3.652597] systemd[1]: Stopped target Timer Units. lb # [ 3.656502] systemd[1]: Mounted /sysroot/run. client # [ 3.653572] systemd[1]: dbus.socket: Deactivated successfully. worker2 # [ 3.655365] systemd[1]: Stopped target Initrd Default Target. lb # [ 3.657930] systemd[1]: Mounted /sysroot/tmp/shared. worker2 # [ 3.656630] systemd[1]: Stopped target Basic System. client # [ 3.655126] systemd[1]: Closed D-Bus System Message Bus Socket. worker2 # [ 3.657592] systemd[1]: Stopped target Initrd Root Device. client # [ 3.655949] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. client # [ 3.656957] systemd[1]: Stopped Find NixOS closure. worker2 # [ 3.659110] systemd[1]: Stopped target Path Units. lb # [ 3.661252] systemd[1]: Mounted /sysroot/tmp/xchg. worker2 # [ 3.659774] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. client # [ 3.658330] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.660863] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker2 # [ 3.661890] systemd[1]: Stopped target Slice Units. client # [ 3.660185] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.662781] systemd[1]: Stopped target Socket Units. client # [ 3.661344] systemd[1]: Stopped Apply Kernel Variables. lb # [ 3.664906] systemd[1]: Starting rw-sysroot-nix-store.service... worker2 # [ 3.663778] systemd[1]: Stopped target System Initialization. client # [ 3.662285] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker2 # [ 3.664753] systemd[1]: Stopped target Swaps. client # [ 3.663412] systemd[1]: Stopped Load Kernel Modules. worker2 # [ 3.665712] systemd[1]: Stopped target Timer Units. worker2 # [ 3.666683] systemd[1]: dbus.socket: Deactivated successfully. client # [ 3.664841] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.665937] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker2 # [ 3.668131] systemd[1]: Closed D-Bus System Message Bus Socket. client # [ 3.667159] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker2 # [ 3.668890] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker2 # [ 3.669895] systemd[1]: Stopped Find NixOS closure. client # [ 3.668651] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.671233] systemd[1]: Starting rw-sysroot-nix-store.service... client # [ 3.669918] systemd[1]: Stopped target Local File Systems. client # [ 3.671113] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.673042] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker2 # [ 3.673899] systemd[1]: Stopped Apply Kernel Variables. client # [ 3.672414] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 3.675761] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.674625] systemd[1]: systemd-modules-load.service: Deactivated successfully. client # [ 3.673336] systemd[1]: Stopped Coldplug All udev Devices. worker2 # [ 3.675549] systemd[1]: Stopped Load Kernel Modules. lb # [ 3.677262] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.676945] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. client # [ 3.675882] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.678048] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. client # [ 3.676911] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.679021] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. client # [ 3.677885] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 3.679921] systemd[1]: Stopped Create System Files and Directories. worker2 # [ 3.680775] systemd[1]: Stopped target Local File Systems. worker2 # [ 3.683966] systemd[1]: Stopped target Preparation for Local File Systems. worker2 # [ 3.684876] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker2 # [ 3.685843] systemd[1]: Stopped Coldplug All udev Devices. client # [ 3.685560] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.688530] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker2 # [ 3.689578] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 3.690568] systemd[1]: Stopped Virtual Console Setup. client # [ 3.690122] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 3.691122] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 3.693118] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker2 # [ 3.697589] systemd[1]: systemd-udevd.service: Deactivated successfully. client # [ 3.698406] systemd[1]: systemd-udevd-varlink.socket: Deactivated successfully. worker2 # [ 3.700542] systemd[1]: Stopped Rule-based Manager for Device Events and Files. client # [ 3.700084] systemd[1]: Closed udev Varlink Socket. client # [ 3.701226] systemd[1]: Starting Cleanup udev Database... client # [ 3.702067] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker2 # [ 3.704232] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker2 # [ 3.705173] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. client # [ 3.705073] systemd[1]: Stopped Create Static Device Nodes in /dev. client # [ 3.705963] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. client # [ 3.707133] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. client # [ 3.708179] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 3.710078] systemd[1]: systemd-udevd-varlink.socket: Deactivated successfully. client # [ 3.709102] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 3.711424] systemd[1]: Closed udev Varlink Socket. client # [ 3.709937] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.713068] systemd[1]: Starting Cleanup udev Database... worker2 # [ 3.713796] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. client # [ 3.712362] systemd[1]: Finished rw-sysroot-nix-store.service. worker2 # [ 3.715142] systemd[1]: Stopped Create Static Device Nodes in /dev. worker2 # [ 3.716861] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. worker2 # [ 3.717948] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker2 # [ 3.718925] systemd[1]: kmod-static-nodes.service: Deactivated successfully. worker2 # [ 3.719846] systemd[1]: Stopped Create List of Static Device Nodes. worker2 # [ 3.720690] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker2 # [ 3.723500] systemd[1]: Finished rw-sysroot-nix-store.service. client # [ 3.727059] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. client # [ 3.728092] systemd[1]: Finished Cleanup udev Database. client # [ 3.728840] systemd[1]: Reached target Switch Root. client # [ 3.730157] systemd[1]: Starting NixOS Activation... worker2 # [ 3.737655] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker2 # [ 3.739123] systemd[1]: Finished Cleanup udev Database. worker2 # [ 3.740538] systemd[1]: Reached target Switch Root. worker2 # [ 3.742421] systemd[1]: Starting NixOS Activation... client # [ 3.797583] initrd-nixos-activation-start[190]: booting system configuration /nix/store/3xd6dbxz1qssv249bz933ccxrijwf6j8-nixos-system-client-test worker2 # [ 3.811826] initrd-nixos-activation-start[189]: booting system configuration /nix/store/qz56dc5qp6pffwrpdfhrqjhrkj2mzhvf-nixos-system-worker2-test client # [ 3.823613] initrd-nixos-activation-start[190]: running activation script... worker2 # [ 3.838572] initrd-nixos-activation-start[189]: running activation script... client # [ 4.161789] initrd-nixos-activation-start[213]: setting up /etc... worker2 # [ 4.166528] initrd-nixos-activation-start[212]: setting up /etc... client # [ 4.259770] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. client # [ 4.262061] systemd[1]: Finished NixOS Activation. client # [ 4.263227] systemd[1]: Starting Switch Root... worker2 # [ 4.271906] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker2 # [ 4.274074] systemd[1]: Finished NixOS Activation. worker2 # [ 4.275279] systemd[1]: Starting Switch Root... client # [ 4.275905] systemd[1]: Switching root. worker2 # [ 4.286957] systemd[1]: Switching root. client # [ 4.535103] systemd-journald[65]: Received SIGTERM from PID 1 (systemd). worker2 # [ 4.544003] systemd-journald[65]: Received SIGTERM from PID 1 (systemd). worker1 # [ 4.458433] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.507558] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.509253] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.510950] systemd[1]: Starting Find NixOS closure... worker1 # [ 4.513560] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.534808] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. worker1 # [ 4.538083] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. worker1 # [ 4.544399] systemd[1]: Finished Find NixOS closure. worker1 # [ 4.546203] systemd[1]: Reached target Initrd Default Target. worker1 # [ 4.547309] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... worker1 # [ 4.560788] systemd[1]: Stopped target Initrd Default Target. worker1 # [ 4.561837] systemd[1]: Stopped target Basic System. worker1 # [ 4.562717] systemd[1]: Stopped target Initrd Root Device. worker1 # [ 4.565085] systemd[1]: Stopped target Path Units. worker1 # [ 4.565750] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. worker1 # [ 4.566778] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. worker1 # [ 4.567816] systemd[1]: Stopped target Slice Units. worker1 # [ 4.568504] systemd[1]: Stopped target Socket Units. worker1 # [ 4.569385] systemd[1]: Stopped target System Initialization. worker1 # [ 4.570195] systemd[1]: Stopped target Swaps. worker1 # [ 4.570836] systemd[1]: Stopped target Timer Units. worker1 # [ 4.571519] systemd[1]: dbus.socket: Deactivated successfully. worker1 # [ 4.572318] systemd[1]: Closed D-Bus System Message Bus Socket. worker1 # [ 4.573238] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. worker1 # [ 4.574789] systemd[1]: Stopped Find NixOS closure. worker1 # [ 4.575865] systemd[1]: Starting rw-sysroot-nix-store.service... worker1 # [ 4.576902] systemd[1]: systemd-sysctl.service: Deactivated successfully. worker1 # [ 4.579174] systemd[1]: Stopped Apply Kernel Variables. lb # [ 4.577271] systemd[1]: Mounting /sysroot/nix/store... worker1 # [ 4.580143] systemd[1]: systemd-modules-load.service: Deactivated successfully. worker1 # [ 4.581300] systemd[1]: Stopped Load Kernel Modules. worker1 # [ 4.582249] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. worker1 # [ 4.583457] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. worker1 # [ 4.584831] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. worker1 # [ 4.587086] systemd[1]: Stopped Create System Files and Directories. worker1 # [ 4.587959] systemd[1]: Stopped target Local File Systems. worker1 # [ 4.588881] systemd[1]: Stopped target Preparation for Local File Systems. worker1 # [ 4.589923] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. worker1 # [ 4.591156] systemd[1]: Stopped Coldplug All udev Devices. worker1 # [ 4.593116] systemd[1]: Stopping Rule-based Manager for Device Events and Files... worker1 # [ 4.594138] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 4.596081] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 4.603708] systemd[1]: initrd-cleanup.service: Deactivated successfully. worker1 # [ 4.606513] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 4.613095] systemd[1]: systemd-udevd.service: Deactivated successfully. worker1 # [ 4.616762] systemd[1]: Stopped Rule-based Manager for Device Events and Files. worker1 # [ 4.617854] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. worker1 # [ 4.618881] systemd[1]: Finished rw-sysroot-nix-store.service. worker1 # [ 4.620314] systemd[1]: systemd-udevd-varlink.socket: Deactivated successfully. worker1 # [ 4.621526] systemd[1]: Closed udev Varlink Socket. worker1 # [ 4.623144] systemd[1]: Starting Cleanup udev Database... worker1 # [ 4.623917] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. worker1 # [ 4.625185] systemd[1]: Stopped Create Static Device Nodes in /dev. worker1 # [ 4.626568] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.625780] systemd[1]: Mounted /sysroot/nix/store. worker1 # [ 4.627620] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. worker1 # [ 4.628557] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.627712] systemd[1]: Reached target Initrd File Systems. worker1 # [ 4.630147] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.631220] systemd[1]: Starting Find NixOS closure... lb # [ 4.637701] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... worker1 # [ 4.646451] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. worker1 # [ 4.647995] systemd[1]: Finished Cleanup udev Database. worker1 # [ 4.649190] systemd[1]: Reached target Switch Root. worker1 # [ 4.650757] systemd[1]: Starting NixOS Activation... lb # [ 4.662089] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. lb # [ 4.663308] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. lb # [ 4.670913] systemd[1]: Finished Find NixOS closure. lb # [ 4.672169] systemd[1]: Reached target Initrd Default Target. lb # [ 4.673921] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... lb # [ 4.687961] systemd[1]: Stopped target Initrd Default Target. lb # [ 4.689174] systemd[1]: Stopped target Basic System. lb # [ 4.691124] systemd[1]: Stopped target Initrd Root Device. lb # [ 4.691889] systemd[1]: Stopped target Path Units. lb # [ 4.692628] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. lb # [ 4.693822] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. lb # [ 4.694889] systemd[1]: Stopped target Slice Units. lb # [ 4.695651] systemd[1]: Stopped target Socket Units. lb # [ 4.696402] systemd[1]: Stopped target System Initialization. lb # [ 4.697447] systemd[1]: Stopped target Swaps. lb # [ 4.698259] systemd[1]: Stopped target Timer Units. lb # [ 4.699796] systemd[1]: dbus.socket: Deactivated successfully. lb # [ 4.700701] systemd[1]: Closed D-Bus System Message Bus Socket. lb # [ 4.701562] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. lb # [ 4.702607] systemd[1]: Stopped Find NixOS closure. lb # [ 4.703824] systemd[1]: Starting rw-sysroot-nix-store.service... lb # [ 4.704804] systemd[1]: systemd-sysctl.service: Deactivated successfully. lb # [ 4.706237] systemd[1]: Stopped Apply Kernel Variables. lb # [ 4.707276] systemd[1]: systemd-modules-load.service: Deactivated successfully. lb # [ 4.709219] systemd[1]: Stopped Load Kernel Modules. lb # [ 4.710156] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. lb # [ 4.711469] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. lb # [ 4.713120] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. lb # [ 4.714178] systemd[1]: Stopped Create System Files and Directories. lb # [ 4.715210] systemd[1]: Stopped target Local File Systems. worker1 # [ 4.716566] initrd-nixos-activation-start[189]: booting system configuration /nix/store/6h4yi05k4c0fkhyw0rk1hkcdcrzgjp91-nixos-system-worker1-test lb # [ 4.715993] systemd[1]: Stopped target Preparation for Local File Systems. lb # [ 4.718103] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. lb # [ 4.719128] systemd[1]: Stopped Coldplug All udev Devices. lb # [ 4.720304] systemd[1]: Stopping Rule-based Manager for Device Events and Files... lb # [ 4.721528] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 4.723476] systemd[1]: Stopped Virtual Console Setup. lb # [ 4.730866] systemd[1]: initrd-cleanup.service: Deactivated successfully. lb # [ 4.733738] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. worker1 # [ 4.741631] initrd-nixos-activation-start[189]: running activation script... lb # [ 4.740575] systemd[1]: systemd-udevd.service: Deactivated successfully. lb # [ 4.743728] systemd[1]: Stopped Rule-based Manager for Device Events and Files. lb # [ 4.746118] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. lb # [ 4.747238] systemd[1]: Finished rw-sysroot-nix-store.service. lb # [ 4.749125] systemd[1]: systemd-udevd-varlink.socket: Deactivated successfully. lb # [ 4.750214] systemd[1]: Closed udev Varlink Socket. lb # [ 4.751636] systemd[1]: Starting Cleanup udev Database... lb # [ 4.752389] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. lb # [ 4.753455] systemd[1]: Stopped Create Static Device Nodes in /dev. lb # [ 4.755138] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. lb # [ 4.756316] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. lb # [ 4.757282] systemd[1]: kmod-static-nodes.service: Deactivated successfully. lb # [ 4.758283] systemd[1]: Stopped Create List of Static Device Nodes. lb # [ 4.774264] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. lb # [ 4.775819] systemd[1]: Finished Cleanup udev Database. lb # [ 4.777337] systemd[1]: Reached target Switch Root. lb # [ 4.779268] systemd[1]: Starting NixOS Activation... client # [ 4.954471] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 4.962094] systemd[1]: Detected virtualization kvm. client # [ 4.963929] systemd[1]: Detected architecture x86-64. client # [ 4.965776] systemd[1]: Detected first boot. lb # [ 4.838542] initrd-nixos-activation-start[191]: booting system configuration /nix/store/s1sdlq7kf1sljabp27xmqpmiignlamvy-nixos-system-lb-test client # [ 4.969708] systemd[1]: Initializing machine ID from random generator. worker2 # [ 4.970730] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker2 # [ 4.980057] systemd[1]: Detected virtualization kvm. worker2 # [ 4.981848] systemd[1]: Detected architecture x86-64. worker2 # [ 4.983726] systemd[1]: Detected first boot. worker2 # [ 4.987616] systemd[1]: Initializing machine ID from random generator. lb # [ 4.862785] initrd-nixos-activation-start[191]: running activation script... worker1 # [ 4.989603] initrd-nixos-activation-start[212]: setting up /etc... client # [ 5.168497] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 5.174519] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker1 # [ 5.090036] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. worker1 # [ 5.091551] systemd[1]: Finished NixOS Activation. worker1 # [ 5.093587] systemd[1]: Starting Switch Root... worker1 # [ 5.107348] systemd[1]: Switching root. lb # [ 5.105768] initrd-nixos-activation-start[214]: setting up /etc... client # [ 5.237183] systemd[1]: Applying preset policy. worker2 # [ 5.244042] systemd[1]: Applying preset policy. lb # [ 5.191684] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. lb # [ 5.193087] systemd[1]: Finished NixOS Activation. lb # [ 5.194988] systemd[1]: Starting Switch Root... lb # [ 5.209364] systemd[1]: Switching root. worker1 # [ 5.365815] systemd-journald[65]: Received SIGTERM from PID 1 (systemd). client # [ 5.465159] systemd[1]: Populated /etc with preset unit settings. worker2 # [ 5.469125] systemd[1]: Populated /etc with preset unit settings. lb # [ 5.473418] systemd-journald[65]: Received SIGTERM from PID 1 (systemd). client # [ 5.641022] systemd[1]: initrd-switch-root.service: Deactivated successfully. client # [ 5.642373] systemd[1]: Stopped initrd-switch-root.service. worker2 # [ 5.647533] systemd[1]: initrd-switch-root.service: Deactivated successfully. worker2 # [ 5.648838] systemd[1]: Stopped initrd-switch-root.service. client # [ 5.644944] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 5.647016] systemd[1]: Created slice Slice /system/getty. worker2 # [ 5.650945] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. client # [ 5.648305] systemd[1]: Created slice User and Session Slice. worker2 # [ 5.653019] systemd[1]: Created slice Slice /system/getty. client # [ 5.649235] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. client # [ 5.650443] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker2 # [ 5.654365] systemd[1]: Created slice User and Session Slice. worker2 # [ 5.655284] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker2 # [ 5.656440] systemd[1]: Started Forward Password Requests to Wall Directory Watch. client # [ 5.651537] systemd[1]: Expecting device /dev/hvc0... client # [ 5.663726] systemd[1]: Expecting device /dev/ttyS0... client # [ 5.664441] systemd[1]: Reached target Local Encrypted Volumes. client # [ 5.665294] systemd[1]: Stopped target initrd-fs.target. worker2 # [ 5.657602] systemd[1]: Expecting device /dev/hvc0... client # [ 5.666082] systemd[1]: Stopped target initrd-root-fs.target. worker2 # [ 5.669833] systemd[1]: Expecting device /dev/ttyS0... client # [ 5.666856] systemd[1]: Stopped target initrd-switch-root.target. worker2 # [ 5.670635] systemd[1]: Reached target Local Encrypted Volumes. client # [ 5.667719] systemd[1]: Reached target Virtual Machines and Containers. worker2 # [ 5.671410] systemd[1]: Stopped target initrd-fs.target. client # [ 5.668595] systemd[1]: Reached target Path Units. worker2 # [ 5.672168] systemd[1]: Stopped target initrd-root-fs.target. client # [ 5.669354] systemd[1]: Reached target Remote File Systems. worker2 # [ 5.672988] systemd[1]: Stopped target initrd-switch-root.target. client # [ 5.670169] systemd[1]: Reached target Slice Units. worker2 # [ 5.673868] systemd[1]: Reached target Virtual Machines and Containers. client # [ 5.670863] systemd[1]: Reached target Swaps. worker2 # [ 5.674781] systemd[1]: Reached target Path Units. worker2 # [ 5.675440] systemd[1]: Reached target Remote File Systems. worker2 # [ 5.676237] systemd[1]: Reached target Slice Units. client # [ 5.672569] systemd[1]: Listening on Query the User Interactively for a Password. worker2 # [ 5.676974] systemd[1]: Reached target Swaps. client # [ 5.674909] systemd[1]: Listening on Process Core Dump Socket. worker2 # [ 5.678816] systemd[1]: Listening on Query the User Interactively for a Password. client # [ 5.676497] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 5.681114] systemd[1]: Listening on Process Core Dump Socket. client # [ 5.678187] systemd[1]: Listening on Factory Reset Management. client # [ 5.679134] systemd[1]: Listening on Hostname Service Socket. worker2 # [ 5.682793] systemd[1]: Listening on Credential Encryption/Decryption. worker2 # [ 5.684478] systemd[1]: Listening on Factory Reset Management. client # [ 5.681578] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 5.685354] systemd[1]: Listening on Hostname Service Socket. client # [ 5.682953] systemd[1]: Listening on Journal Audit Socket. worker2 # [ 5.687983] systemd[1]: Starting Journal Log Access Socket... client # [ 5.685555] systemd[1]: Listening on Console Output Muting Service Socket. worker2 # [ 5.689589] systemd[1]: Listening on Journal Audit Socket. client # [ 5.686707] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. client # [ 5.687788] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.692080] systemd[1]: Listening on Console Output Muting Service Socket. client # [ 5.689098] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 5.693565] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker2 # [ 5.694681] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.692811] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 5.695972] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki client # [ 5.693815] systemd[1]: Listening on udev Varlink Socket. client # [ 5.696081] systemd[1]: Mounting Huge Pages File System... worker2 # [ 5.699691] systemd[1]: Listening on Disk Repartitioning Service Socket. worker2 # [ 5.700786] systemd[1]: Listening on udev Varlink Socket. client # [ 5.698231] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 5.703186] systemd[1]: Mounting Huge Pages File System... worker2 # [ 5.706637] systemd[1]: Mounting POSIX Message Queue File System... client # [ 5.705116] systemd[1]: Mounting Kernel Debug File System... worker2 # [ 5.714815] systemd[1]: Mounting Kernel Debug File System... client # [ 5.712575] systemd[1]: Mounting Kernel Trace File System... worker2 # [ 5.721139] systemd[1]: Mounting Kernel Trace File System... client # [ 5.719832] systemd[1]: Starting Create List of Static Device Nodes... worker2 # [ 5.729048] systemd[1]: Starting Create List of Static Device Nodes... client # [ 5.730689] systemd[1]: Starting Load Kernel Module configfs... client # [ 5.734499] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker2 # [ 5.740254] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 5.746572] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 5.744850] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 5.753095] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 5.757157] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 5.760748] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 5.767831] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.772598] systemd[1]: Mounting FUSE Control File System... worker2 # [ 5.773419] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 5.772671] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) worker1 # [ 5.781947] systemd[1]: Detected virtualization kvm. client # [ 5.776821] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 5.783669] systemd[1]: Detected architecture x86-64. worker1 # [ 5.785538] systemd[1]: Detected first boot. worker1 # [ 5.789484] systemd[1]: Initializing machine ID from random generator. worker2 # [ 5.789605] systemd[1]: Starting Journal Service... client # [ 5.789243] systemd[1]: Starting Journal Service... worker2 # [ 5.793434] systemd[1]: Starting Load Kernel Modules... client # [ 5.794510] systemd[1]: Starting Load Kernel Modules... worker2 # [ 5.802278] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 5.807648] systemd[1]: Starting Remount Root and Kernel File Systems... client # [ 5.806009] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker2 # [ 5.810520] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.815922] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 5.820098] systemd[1]: Listening on Journal Log Access Socket. client # [ 5.816141] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 5.822820] systemd[1]: Mounted Huge Pages File System. worker2 # [ 5.825051] systemd[1]: Mounted POSIX Message Queue File System. client # [ 5.821700] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 5.827747] systemd[1]: Mounted Kernel Debug File System. worker2 # [ 5.829780] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 5.832582] systemd[1]: Finished Create List of Static Device Nodes. worker2 # [ 5.834833] systemd[1]: Mounted FUSE Control File System. client # [ 5.833062] systemd[1]: Starting Coldplug All udev Devices... worker2 # [ 5.840095] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 5.847337] systemd-journald[284]: Collecting audit messages is enabled. client # [ 5.849030] systemd[1]: Listening on Journal Log Access Socket. client # [ 5.854774] systemd[1]: Mounted Huge Pages File System. client # [ 5.857875] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 5.863929] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker2 # [ 5.866135] systemd[1]: Finished Load Kernel Module configfs. client # [ 5.863837] systemd[1]: Mounted Kernel Debug File System. client # [ 5.866843] systemd[1]: Mounted Kernel Trace File System. worker2 # [ 5.871873] systemd[1]: Mounting Kernel Configuration File System... client # [ 5.873922] systemd[1]: Finished Create List of Static Device Nodes. client # [ 5.881183] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 5.877938] systemd[1]: systemd 262 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) client # [ 5.882789] loop: module loaded lb # [ 5.887388] systemd[1]: Detected virtualization kvm. lb # [ 5.889145] systemd[1]: Detected architecture x86-64. lb # [ 5.891110] systemd[1]: Detected first boot. client # [ 5.887139] systemd[1]: Finished Load Kernel Module configfs. client # [ 5.758097] systemd[1]: Queued start job for default target Multi-User System. client # [ 5.759328] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 5.895018] systemd[1]: Initializing machine ID from random generator. client # [ 5.761552] systemd-modules-load[285]: Inserted module 'loop' worker2 # [ 5.895645] systemd[1]: Mounted Kernel Configuration File System. client # [ 5.894023] systemd[1]: Started Journal Service. client # [ 5.768335] systemd[1]: Mounted FUSE Control File System. worker2 # [ 5.906798] EXT4-fs (vda): re-mounted 7eafd21b-271c-4496-b06d-1827da5cb4a1. client # [ 5.773224] systemd[1]: Finished Load Kernel Modules. worker2 # [ 5.914419] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 5.916870] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 5.918568] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 5.788933] systemd[1]: Mounting Kernel Configuration File System... worker2 # [ 5.924248] systemd-journald[283]: Collecting audit messages is enabled. client # [ 5.792132] systemd[1]: Starting Apply Kernel Variables... client # [ 5.923635] EXT4-fs (vda): re-mounted 811e8090-b889-4354-ba7b-fd324bde1ffe. worker2 # [ 5.927797] systemd[1]: Starting Load/Save OS Random Seed... worker2 # [ 5.929438] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.801079] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker2 # [ 5.937201] loop: module loaded worker2 # [ 5.942957] systemd[1]: Finished Load Kernel Modules. client # [ 5.813123] systemd[1]: Finished Remount Root and Kernel File Systems. worker2 # [ 5.948106] systemd[1]: Starting Firewall... client # [ 5.814103] systemd[1]: Listening on Disk Image Download Service Socket. worker2 # [ 5.952090] systemd[1]: Starting Apply Kernel Variables... client # [ 5.827537] systemd-oomd[286]: No swap; memory pressure usage will be degraded client # [ 5.831628] systemd[1]: Starting Flush Journal to Persistent Storage... client # [ 5.832869] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 5.842261] systemd[1]: Starting Load/Save OS Random Seed... client # [ 5.843086] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 5.848104] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker2 # [ 5.982486] systemd[1]: Started Journal Service. worker2 # [ 5.851182] systemd[1]: Queued start job for default target Multi-User System. worker2 # [ 5.855177] systemd[1]: systemd-journald.service: Deactivated successfully. worker2 # [ 5.860524] systemd-modules-load[284]: Inserted module 'loop' worker2 # [ 5.866151] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 5.889857] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker2 # [ 5.890982] systemd[1]: Starting Create Static Device Nodes in /dev... client # [ 5.901256] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 5.906948] systemd[1]: Finished Load/Save OS Random Seed. worker2 # [ 5.907831] systemd[1]: Reached target First Boot Complete. client # [ 6.036745] systemd-journald[284]: Received client request to flush runtime journal. worker1 # [ 6.068804] systemd[1]: bpf-restrict-fs: LSM BPF program attached worker2 # [ 6.080414] systemd-journald[283]: Received client request to flush runtime journal. lb # [ 6.103885] systemd[1]: bpf-restrict-fs: LSM BPF program attached client # [ 5.984404] systemd[1]: Finished Load/Save OS Random Seed. client # [ 5.987445] systemd[1]: Reached target First Boot Complete. client # [ 5.988300] systemd[1]: Finished Apply Kernel Variables. client # [ 5.991179] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 6.137598] systemd[1]: Applying preset policy. client # [ 6.026710] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. client # [ 6.031532] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 6.173485] systemd[1]: Applying preset policy. worker2 # [ 6.057228] systemd[1]: Finished Apply Kernel Variables. worker2 # [ 6.059556] systemd-oomd[285]: No swap; memory pressure usage will be degraded worker2 # [ 6.063163] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. client # [ 6.063476] systemd[1]: Finished Coldplug All udev Devices. worker2 # [ 6.065889] systemd[1]: Finished Create Static Device Nodes in /dev. worker2 # [ 6.068196] systemd[1]: Reached target Preparation for Local File Systems. worker2 # [ 6.069258] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 6.070297] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 6.079189] systemd[1]: Finished Create Static Device Nodes in /dev. client # [ 6.081148] systemd[1]: Reached target Preparation for Local File Systems. client # [ 6.082692] systemd[1]: Starting Rule-based Manager for Device Events and Files... client # [ 6.113953] systemd-udevd[315]: Using default interface naming scheme 'v261'. worker2 # [ 6.145170] systemd-udevd[316]: Using default interface naming scheme 'v261'. client # [ 6.146228] systemd[1]: Started Rule-based Manager for Device Events and Files. worker2 # [ 6.215700] systemd[1]: Started Rule-based Manager for Device Events and Files. lb # [ 6.357885] systemd[1]: Populated /etc with preset unit settings. worker1 # [ 6.359537] systemd[1]: Populated /etc with preset unit settings. client # [ 6.223502] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.267529] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. worker2 # [ 6.281230] systemd[1]: Finished Coldplug All udev Devices. client # [ 6.283069] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. client # [ 6.311732] (udev-worker)[325]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. client # [ 6.317274] (udev-worker)[325]: Network interface NamePolicy= disabled on kernel command line. client # [ 6.318683] (udev-worker)[324]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 6.377453] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse client # [ 6.390502] systemd[1]: Condition check resulted in Virtio network device being skipped. client # [ 6.391742] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.393712] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.396132] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.397715] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client # [ 6.398966] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 6.544561] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 6.545920] systemd[1]: Stopped initrd-switch-root.service. worker1 # [ 6.549193] systemd[1]: initrd-switch-root.service: Deactivated successfully. lb # [ 6.548567] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. worker1 # [ 6.550523] systemd[1]: Stopped initrd-switch-root.service. lb # [ 6.550694] systemd[1]: Created slice Slice /system/getty. worker1 # [ 6.552506] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. lb # [ 6.552013] systemd[1]: Created slice User and Session Slice. lb # [ 6.552948] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. worker1 # [ 6.554561] systemd[1]: Created slice Slice /system/getty. lb # [ 6.554143] systemd[1]: Started Forward Password Requests to Wall Directory Watch. worker1 # [ 6.555880] systemd[1]: Created slice User and Session Slice. lb # [ 6.555301] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 6.556785] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. lb # [ 6.556041] systemd[1]: Expecting device /dev/ttyS0... lb # [ 6.556843] systemd[1]: Reached target Local Encrypted Volumes. worker1 # [ 6.557989] systemd[1]: Started Forward Password Requests to Wall Directory Watch. lb # [ 6.557660] systemd[1]: Stopped target initrd-fs.target. worker1 # [ 6.559050] systemd[1]: Expecting device /dev/hvc0... worker1 # [ 6.570850] systemd[1]: Expecting device /dev/ttyS0... lb # [ 6.558401] systemd[1]: Stopped target initrd-root-fs.target. worker1 # [ 6.571594] systemd[1]: Reached target Local Encrypted Volumes. lb # [ 6.570788] systemd[1]: Stopped target initrd-switch-root.target. worker1 # [ 6.572399] systemd[1]: Stopped target initrd-fs.target. lb # [ 6.571637] systemd[1]: Reached target Virtual Machines and Containers. worker1 # [ 6.573129] systemd[1]: Stopped target initrd-root-fs.target. lb # [ 6.572539] systemd[1]: Reached target Path Units. worker1 # [ 6.573874] systemd[1]: Stopped target initrd-switch-root.target. lb # [ 6.573240] systemd[1]: Reached target Remote File Systems. worker1 # [ 6.574738] systemd[1]: Reached target Virtual Machines and Containers. lb # [ 6.574031] systemd[1]: Reached target Slice Units. worker1 # [ 6.575616] systemd[1]: Reached target Path Units. lb # [ 6.574769] systemd[1]: Reached target Swaps. worker1 # [ 6.576299] systemd[1]: Reached target Remote File Systems. worker1 # [ 6.577061] systemd[1]: Reached target Slice Units. worker1 # [ 6.577737] systemd[1]: Reached target Swaps. lb # [ 6.576649] systemd[1]: Listening on Query the User Interactively for a Password. worker1 # [ 6.579516] systemd[1]: Listening on Query the User Interactively for a Password. lb # [ 6.579018] systemd[1]: Listening on Process Core Dump Socket. worker1 # [ 6.581821] systemd[1]: Listening on Process Core Dump Socket. lb # [ 6.580664] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 6.582340] systemd[1]: Listening on Factory Reset Management. worker1 # [ 6.583576] systemd[1]: Listening on Credential Encryption/Decryption. lb # [ 6.583296] systemd[1]: Listening on Hostname Service Socket. worker1 # [ 6.585281] systemd[1]: Listening on Factory Reset Management. worker1 # [ 6.586186] systemd[1]: Listening on Hostname Service Socket. lb # [ 6.585894] systemd[1]: Starting Journal Log Access Socket... worker2 # [ 6.452196] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 6.587321] systemd[1]: Listening on Journal Audit Socket. worker1 # [ 6.588826] systemd[1]: Starting Journal Log Access Socket... worker1 # [ 6.590319] systemd[1]: Listening on Journal Audit Socket. lb # [ 6.589899] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 6.591345] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. worker1 # [ 6.592826] systemd[1]: Listening on Console Output Muting Service Socket. lb # [ 6.592429] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.594323] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. lb # [ 6.593723] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker1 # [ 6.595408] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.596662] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki lb # [ 6.597455] systemd[1]: Listening on Disk Repartitioning Service Socket. lb # [ 6.598507] systemd[1]: Listening on udev Varlink Socket. worker1 # [ 6.600508] systemd[1]: Listening on Disk Repartitioning Service Socket. worker1 # [ 6.601516] systemd[1]: Listening on udev Varlink Socket. lb # [ 6.600949] systemd[1]: Mounting Huge Pages File System... worker1 # [ 6.603988] systemd[1]: Mounting Huge Pages File System... lb # [ 6.603568] systemd[1]: Mounting POSIX Message Queue File System... worker1 # [ 6.606381] systemd[1]: Mounting POSIX Message Queue File System... worker2 # [ 6.474208] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 6.612037] systemd[1]: Mounting Kernel Debug File System... lb # [ 6.611277] systemd[1]: Mounting Kernel Debug File System... lb # [ 6.618660] systemd[1]: Mounting Kernel Trace File System... worker1 # [ 6.620338] systemd[1]: Mounting Kernel Trace File System... client # [ 6.617933] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 6.620687] mousedev: PS/2 mouse device common for all mice worker1 # [ 6.628196] systemd[1]: Starting Create List of Static Device Nodes... lb # [ 6.627105] systemd[1]: Starting Create List of Static Device Nodes... worker1 # [ 6.638800] systemd[1]: Starting Load Kernel Module configfs... lb # [ 6.638281] systemd[1]: Starting Load Kernel Module configfs... worker2 # [ 6.504571] (udev-worker)[351]: Network interface NamePolicy= disabled on kernel command line. worker1 # [ 6.641171] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm client # [ 6.637164] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 6.643696] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm worker1 # [ 6.646951] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 6.513619] systemd[1]: Mounting /run/wrappers... worker1 # [ 6.650260] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 6.518319] (udev-worker)[357]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker2 # [ 6.521172] (udev-worker)[357]: Network interface NamePolicy= disabled on kernel command line. lb # [ 6.655313] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 6.522926] systemd[1]: Mounting /run/wrappers... client # [ 6.652950] parport_pc 00:02: reported by Plug and Play ACPI client # [ 6.656020] rtc_cmos PNP0B00:00: setting system clock to 2026-11-07T15:07:42 UTC (1794064062) client # [ 6.657497] systemd-journald[284]: Time jumped backwards, rotating. lb # [ 6.664593] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker1 # [ 6.668935] systemd[1]: Mounting FUSE Control File System... worker1 # [ 6.669763] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.665179] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console lb # [ 6.681263] systemd[1]: Mounting FUSE Control File System... client # [ 6.678170] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 6.682149] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 6.681650] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input3 worker1 # [ 6.689711] systemd[1]: Starting Journal Service... lb # [ 6.689663] systemd[1]: Starting Journal Service... client # [ 6.688748] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 6.695310] systemd[1]: Starting Load Kernel Modules... worker1 # [ 6.701431] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... lb # [ 6.702482] systemd[1]: Starting Load Kernel Modules... worker1 # [ 6.705686] systemd[1]: Starting Remount Root and Kernel File Systems... worker2 # [ 6.572399] systemd[1]: Mounted /run/wrappers. worker1 # [ 6.708006] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 6.573617] systemd[1]: Reached target Local File Systems. worker2 # [ 6.576937] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 6.578708] systemd[1]: Starting register-nix-paths.service... lb # [ 6.714560] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... worker1 # [ 6.716194] systemd[1]: Starting Coldplug All udev Devices... client # [ 6.580246] systemd[1]: Mounted /run/wrappers. worker2 # [ 6.582613] systemd[1]: Starting Create SUID/SGID Wrappers... client # [ 6.582177] systemd[1]: Reached target Local File Systems. worker2 # [ 6.583713] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 6.720502] systemd[1]: Listening on Journal Log Access Socket. client # [ 6.585134] systemd[1]: Listening on Boot Loader Control Service Socket. worker2 # [ 6.587121] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 6.722358] systemd[1]: Mounted Huge Pages File System. client # [ 6.587225] systemd[1]: Starting register-nix-paths.service... worker1 # [ 6.724274] systemd[1]: Mounted POSIX Message Queue File System. worker2 # [ 6.591364] systemd[1]: Starting Create System Files and Directories... worker1 # [ 6.726447] systemd[1]: Mounted Kernel Debug File System. client # [ 6.591070] systemd[1]: Starting Create SUID/SGID Wrappers... lb # [ 6.726438] systemd[1]: Starting Remount Root and Kernel File Systems... worker1 # [ 6.728376] systemd[1]: Mounted Kernel Trace File System. client # [ 6.591944] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 6.730541] systemd[1]: Mounted FUSE Control File System. lb # [ 6.731488] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.734004] systemd[1]: Finished Create List of Static Device Nodes. worker1 # [ 6.738770] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... client # [ 6.602957] systemd[1]: Starting Save Transient machine-id to Disk... lb # [ 6.744397] systemd[1]: Starting Coldplug All udev Devices... client # [ 6.610897] systemd[1]: Starting Create System Files and Directories... lb # [ 6.753385] systemd-journald[285]: Collecting audit messages is enabled. lb # [ 6.754616] systemd[1]: Listening on Journal Log Access Socket. lb # [ 6.757349] systemd[1]: Mounted Huge Pages File System. lb # [ 6.762395] systemd[1]: Mounted POSIX Message Queue File System. worker1 # [ 6.767017] systemd[1]: modprobe@configfs.service: Deactivated successfully. worker1 # [ 6.769029] systemd[1]: Finished Load Kernel Module configfs. lb # [ 6.771434] systemd[1]: Mounted Kernel Debug File System. worker1 # [ 6.773521] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.777930] systemd[1]: Mounted Kernel Trace File System. lb # [ 6.647540] systemd[1]: Queued start job for default target Multi-User System. lb # [ 6.648833] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 6.787661] systemd[1]: Started Journal Service. lb # [ 6.663253] systemd[1]: Finished Create List of Static Device Nodes. lb # [ 6.664335] systemd[1]: modprobe@configfs.service: Deactivated successfully. lb # [ 6.665878] systemd[1]: Finished Load Kernel Module configfs. worker1 # [ 6.799493] systemd[1]: Mounted Kernel Configuration File System. worker2 # [ 6.672092] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 6.809227] EXT4-fs (vda): re-mounted 7a4fbbbc-552f-4516-a20e-5ddf5733ab05. worker2 # [ 6.676497] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 6.675925] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 6.681081] systemd[1]: Mounted FUSE Control File System. client # [ 6.679705] systemd[1]: Finished Save Transient machine-id to Disk. worker1 # [ 6.820294] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 6.822253] systemd[1]: Listening on Disk Image Download Service Socket. lb # [ 6.821639] loop: module loaded worker1 # [ 6.824015] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore lb # [ 6.826261] EXT4-fs (vda): re-mounted 2eb9dacd-9e83-4f0a-8b16-2d67256501ad. worker1 # [ 6.829323] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 6.696084] systemd-modules-load[286]: Inserted module 'loop' worker1 # [ 6.830971] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.832415] systemd-journald[283]: Collecting audit messages is enabled. lb # [ 6.702128] systemd[1]: Mounting Kernel Configuration File System... lb # [ 6.705087] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... worker1 # [ 6.840178] loop: module loaded lb # [ 6.710404] systemd[1]: Finished Load Kernel Modules. lb # [ 6.711178] systemd[1]: Finished Remount Root and Kernel File Systems. worker1 # [ 6.846657] systemd[1]: Finished Load Kernel Modules. worker1 # [ 6.853295] systemd[1]: Starting Firewall... lb # [ 6.723099] systemd[1]: Listening on Disk Image Download Service Socket. worker1 # [ 6.857275] systemd[1]: Starting Apply Kernel Variables... client # [ 6.724424] systemd[1]: Finished Create System Files and Directories. lb # [ 6.729947] systemd[1]: Starting Firewall... worker2 # [ 6.730092] systemd[1]: Finished Create System Files and Directories. client # [ 6.731975] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 6.735960] systemd[1]: Starting Flush Journal to Persistent Storage... worker2 # [ 6.735407] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 6.736974] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 6.735166] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 6.737379] systemd[1]: Starting Record System Boot/Shutdown in UTMP... lb # [ 6.741218] systemd-oomd[288]: No swap; memory pressure usage will be degraded lb # [ 6.745074] systemd[1]: Starting Load/Save OS Random Seed... lb # [ 6.753675] systemd[1]: Starting Apply Kernel Variables... lb # [ 6.754533] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker1 # [ 6.759557] systemd[1]: Queued start job for default target Multi-User System.[ 6.892508] systemd[1]: Started Journal Service. worker1 # worker1 # [ 6.767796] systemd[1]: systemd-journald.service: Deactivated successfully. lb # [ 6.772063] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 6.779264] systemd-modules-load[284]: Inserted module 'loop' worker1 # [ 6.780560] systemd[1]: Starting Flush Journal to Persistent Storage... worker1 # [ 6.783307] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. worker1 # [ 6.789588] systemd[1]: Starting Create Static Device Nodes in /dev... worker1 # [ 6.814445] systemd[1]: Finished Load/Save OS Random Seed. worker1 # [ 6.815388] systemd[1]: Reached target First Boot Complete. worker2 # [ 6.812792] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 6.811263] systemd[1]: Finished Record System Boot/Shutdown in UTMP. client # [ 6.830670] systemd[1]: Finished Rebuild Journal Catalog. lb # [ 6.966768] systemd-journald[285]: Received client request to flush runtime journal. client # [ 6.836102] systemd[1]: Starting Update is Completed... worker1 # [ 6.848536] systemd-oomd[285]: No swap; memory pressure usage will be degraded worker1 # [ 6.983491] systemd-journald[283]: Received client request to flush runtime journal. client # [ 6.707849] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker2 # [ 6.866172] systemd[1]: Finished Rebuild Journal Catalog. worker2 # [ 6.869134] systemd[1]: Starting Update is Completed... client # [ 6.948738] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt client # [ 6.948850] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD client # [ 6.878550] systemd[1]: Finished Update is Completed. client # [ 6.985470] Console: switching to colour dummy device 80x25 client # [ 7.031397] [drm] Found bochs VGA, ID 0xb0c5. client # [ 7.031399] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. client # [ 7.049176] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 client # [ 7.051832] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic client # [ 7.052524] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 7.053888] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 lb # [ 6.930498] systemd[1]: Mounted Kernel Configuration File System. lb # [ 6.932482] systemd[1]: Finished Load/Save OS Random Seed. lb # [ 6.934178] systemd[1]: Reached target First Boot Complete. lb # [ 6.935444] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. lb # [ 6.936774] systemd[1]: Starting Create Static Device Nodes in /dev... lb # [ 6.938273] systemd[1]: Finished Apply Kernel Variables. lb # [ 6.940386] systemd[1]: Finished Flush Journal to Persistent Storage. worker1 # [ 6.966458] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. worker1 # [ 6.969413] systemd[1]: Finished Apply Kernel Variables. worker1 # [ 6.972307] systemd[1]: Finished Create Static Device Nodes in /dev. worker1 # [ 6.973220] systemd[1]: Reached target Preparation for Local File Systems. worker1 # [ 6.974983] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker1 # [ 6.977160] systemd[1]: Finished Flush Journal to Persistent Storage. client # [ 7.122943] Console: switching to colour frame buffer device 160x50 client # [ 7.130946] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 7.002857] systemd[1]: Finished Update is Completed. worker2 # [ 7.014389] systemd[1]: Condition check resulted in Virtio network device being skipped. worker2 # [ 7.015566] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 7.017314] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 7.019321] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 7.022628] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.024902] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 7.026751] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.033187] systemd[1]: Finished Coldplug All udev Devices. worker1 # [ 7.043605] systemd-udevd[316]: Using default interface naming scheme 'v261'. lb # [ 7.043784] systemd[1]: Finished Create Static Device Nodes in /dev. lb # [ 7.045139] systemd[1]: Reached target Preparation for Local File Systems. lb # [ 7.048446] systemd[1]: Starting Rule-based Manager for Device Events and Files... worker2 # [ 7.186238] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 7.204237] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input3 worker2 # [ 7.211910] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 7.092373] systemd-udevd[323]: Using default interface naming scheme 'v261'. worker1 # [ 7.118562] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 7.122424] systemd[1]: Starting Virtual Console Setup... client # [ 7.258958] ppdev: user-space parallel port driver lb # [ 7.141080] systemd[1]: Started Rule-based Manager for Device Events and Files. client # [ 7.298265] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker2 # [ 7.173104] systemd[1]: Finished Firewall. client # [ 7.302999] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) worker1 # [ 7.186411] systemd[1]: Finished Coldplug All udev Devices. client # [ 7.206245] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. client # [ 7.207335] systemd[1]: Stopped Virtual Console Setup. client # [ 7.215972] systemd[1]: Starting Virtual Console Setup... client # [ 7.371147] kvm_amd: TSC scaling supported client # [ 7.371558] kvm_amd: Nested Virtualization enabled client # [ 7.373119] kvm_amd: Nested Paging enabled client # [ 7.373517] kvm_amd: LBR virtualization supported client # [ 7.374771] kvm_amd: Virtual VMLOAD VMSAVE supported client # [ 7.375281] kvm_amd: Virtual GIF supported client # [ 7.376538] kvm_amd: Virtual NMI enabled lb # [ 7.251860] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 7.273630] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker1 # [ 7.276774] systemd[1]: Load Kernel Module fuse skipped, unmet condition check ConditionKernelModuleLoaded=!fuse worker2 # [ 7.274764] systemd[1]: Finished Create SUID/SGID Wrappers. client # [ 7.425742] EDAC MC: Ver: 3.0.0 lb # [ 7.333344] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. client # [ 7.334436] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 7.399161] rtc_cmos PNP0B00:00: RTC can wake from S4 client # [ 7.336433] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 7.411793] mousedev: PS/2 mouse device common for all mice worker2 # [ 7.419670] rtc_cmos PNP0B00:00: registered as rtc0 worker2 # [ 7.419741] rtc_cmos PNP0B00:00: setting system clock to 2026-11-07T15:07:42 UTC (1794064062) worker2 # [ 7.419817] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker2 # [ 7.422627] systemd-journald[283]: Time jumped backwards, rotating. worker2 # [ 7.457328] parport_pc 00:02: reported by Plug and Play ACPI worker2 # [ 7.457419] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 7.360832] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. lb # [ 7.361277] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. worker1 # [ 7.373201] systemd[1]: Condition check resulted in /dev/ttyS0 being skipped. lb # [ 7.376801] (udev-worker)[353]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 7.469034] Console: switching to colour dummy device 80x25 worker2 # [ 7.524081] [drm] Found bochs VGA, ID 0xb0c5. worker2 # [ 7.524084] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 7.398408] (udev-worker)[355]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. lb # [ 7.401148] (udev-worker)[355]: Network interface NamePolicy= disabled on kernel command line. worker2 # [ 7.540583] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker2 # [ 7.541229] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 worker1 # [ 7.412361] (udev-worker)[353]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. worker1 # [ 7.414850] (udev-worker)[353]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.416769] systemd[1]: Mounting /run/wrappers... worker1 # [ 7.420352] systemd[1]: Mounting /run/wrappers... worker2 # [ 7.556722] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker2 # [ 7.557358] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker1 # [ 7.428868] (udev-worker)[357]: Network interface NamePolicy= disabled on kernel command line. lb # [ 7.457096] systemd[1]: Mounted /run/wrappers. lb # [ 7.458962] systemd[1]: Reached target Local File Systems. lb # [ 7.462836] systemd[1]: Listening on Boot Loader Control Service Socket. lb # [ 7.467340] systemd[1]: Starting register-nix-paths.service... lb # [ 7.471413] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 7.473549] systemd[1]: Mounted /run/wrappers. lb # [ 7.472334] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.474279] systemd[1]: Reached target Local File Systems. worker1 # [ 7.476813] systemd[1]: Listening on Boot Loader Control Service Socket. worker1 # [ 7.480350] systemd[1]: Starting register-nix-paths.service... lb # [ 7.480135] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 7.483925] systemd[1]: Starting Create SUID/SGID Wrappers... worker1 # [ 7.485026] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.488150] systemd[1]: Starting Save Transient machine-id to Disk... worker1 # [ 7.492429] systemd[1]: Starting Create System Files and Directories... lb # [ 7.501426] systemd[1]: Starting Create System Files and Directories... client # [ 7.524255] systemd-vconsole-setup[402]: Configuration of first virtual console was skipped, ignoring remaining ones. client # [ 7.527340] systemd[1]: Finished Virtual Console Setup. worker2 # [ 7.625979] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 client # [ 7.550864] systemd[1]: Finished register-nix-paths.service. client # [ 7.552150] systemd[1]: Reached target System Initialization. client # [ 7.553520] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 7.554834] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 7.556156] systemd[1]: Reached target Timer Units. client # [ 7.556875] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 7.558201] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 7.560935] systemd[1]: Starting Virtual Console Setup... client # [ 7.559821] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local). client # [ 7.564075] systemd[1]: Starting OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK)... client # [ 7.565223] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. client # [ 7.567463] systemd[1]: Starting nftables firewall... worker1 # [ 7.575969] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. worker1 # [ 7.579303] systemd[1]: Finished Save Transient machine-id to Disk. client # [ 7.575744] systemd[1]: Starting D-Bus System Message Bus... lb # [ 7.579755] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. lb # [ 7.587480] systemd[1]: Finished Save Transient machine-id to Disk. worker2 # [ 7.626258] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 worker2 # [ 7.657243] Console: switching to colour frame buffer device 160x50 client # [ 7.593956] systemd-ssh-issue[422]: Options --make-vsock/--rm-vsock have been replaced by make-vsock/rm-vsock verbs. client # [ 7.597116] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK). client # [ 7.598574] systemd[1]: Reached target Socket Units. worker2 # [ 7.753439] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker2 # [ 7.627432] systemd[1]: Finished register-nix-paths.service. worker2 # [ 7.629303] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 7.632210] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 7.636554] systemd[1]: Starting Virtual Console Setup... client # [ 7.635526] dbus-broker-launch[424]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 7.642158] systemd[1]: Finished Create System Files and Directories. client # [ 7.638302] dbus-broker-launch[424]: NSS returned no entry for 'systemd-timesync' worker1 # [ 7.645319] systemd[1]: Starting Rebuild Journal Catalog... client # [ 7.639519] dbus-broker-launch[424]: Invalid user-name in /nix/store/gzaysp48skjfi07r2nqzkw92g9dg17kq-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 7.644349] systemd[1]: Finished Create System Files and Directories. worker1 # [ 7.648230] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.782324] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) lb # [ 7.652251] systemd[1]: Condition check resulted in Virtio network device being skipped. lb # [ 7.653434] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore client # [ 7.651321] systemd[1]: Started D-Bus System Message Bus. client # [ 7.652277] systemd[1]: Reached target Basic System. lb # [ 7.655356] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. lb # [ 7.657360] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 client # [ 7.656117] systemd[1]: Started backdoor.service. lb # [ 7.663255] systemd[1]: Starting Rebuild Journal Catalog... lb # [ 7.664554] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore client # [ 7.662363] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 7.666065] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.667306] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os lb # [ 7.673577] systemd[1]: Starting Record System Boot/Shutdown in UTMP... worker2 # [ 7.810539] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 7.677167] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 7.680438] dbus-broker-launch[424]: Ready client # [ 7.684497] systemd[1]: Starting Post-Boot Actions... client # [ 7.692457] systemd[1]: Started Reset console on configuration changes. worker2 # [ 7.828436] ppdev: user-space parallel port driver client # [ 7.709588] systemd[1]: Starting resolvconf update... client # [ 7.721500] systemd[1]: Starting SSH Host Keys Generation... worker1 # [ 7.726888] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker2 # [ 7.763079] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker2 # [ 7.766219] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 7.770710] systemd[1]: Starting Virtual Console Setup... lb # [ 7.772521] systemd[1]: Finished Record System Boot/Shutdown in UTMP. worker1 # [ 7.779104] systemd[1]: Finished Rebuild Journal Catalog. worker1 # [ 7.781960] systemd[1]: Starting Update is Completed... client # connecting to host... client # [ 7.783261] systemd[1]: Finished Post-Boot Actions. lb # [ 7.802338] systemd[1]: Finished Rebuild Journal Catalog. client # [ 7.803691] nsncd[435]: Nov 07 15:07:43.777 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 7.810719] systemd[1]: Starting Update is Completed... client # [ 7.812779] systemd[1]: Started Name Service Cache Daemon (nsncd). client: Guest shell says: b'Spawning backdoor root shell...\n' client # [ 7.825237] systemd[1]: Reached target Host and Network Name Lookups. client # [ 7.826207] systemd[1]: Reached target User and Group Name Lookups. client # [ 7.837800] systemd[1]: Starting User Login Management... worker1 # [ 7.848541] systemd[1]: Condition check resulted in Virtio network device being skipped. worker1 # [ 7.850235] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker1 # [ 7.852799] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker1 # [ 7.854503] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker1 # [ 7.857214] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 7.999592] kvm_amd: TSC scaling supported client # [ 7.863598] systemd[1]: Finished Import lastlog data into lastlog2 database. worker2 # [ 7.999992] kvm_amd: Nested Virtualization enabled worker1 # [ 7.859670] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client: connected to guest root shell worker1 # [ 7.861381] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os client: (connecting took 8.57 seconds) worker2 # [ 8.000405] kvm_amd: Nested Paging enabled client: (finished: waiting for the VM to finish booting, in 8.57 seconds) worker2 # [ 8.000971] kvm_amd: LBR virtualization supported worker1 # [ 7.899113] systemd[1]: Finished Update is Completed. worker2 # [ 8.001385] kvm_amd: Virtual VMLOAD VMSAVE supported worker2 # [ 8.002257] kvm_amd: Virtual GIF supported worker2 # [ 8.002837] kvm_amd: Virtual NMI enabled worker2 # [ 8.032247] EDAC MC: Ver: 3.0.0 lb # [ 7.948131] systemd[1]: Finished Update is Completed. worker2 # [ 7.953428] systemd-vconsole-setup[520]: Configuration of first virtual console was skipped, ignoring remaining ones. worker1 # [ 8.091646] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console worker2 # [ 7.957231] systemd[1]: Finished Virtual Console Setup. worker2 # [ 7.958389] systemd[1]: Reached target System Initialization. worker2 # [ 7.959460] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 8.093981] mousedev: PS/2 mouse device common for all mice worker2 # [ 7.960671] systemd[1]: Started Daily Cleanup of Temporary Directories. worker2 # [ 7.962120] systemd[1]: Reached target Timer Units. worker2 # [ 7.962833] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 7.964714] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 7.965986] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local). worker2 # [ 7.969628] systemd[1]: Starting OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK)... worker2 # [ 7.970798] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker2 # [ 7.975146] systemd[1]: Starting D-Bus System Message Bus... client # [ 7.977298] systemd-logind[465]: New seat seat0. client # [ 7.978132] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 8.119130] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console client # [ 7.981495] systemd[1]: Stopping Host and Network Name Lookups... client # [ 7.984969] systemd[1]: Stopped target User and Group Name Lookups. client # [ 7.986126] systemd[1]: Stopping User and Group Name Lookups... client # [ 7.986985] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... client # [ 7.993887] systemd[1]: nscd.service: Deactivated successfully. client # [ 7.994762] systemd[1]: Stopped Name Service Cache Daemon (nsncd). client # [ 7.995686] systemd-logind[465]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard) worker2 # [ 7.997818] systemd-ssh-issue[524]: Options --make-vsock/--rm-vsock have been replaced by make-vsock/rm-vsock verbs. client # [ 7.996842] systemd-logind[465]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker2 # [ 8.000350] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK). worker2 # [ 8.001523] systemd[1]: Reached target Socket Units. client # [ 8.006346] systemd[1]: Started User Login Management. worker2 # [ 8.018310] dbus-broker-launch[525]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 8.020320] dbus-broker-launch[525]: NSS returned no entry for 'systemd-timesync' worker2 # [ 8.021437] dbus-broker-launch[525]: Invalid user-name in /nix/store/sbwhl2jiv5a7icfk0g28xi6s8g4dnql5-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 8.028612] systemd[1]: Started D-Bus System Message Bus. worker2 # [ 8.030066] systemd[1]: Reached target Basic System. worker2 # [ 8.033907] systemd[1]: Started backdoor.service. worker2 # [ 8.036699] systemd[1]: Starting Import lastlog data into lastlog2 database... worker2 # [ 8.040866] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.048077] systemd[1]: Starting Post-Boot Actions... worker2 # [ 8.050338] systemd[1]: Started Reset console on configuration changes. client # [ 8.051095] systemd[1]: Starting linger-users.service... worker2 # [ 8.058077] systemd[1]: Starting resolvconf update... client # [ 8.058024] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.061155] systemd[1]: Starting SSH Host Keys Generation... worker1 # [ 8.088859] systemd[1]: Finished Firewall. worker2 # [ 8.094494] dbus-broker-launch[525]: Ready client # [ 8.130501] systemd[1]: linger-users.service: Deactivated successfully. client # [ 8.134316] systemd[1]: Finished linger-users.service. client # [ 8.136950] systemd[1]: Finished resolvconf update. client # [ 8.147472] systemd[1]: Starting DHCP Client... worker2 # [ 8.149839] systemd[1]: Finished Post-Boot Actions. client # [ 8.148449] nsncd[533]: Nov 07 15:07:44.121 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" client # [ 8.151949] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.154821] systemd[1]: Reached target Host and Network Name Lookups. client # [ 8.158226] systemd[1]: Reached target User and Group Name Lookups. worker2 # [ 8.162680] nsncd[530]: Nov 07 15:07:43.372 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 8.167544] systemd[1]: Started Name Service Cache Daemon (nsncd). worker2 # [ 8.169792] systemd[1]: Reached target Host and Network Name Lookups. worker2 # connecting to host... worker1 # [ 8.174054] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 8.173563] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 8.176327] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 8.175701] systemd[1]: Starting User Login Management... worker2 # [ 8.197613] systemd[1]: Finished Import lastlog data into lastlog2 database. worker1 # [ 8.128069] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input3 worker1 # [ 8.290062] mousedev: PS/2 mouse device common for all mice worker1 # [ 8.291848] rtc_cmos PNP0B00:00: RTC can wake from S4 worker1 # [ 8.323011] rtc_cmos PNP0B00:00: registered as rtc0 worker1 # [ 8.323078] rtc_cmos PNP0B00:00: setting system clock to 2026-11-07T15:07:43 UTC (1794064063) worker1 # [ 8.323156] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs worker1 # [ 8.324609] systemd-journald[283]: Time jumped backwards, rotating. worker1 # [ 8.330224] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized worker1 # [ 8.333590] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 8.156694] input: QEMU Virtio Keyboard as /devices/pci0000:00/0000:00:06.0/virtio4/input/input3 lb # [ 8.327145] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized lb # [ 8.338933] rtc_cmos PNP0B00:00: RTC can wake from S4 lb # [ 8.283221] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. lb # [ 8.284636] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 8.288872] systemd[1]: Stopped target Host and Network Name Lookups. worker2 # [ 8.289859] systemd[1]: Stopping Host and Network Name Lookups... worker2 # [ 8.290782] systemd[1]: Stopped target User and Group Name Lookups. worker2 # [ 8.291675] systemd[1]: Stopping User and Group Name Lookups... worker2 # [ 8.292525] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 8.299477] systemd-logind[555]: New seat seat0. worker2 # [ 8.306080] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 8.306873] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 8.308734] systemd-logind[555]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard) worker2 # [ 8.310586] systemd-logind[555]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) worker1 # [ 8.333674] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] worker1 # [ 8.352007] Console: switching to colour dummy device 80x25 worker1 # [ 8.450118] [drm] Found bochs VGA, ID 0xb0c5. worker1 # [ 8.450120] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. worker2 # [ 8.315817] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker2 # [ 8.316695] systemd[1]: Started User Login Management. worker2 # [ 8.318660] systemd[1]: Starting linger-users.service... worker1 # [ 8.460060] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt worker1 # [ 8.460693] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD lb # [ 8.354135] parport_pc 00:02: reported by Plug and Play ACPI lb # [ 8.363596] rtc_cmos PNP0B00:00: registered as rtc0 lb # [ 8.363670] rtc_cmos PNP0B00:00: setting system clock to 2026-11-07T15:07:43 UTC (1794064063) worker1 # [ 8.473009] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic worker1 # [ 8.473647] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 lb # [ 8.363765] rtc_cmos PNP0B00:00: alarms up to one day, y3k, 242 bytes nvram, hpet irqs lb # [ 8.365682] systemd-journald[285]: Time jumped backwards, rotating. lb # [ 8.380320] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)] lb # [ 8.368875] systemd[1]: Finished register-nix-paths.service. client # [ 8.366969] dhcpcd[566]: dhcpcd-10.3.2 starting lb # [ 8.371906] systemd[1]: Reached target System Initialization. lb # [ 8.373840] systemd[1]: Started Discard unused filesystem blocks once a week. lb # [ 8.374916] systemd[1]: Started niks3 garbage collection timer. lb # [ 8.376274] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 8.373667] dhcpcd[573]: dev: loaded udev lb # [ 8.378292] systemd[1]: Reached target Timer Units. lb # [ 8.379773] systemd[1]: Listening on D-Bus System Message Bus Socket. worker2 # [ 8.381549] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 8.384768] systemd[1]: Listening on niks3 server socket. lb # [ 8.385618] systemd[1]: Listening on Nix Daemon Socket. worker2 # [ 8.384956] systemd[1]: Finished linger-users.service. worker2 # [ 8.387952] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 8.389410] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local). worker2 # [ 8.388983] nsncd[605]: Nov 07 15:07:43.600 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker2 # [ 8.393121] systemd[1]: Reached target Host and Network Name Lookups. worker2 # [ 8.394482] systemd[1]: Reached target User and Group Name Lookups. lb # [ 8.396531] systemd[1]: Starting OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK)... lb # [ 8.397752] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. lb # [ 8.404191] systemd[1]: Finished Firewall. worker2 # [ 8.407185] systemd[1]: Finished resolvconf update. worker2 # [ 8.407877] systemd[1]: Reached target Preparation for Network. lb # [ 8.413349] Console: switching to colour dummy device 80x25 lb # [ 8.481788] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt lb # [ 8.481930] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD worker2 # [ 8.413048] systemd[1]: Starting DHCP Client... client # [ 8.543251] 8021q: 802.1Q VLAN Support v1.8 lb # [ 8.417532] systemd[1]: Starting D-Bus System Message Bus... worker2 # [ 8.418427] systemd[1]: Starting Address configuration of eth1... worker2 # [ 8.424073] systemd[1]: Starting Extra networking commands.... lb # [ 8.446311] systemd-ssh-issue[522]: Options --make-vsock/--rm-vsock have been replaced by make-vsock/rm-vsock verbs. lb # [ 8.453057] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK). lb # [ 8.455827] systemd[1]: Reached target Socket Units. lb # [ 8.592682] [drm] Found bochs VGA, ID 0xb0c5. lb # [ 8.592686] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfebd0000. lb # [ 8.595442] bochs-drm 0000:00:01.0: [drm] Registered 1 planes with drm panic lb # [ 8.596133] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0 client # [ 8.461379] systemd[1]: Finished nftables firewall. client # [ 8.463513] systemd[1]: Reached target Preparation for Network. worker1 # [ 8.469896] systemd[1]: Starting Virtual Console Setup... lb # [ 8.604017] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 lb # [ 8.606850] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 client # [ 8.473134] systemd[1]: Starting Address configuration of eth1... client # [ 8.479221] systemd[1]: Starting Extra networking commands.... lb # [ 8.495785] systemd[1]: Starting Virtual Console Setup... client # [ 8.503054] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 8.512328] network-addresses-eth1-start[635]: adding address 192.168.1.4/24... done worker1 # [ 8.538191] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input5 worker2 # [ 8.527438] network-addresses-eth1-start[635]: adding address 2001:db8:1::4/64... done worker1 # [ 8.538442] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 worker1 # [ 8.645697] Console: switching to colour frame buffer device 160x50 lb # [ 8.542448] dbus-broker-launch[524]: Looking up NSS user entry for 'systemd-timesync'... worker1 # [ 8.678581] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device worker1 # [ 8.511106] systemd[1]: Finished register-nix-paths.service. worker2 # [ 8.547458] systemd[1]: Finished Address configuration of eth1. worker1 # [ 8.554191] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.555534] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.557185] systemd[1]: Starting Virtual Console Setup... worker1 # [ 8.711510] ppdev: user-space parallel port driver worker1 # [ 8.725768] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) worker1 # [ 8.753243] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0) client # [ 8.747552] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker2 # [ 8.622825] dhcpcd[644]: dhcpcd-10.3.2 starting client # [ 8.752987] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' client # [ 8.755723] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' lb # [ 8.753225] ppdev: user-space parallel port driver client # [ 8.758064] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 8.629521] dhcpcd[699]: dev: loaded udev client # [ 8.758862] cfg80211: failed to load regulatory.db worker2 # [ 8.630715] systemd[1]: Finished Extra networking commands.. worker2 # [ 8.633310] systemd[1]: Reached target Network. worker2 # [ 8.633933] systemd[1]: Starting Permit User Sessions... worker1 # [ 8.648099] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. worker1 # [ 8.651191] systemd[1]: Stopped Virtual Console Setup. worker1 # [ 8.652691] systemd[1]: Starting Virtual Console Setup... worker2 # [ 8.794030] 8021q: 802.1Q VLAN Support v1.8 client # [ 8.791319] 8021q: adding VLAN 0 to HW filter on device eth1 worker2 # [ 8.796191] 8021q: adding VLAN 0 to HW filter on device eth1 client # [ 8.692185] network-addresses-eth1-start[580]: adding address 192.168.1.1/24... done client # [ 8.696861] dhcpcd[594]: /nix/store/b0pjy70gw2ag8316wfzh6wwfy8y51008-openresolv-3.17.4/sbin/.resolvconf-wrapped: line 1250: kill: (582) - Operation not permitted client # [ 8.698987] dhcpcd[594]: .resolvconf-wrapped: clearing stale lock pid 582 lb # [ 8.761319] Console: switching to colour frame buffer device 160x50 lb # [ 8.782820] iTCO_wdt iTCO_wdt.0.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660) client # [ 8.715598] network-addresses-eth1-start[580]: adding address 2001:db8:1::1/64... done worker2 # [ 8.728208] systemd[1]: Finished Permit User Sessions. worker2 # [ 8.728971] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker2 # [ 8.734388] systemd[1]: Started Getty on tty1. worker2 # [ 8.735445] systemd[1]: Reached target Login Prompts. client # [ 8.739443] systemd[1]: Finished Address configuration of eth1. worker1 # [ 8.878935] kvm_amd: TSC scaling supported worker1 # [ 8.879451] kvm_amd: Nested Virtualization enabled worker1 # [ 8.879872] kvm_amd: Nested Paging enabled worker1 # [ 8.880415] kvm_amd: LBR virtualization supported worker1 # [ 8.880847] kvm_amd: Virtual VMLOAD VMSAVE supported worker1 # [ 8.881677] kvm_amd: Virtual GIF supported worker1 # [ 8.882268] kvm_amd: Virtual NMI enabled client # [ 8.878462] 8021q: adding VLAN 0 to HW filter on device eth0 client # [ 8.750726] dhcpcd[573]: eth0: waiting for carrier client # [ 8.751485] dhcpcd[573]: eth0: carrier acquired lb # [ 8.788059] iTCO_wdt iTCO_wdt.0.auto: initialized. heartbeat=30 sec (nowayout=0) lb # [ 8.900036] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device lb # [ 8.549568] dbus-broker-launch[524]: NSS returned no entry for 'systemd-timesync' client # [ 8.766724] dhcpcd[573]: DUID 00:01:00:01:32:81:fb:40:52:54:00:12:34:56 client # [ 8.767652] dhcpcd[573]: eth0: IAID 00:12:34:56 client # [ 8.768288] dhcpcd[573]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 8.770482] dbus-broker-launch[524]: Invalid user-name in /nix/store/4fv08np9vas9fjdx49fqx84x5z3nxlmx-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" lb # [ 8.772736] systemd[1]: Started D-Bus System Message Bus. lb # connecting to host... worker1 # [ 8.908515] EDAC MC: Ver: 3.0.0 lb # [ 8.774884] systemd[1]: Reached target Basic System. lb # [ 8.780360] systemd[1]: Started backdoor.service. lb # [ 8.781689] systemd[1]: Starting Import lastlog data into lastlog2 database... lb # [ 8.786494] nsncd[533]: Nov 07 15:07:43.956 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 8.789790] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 8.793634] dbus-broker-launch[524]: Ready lb # [ 8.795804] systemd[1]: Starting Post-Boot Actions... lb # [ 8.801146] systemd[1]: Started Reset console on configuration changes. lb # [ 8.802355] systemd[1]: Starting resolvconf update... lb # [ 8.804570] systemd[1]: Starting SSH Host Keys Generation... lb # [ 8.808132] systemd[1]: Started Name Service Cache Daemon (nsncd). client # [ 8.805495] systemd[1]: Finished Extra networking commands.. lb # [ 8.808984] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 8.810817] systemd[1]: Reached target User and Group Name Lookups. client # [ 8.808080] systemd[1]: Reached target Network. lb # [ 8.813072] systemd[1]: Starting User Login Management... lb # [ 8.813857] systemd[1]: Finished Post-Boot Actions. client # [ 8.810847] systemd[1]: Starting Permit User Sessions... worker2 # [ 8.948254] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 8.817474] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 8.818371] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. lb # [ 8.819361] systemd[1]: Stopped Virtual Console Setup. worker2 # [ 8.951175] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker2 # [ 8.953485] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker2 # [ 8.955283] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker2 # [ 8.956151] cfg80211: failed to load regulatory.db client # [ 8.829211] sshd-keygen-start[480]: Generating public/private rsa key pair. client # [ 8.830283] sshd-keygen-start[480]: Your identification has been saved in /etc/ssh/ssh_host_rsa_key worker1 # [ 8.833955] systemd-vconsole-setup[521]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 8.834375] systemd[1]: Starting Virtual Console Setup... client # [ 8.831591] sshd-keygen-start[480]: Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub client # [ 8.832730] sshd-keygen-start[480]: The key fingerprint is: worker1 # [ 8.838143] systemd[1]: Finished Virtual Console Setup. client # [ 8.833531] sshd-keygen-start[480]: SHA256:scYVmvb5RkQX+HJ5FfhCDDEVRma3isDUc3DmpIlVfvo root@client worker1 # [ 8.838860] systemd[1]: Reached target System Initialization. client # [ 8.834597] sshd-keygen-start[480]: The key's randomart image is: client # [ 8.835427] sshd-keygen-start[480]: +---[RSA 4096]----+ worker1 # [ 8.839885] systemd[1]: Started Discard unused filesystem blocks once a week. client # [ 8.836066] sshd-keygen-start[480]: | .o*X&=+.| client # [ 8.836761] sshd-keygen-start[480]: | ooo=#*. o| worker1 # [ 8.841700] systemd[1]: Started Daily Cleanup of Temporary Directories. client # [ 8.837451] sshd-keygen-start[480]: | =+.o=+.+.| worker1 # [ 8.842689] systemd[1]: Reached target Timer Units. client # [ 8.838088] sshd-keygen-start[480]: | o =.oo.B..| client # [ 8.838751] sshd-keygen-start[480]: | S o..=.. | worker1 # [ 8.843610] systemd[1]: Listening on D-Bus System Message Bus Socket. client # [ 8.839964] sshd-keygen-start[480]: | . o . | client # [ 8.840735] sshd-keygen-start[480]: | o E | worker1 # [ 8.845650] systemd[1]: Listening on Nix Daemon Socket. client # [ 8.841561] sshd-keygen-start[480]: | . | client # [ 8.842213] sshd-keygen-start[480]: | | worker1 # [ 8.846567] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_UNIX Local). client # [ 8.842888] sshd-keygen-start[480]: +----[SHA256]-----+ worker1 # [ 8.849938] systemd[1]: Starting OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK)... worker1 # [ 8.851133] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. worker1 # [ 8.854652] systemd[1]: Starting D-Bus System Message Bus... client # [ 8.855561] systemd[1]: Finished Permit User Sessions. client # [ 8.860634] systemd[1]: Started Getty on tty1. client # [ 8.863661] systemd[1]: Reached target Login Prompts. worker2 # [ 8.999570] 8021q: adding VLAN 0 to HW filter on device eth0 worker2 # [ 8.869230] dhcpcd[699]: eth0: waiting for carrier worker1 # [ 8.876252] systemd-ssh-issue[525]: Options --make-vsock/--rm-vsock have been replaced by make-vsock/rm-vsock verbs. client # [ 8.874592] sshd-keygen-start[658]: Generating public/private ed25519 key pair. worker1 # [ 8.879956] systemd[1]: Listening on OpenSSH Server Socket (systemd-ssh-generator, AF_VSOCK). client # [ 8.875835] sshd-keygen-start[658]: Your identification has been saved in /etc/ssh/ssh_host_ed25519_key worker1 # [ 8.881298] systemd[1]: Reached target Socket Units. client # [ 8.877115] sshd-keygen-start[658]: Your public key has been saved in /etc/ssh/ssh_host_ed25519_key.pub client # [ 8.878232] sshd-keygen-start[658]: The key fingerprint is: client # [ 8.878948] sshd-keygen-start[658]: SHA256:q1yPHdF7gdBP9ryrdhN1Gd0QvJypmCdKBr+Vwr+b6UY root@client client # [ 8.880093] sshd-keygen-start[658]: The key's randomart image is: client # [ 8.881196] sshd-keygen-start[658]: +--[ED25519 256]--+ client # [ 8.881881] sshd-keygen-start[658]: | .ooo| client # [ 8.882912] sshd-keygen-start[658]: | . ..o| client # [ 8.883725] sshd-keygen-start[658]: | . ..o+o| client # [ 8.884573] sshd-keygen-start[658]: | . o ==+o| client # [ 8.885268] sshd-keygen-start[658]: | +S .+o.o =| client # [ 8.885962] sshd-keygen-start[658]: | *.E.o. o.| client # [ 8.887086] sshd-keygen-start[658]: | ooB.o. ...| client # [ 8.887792] sshd-keygen-start[658]: | . oo+o+ o o.| client # [ 8.889148] sshd-keygen-start[658]: | o .oOo..o..| client # [ 8.889837] sshd-keygen-start[658]: +----[SHA256]-----+ client # [ 8.890684] systemd[1]: sshd-keygen.service: Deactivated successfully. client # [ 8.891785] systemd[1]: Finished SSH Host Keys Generation. worker1 # [ 8.897892] dbus-broker-launch[526]: Looking up NSS user entry for 'systemd-timesync'... client # [ 8.894976] systemd[1]: Starting SSH Daemon... worker1 # [ 8.899826] dbus-broker-launch[526]: NSS returned no entry for 'systemd-timesync' worker1 # [ 8.900906] dbus-broker-launch[526]: Invalid user-name in /nix/store/xzcbrzm56dcslzq4zybyrbh2hx274d7i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker1 # [ 8.907851] systemd[1]: Started D-Bus System Message Bus. worker1 # [ 8.909651] systemd[1]: Reached target Basic System. worker1 # [ 8.913028] systemd[1]: Starting Nix worker-protocol over gRPC... worker1 # [ 8.915866] systemd[1]: Started backdoor.service. worker1 # [ 8.920952] systemd[1]: Starting Import lastlog data into lastlog2 database... client # [ 8.918352] sshd[660]: Server listening on 0.0.0.0 port 22. worker1 # [ 8.923336] systemd[1]: Starting Name Service Cache Daemon (nsncd)... client # [ 8.919553] sshd[660]: Server listening on :: port 22. client # [ 8.920585] systemd[1]: Started SSH Daemon. worker1 # [ 8.929168] systemd[1]: Starting Post-Boot Actions... worker1 # [ 8.936567] systemd[1]: Started Reset console on configuration changes. worker1 # [ 8.941558] systemd[1]: Starting resolvconf update... worker1 # [ 8.954242] systemd[1]: Starting SSH Host Keys Generation... worker2 # [ 8.971766] sshd-keygen-start[569]: Generating public/private rsa key pair. worker2 # [ 8.972803] sshd-keygen-start[569]: Your identification has been saved in /etc/ssh/ssh_host_rsa_key worker2 # [ 8.973963] sshd-keygen-start[569]: Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub worker2 # [ 8.975490] sshd-keygen-start[569]: The key fingerprint is: worker2 # [ 8.976302] sshd-keygen-start[569]: SHA256:bEiGO4afIEAcL8w7HqjRMT2mHtWdme3oXu1N+Tb6Kls root@worker2 worker2 # [ 8.977442] sshd-keygen-start[569]: The key's randomart image is: worker2 # [ 8.978310] sshd-keygen-start[569]: +---[RSA 4096]----+ worker2 # [ 8.978963] sshd-keygen-start[569]: |.o. | worker2 # [ 8.979657] sshd-keygen-start[569]: |+... o . = | worker2 # [ 8.980373] sshd-keygen-start[569]: |.+o.* + = . | worker2 # [ 8.980996] sshd-keygen-start[569]: |o.oB = o o | worker2 # [ 8.981721] sshd-keygen-start[569]: |++* + . S . | worker2 # [ 8.982443] sshd-keygen-start[569]: |o+o= o o . . | worker2 # [ 8.983634] sshd-keygen-start[569]: |... o . . .Eo | worker2 # [ 8.984502] sshd-keygen-start[569]: | . . o.o o.| worker2 # [ 8.985216] sshd-keygen-start[569]: | . .+o=oo| worker2 # [ 8.986152] sshd-keygen-start[569]: +----[SHA256]-----+ lb # [ 8.990896] systemd[1]: Stopped target Host and Network Name Lookups. lb # [ 8.991941] systemd[1]: Stopping Host and Network Name Lookups... lb # [ 8.992815] systemd[1]: Stopped target User and Group Name Lookups. lb # [ 8.993725] systemd[1]: Stopping User and Group Name Lookups... lb # [ 8.994603] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker2 # [ 9.002707] sshd-keygen-start[719]: Generating public/private ed25519 key pair. lb # [ 9.005479] systemd[1]: nscd.service: Deactivated successfully. worker2 # [ 9.003952] sshd-keygen-start[719]: Your identification has been saved in /etc/ssh/ssh_host_ed25519_key worker2 # [ 9.005153] sshd-keygen-start[719]: Your public key has been saved in /etc/ssh/ssh_host_ed25519_key.pub worker2 # [ 9.006463] sshd-keygen-start[719]: The key fingerprint is: worker2 # [ 9.007290] sshd-keygen-start[719]: SHA256:5KYgTKBLwc1omD4Bj/nbSYntx4nYt0zFHfOMOXsa02Y root@worker2 lb # [ 9.010120] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker2 # [ 9.008622] sshd-keygen-start[719]: The key's randomart image is: worker2 # [ 9.009486] sshd-keygen-start[719]: +--[ED25519 256]--+ worker2 # [ 9.010999] sshd-keygen-start[719]: |*o+ | worker2 # [ 9.011752] sshd-keygen-start[719]: |+X.o | worker2 # [ 9.012485] sshd-keygen-start[719]: |*.+ . o | worker2 # [ 9.014158] sshd-keygen-start[719]: |.B o . + . B | worker2 # [ 9.014793] sshd-keygen-start[719]: |. * = S = o | worker2 # [ 9.015520] sshd-keygen-start[719]: | O = = + | worker2 # [ 9.016322] sshd-keygen-start[719]: | o * B + E | worker2 # [ 9.016995] sshd-keygen-start[719]: | = . B | worker2 # [ 9.017695] sshd-keygen-start[719]: | o . | worker2 # [ 9.018438] sshd-keygen-start[719]: +----[SHA256]-----+ worker2 # [ 9.019401] systemd[1]: sshd-keygen.service: Deactivated successfully. worker2 # [ 9.021427] systemd[1]: Finished SSH Host Keys Generation. lb # [ 9.024332] systemd-logind[553]: New seat seat0. worker2 # [ 9.023729] systemd[1]: Starting SSH Daemon... worker1 # [ 9.028613] dbus-broker-launch[526]: Ready lb # [ 9.030616] systemd-logind[553]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard) lb # [ 9.031845] systemd[1]: Starting Name Service Cache Daemon (nsncd)... lb # [ 9.037519] systemd-logind[553]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 9.038813] systemd[1]: Started User Login Management. lb # [ 9.045149] systemd[1]: Starting linger-users.service... worker2 # [ 9.046307] sshd[721]: Server listening on 0.0.0.0 port 22. worker2 # [ 9.047558] sshd[721]: Server listening on :: port 22. worker2 # [ 9.048802] systemd[1]: Started SSH Daemon. worker1 # [ 9.099905] nix-grpc-daemon[529]: ts=2026-11-07T15:07:44Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker1 # [ 9.121537] nix-grpc-daemon[529]: ts=2026-11-07T15:07:44Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker1 # [ 9.127429] nix-grpc-daemon[529]: ts=2026-11-07T15:07:44Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.3:50051 niks3=http://lb:5751 max_jobs=1 worker1 # [ 9.131558] systemd[1]: Finished Post-Boot Actions. lb # [ 9.133603] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 9.134869] nsncd[617]: Nov 07 15:07:44.401 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 9.139234] systemd[1]: linger-users.service: Deactivated successfully. lb # [ 9.143286] systemd[1]: Finished linger-users.service. lb # [ 9.144058] systemd[1]: Reached target Host and Network Name Lookups. lb # [ 9.144932] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.148088] nix-grpc-daemon[529]: ts=2026-11-07T15:07:44Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker1 # [ 9.151669] systemd[1]: Started Nix worker-protocol over gRPC. client: (finished: waiting for unit network-addresses-eth1.service, in 9.83 seconds) client: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; } lb # [ 9.293211] kvm_amd: TSC scaling supported worker1 # [ 9.161221] nix-grpc-daemon[529]: ts=2026-11-07T15:07:44Z level=info event=scheduler_lock_lost error="error: http://lb:5751/api/farm/lead: Could not connect to server" lb # [ 9.293679] kvm_amd: Nested Virtualization enabled lb # [ 9.294122] kvm_amd: Nested Paging enabled worker1 # [ 9.166277] systemd[1]: Started Name Service Cache Daemon (nsncd). lb # [ 9.298711] kvm_amd: LBR virtualization supported lb # [ 9.299260] kvm_amd: Virtual VMLOAD VMSAVE supported lb # [ 9.299745] kvm_amd: Virtual GIF supported lb # [ 9.300120] kvm_amd: Virtual NMI enabled worker1 # [ 9.173873] systemd[1]: Reached target Host and Network Name Lookups. worker1 # connecting to host... client: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.1/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit network-addresses-eth1.service lb: waiting for the VM to finish booting lb: Guest shell says: b'Spawning backdoor root shell...\n' lb: connected to guest root shell lb: (connecting took 0.00 seconds) lb: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker1 # [ 9.179706] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.180589] systemd[1]: Starting User Login Management... worker1 # [ 9.183931] nsncd[532]: Nov 07 15:07:44.472 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" lb # [ 9.194898] systemd[1]: Finished resolvconf update. lb # [ 9.198159] systemd[1]: Reached target Preparation for Network. lb # [ 9.212154] systemd[1]: Starting DHCP Client... lb # [ 9.216113] systemd[1]: Starting Address configuration of eth1... lb # [ 9.220915] systemd[1]: Starting Extra networking commands.... worker1 # [ 9.227172] nix-grpc-daemon[529]: ts=2026-11-07T15:07:44Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker1 # [ 9.237270] systemd[1]: Finished Import lastlog data into lastlog2 database. lb # [ 9.369122] EDAC MC: Ver: 3.0.0 worker1 # [ 9.328034] systemd[1]: Stopped target Host and Network Name Lookups. worker1 # [ 9.331256] systemd[1]: Stopping Host and Network Name Lookups... worker1 # [ 9.334247] systemd[1]: Stopped target User and Group Name Lookups. worker1 # [ 9.337450] systemd[1]: Stopping User and Group Name Lookups... worker1 # [ 9.338606] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... worker1 # [ 9.339506] systemd[1]: nscd.service: Deactivated successfully. worker1 # [ 9.342114] systemd[1]: Stopped Name Service Cache Daemon (nsncd). worker1 # [ 9.346243] systemd[1]: Starting Name Service Cache Daemon (nsncd)... worker1 # [ 9.357026] systemd-logind[608]: New seat seat0. lb # [ 9.360107] sshd-keygen-start[576]: Generating public/private rsa key pair. lb # [ 9.361163] sshd-keygen-start[576]: Your identification has been saved in /etc/ssh/ssh_host_rsa_key lb # [ 9.362348] sshd-keygen-start[576]: Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub lb # [ 9.363437] sshd-keygen-start[576]: The key fingerprint is: worker1 # [ 9.364731] systemd-logind[608]: Watching system buttons on /dev/input/event2 (QEMU Virtio Keyboard) worker1 # [ 9.365911] systemd-logind[608]: Watching system buttons on /dev/input/event0 (AT Translated Set 2 keyboard) lb # [ 9.365823] sshd-keygen-start[576]: SHA256:IOeFqFanxPSLBbNKW0WEQiiIUHbEXxCn7MJWjdyhTX8 root@lb lb # [ 9.367117] sshd-keygen-start[576]: The key's randomart image is: worker1 # [ 9.369329] systemd[1]: Started User Login Management. lb # [ 9.367911] sshd-keygen-start[576]: +---[RSA 4096]----+ lb # [ 9.369527] sshd-keygen-start[576]: |=++o*+*o+ | lb # [ 9.370670] sshd-keygen-start[576]: |=..+oX @.o | lb # [ 9.371419] sshd-keygen-start[576]: |. ..O.#.= . E | lb # [ 9.372654] sshd-keygen-start[576]: | . O @.+ . | worker1 # [ 9.374243] systemd[1]: Starting linger-users.service... lb # [ 9.373844] sshd-keygen-start[576]: | = * + S | lb # [ 9.375289] sshd-keygen-start[576]: | . . . | lb # [ 9.375974] sshd-keygen-start[576]: | | lb # [ 9.377724] sshd-keygen-start[576]: | | lb # [ 9.378957] sshd-keygen-start[576]: | | lb # [ 9.380228] sshd-keygen-start[576]: +----[SHA256]-----+ lb # [ 9.381223] network-addresses-eth1-start[648]: adding address 192.168.1.2/24... done lb # [ 9.397100] network-addresses-eth1-start[648]: adding address 2001:db8:1::2/64... done lb # [ 9.423125] systemd[1]: Finished Address configuration of eth1. worker1 # [ 9.424809] systemd[1]: Started Name Service Cache Daemon (nsncd). worker1 # [ 9.427152] systemd[1]: Reached target Host and Network Name Lookups. worker1 # [ 9.428936] systemd[1]: Reached target User and Group Name Lookups. worker1 # [ 9.432239] nsncd[659]: Nov 07 15:07:44.737 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" worker1 # [ 9.434597] nix-grpc-daemon[529]: ts=2026-11-07T15:07:44Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" worker1 # [ 9.444093] systemd[1]: linger-users.service: Deactivated successfully. worker1 # [ 9.445925] systemd[1]: Finished linger-users.service. lb # [ 9.448923] sshd-keygen-start[696]: Generating public/private ed25519 key pair. worker1 # [ 9.452110] systemd[1]: Finished resolvconf update. lb # [ 9.450445] sshd-keygen-start[696]: Your identification has been saved in /etc/ssh/ssh_host_ed25519_key worker1 # [ 9.452766] systemd[1]: Reached target Preparation for Network. lb # [ 9.452085] sshd-keygen-start[696]: Your public key has been saved in /etc/ssh/ssh_host_ed25519_key.pub lb # [ 9.453507] sshd-keygen-start[696]: The key fingerprint is: lb # [ 9.454279] sshd-keygen-start[696]: SHA256:SQlPn0/lZqp84b+K/EEHCps97O36RUZFFTA/gvCW3YY root@lb lb # [ 9.456130] sshd-keygen-start[696]: The key's randomart image is: lb # [ 9.457045] sshd-keygen-start[696]: +--[ED25519 256]--+ lb # [ 9.457839] sshd-keygen-start[696]: | . .. ooo*| worker1 # [ 9.459714] systemd[1]: Starting DHCP Client... lb # [ 9.458574] sshd-keygen-start[696]: | + oo.+o=. | lb # [ 9.460088] sshd-keygen-start[696]: | = o=oE== | lb # [ 9.460849] sshd-keygen-start[696]: | . B.+ *o .| lb # [ 9.461618] sshd-keygen-start[696]: | S = = + | worker1 # [ 9.463182] systemd[1]: Starting Address configuration of eth1... lb # [ 9.463100] sshd-keygen-start[696]: | o * = | lb # [ 9.463864] sshd-keygen-start[696]: | + = . | lb # [ 9.464566] sshd-keygen-start[696]: | . + + | lb # [ 9.465270] sshd-keygen-start[696]: | ++=.o. | worker1 # [ 9.467066] systemd[1]: Starting Extra networking commands.... lb # [ 9.465969] sshd-keygen-start[696]: +----[SHA256]-----+ lb # [ 9.471454] systemd[1]: sshd-keygen.service: Deactivated successfully. lb # [ 9.473100] systemd[1]: Finished SSH Host Keys Generation. lb # [ 9.491806] dhcpcd[658]: dhcpcd-10.3.2 starting lb # [ 9.495749] dhcpcd[718]: dev: loaded udev lb # [ 9.640160] 8021q: 802.1Q VLAN Support v1.8 lb # [ 9.640712] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 9.510079] systemd[1]: Finished Extra networking commands.. lb # [ 9.511756] systemd[1]: Reached target Network. worker2 # [ 9.509890] dhcpcd[699]: eth0: carrier acquired lb # [ 9.516932] systemd[1]: Starting PostgreSQL Server... lb # [ 9.522140] systemd[1]: Starting SSH Daemon... worker2 # [ 9.521210] dhcpcd[699]: DUID 00:01:00:01:32:81:fb:40:52:54:00:12:34:56 worker2 # [ 9.523877] dhcpcd[699]: eth0: IAID 00:12:34:56 worker2 # [ 9.525702] dhcpcd[699]: eth0: adding address fe80::5054:ff:fe12:3456 lb # [ 9.528992] systemd[1]: Starting Permit User Sessions... worker1 # [ 9.556365] network-addresses-eth1-start[688]: adding address 192.168.1.3/24... done lb # [ 9.556551] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. worker1 # [ 9.570195] network-addresses-eth1-start[688]: adding address 2001:db8:1::3/64... done lb # [ 9.583552] systemd[1]: Finished Permit User Sessions. worker1 # [ 9.590184] systemd[1]: Finished Address configuration of eth1. lb # [ 9.594816] systemd[1]: Started Getty on tty1. lb # [ 9.599772] systemd[1]: Reached target Login Prompts. lb # [ 9.629646] sshd[725]: Server listening on 0.0.0.0 port 22. lb # [ 9.630512] sshd[725]: Server listening on :: port 22. lb # [ 9.632100] systemd[1]: Started SSH Daemon. lb # [ 9.800251] cfg80211: Loading compiled-in X.509 certificates for regulatory database lb # [ 9.802744] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 9.671896] systemd[1]: Finished Extra networking commands.. worker1 # [ 9.672768] systemd[1]: Reached target Network. lb # [ 9.803409] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 9.674681] systemd[1]: Starting Permit User Sessions... lb # [ 9.805762] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 lb # [ 9.806571] cfg80211: failed to load regulatory.db worker1 # [ 9.683224] dhcpcd[699]: dhcpcd-10.3.2 starting worker1 # [ 9.687365] dhcpcd[754]: dev: loaded udev lb # [ 9.705469] systemd-vconsole-setup[573]: Configuration of first virtual console was skipped, ignoring remaining ones. lb # [ 9.710304] systemd[1]: Finished Virtual Console Setup. worker1 # [ 9.845435] 8021q: 802.1Q VLAN Support v1.8 worker1 # [ 9.845870] 8021q: adding VLAN 0 to HW filter on device eth1 lb # [ 9.858862] 8021q: adding VLAN 0 to HW filter on device eth0 lb # [ 9.727780] dhcpcd[718]: eth0: waiting for carrier lb # [ 9.728931] dhcpcd[718]: eth0: carrier acquired lb # [ 9.734775] dhcpcd[718]: DUID 00:01:00:01:32:81:fb:41:52:54:00:12:34:56 lb # [ 9.735930] dhcpcd[718]: eth0: IAID 00:12:34:56 lb # [ 9.736790] dhcpcd[718]: eth0: adding address fe80::5054:ff:fe12:3456 worker1 # [ 9.750202] systemd[1]: Finished Permit User Sessions. worker1 # [ 9.755240] systemd[1]: Started Getty on tty1. worker1 # [ 9.755888] systemd[1]: Reached target Login Prompts. lb # [ 9.757663] postgresql-pre-start[736]: The files belonging to this database system will be owned by user "postgres". lb # [ 9.759054] postgresql-pre-start[736]: This user must also own the server process. lb # [ 9.761655] postgresql-pre-start[736]: The database cluster will be initialized with locale "en_US.UTF-8". lb # [ 9.763113] postgresql-pre-start[736]: The default database encoding has accordingly been set to "UTF8". lb # [ 9.764244] postgresql-pre-start[736]: The default text search configuration will be set to "english". lb # [ 9.766186] postgresql-pre-start[736]: Data page checksums are enabled. lb # [ 9.767115] postgresql-pre-start[736]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok lb # [ 9.768280] postgresql-pre-start[736]: creating subdirectories ... ok lb # [ 9.769123] postgresql-pre-start[736]: selecting dynamic shared memory implementation ... posix worker1 # [ 9.785959] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. lb # [ 9.822864] postgresql-pre-start[736]: selecting default "max_connections" ... 100 worker1 # [ 9.828306] nix-grpc-daemon[529]: ts=2026-11-07T15:07:45Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: FAILED_PRECONDITION: ipv4:192.168.1.2:50051: connect failed: addr: ipv4:192.168.1.2:50051 error: Network is unreachable" lb # [ 9.864659] postgresql-pre-start[736]: selecting default "shared_buffers" ... 128MB worker1 # [ 10.006577] cfg80211: Loading compiled-in X.509 certificates for regulatory database worker1 # [ 10.009167] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' worker1 # [ 10.009802] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' worker1 # [ 10.013040] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 worker1 # [ 10.013819] cfg80211: failed to load regulatory.db worker1 # [ 10.055577] 8021q: adding VLAN 0 to HW filter on device eth0 worker1 # [ 9.926240] dhcpcd[754]: eth0: waiting for carrier worker1 # [ 9.927267] dhcpcd[754]: eth0: carrier acquired worker1 # [ 9.934679] dhcpcd[754]: DUID 00:01:00:01:32:81:fb:41:52:54:00:12:34:56 worker1 # [ 9.935642] dhcpcd[754]: eth0: IAID 00:12:34:56 worker1 # [ 9.936314] dhcpcd[754]: eth0: adding address fe80::5054:ff:fe12:3456 worker2 # [ 9.957505] dhcpcd[699]: eth0: soliciting a DHCP lease worker2 # [ 10.106980] NET: Registered PF_PACKET protocol family worker2 # [ 9.980712] dhcpcd[699]: eth0: offered 10.0.2.15 from 10.0.2.2 worker2 # [ 9.985351] dhcpcd[699]: eth0: probing address 10.0.2.15/24 lb: (finished: waiting for unit network-addresses-eth1.service, in 1.18 seconds) lb: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; } lb: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.2/ || { ip -4 addr >&2; false; }, in 0.05 seconds) worker1: waiting for unit network-addresses-eth1.service worker1: waiting for the VM to finish booting worker1: Guest shell says: b'Spawning backdoor root shell...\n' worker1: connected to guest root shell worker1: (connecting took 0.00 seconds) worker1: (finished: waiting for the VM to finish booting, in 0.00 seconds) lb # [ 10.457837] postgresql-pre-start[736]: selecting default time zone ... UTC client # [ 10.454659] dhcpcd[573]: eth0: soliciting a DHCP lease lb # [ 10.460719] postgresql-pre-start[736]: creating configuration files ... ok client # [ 10.602578] NET: Registered PF_PACKET protocol family worker1: (finished: waiting for unit network-addresses-eth1.service, in 0.08 seconds) worker1: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; } client # [ 10.477880] dhcpcd[573]: eth0: offered 10.0.2.15 from 10.0.2.2 client # [ 10.481594] dhcpcd[573]: eth0: probing address 10.0.2.15/24 client # [ 10.483868] dhcpcd[573]: eth0: soliciting an IPv6 router client # [ 10.486781] dhcpcd[573]: eth0: Router Advertisement from fe80::2 client # [ 10.489300] dhcpcd[573]: eth0: adding address fec0::5054:ff:fe12:3456/64 client # [ 10.492230] dhcpcd[573]: eth0: adding route to fec0::/64 client # [ 10.494233] dhcpcd[573]: eth0: adding default route via fe80::2 worker1: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.3/ || { ip -4 addr >&2; false; }, in 0.03 seconds) worker2: waiting for unit network-addresses-eth1.service worker2: waiting for the VM to finish booting worker2: Guest shell says: b'Spawning backdoor root shell...\n' worker2: connected to guest root shell worker2: (connecting took 0.00 seconds) worker2: (finished: waiting for the VM to finish booting, in 0.00 seconds) worker2: (finished: waiting for unit network-addresses-eth1.service, in 0.05 seconds) worker2: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; } worker2: (finished: must succeed: ip -4 addr show | grep -qF 192.168.1.4/ || { ip -4 addr >&2; false; }, in 0.02 seconds) lb: waiting for unit niks3.service worker1 # [ 10.629105] nix-grpc-daemon[529]: ts=2026-11-07T15:07:45Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv4:192.168.1.2:50051: Failed to connect to remote host: Connection refused" lb # [ 10.653403] postgresql-pre-start[736]: running bootstrap script ... ok lb # [ 11.058265] postgresql-pre-start[736]: performing post-bootstrap initialization ... ok worker1 # [ 11.060374] sshd-keygen-start[624]: Generating public/private rsa key pair. worker1 # [ 11.061764] sshd-keygen-start[624]: Your identification has been saved in /etc/ssh/ssh_host_rsa_key worker1 # [ 11.062847] sshd-keygen-start[624]: Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub worker1 # [ 11.063969] sshd-keygen-start[624]: The key fingerprint is: worker1 # [ 11.064771] sshd-keygen-start[624]: SHA256:1X/9pEQzs6jiEWu/ibI3iGmgxmNRsqtiAvHn2eoqm7M root@worker1 worker1 # [ 11.066050] sshd-keygen-start[624]: The key's randomart image is: worker1 # [ 11.066894] sshd-keygen-start[624]: +---[RSA 4096]----+ worker1 # [ 11.067828] sshd-keygen-start[624]: | | worker1 # [ 11.068524] sshd-keygen-start[624]: | . | worker1 # [ 11.069337] sshd-keygen-start[624]: | . . = | worker1 # [ 11.070050] sshd-keygen-start[624]: |.. . . + =.| worker1 # [ 11.071062] sshd-keygen-start[624]: | o+ S . + +| worker1 # [ 11.071759] sshd-keygen-start[624]: |.oo . o . . +.| worker1 # [ 11.072453] sshd-keygen-start[624]: |o.o+ = .= . . .| worker1 # [ 11.073307] sshd-keygen-start[624]: |*O * +oo= . | worker1 # [ 11.073953] sshd-keygen-start[624]: |E=o+o..+o.+. | worker1 # [ 11.074684] sshd-keygen-start[624]: +----[SHA256]-----+ worker1 # [ 11.091526] sshd-keygen-start[784]: Generating public/private ed25519 key pair. worker1 # [ 11.092469] sshd-keygen-start[784]: Your identification has been saved in /etc/ssh/ssh_host_ed25519_key worker1 # [ 11.093635] sshd-keygen-start[784]: Your public key has been saved in /etc/ssh/ssh_host_ed25519_key.pub worker1 # [ 11.094911] sshd-keygen-start[784]: The key fingerprint is: worker1 # [ 11.095891] sshd-keygen-start[784]: SHA256:YcYR0PcgCdSVwRqkQcEfvtKl1wV/8zyvohMoZvbForM root@worker1 worker1 # [ 11.097133] sshd-keygen-start[784]: The key's randomart image is: worker1 # [ 11.097912] sshd-keygen-start[784]: +--[ED25519 256]--+ worker1 # [ 11.099048] sshd-keygen-start[784]: | +BB+=oo | worker1 # [ 11.099980] sshd-keygen-start[784]: | .+B.= . | worker1 # [ 11.100654] sshd-keygen-start[784]: | .o=* o o | worker1 # [ 11.102292] sshd-keygen-start[784]: | o+.. . o..| worker1 # [ 11.102946] sshd-keygen-start[784]: | .S* . . oo| worker1 # [ 11.103712] sshd-keygen-start[784]: | * * = . .o| worker1 # [ 11.104657] sshd-keygen-start[784]: | + = + . o| worker1 # [ 11.105349] sshd-keygen-start[784]: | o . . . .| worker1 # [ 11.106023] sshd-keygen-start[784]: | Eo .o ... | worker1 # [ 11.106657] sshd-keygen-start[784]: +----[SHA256]-----+ worker1 # [ 11.108322] systemd[1]: sshd-keygen.service: Deactivated successfully. worker1 # [ 11.110249] systemd[1]: Finished SSH Host Keys Generation. worker1 # [ 11.110942] systemd[1]: sshd-keygen.service: Consumed 1.319s CPU time over 2.151s wall clock time, 2.5M memory peak. worker1 # [ 11.113519] systemd[1]: Starting SSH Daemon... worker1 # [ 11.137423] sshd[786]: Server listening on 0.0.0.0 port 22. worker1 # [ 11.138269] systemd[1]: Started SSH Daemon. worker1 # [ 11.138826] sshd[786]: Server listening on :: port 22. worker1 # [ 11.154170] dhcpcd[754]: eth0: soliciting an IPv6 router worker1 # [ 11.154958] dhcpcd[754]: eth0: Router Advertisement from fe80::2 worker1 # [ 11.155937] dhcpcd[754]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker1 # [ 11.156802] dhcpcd[754]: eth0: adding route to fec0::/64 worker1 # [ 11.157585] dhcpcd[754]: eth0: adding default route via fe80::2 lb # [ 11.195508] postgresql-pre-start[736]: syncing data to disk ... ok lb # [ 11.197493] postgresql-pre-start[736]: initdb: warning: enabling "trust" authentication for local connections lb # [ 11.198792] postgresql-pre-start[736]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. lb # [ 11.200715] postgresql-pre-start[736]: Success. You can now start the database server using: lb # [ 11.201855] postgresql-pre-start[736]: pg_ctl -D /var/lib/postgresql/18 -l logfile start lb # [ 11.260065] dhcpcd[718]: eth0: soliciting a DHCP lease lb # [ 11.403898] NET: Registered PF_PACKET protocol family lb # [ 11.280263] postgres[774]: [774] LOG: starting PostgreSQL 18.6 on x86_64-pc-linux-gnu, compiled by clang version 21.1.8, 64-bit lb # [ 11.283539] dhcpcd[718]: eth0: offered 10.0.2.15 from 10.0.2.2 lb # [ 11.285179] dhcpcd[718]: eth0: probing address 10.0.2.15/24 lb # [ 11.290429] postgres[774]: [774] LOG: listening on IPv6 address "::1", port 5432 lb # [ 11.291641] postgres[774]: [774] LOG: listening on IPv4 address "127.0.0.1", port 5432 lb # [ 11.295177] postgres[774]: [774] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" lb # [ 11.312631] postgres[784]: [784] LOG: database system was shut down at 2026-11-07 15:07:46 GMT lb # [ 11.320182] postgres[774]: [774] LOG: database system is ready to accept connections lb # [ 11.324682] systemd[1]: Started PostgreSQL Server. lb # [ 11.332069] systemd[1]: Starting PostgreSQL Setup Scripts... lb # [ 11.456398] postgresql-setup-start[796]: CREATE DATABASE lb # [ 11.484031] postgresql-setup-start[801]: CREATE ROLE lb # [ 11.495890] postgresql-setup-start[803]: ALTER DATABASE lb # [ 11.500304] systemd[1]: Finished PostgreSQL Setup Scripts. lb # [ 11.502447] systemd[1]: Reached target PostgreSQL. lb # [ 11.622185] dhcpcd[718]: eth0: soliciting an IPv6 router lb # [ 11.623617] dhcpcd[718]: eth0: Router Advertisement from fe80::2 lb # [ 11.624477] dhcpcd[718]: eth0: adding address fec0::5054:ff:fe12:3456/64 lb # [ 11.625382] dhcpcd[718]: eth0: adding route to fec0::/64 lb # [ 11.626206] dhcpcd[718]: eth0: adding default route via fe80::2 worker1 # [ 11.766806] dhcpcd[754]: eth0: soliciting a DHCP lease worker1 # [ 11.915316] NET: Registered PF_PACKET protocol family worker1 # [ 11.790754] dhcpcd[754]: eth0: offered 10.0.2.15 from 10.0.2.2 worker1 # [ 11.793348] dhcpcd[754]: eth0: probing address 10.0.2.15/24 worker2 # [ 12.034659] dhcpcd[699]: eth0: soliciting an IPv6 router worker2 # [ 12.037643] dhcpcd[699]: eth0: Router Advertisement from fe80::2 worker2 # [ 12.039785] dhcpcd[699]: eth0: adding address fec0::5054:ff:fe12:3456/64 worker2 # [ 12.042081] dhcpcd[699]: eth0: adding route to fec0::/64 worker2 # [ 12.043914] dhcpcd[699]: eth0: adding default route via fe80::2 worker1 # [ 12.230141] nix-grpc-daemon[529]: ts=2026-11-07T15:07:47Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" worker2 # [ 15.053649] dhcpcd[699]: eth0: leased 10.0.2.15 for 86400 seconds worker2 # [ 15.056616] dhcpcd[699]: eth0: adding route to 10.0.2.0/24 worker2 # [ 15.058848] dhcpcd[699]: eth0: adding default route via 10.0.2.2 worker2 # [ 15.140395] systemd[1]: Started DHCP Client. worker2 # [ 15.142192] systemd[1]: Reached target Network is Online. worker2 # [ 15.144901] systemd[1]: Starting scheduler-token.service... worker2 # [ 15.178475] systemd[1]: scheduler-token.service: Main process exited, code=exited, status=7/NOTRUNNING worker2 # [ 15.180255] systemd[1]: scheduler-token.service: Failed with result 'exit-code'. worker2 # [ 15.182081] systemd[1]: Failed to start scheduler-token.service. worker2 # [ 15.183613] systemd[1]: Dependency failed for Nix worker-protocol over gRPC. worker2 # [ 15.185231] systemd[1]: nix-grpc-daemon.service: Job nix-grpc-daemon.service/start failed with result 'dependency'. worker2 # [ 15.187072] systemd[1]: scheduler-token.service: Consumed 17ms CPU time over 35ms wall clock time, 3M memory peak, 40B incoming IP traffic, 60B outgoing IP traffic. worker2 # [ 15.188991] systemd[1]: Reached target Multi-User System. worker2 # [ 15.189924] systemd[1]: Startup finished in 862ms (kernel) + 3.601s (initrd) + 10.724s (userspace) = 15.188s. worker1 # [ 15.430712] nix-grpc-daemon[529]: ts=2026-11-07T15:07:50Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" client # [ 16.050628] dhcpcd[573]: eth0: leased 10.0.2.15 for 86400 seconds client # [ 16.053592] dhcpcd[573]: eth0: adding route to 10.0.2.0/24 client # [ 16.055973] dhcpcd[573]: eth0: adding default route via 10.0.2.2 client # [ 16.138365] systemd[1]: Started DHCP Client. client # [ 16.140129] systemd[1]: Reached target Multi-User System. client # [ 16.141225] systemd[1]: Startup finished in 853ms (kernel) + 3.602s (initrd) + 11.685s (userspace) = 16.141s. worker2 # [ 16.430509] systemd[1]: scheduler-token.service: Scheduled restart job, restart counter is at 1. worker2 # [ 16.438211] systemd[1]: Starting scheduler-token.service... lb # [ 16.457734] dhcpcd[718]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 16.461572] dhcpcd[718]: eth0: adding route to 10.0.2.0/24 lb # [ 16.464314] dhcpcd[718]: eth0: adding default route via 10.0.2.2 worker2 # [ 16.488396] systemd[1]: scheduler-token.service: Main process exited, code=exited, status=7/NOTRUNNING worker2 # [ 16.489978] systemd[1]: scheduler-token.service: Failed with result 'exit-code'. worker2 # [ 16.491857] systemd[1]: Failed to start scheduler-token.service. worker2 # [ 16.493076] systemd[1]: scheduler-token.service: Consumed 33ms CPU time over 1.307s wall clock time, 2.1M memory peak, 40B incoming IP traffic, 60B outgoing IP traffic. lb # [ 16.548390] systemd[1]: Started DHCP Client. lb # [ 16.550397] systemd[1]: Reached target Network is Online. lb # [ 16.553782] systemd[1]: Started Envoy reverse proxy. lb # [ 16.557531] systemd[1]: Started Garage Object Storage (S3 compatible). lb # [ 16.563885] systemd[1]: Starting garage-setup.service... lb # [ 16.569761] systemd[1]: Started mock-oidc.service. lb # [ 16.688526] garage[913]: 2026-11-07T15:07:51.956592Z INFO garage::server: Loading configuration... lb # [ 16.697187] garage[913]: 2026-11-07T15:07:51.965594Z INFO garage::server: Initializing Garage main data store... lb # [ 16.699407] garage[913]: 2026-11-07T15:07:51.967794Z INFO garage_model::garage: Opening database... lb # [ 16.700876] garage[913]: 2026-11-07T15:07:51.967813Z INFO garage_db::lmdb_adapter: Opening LMDB database at: /var/lib/garage/meta/db.lmdb lb # [ 16.704311] garage[913]: 2026-11-07T15:07:51.972603Z INFO garage_model::garage: Initializing RPC... lb # [ 16.705845] garage[913]: 2026-11-07T15:07:51.972629Z WARN garage_rpc::replication_mode: Legacy config option replication_mode in use. Please migrate to replication_factor and consistency_mode lb # [ 16.710675] garage-setup-start[924]: Error: Unable to read node key. It will be generated by your garage node the first time is it launched. Ensure that your garage node is currently running. (The node key is supposed to be stored in your metadata directory.) lb # [ 16.713511] garage-setup-start[924]: IO error: No such file or directory (os error 2) lb # [ 16.715128] garage[913]: 2026-11-07T15:07:51.978285Z INFO garage_model::garage: Initialize background variable system... lb # [ 16.716973] garage[913]: 2026-11-07T15:07:51.978608Z INFO garage_model::garage: Initialize membership management system... lb # [ 16.720031] garage[913]: 2026-11-07T15:07:51.978640Z INFO garage_rpc::system: Generating new node key pair. lb # [ 16.721557] garage[913]: 2026-11-07T15:07:51.978739Z INFO garage_rpc::system: Node ID of this node: b0fcf0e6f48469a7 lb # [ 16.723209] garage[913]: 2026-11-07T15:07:51.978916Z WARN garage_rpc::system: Using autodetected rpc_public_addr: 10.0.2.15:3901. Consider specifying it explicitly in configuration file if possible. lb # [ 16.725532] garage[913]: 2026-11-07T15:07:51.978937Z INFO garage_rpc::layout::manager: No valid previous cluster layout stored (IO error: No such file or directory (os error 2)), starting fresh. lb # [ 16.729278] garage[913]: 2026-11-07T15:07:51.997657Z INFO garage_rpc::layout::helper: ack_until updated to 0 lb # [ 16.733210] garage[913]: 2026-11-07T15:07:51.999650Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.735039] garage[913]: 2026-11-07T15:07:51.999662Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.736811] garage[913]: 2026-11-07T15:07:51.999668Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.738554] garage[913]: 2026-11-07T15:07:51.999674Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.740289] garage[913]: 2026-11-07T15:07:51.999679Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.742022] garage[913]: 2026-11-07T15:07:51.999685Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.743786] garage[913]: 2026-11-07T15:07:51.999694Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.748117] garage[913]: 2026-11-07T15:07:51.999699Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.749973] garage[913]: 2026-11-07T15:07:51.999705Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.751762] garage[913]: 2026-11-07T15:07:51.999711Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.753531] garage[913]: 2026-11-07T15:07:51.999716Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.755252] garage[913]: 2026-11-07T15:07:51.999722Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.757054] garage[913]: 2026-11-07T15:07:51.999728Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.758845] garage[913]: 2026-11-07T15:07:51.999733Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.760597] garage[913]: 2026-11-07T15:07:51.999741Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.764926] garage[913]: 2026-11-07T15:07:51.999746Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.766787] garage[913]: 2026-11-07T15:07:51.999752Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.768605] garage[913]: 2026-11-07T15:07:51.999757Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.770254] garage[913]: 2026-11-07T15:07:51.999763Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.772022] garage[913]: 2026-11-07T15:07:51.999768Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.773807] garage[913]: 2026-11-07T15:07:51.999774Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.775532] garage[913]: 2026-11-07T15:07:51.999779Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.780143] garage[913]: 2026-11-07T15:07:51.999786Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.781959] garage[913]: 2026-11-07T15:07:51.999792Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.783727] garage[913]: 2026-11-07T15:07:51.999797Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.785441] garage[913]: 2026-11-07T15:07:51.999803Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.787142] garage[913]: 2026-11-07T15:07:51.999808Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.788962] garage[913]: 2026-11-07T15:07:51.999814Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.790778] garage[913]: 2026-11-07T15:07:51.999820Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.795305] garage[913]: 2026-11-07T15:07:51.999825Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.797227] garage[913]: 2026-11-07T15:07:51.999832Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.799366] garage[913]: 2026-11-07T15:07:51.999838Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.801158] garage[913]: 2026-11-07T15:07:51.999843Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.802928] garage[913]: 2026-11-07T15:07:51.999849Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.804679] garage[913]: 2026-11-07T15:07:51.999854Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.807807] garage[913]: 2026-11-07T15:07:51.999860Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.812073] garage[913]: 2026-11-07T15:07:51.999865Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.813864] garage[913]: 2026-11-07T15:07:51.999871Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.815582] garage[913]: 2026-11-07T15:07:51.999878Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.817284] garage[913]: 2026-11-07T15:07:51.999883Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.819030] garage[913]: 2026-11-07T15:07:51.999889Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.820812] garage[913]: 2026-11-07T15:07:51.999894Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.824069] garage[913]: 2026-11-07T15:07:51.999900Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.825933] garage[913]: 2026-11-07T15:07:51.999906Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.827672] garage[913]: 2026-11-07T15:07:51.999911Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.829499] garage[913]: 2026-11-07T15:07:51.999917Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.831268] garage[913]: 2026-11-07T15:07:51.999924Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.832983] garage[913]: 2026-11-07T15:07:51.999929Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.834733] garage[913]: 2026-11-07T15:07:51.999935Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.837966] garage[913]: 2026-11-07T15:07:51.999940Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.840698] garage[913]: 2026-11-07T15:07:51.999946Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.842882] garage[913]: 2026-11-07T15:07:51.999952Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.845685] garage[913]: 2026-11-07T15:07:51.999957Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.847415] garage[913]: 2026-11-07T15:07:51.999962Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.849137] garage[913]: 2026-11-07T15:07:51.999969Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.850880] garage[913]: 2026-11-07T15:07:51.999975Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.854430] garage[913]: 2026-11-07T15:07:51.999980Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.856516] garage[913]: 2026-11-07T15:07:51.999986Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.858676] garage[913]: 2026-11-07T15:07:51.999991Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.861087] garage[913]: 2026-11-07T15:07:51.999997Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.862925] garage[913]: 2026-11-07T15:07:52.000002Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.864700] garage[913]: 2026-11-07T15:07:52.000008Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.867270] garage[913]: 2026-11-07T15:07:52.000015Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.869061] garage[913]: 2026-11-07T15:07:52.000021Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.870798] garage[913]: 2026-11-07T15:07:52.000026Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.872551] garage[913]: 2026-11-07T15:07:52.000032Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.874312] garage[913]: 2026-11-07T15:07:52.000037Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.876117] garage[913]: 2026-11-07T15:07:52.000043Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.877842] garage[913]: 2026-11-07T15:07:52.000049Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.881079] garage[913]: 2026-11-07T15:07:52.000054Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.883863] garage[913]: 2026-11-07T15:07:52.000061Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.885617] garage[913]: 2026-11-07T15:07:52.000066Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.887344] garage[913]: 2026-11-07T15:07:52.000072Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.889229] garage[913]: 2026-11-07T15:07:52.000077Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.891096] garage[913]: 2026-11-07T15:07:52.000083Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.892856] garage[913]: 2026-11-07T15:07:52.000095Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.894533] garage[913]: 2026-11-07T15:07:52.000101Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.898364] garage[913]: 2026-11-07T15:07:52.000107Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.900180] garage[913]: 2026-11-07T15:07:52.000114Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.901961] garage[913]: 2026-11-07T15:07:52.000119Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.903773] garage[913]: 2026-11-07T15:07:52.000125Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.905529] garage[913]: 2026-11-07T15:07:52.000130Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.907283] garage[913]: 2026-11-07T15:07:52.000136Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.909159] garage[913]: 2026-11-07T15:07:52.000141Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.910994] garage[913]: 2026-11-07T15:07:52.000147Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.915738] garage[913]: 2026-11-07T15:07:52.000153Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.917420] garage[913]: 2026-11-07T15:07:52.000159Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.919234] garage[913]: 2026-11-07T15:07:52.000165Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.921029] garage[913]: 2026-11-07T15:07:52.000171Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.922838] garage[913]: 2026-11-07T15:07:52.000176Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.924554] garage[913]: 2026-11-07T15:07:52.000182Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.928073] garage[913]: 2026-11-07T15:07:52.000190Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.930820] garage[913]: 2026-11-07T15:07:52.000195Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.932458] garage[913]: 2026-11-07T15:07:52.000202Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.934200] garage[913]: 2026-11-07T15:07:52.000208Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.935975] garage[913]: 2026-11-07T15:07:52.000214Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.937740] garage[913]: 2026-11-07T15:07:52.000219Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.939405] garage[913]: 2026-11-07T15:07:52.000225Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.941184] garage[913]: 2026-11-07T15:07:52.000231Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.943841] garage[913]: 2026-11-07T15:07:52.000237Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.946949] garage[913]: 2026-11-07T15:07:52.000242Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.948791] garage[913]: 2026-11-07T15:07:52.000247Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.950603] garage[913]: 2026-11-07T15:07:52.000254Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.952381] garage[913]: 2026-11-07T15:07:52.000260Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.954122] garage[913]: 2026-11-07T15:07:52.000266Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.955915] garage[913]: 2026-11-07T15:07:52.000271Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.959627] garage[913]: 2026-11-07T15:07:52.000277Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.961850] garage[913]: 2026-11-07T15:07:52.000283Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.964438] garage[913]: 2026-11-07T15:07:52.000289Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.967177] garage[913]: 2026-11-07T15:07:52.000294Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.970065] garage[913]: 2026-11-07T15:07:52.000301Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.971898] garage[913]: 2026-11-07T15:07:52.000307Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.974222] garage[913]: 2026-11-07T15:07:52.000312Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.976065] garage[913]: 2026-11-07T15:07:52.000318Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.977880] garage[913]: 2026-11-07T15:07:52.000323Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.979553] garage[913]: 2026-11-07T15:07:52.000329Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.981233] garage[913]: 2026-11-07T15:07:52.000335Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.982992] garage[913]: 2026-11-07T15:07:52.000340Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.984754] garage[913]: 2026-11-07T15:07:52.000347Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.987350] garage[913]: 2026-11-07T15:07:52.000353Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.990243] garage[913]: 2026-11-07T15:07:52.000358Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.992439] garage[913]: 2026-11-07T15:07:52.000364Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.994112] garage[913]: 2026-11-07T15:07:52.000370Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.995892] garage[913]: 2026-11-07T15:07:52.000375Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 16.997826] garage[913]: 2026-11-07T15:07:52.000381Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.001388] garage[913]: 2026-11-07T15:07:52.000387Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.003206] garage[913]: 2026-11-07T15:07:52.000393Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.005065] garage[913]: 2026-11-07T15:07:52.000399Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.006808] garage[913]: 2026-11-07T15:07:52.000404Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.008530] garage[913]: 2026-11-07T15:07:52.000410Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.010333] garage[913]: 2026-11-07T15:07:52.000415Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.012134] garage[913]: 2026-11-07T15:07:52.000421Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.014748] garage[913]: 2026-11-07T15:07:52.000427Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.016504] garage[913]: 2026-11-07T15:07:52.000432Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.018211] garage[913]: 2026-11-07T15:07:52.000439Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.020843] garage[913]: 2026-11-07T15:07:52.000445Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.022654] garage[913]: 2026-11-07T15:07:52.000451Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.024354] garage[913]: 2026-11-07T15:07:52.000457Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.026132] garage[913]: 2026-11-07T15:07:52.000462Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.030127] garage[913]: 2026-11-07T15:07:52.000468Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.031917] garage[913]: 2026-11-07T15:07:52.000473Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.033688] garage[913]: 2026-11-07T15:07:52.000479Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.035453] garage[913]: 2026-11-07T15:07:52.000486Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.037107] garage[913]: 2026-11-07T15:07:52.000492Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.038833] garage[913]: 2026-11-07T15:07:52.000497Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.040551] garage[913]: 2026-11-07T15:07:52.000536Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.043824] garage[913]: 2026-11-07T15:07:52.031270Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.047111] garage[913]: 2026-11-07T15:07:52.031278Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.048855] garage[913]: 2026-11-07T15:07:52.031284Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.050570] garage[913]: 2026-11-07T15:07:52.031290Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.052226] garage[913]: 2026-11-07T15:07:52.031296Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.053954] garage[913]: 2026-11-07T15:07:52.031301Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.055676] garage[913]: 2026-11-07T15:07:52.031307Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.058494] garage[913]: 2026-11-07T15:07:52.031313Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.060314] garage[913]: 2026-11-07T15:07:52.031318Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.062111] garage[913]: 2026-11-07T15:07:52.031324Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.063911] garage[913]: 2026-11-07T15:07:52.031330Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.065669] garage[913]: 2026-11-07T15:07:52.031335Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.067415] garage[913]: 2026-11-07T15:07:52.031341Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.069179] garage[913]: 2026-11-07T15:07:52.031353Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.073118] garage[913]: 2026-11-07T15:07:52.031359Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.074911] garage[913]: 2026-11-07T15:07:52.031365Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.076691] garage[913]: 2026-11-07T15:07:52.031371Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.078364] garage[913]: 2026-11-07T15:07:52.031376Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.080120] garage[913]: 2026-11-07T15:07:52.031382Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.081882] garage[913]: 2026-11-07T15:07:52.031388Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.083679] garage[913]: 2026-11-07T15:07:52.031393Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.085436] garage[913]: 2026-11-07T15:07:52.031399Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.088137] garage[913]: 2026-11-07T15:07:52.031405Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.089969] garage[913]: 2026-11-07T15:07:52.031411Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.091793] garage[913]: 2026-11-07T15:07:52.031418Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.093533] garage[913]: 2026-11-07T15:07:52.031424Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.095327] garage[913]: 2026-11-07T15:07:52.031430Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.097107] garage[913]: 2026-11-07T15:07:52.031436Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.098879] garage[913]: 2026-11-07T15:07:52.031442Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.103716] garage[913]: 2026-11-07T15:07:52.031448Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.105403] garage[913]: 2026-11-07T15:07:52.031454Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.107201] garage[913]: 2026-11-07T15:07:52.031459Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.108927] garage[913]: 2026-11-07T15:07:52.031468Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.110681] garage[913]: 2026-11-07T15:07:52.031475Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.112395] garage[913]: 2026-11-07T15:07:52.031481Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.114113] garage[913]: 2026-11-07T15:07:52.031487Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.116875] garage[913]: 2026-11-07T15:07:52.031492Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.118655] garage[913]: 2026-11-07T15:07:52.031498Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.120356] garage[913]: 2026-11-07T15:07:52.031530Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.122085] garage[913]: 2026-11-07T15:07:52.031544Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.123894] garage[913]: 2026-11-07T15:07:52.031551Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.125667] garage[913]: 2026-11-07T15:07:52.031557Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.127411] garage[913]: 2026-11-07T15:07:52.031563Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.131650] garage[913]: 2026-11-07T15:07:52.031569Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.133610] garage[913]: 2026-11-07T15:07:52.031574Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.135914] garage[913]: 2026-11-07T15:07:52.031580Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.138331] garage[913]: 2026-11-07T15:07:52.031585Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.140125] garage[913]: 2026-11-07T15:07:52.031591Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.141859] garage[913]: 2026-11-07T15:07:52.031598Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.145885] garage[913]: 2026-11-07T15:07:52.031606Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.147730] garage[913]: 2026-11-07T15:07:52.031611Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.149363] garage[913]: 2026-11-07T15:07:52.031617Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.151247] garage[913]: 2026-11-07T15:07:52.031623Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.152924] garage[913]: 2026-11-07T15:07:52.031628Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.154667] garage[913]: 2026-11-07T15:07:52.031634Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.156384] garage[913]: 2026-11-07T15:07:52.031639Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.160122] garage[913]: 2026-11-07T15:07:52.031646Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.161943] garage[913]: 2026-11-07T15:07:52.031652Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.163845] garage[913]: 2026-11-07T15:07:52.031658Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.165553] garage[913]: 2026-11-07T15:07:52.031663Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.167350] garage[913]: 2026-11-07T15:07:52.031669Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.169335] garage[913]: 2026-11-07T15:07:52.031674Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.171123] garage[913]: 2026-11-07T15:07:52.031680Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.175085] garage[913]: 2026-11-07T15:07:52.031686Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.176923] garage[913]: 2026-11-07T15:07:52.031692Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.178669] garage[913]: 2026-11-07T15:07:52.031699Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.180400] garage[913]: 2026-11-07T15:07:52.031705Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.182119] garage[913]: 2026-11-07T15:07:52.031710Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.183848] garage[913]: 2026-11-07T15:07:52.031716Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.185555] garage[913]: 2026-11-07T15:07:52.031721Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.188614] garage[913]: 2026-11-07T15:07:52.031727Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.190907] garage[913]: 2026-11-07T15:07:52.031732Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.194272] garage[913]: 2026-11-07T15:07:52.031739Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.196062] garage[913]: 2026-11-07T15:07:52.031745Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.197850] garage[913]: 2026-11-07T15:07:52.031751Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.199550] garage[913]: 2026-11-07T15:07:52.031756Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.202514] garage[913]: 2026-11-07T15:07:52.031761Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.204273] garage[913]: 2026-11-07T15:07:52.031767Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.206161] garage[913]: 2026-11-07T15:07:52.031773Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.207982] garage[913]: 2026-11-07T15:07:52.031779Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.209846] garage[913]: 2026-11-07T15:07:52.031786Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.211607] garage[913]: 2026-11-07T15:07:52.031796Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.213381] garage[913]: 2026-11-07T15:07:52.031801Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.218464] garage[913]: 2026-11-07T15:07:52.031807Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.220175] garage[913]: 2026-11-07T15:07:52.031813Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.221900] garage[913]: 2026-11-07T15:07:52.031818Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.223696] garage[913]: 2026-11-07T15:07:52.031824Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.225355] garage[913]: 2026-11-07T15:07:52.031829Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.227118] garage[913]: 2026-11-07T15:07:52.031837Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.228816] garage[913]: 2026-11-07T15:07:52.031842Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.231190] garage[913]: 2026-11-07T15:07:52.031848Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.234831] garage[913]: 2026-11-07T15:07:52.031853Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.237927] garage[913]: 2026-11-07T15:07:52.031859Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.240788] garage[913]: 2026-11-07T15:07:52.031865Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker1 # [ 17.242704] dhcpcd[754]: eth0: leased 10.0.2.15 for 86400 seconds lb # [ 17.242531] garage[913]: 2026-11-07T15:07:52.031870Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.244269] garage[913]: 2026-11-07T15:07:52.031876Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker1 # [ 17.245807] dhcpcd[754]: eth0: adding route to 10.0.2.0/24 lb # [ 17.245943] garage[913]: 2026-11-07T15:07:52.031882Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker1 # [ 17.247979] dhcpcd[754]: eth0: adding default route via 10.0.2.2 lb # [ 17.247660] garage[913]: 2026-11-07T15:07:52.031889Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.249297] garage[913]: 2026-11-07T15:07:52.031895Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.252178] garage[913]: 2026-11-07T15:07:52.031901Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.254302] garage[913]: 2026-11-07T15:07:52.031906Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.256131] garage[913]: 2026-11-07T15:07:52.031912Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.258332] garage[913]: 2026-11-07T15:07:52.031917Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.260142] garage[913]: 2026-11-07T15:07:52.031923Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.261963] garage[913]: 2026-11-07T15:07:52.031929Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.263702] garage[913]: 2026-11-07T15:07:52.031935Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.265479] garage[913]: 2026-11-07T15:07:52.031941Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.270193] garage[913]: 2026-11-07T15:07:52.031946Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.271978] garage[913]: 2026-11-07T15:07:52.031952Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.273711] garage[913]: 2026-11-07T15:07:52.031958Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.275404] garage[913]: 2026-11-07T15:07:52.031963Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.277237] garage[913]: 2026-11-07T15:07:52.031969Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.279102] garage[913]: 2026-11-07T15:07:52.031975Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.280879] garage[913]: 2026-11-07T15:07:52.031982Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.283118] garage[913]: 2026-11-07T15:07:52.031988Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.285300] garage[913]: 2026-11-07T15:07:52.031994Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.287333] garage[913]: 2026-11-07T15:07:52.031999Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.289103] garage[913]: 2026-11-07T15:07:52.032005Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.290848] garage[913]: 2026-11-07T15:07:52.032010Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.292557] garage[913]: 2026-11-07T15:07:52.032016Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.296201] garage[913]: 2026-11-07T15:07:52.032023Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.298072] garage[913]: 2026-11-07T15:07:52.032028Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.299866] garage[913]: 2026-11-07T15:07:52.032034Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.301604] garage[913]: 2026-11-07T15:07:52.032039Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.303252] garage[913]: 2026-11-07T15:07:52.032045Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.304985] garage[913]: 2026-11-07T15:07:52.032051Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.306740] garage[913]: 2026-11-07T15:07:52.032056Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.308839] garage[913]: 2026-11-07T15:07:52.032062Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.311876] garage[913]: 2026-11-07T15:07:52.032069Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.313651] garage[913]: 2026-11-07T15:07:52.032076Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.315337] garage[913]: 2026-11-07T15:07:52.032081Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.317157] garage[913]: 2026-11-07T15:07:52.032087Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.318871] garage[913]: 2026-11-07T15:07:52.032098Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.320605] garage[913]: 2026-11-07T15:07:52.032104Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.324325] garage[913]: 2026-11-07T15:07:52.032110Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.326334] garage[913]: 2026-11-07T15:07:52.032115Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker1 # [ 17.329418] systemd[1]: Started DHCP Client. lb # [ 17.328377] garage[913]: 2026-11-07T15:07:52.032122Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker1 # [ 17.331477] systemd[1]: Reached target Multi-User System. worker1 # [ 17.332518] systemd[1]: Startup finished in 844ms (kernel) + 4.425s (initrd) + 12.060s (userspace) = 17.331s. lb # [ 17.331071] garage[913]: 2026-11-07T15:07:52.032128Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.332916] garage[913]: 2026-11-07T15:07:52.032134Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.334592] garage[913]: 2026-11-07T15:07:52.032139Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.336282] garage[913]: 2026-11-07T15:07:52.032145Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.338381] garage[913]: 2026-11-07T15:07:52.032150Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.340258] garage[913]: 2026-11-07T15:07:52.032156Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.342980] garage[913]: 2026-11-07T15:07:52.032161Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.345095] garage[913]: 2026-11-07T15:07:52.032168Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.348066] garage[913]: 2026-11-07T15:07:52.032175Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.349857] garage[913]: 2026-11-07T15:07:52.032181Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.351623] garage[913]: 2026-11-07T15:07:52.032186Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.353457] garage[913]: 2026-11-07T15:07:52.032192Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.355243] garage[913]: 2026-11-07T15:07:52.032197Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.356978] garage[913]: 2026-11-07T15:07:52.032203Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.358724] garage[913]: 2026-11-07T15:07:52.032208Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.360500] garage[913]: 2026-11-07T15:07:52.032215Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.362360] garage[913]: 2026-11-07T15:07:52.032221Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.364274] garage[913]: 2026-11-07T15:07:52.032226Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.366084] garage[913]: 2026-11-07T15:07:52.032232Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.367922] garage[913]: 2026-11-07T15:07:52.032237Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.369714] garage[913]: 2026-11-07T15:07:52.032243Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.371506] garage[913]: 2026-11-07T15:07:52.032248Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.373203] garage[913]: 2026-11-07T15:07:52.032254Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.375041] garage[913]: 2026-11-07T15:07:52.032260Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.376818] garage[913]: 2026-11-07T15:07:52.032267Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.378648] garage[913]: 2026-11-07T15:07:52.032273Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.381926] garage[913]: 2026-11-07T15:07:52.032279Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.383637] garage[913]: 2026-11-07T15:07:52.032284Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.385362] garage[913]: 2026-11-07T15:07:52.032290Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.387179] garage[913]: 2026-11-07T15:07:52.032295Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.389029] garage[913]: 2026-11-07T15:07:52.032301Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.392067] garage[913]: 2026-11-07T15:07:52.032308Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.393841] garage[913]: 2026-11-07T15:07:52.032314Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.395724] garage[913]: 2026-11-07T15:07:52.032319Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.397397] garage[913]: 2026-11-07T15:07:52.032325Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.399121] garage[913]: 2026-11-07T15:07:52.032331Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.400804] garage[913]: 2026-11-07T15:07:52.032336Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.402542] garage[913]: 2026-11-07T15:07:52.032342Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.404255] garage[913]: 2026-11-07T15:07:52.032347Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.405985] garage[913]: 2026-11-07T15:07:52.032354Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.408197] garage[913]: 2026-11-07T15:07:52.032361Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.411153] garage[913]: 2026-11-07T15:07:52.032367Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.412992] garage[913]: 2026-11-07T15:07:52.032372Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.414703] garage[913]: 2026-11-07T15:07:52.032378Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.416372] garage[913]: 2026-11-07T15:07:52.032383Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.418156] garage[913]: 2026-11-07T15:07:52.032389Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.419959] garage[913]: 2026-11-07T15:07:52.032395Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.423160] garage[913]: 2026-11-07T15:07:52.032401Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.425125] garage[913]: 2026-11-07T15:07:52.032407Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.426934] garage[913]: 2026-11-07T15:07:52.032412Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.428752] garage[913]: 2026-11-07T15:07:52.032418Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.430760] garage[913]: 2026-11-07T15:07:52.032424Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.432571] garage[913]: 2026-11-07T15:07:52.032429Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.434303] garage[913]: 2026-11-07T15:07:52.032434Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.436834] garage[913]: 2026-11-07T15:07:52.032440Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.441102] garage[913]: 2026-11-07T15:07:52.032447Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.442936] garage[913]: 2026-11-07T15:07:52.032454Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.444648] garage[913]: 2026-11-07T15:07:52.032459Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.446419] garage[913]: 2026-11-07T15:07:52.032465Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.448181] garage[913]: 2026-11-07T15:07:52.032471Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.452076] garage[913]: 2026-11-07T15:07:52.032476Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.453824] garage[913]: 2026-11-07T15:07:52.032482Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.455511] garage[913]: 2026-11-07T15:07:52.032487Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.457237] garage[913]: 2026-11-07T15:07:52.032494Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.459117] garage[913]: 2026-11-07T15:07:52.032500Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.460898] garage[913]: 2026-11-07T15:07:52.046563Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.462706] garage[913]: 2026-11-07T15:07:52.046578Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.464468] garage[913]: 2026-11-07T15:07:52.046584Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.468704] garage[913]: 2026-11-07T15:07:52.046590Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.470395] garage[913]: 2026-11-07T15:07:52.046595Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.472129] garage[913]: 2026-11-07T15:07:52.046601Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.473803] garage[913]: 2026-11-07T15:07:52.046609Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.475641] garage[913]: 2026-11-07T15:07:52.046617Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.477378] garage[913]: 2026-11-07T15:07:52.046622Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.479157] garage[913]: 2026-11-07T15:07:52.046628Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.480949] garage[913]: 2026-11-07T15:07:52.046633Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.485076] garage[913]: 2026-11-07T15:07:52.046639Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.486851] garage[913]: 2026-11-07T15:07:52.046645Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.488544] garage[913]: 2026-11-07T15:07:52.046650Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.490314] garage[913]: 2026-11-07T15:07:52.046657Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.492103] garage[913]: 2026-11-07T15:07:52.046662Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.493959] garage[913]: 2026-11-07T15:07:52.046757Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.495711] garage[913]: 2026-11-07T15:07:52.046765Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.501082] garage[913]: 2026-11-07T15:07:52.046770Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.502866] garage[913]: 2026-11-07T15:07:52.046807Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.504555] garage[913]: 2026-11-07T15:07:52.046812Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.506379] garage[913]: 2026-11-07T15:07:52.046818Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.508109] garage[913]: 2026-11-07T15:07:52.046825Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.510052] garage[913]: 2026-11-07T15:07:52.046832Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.511850] garage[913]: 2026-11-07T15:07:52.047733Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.513681] garage[913]: 2026-11-07T15:07:52.047739Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.515562] garage[913]: 2026-11-07T15:07:52.047744Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.517364] garage[913]: 2026-11-07T15:07:52.047750Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.519119] garage[913]: 2026-11-07T15:07:52.047756Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.520905] garage[913]: 2026-11-07T15:07:52.047761Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.522757] garage[913]: 2026-11-07T15:07:52.047769Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.524639] garage[913]: 2026-11-07T15:07:52.047774Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.526345] garage[913]: 2026-11-07T15:07:52.047780Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.529453] garage[913]: 2026-11-07T15:07:52.047785Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.531621] garage[913]: 2026-11-07T15:07:52.047791Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.533857] garage[913]: 2026-11-07T15:07:52.047797Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.536276] garage[913]: 2026-11-07T15:07:52.047802Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.539073] garage[913]: 2026-11-07T15:07:52.047808Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.540858] garage[913]: 2026-11-07T15:07:52.047815Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.543082] garage[913]: 2026-11-07T15:07:52.047822Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.544874] garage[913]: 2026-11-07T15:07:52.047828Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.546660] garage[913]: 2026-11-07T15:07:52.047833Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.548387] garage[913]: 2026-11-07T15:07:52.047839Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.550280] garage[913]: 2026-11-07T15:07:52.047845Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.553531] garage[913]: 2026-11-07T15:07:52.047850Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.556474] garage[913]: 2026-11-07T15:07:52.047856Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.558789] garage[913]: 2026-11-07T15:07:52.047863Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.561053] garage[913]: 2026-11-07T15:07:52.047868Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.562812] garage[913]: 2026-11-07T15:07:52.047874Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.564510] garage[913]: 2026-11-07T15:07:52.047879Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.566274] garage[913]: 2026-11-07T15:07:52.047885Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.568083] garage[913]: 2026-11-07T15:07:52.047891Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.570843] garage[913]: 2026-11-07T15:07:52.047896Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.572525] garage[913]: 2026-11-07T15:07:52.047902Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.574245] garage[913]: 2026-11-07T15:07:52.047909Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.576066] garage[913]: 2026-11-07T15:07:52.047915Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.577878] garage[913]: 2026-11-07T15:07:52.047921Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.579544] garage[913]: 2026-11-07T15:07:52.047927Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.582928] garage[913]: 2026-11-07T15:07:52.047932Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.584757] garage[913]: 2026-11-07T15:07:52.047938Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.586876] garage[913]: 2026-11-07T15:07:52.047943Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.588822] garage[913]: 2026-11-07T15:07:52.047949Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.591072] garage[913]: 2026-11-07T15:07:52.047956Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.592866] garage[913]: 2026-11-07T15:07:52.047961Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.594712] garage[913]: 2026-11-07T15:07:52.047967Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.596744] garage[913]: 2026-11-07T15:07:52.047972Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.598647] garage[913]: 2026-11-07T15:07:52.047978Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.600387] garage[913]: 2026-11-07T15:07:52.047984Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.602139] garage[913]: 2026-11-07T15:07:52.047989Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.603851] garage[913]: 2026-11-07T15:07:52.047995Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.605512] garage[913]: 2026-11-07T15:07:52.048002Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.607248] garage[913]: 2026-11-07T15:07:52.048008Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.609093] garage[913]: 2026-11-07T15:07:52.048014Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.612708] garage[913]: 2026-11-07T15:07:52.048019Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.614579] garage[913]: 2026-11-07T15:07:52.048025Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.616453] garage[913]: 2026-11-07T15:07:52.048031Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.618481] garage[913]: 2026-11-07T15:07:52.048036Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.620738] garage[913]: 2026-11-07T15:07:52.048042Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.623355] garage[913]: 2026-11-07T15:07:52.048049Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.626650] garage[913]: 2026-11-07T15:07:52.048054Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.628389] garage[913]: 2026-11-07T15:07:52.048060Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.630163] garage[913]: 2026-11-07T15:07:52.048066Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.631937] garage[913]: 2026-11-07T15:07:52.048071Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.634070] garage[913]: 2026-11-07T15:07:52.048077Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.636651] garage[913]: 2026-11-07T15:07:52.048083Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.638382] garage[913]: 2026-11-07T15:07:52.048095Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.640868] garage[913]: 2026-11-07T15:07:52.048102Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.642678] garage[913]: 2026-11-07T15:07:52.048109Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.644333] garage[913]: 2026-11-07T15:07:52.048114Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.646144] garage[913]: 2026-11-07T15:07:52.048120Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.647913] garage[913]: 2026-11-07T15:07:52.048125Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.649649] garage[913]: 2026-11-07T15:07:52.048131Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.652447] garage[913]: 2026-11-07T15:07:52.048136Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.654573] garage[913]: 2026-11-07T15:07:52.048142Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.658071] garage[913]: 2026-11-07T15:07:52.048150Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.659864] garage[913]: 2026-11-07T15:07:52.048155Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.661533] garage[913]: 2026-11-07T15:07:52.048161Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.663266] garage[913]: 2026-11-07T15:07:52.048167Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.664986] garage[913]: 2026-11-07T15:07:52.048172Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.666833] garage[913]: 2026-11-07T15:07:52.048178Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.668924] garage[913]: 2026-11-07T15:07:52.048183Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.670671] garage[913]: 2026-11-07T15:07:52.048189Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.672410] garage[913]: 2026-11-07T15:07:52.048196Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.674183] garage[913]: 2026-11-07T15:07:52.048203Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.675937] garage[913]: 2026-11-07T15:07:52.048208Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.677683] garage[913]: 2026-11-07T15:07:52.048214Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.679390] garage[913]: 2026-11-07T15:07:52.048219Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.681744] garage[913]: 2026-11-07T15:07:52.048225Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.684142] garage[913]: 2026-11-07T15:07:52.048231Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.685873] garage[913]: 2026-11-07T15:07:52.048236Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.687657] garage[913]: 2026-11-07T15:07:52.048243Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.689693] garage[913]: 2026-11-07T15:07:52.048249Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.693696] garage[913]: 2026-11-07T15:07:52.048255Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.695520] garage[913]: 2026-11-07T15:07:52.048261Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.697298] garage[913]: 2026-11-07T15:07:52.048266Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.699089] garage[913]: 2026-11-07T15:07:52.048271Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.700834] garage[913]: 2026-11-07T15:07:52.048277Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.702508] garage[913]: 2026-11-07T15:07:52.048283Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.704216] garage[913]: 2026-11-07T15:07:52.048290Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.708524] garage[913]: 2026-11-07T15:07:52.048296Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.712083] garage[913]: 2026-11-07T15:07:52.048302Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.713819] garage[913]: 2026-11-07T15:07:52.048307Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.715569] garage[913]: 2026-11-07T15:07:52.048313Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.717249] garage[913]: 2026-11-07T15:07:52.048319Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.720080] garage[913]: 2026-11-07T15:07:52.048324Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.721904] garage[913]: 2026-11-07T15:07:52.048330Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.723591] garage[913]: 2026-11-07T15:07:52.048337Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.725253] garage[913]: 2026-11-07T15:07:52.048343Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.726990] garage[913]: 2026-11-07T15:07:52.048349Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.728838] garage[913]: 2026-11-07T15:07:52.048354Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.730512] garage[913]: 2026-11-07T15:07:52.048360Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.732194] garage[913]: 2026-11-07T15:07:52.048365Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.735726] garage[913]: 2026-11-07T15:07:52.048371Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.738468] garage[913]: 2026-11-07T15:07:52.048376Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.740240] garage[913]: 2026-11-07T15:07:52.048383Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.743988] garage[913]: 2026-11-07T15:07:52.048392Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 17.740447] systemd[1]: scheduler-token.service: Scheduled restart job, restart counter is at 2. lb # [ 17.745808] garage[913]: 2026-11-07T15:07:52.048397Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.749512] garage[913]: 2026-11-07T15:07:52.048403Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 17.748211] systemd[1]: Starting scheduler-token.service... lb # [ 17.751464] garage[913]: 2026-11-07T15:07:52.048409Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.754063] garage[913]: 2026-11-07T15:07:52.048414Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.755878] garage[913]: 2026-11-07T15:07:52.048420Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.757562] garage[913]: 2026-11-07T15:07:52.048425Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.759662] garage[913]: 2026-11-07T15:07:52.048432Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.763341] garage[913]: 2026-11-07T15:07:52.048438Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.765109] garage[913]: 2026-11-07T15:07:52.048444Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.766784] garage[913]: 2026-11-07T15:07:52.048449Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.768531] garage[913]: 2026-11-07T15:07:52.048455Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.770229] garage[913]: 2026-11-07T15:07:52.048460Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.772080] garage[913]: 2026-11-07T15:07:52.048466Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.773823] garage[913]: 2026-11-07T15:07:52.048472Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.775525] garage[913]: 2026-11-07T15:07:52.048479Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.779237] garage[913]: 2026-11-07T15:07:52.048486Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.781057] garage[913]: 2026-11-07T15:07:52.048491Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.782742] garage[913]: 2026-11-07T15:07:52.048497Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.784456] garage[913]: 2026-11-07T15:07:52.048526Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.786194] garage[913]: 2026-11-07T15:07:52.074894Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.788040] garage[913]: 2026-11-07T15:07:52.074900Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.789825] garage[913]: 2026-11-07T15:07:52.074907Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.792746] garage[913]: 2026-11-07T15:07:52.074913Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.794725] garage[913]: 2026-11-07T15:07:52.074919Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.799051] garage[913]: 2026-11-07T15:07:52.074925Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 17.798387] systemd[1]: scheduler-token.service: Main process exited, code=exited, status=7/NOTRUNNING worker2 # [ 17.800288] systemd[1]: scheduler-token.service: Failed with result 'exit-code'. lb # [ 17.802075] garage[913]: 2026-11-07T15:07:52.074931Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.803800] garage[913]: 2026-11-07T15:07:52.074936Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! worker2 # [ 17.803099] systemd[1]: Failed to start scheduler-token.service. lb # [ 17.805552] garage[913]: 2026-11-07T15:07:52.074942Z WARN garage_rpc::layout::version: Ring not yet ready, read/writes will be lost! lb # [ 17.807784] garage[913]: 2026-11-07T15:07:52.074976Z INFO garage_model::garage: Initialize block manager... worker2 # [ 17.805492] systemd[1]: scheduler-token.service: Consumed 33ms CPU time over 1.305s wall clock time, 2.1M memory peak, 40B incoming IP traffic, 60B outgoing IP traffic. lb # [ 17.809237] garage[913]: 2026-11-07T15:07:52.108333Z INFO garage_model::garage: Initialize bucket_table... lb # [ 17.810752] garage[913]: 2026-11-07T15:07:52.121117Z INFO garage_model::garage: Initialize bucket_alias_table... lb # [ 17.812224] garage[913]: 2026-11-07T15:07:52.121826Z INFO garage_model::garage: Initialize key_table_table... lb # [ 17.813830] garage[913]: 2026-11-07T15:07:52.121895Z INFO garage_model::garage: Initialize block_ref_table... lb # [ 17.815362] garage[913]: 2026-11-07T15:07:52.122753Z INFO garage_model::garage: Initialize version_table... lb # [ 17.816950] garage[913]: 2026-11-07T15:07:52.124677Z INFO garage_model::garage: Initialize multipart upload counter table... lb # [ 17.818640] garage[913]: 2026-11-07T15:07:52.126984Z INFO garage_model::garage: Initialize multipart upload table... lb # [ 17.821231] garage[913]: 2026-11-07T15:07:52.128968Z INFO garage_model::garage: Initialize object counter table... lb # [ 17.824320] garage[913]: 2026-11-07T15:07:52.148178Z INFO garage_model::garage: Initialize object_table... lb # [ 17.825891] garage[913]: 2026-11-07T15:07:52.165540Z INFO garage_model::garage: Load lifecycle worker state... lb # [ 17.827567] garage[913]: 2026-11-07T15:07:52.165980Z INFO garage_model::garage: Initialize K2V counter table... lb # [ 17.829125] garage[913]: 2026-11-07T15:07:52.180539Z INFO garage_model::garage: Initialize K2V subscription manager... lb # [ 17.830748] garage[913]: 2026-11-07T15:07:52.180551Z INFO garage_model::garage: Initialize K2V item table... lb # [ 17.832267] garage[913]: 2026-11-07T15:07:52.194803Z INFO garage_model::garage: Initialize K2V RPC handler... lb # [ 17.834220] garage[913]: 2026-11-07T15:07:52.198345Z INFO garage::server: Initializing background runner... lb # [ 17.835934] garage[913]: 2026-11-07T15:07:52.214312Z INFO garage::server: Spawning Garage workers... lb # [ 17.837511] garage[913]: 2026-11-07T15:07:52.215057Z INFO garage_model::s3::lifecycle_worker: Starting lifecycle worker for 2026-11-07 lb # [ 17.839266] garage[913]: 2026-11-07T15:07:52.215080Z INFO garage::server: Initialize Admin API server and metrics collector... lb # [ 17.841051] garage[913]: 2026-11-07T15:07:52.226352Z INFO garage::server: Launching internal Garage cluster communications... lb # [ 17.842737] garage[913]: 2026-11-07T15:07:52.226392Z INFO garage::server: Create admin RPC handler... lb # [ 17.844163] garage[913]: 2026-11-07T15:07:52.226408Z INFO garage::server: Initializing S3 API server... lb # [ 17.848527] garage[913]: 2026-11-07T15:07:52.234857Z INFO garage_model::s3::lifecycle_worker: Lifecycle worker finished for 2026-11-07, objects expired: 0, mpu aborted: 0 lb # [ 17.850764] garage[913]: 2026-11-07T15:07:52.257933Z INFO garage_net::netapp: Listening on 127.0.0.1:3901 lb # [ 17.852265] garage[913]: 2026-11-07T15:07:52.258668Z INFO garage_rpc::system: Doing a bootstrap/discovery step (not_configured: true, no_peers: false, bad_peers: true) lb # [ 17.854271] garage[913]: 2026-11-07T15:07:52.258938Z INFO garage_api_common::generic_server: S3 API server listening on http://0.0.0.0:9000 lb # [ 17.878085] garage[913]: 2026-11-07T15:07:53.145742Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:60370, negotiating handshake... lb # [ 17.884402] garage[913]: 2026-11-07T15:07:53.152674Z INFO garage_net::netapp: Accepted connection from 94e909564994058f at 127.0.0.1:60370 lb # [ 17.889420] mock-oidc-server[915]: Mock OIDC Server running lb # [ 17.890723] mock-oidc-server[915]: OIDC Address: 192.168.1.2:8080 lb # [ 17.892109] mock-oidc-server[915]: Issue Address: 0.0.0.0:8081 lb # [ 17.892924] mock-oidc-server[915]: Issuer: http://192.168.1.2:8080/oidc lb # [ 17.894155] mock-oidc-server[915]: JWKS: http://192.168.1.2:8080/oidc/.well-known/jwks.json lb # [ 17.895707] mock-oidc-server[915]: Discovery: http://192.168.1.2:8080/oidc/.well-known/openid-configuration lb # [ 17.898284] mock-oidc-server[915]: Issue tokens: http://0.0.0.0:8081/issue?sub=... lb # [ 17.926468] garage-setup-start[941]: ==== HEALTHY NODES ==== lb # [ 17.927698] garage-setup-start[941]: ID Hostname Address Tags Zone Capacity DataAvail lb # [ 17.929354] garage-setup-start[941]: b0fcf0e6f48469a7 lb 10.0.2.15:3901 NO ROLE ASSIGNED lb # [ 17.931573] garage[913]: 2026-11-07T15:07:53.199837Z INFO garage_net::netapp: Connection from 94e909564994058f closed lb # [ 17.960930] garage[913]: 2026-11-07T15:07:53.229155Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:60376, negotiating handshake... lb # [ 17.964786] garage[913]: 2026-11-07T15:07:53.232685Z INFO garage_net::netapp: Accepted connection from f15f999a9ce46c02 at 127.0.0.1:60376 lb # [ 18.008955] garage-setup-start[948]: Role changes are staged but not yet committed. lb # [ 18.010270] garage-setup-start[948]: Use `garage layout show` to view staged role changes, lb # [ 18.011476] garage-setup-start[948]: and `garage layout apply` to enact staged changes. lb # [ 18.012800] garage[913]: 2026-11-07T15:07:53.278488Z INFO garage_net::netapp: Connection from f15f999a9ce46c02 closed lb # [ 18.026628] envoy[912]: [2026-11-07 15:07:53.294][912][warning][misc] [source/server/cgroup_cpu_util.cc:253] Cgroup path /system.slice/envoy.service is outside mount root /system.slice/envoy.service/memory.pressure lb # [ 18.032972] garage[913]: 2026-11-07T15:07:53.300709Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:60388, negotiating handshake... lb # [ 18.034922] garage[913]: 2026-11-07T15:07:53.301384Z INFO garage_net::netapp: Accepted connection from f9e3e2c9ae339cdf at 127.0.0.1:60388 lb # [ 18.044266] envoy[912]: [2026-11-07 15:07:53.312][912][info][main] [source/server/server.cc:463] initializing epoch 0 (base id=0, hot restart version=11.104) lb # [ 18.047057] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:465] statically linked extensions: lb # [ 18.048532] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.upstreams: envoy.filters.connection_pools.tcp.generic lb # [ 18.050155] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.clusters: envoy.cluster.dns, envoy.cluster.eds, envoy.cluster.logical_dns, envoy.cluster.original_dst, envoy.cluster.static, envoy.cluster.strict_dns, envoy.clusters.aggregate, envoy.clusters.composite, envoy.clusters.dynamic_forward_proxy, envoy.clusters.dynamic_modules, envoy.clusters.mcp_multicluster, envoy.clusters.redis, envoy.clusters.reverse_connection lb # [ 18.054763] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.thrift_proxy.filters: envoy.filters.thrift.header_to_metadata, envoy.filters.thrift.payload_to_metadata, envoy.filters.thrift.rate_limit, envoy.filters.thrift.router lb # [ 18.057471] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.tls.upstream_certificate_mappers: envoy.tls.certificate_mappers.static_name, envoy.tls.upstream_certificate_mappers.filter_state_override lb # [ 18.059955] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.thrift_proxy.protocols: auto, binary, binary/non-strict, compact, twitter lb # [ 18.061884] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] filter_state.object: envoy.ai.llm_protocol.request, envoy.ai.model.request, envoy.bool, envoy.filters.listener.original_dst.local_ip, envoy.filters.listener.original_dst.remote_ip, envoy.hashable_string, envoy.network.application_protocols, envoy.network.ip, envoy.network.network_namespace, envoy.network.transport_socket.http_11_proxy.info, envoy.network.transport_socket.original_dst_address, envoy.network.upstream_server_name, envoy.network.upstream_subject_alt_names, envoy.ratelimit.hits_addend, envoy.router.debug_config, envoy.string, envoy.tcp_proxy.cluster, envoy.tcp_proxy.disable_tunneling, envoy.tcp_proxy.per_connection_idle_timeout_ms, envoy.upstream.dynamic_host, envoy.upstream.dynamic_port lb # [ 18.078306] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.rds_factory: envoy.rds_factory.default lb # [ 18.079914] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.tls.certificate_mappers: envoy.tls.certificate_mappers.sni, envoy.tls.certificate_mappers.static_name lb # [ 18.082127] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.bootstrap: envoy.bootstrap.dynamic_modules, envoy.bootstrap.internal_listener, envoy.bootstrap.reverse_tunnel.downstream_socket_interface, envoy.bootstrap.reverse_tunnel.upstream_socket_interface, envoy.bootstrap.wasm, envoy.extensions.network.socket_interface.default_socket_interface, envoy.extensions.network.socket_interface.sockmap lb # [ 18.086397] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.health_checkers: envoy.health_checkers.dynamic_modules, envoy.health_checkers.grpc, envoy.health_checkers.http, envoy.health_checkers.redis, envoy.health_checkers.tcp, envoy.health_checkers.thrift, envoy.health_checkers.udp lb # [ 18.091076] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.health_check.event_sinks: envoy.health_check.event_sink.file lb # [ 18.092988] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.thrift_proxy.transports: auto, framed, header, unframed lb # [ 18.094686] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.http.ext_proc.processing_request_modifiers: envoy.extensions.http.ext_proc.mapped_attribute_builder lb # [ 18.096888] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.network.dns_resolver: envoy.network.dns_resolver.cares, envoy.network.dns_resolver.getaddrinfo, envoy.network.dns_resolver.hickory lb # [ 18.099235] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.resolvers: envoy.ip, envoy.resolvers.reverse_connection lb # [ 18.100968] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.http.early_header_mutation: envoy.http.early_header_mutation.dynamic_modules, envoy.http.early_header_mutation.header_mutation lb # [ 18.103327] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.http.ai_filters: envoy.http.ai_filters.request_info, envoy.http.ai_filters.schema_validation, envoy.http.ai_filters.transcoder lb # [ 18.108154] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.filters.http: envoy.bandwidth_limit, envoy.buffer, envoy.cors, envoy.csrf, envoy.ext_authz, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.fault, envoy.filters.http.a2a, envoy.filters.http.adaptive_concurrency, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.alternate_protocols_cache, envoy.filters.http.api_key_auth, envoy.filters.http.aws_eventstream_parser, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.bandwidth_limit, envoy.filters.http.bandwidth_share, envoy.filters.http.basic_auth, envoy.filters.http.body_size_limit, envoy.filters.http.buffer, envoy.filters.http.cache, envoy.filters.http.cache_v2, envoy.filters.http.cdn_loop, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.connect_grpc_bridge, envoy.filters.http.cors, envoy.filters.http.credential_injector, envoy.filters.http.csrf, envoy.filters.http.custom_response, envoy.filters.http.decompressor, envoy.filters.http.dynamic_forward_proxy, envoy.filters.http.ext_authz, envoy.filters.http.ext_proc, envoy.filters.http.fault, envoy.filters.http.file_server, envoy.filters.http.file_system_buffer, envoy.filters.http.filter_chain, envoy.filters.http.gcp_authn, envoy.filters.http.geoip, envoy.filters.http.grpc_field_extraction, envoy.filters.http.grpc_http1_bridge, envoy.filters.http.grpc_http1_reverse_bridge, envoy.filters.http.grpc_json_reverse_transcoder, envoy.filters.http.grpc_json_transcoder, envoy.filters.http.grpc_stats, envoy.filters.http.grpc_web, envoy.filters.http.header_mutation, envoy.filters.http.header_to_metadata, envoy.filters.http.health_check, envoy.filters.http.ip_tagging, envoy.filters.http.json_to_metadata, envoy.filters.http.jwt_authn, envoy.filters.http.local_ratelimit, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.mcp, envoy.filters.http.mcp_json_rest_bridge, envoy.filters.http.mcp_router, envoy.filters.http.oauth2, envoy.filters.http.on_demand, envoy.filters.http.original_src, envoy.filters.http.proto_api_scrubber, envoy.filters.http.proto_message_extraction, envoy.filters.http.rate_limit_quota, envoy.filters.http.ratelimit, envoy.filters.http.rbac, envoy.filters.http.router, envoy.filters.http.set_filter_state, envoy.filters.http.set_metadata, envoy.filters.http.sse_to_metadata, envoy.filters.http.stateful_session, envoy.filters.http.tap, envoy.filters.http.thrift_to_metadata, envoy.filters.http.transform, envoy.filters.http.wasm, envoy.geoip, envoy.grpc_http1_bridge, envoy.grpc_json_transcoder, envoy.grpc_web, envoy.health_check, envoy.ip_tagging, envoy.local_rate_limit, envoy.lua, envoy.rate_limit, envoy.router lb # [ 18.134992] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.generic_proxy.filters: envoy.filters.generic.router lb # [ 18.136781] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.http.header_validators: envoy.http.header_validators.envoy_default lb # [ 18.138547] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.filters.udp.session: envoy.filters.udp.session.dynamic_forward_proxy, envoy.filters.udp.session.ext_authz, envoy.filters.udp.session.http_capsule lb # [ 18.141284] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.srds_factory: envoy.srds_factory.default lb # [ 18.142937] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.filters.udp_listener: envoy.filters.udp.dns_filter, envoy.filters.udp_listener.dynamic_modules, envoy.filters.udp_listener.udp_proxy lb # [ 18.145978] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.router.cluster_specifier_plugin: envoy.router.cluster_specifier_plugin.dynamic_modules, envoy.router.cluster_specifier_plugin.lua, envoy.router.cluster_specifier_plugin.matcher, envoy.router.cluster_specifier_plugin.priority_group lb # [ 18.149425] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.config_subscription: envoy.config_subscription.ads, envoy.config_subscription.ads_collection, envoy.config_subscription.aggregated_grpc_collection, envoy.config_subscription.delta_grpc, envoy.config_subscription.delta_grpc_collection, envoy.config_subscription.filesystem, envoy.config_subscription.filesystem_collection, envoy.config_subscription.grpc, envoy.config_subscription.rest lb # [ 18.154138] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.tls.cert_validator: envoy.tls.cert_validator.default, envoy.tls.cert_validator.dynamic_modules, envoy.tls.cert_validator.spiffe lb # [ 18.156552] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.quic.server.crypto_stream: envoy.quic.crypto_stream.server.quiche lb # [ 18.158272] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.http.stateful_session: envoy.http.stateful_session.cookie, envoy.http.stateful_session.envelope, envoy.http.stateful_session.header lb # [ 18.162909] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.dubbo_proxy.protocols: dubbo lb # [ 18.164537] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.quic.connection_id_generator: envoy.quic.connection_id_generator.quic_lb, envoy.quic.deterministic_connection_id_generator lb # [ 18.166774] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.built_in_formatters: envoy.built_in_formatters.cel, envoy.built_in_formatters.http.default, envoy.built_in_formatters.metadata, envoy.built_in_formatters.stream_info.default, envoy.built_in_formatters.xfcc_value lb # [ 18.169954] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.generic_proxy.codecs: envoy.generic_proxy.codecs.dubbo, envoy.generic_proxy.codecs.http1 lb # [ 18.171891] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.quic.client_packet_writer: envoy.quic.packet_writer.default lb # [ 18.173655] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.access_loggers.extension_filters: envoy.access_loggers.extension_filters.cel, envoy.access_loggers.extension_filters.process_ratelimit lb # [ 18.176143] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.matching.network.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 18.178993] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.queue_policy: envoy.queue_policy.fifo lb # [ 18.180878] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.compression.compressor: envoy.compression.brotli.compressor, envoy.compression.gzip.compressor, envoy.compression.zstd.compressor lb # [ 18.183358] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.guarddog_actions: envoy.watchdog.abort_action, envoy.watchdog.backtrace_action, envoy.watchdog.profile_action lb # [ 18.185654] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.formatter: envoy.formatter.cel, envoy.formatter.dynamic_modules, envoy.formatter.file_content, envoy.formatter.generic_secret, envoy.formatter.metadata, envoy.formatter.req_without_query lb # [ 18.188564] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.route_config_update_requester: envoy.route_config_update_requester.default lb # [ 18.190344] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.regex_engines: envoy.regex_engines.google_re2 lb # [ 18.194308] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.matching.common_inputs: envoy.matching.common_inputs.environment_variable lb # [ 18.196255] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.tls_handshakers: envoy.tls.handshakers.dynamic_modules lb # [ 18.197898] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.matching.action: envoy.matching.action.transport_socket.name, envoy.matching.actions.format_string lb # [ 18.200109] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.http.ext_proc.response_processors: envoy.extensions.http.ext_proc.save_processing_response lb # [ 18.202157] envoy[912]: [2026-11-07 15:07:53.314][912][info][main] [source/server/server.cc:467] envoy.tracers.opentelemetry.samplers: envoy.tracers.opentelemetry.samplers.always_on, envoy.tracers.opentelemetry.samplers.cel, envoy.tracers.opentelemetry.samplers.dynatrace, envoy.tracers.opentelemetry.samplers.parent_based, envoy.tracers.opentelemetry.samplers.trace_id_ratio_based lb # [ 18.209050] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.access_loggers: envoy.access_loggers.dynamic_modules, envoy.access_loggers.file, envoy.access_loggers.fluentd, envoy.access_loggers.http_grpc, envoy.access_loggers.open_telemetry, envoy.access_loggers.stats, envoy.access_loggers.stderr, envoy.access_loggers.stdout, envoy.access_loggers.tcp_grpc, envoy.access_loggers.wasm, envoy.file_access_log, envoy.fluentd_access_log, envoy.http_grpc_access_log, envoy.open_telemetry_access_log, envoy.stderr_access_log, envoy.stdout_access_log, envoy.tcp_grpc_access_log, envoy.wasm_access_log lb # [ 18.215323] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.internal_redirect_predicates: envoy.internal_redirect_predicates.allow_listed_routes, envoy.internal_redirect_predicates.filter_state, envoy.internal_redirect_predicates.previous_routes, envoy.internal_redirect_predicates.safe_cross_scheme lb # [ 18.218689] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] network.connection.client: default, envoy_internal lb # [ 18.220269] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.http.forward_client_cert_details: forward_client_cert lb # [ 18.222036] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.http.original_ip_detection: envoy.http.original_ip_detection.custom_header, envoy.http.original_ip_detection.xff lb # [ 18.224271] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.dubbo_proxy.filters: envoy.filters.dubbo.router lb # [ 18.225890] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.common.key_value: envoy.key_value.file_based lb # [ 18.227528] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.http.stateful_header_formatters: envoy.http.stateful_header_formatters.dynamic_modules, envoy.http.stateful_header_formatters.preserve_case, preserve_case lb # [ 18.230140] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.filters.upstream_network: envoy.filters.upstream_network.reverse_tunnel_lifecycle lb # [ 18.232126] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.matching.stat_matching_data.input: stat_full_name_match_input lb # [ 18.233862] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.upstream.local_address_selector: envoy.upstream.local_address_selector.default_local_address_selector, envoy.upstream.local_address_selector.filter_state_override lb # [ 18.236432] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.tls.certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 18.238231] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.request_id: envoy.request_id.uuid lb # [ 18.239737] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.ssl.server_context_factory: envoy.ssl.server_context_factory.default lb # [ 18.244169] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.filters.network: envoy.echo, envoy.ext_authz, envoy.filters.network.connection_limit, envoy.filters.network.direct_response, envoy.filters.network.dubbo_proxy, envoy.filters.network.dynamic_modules, envoy.filters.network.echo, envoy.filters.network.ext_authz, envoy.filters.network.ext_proc, envoy.filters.network.generic_proxy, envoy.filters.network.geoip, envoy.filters.network.http_connection_manager, envoy.filters.network.local_ratelimit, envoy.filters.network.mongo_proxy, envoy.filters.network.ratelimit, envoy.filters.network.rbac, envoy.filters.network.redis_proxy, envoy.filters.network.reverse_tunnel, envoy.filters.network.reverse_tunnel_drain_aware_http_connection_manager, envoy.filters.network.set_filter_state, envoy.filters.network.sni_cluster, envoy.filters.network.sni_dynamic_forward_proxy, envoy.filters.network.tcp_bandwidth_limit, envoy.filters.network.tcp_proxy, envoy.filters.network.thrift_proxy, envoy.filters.network.wasm, envoy.filters.network.zookeeper_proxy, envoy.http_connection_manager, envoy.mongo_proxy, envoy.ratelimit, envoy.redis_proxy, envoy.tcp_proxy lb # [ 18.255397] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.tls.upstream_certificate_selectors: envoy.tls.certificate_selectors.on_demand_secret lb # [ 18.257424] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.http.cache: envoy.extensions.http.cache.file_system_http_cache, envoy.extensions.http.cache.simple lb # [ 18.259531] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.compression.decompressor: envoy.compression.brotli.decompressor, envoy.compression.gzip.decompressor, envoy.compression.zstd.decompressor lb # [ 18.261935] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.path.match: envoy.path.match.uri_template.uri_template_matcher lb # [ 18.263760] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.content_parsers: envoy.content_parsers.json lb # [ 18.266071] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.quic.server_preferred_address: quic.server_preferred_address.datasource, quic.server_preferred_address.fixed lb # [ 18.268342] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.rbac.matchers: envoy.rbac.matchers.upstream_ip_port lb # [ 18.269979] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.resource_monitors: envoy.resource_monitors.cgroup_memory, envoy.resource_monitors.cpu_utilization, envoy.resource_monitors.fixed_heap, envoy.resource_monitors.injected_resource lb # [ 18.272859] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.tracers: envoy.tracers.datadog, envoy.tracers.dynamic_modules, envoy.tracers.fluentd, envoy.tracers.opentelemetry, envoy.tracers.skywalking, envoy.tracers.xray, envoy.tracers.zipkin, envoy.zipkin lb # [ 18.275897] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.retry_host_predicates: envoy.retry_host_predicates.omit_canary_hosts, envoy.retry_host_predicates.omit_host_metadata, envoy.retry_host_predicates.previous_hosts lb # [ 18.278595] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.http.cache_v2: envoy.extensions.http.cache_v2.file_system_http_cache, envoy.extensions.http.cache_v2.simple lb # [ 18.280731] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.rate_limit_descriptors: envoy.rate_limit_descriptors.expr, envoy.rate_limit_descriptors.jwt_claim lb # [ 18.282776] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.matching.http.custom_matchers: envoy.matching.custom_matchers.domain_matcher, envoy.matching.custom_matchers.ip_range_matcher lb # [ 18.287138] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.matching.generic_proxy_request_input.input: envoy.matching.generic_proxy.input.host, envoy.matching.generic_proxy.input.method, envoy.matching.generic_proxy.input.path, envoy.matching.generic_proxy.input.property, envoy.matching.generic_proxy.input.request, envoy.matching.generic_proxy.input.service lb # [ 18.291125] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.load_balancing_policies: envoy.load_balancing_policies.client_side_weighted_round_robin, envoy.load_balancing_policies.cluster_provided, envoy.load_balancing_policies.dynamic_modules, envoy.load_balancing_policies.least_request, envoy.load_balancing_policies.load_aware_locality, envoy.load_balancing_policies.maglev, envoy.load_balancing_policies.override_host, envoy.load_balancing_policies.random, envoy.load_balancing_policies.ring_hash, envoy.load_balancing_policies.round_robin, envoy.load_balancing_policies.subset, envoy.load_balancing_policies.wrr_locality lb # [ 18.297509] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.router.route_specifiers: envoy.router.route_specifiers.dynamic_modules lb # [ 18.299314] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.transport_sockets.upstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.http_11_proxy, envoy.transport_sockets.internal_upstream, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, envoy.transport_sockets.upstream_proxy_protocol, raw_buffer, starttls, tls lb # [ 18.304744] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.http.injected_credentials: envoy.http.injected_credentials.generic, envoy.http.injected_credentials.oauth2 lb # [ 18.306915] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.transport_sockets.downstream: envoy.transport_sockets.alts, envoy.transport_sockets.dynamic_modules, envoy.transport_sockets.quic, envoy.transport_sockets.raw_buffer, envoy.transport_sockets.starttls, envoy.transport_sockets.tap, envoy.transport_sockets.tcp_stats, envoy.transport_sockets.tls, raw_buffer, starttls, tls lb # [ 18.313238] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.upstream_options: envoy.extensions.upstreams.http.reverse_tunnel.v3.ReverseTunnelUpstreamCodecOptions, envoy.extensions.upstreams.http.v3.HttpProtocolOptions, envoy.extensions.upstreams.tcp.v3.TcpProtocolOptions, envoy.upstreams.http.http_protocol_options, envoy.upstreams.tcp.tcp_protocol_options lb # [ 18.317180] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.geoip_providers: envoy.geoip_providers.maxmind lb # [ 18.318823] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.matching.transport_socket.input: envoy.matching.inputs.endpoint_metadata, envoy.matching.inputs.locality_metadata, envoy.matching.inputs.transport_socket_filter_state lb # [ 18.321532] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.connection_handler: envoy.connection_handler.default lb # [ 18.323200] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.listener_manager_impl: envoy.listener_manager_impl.default, envoy.listener_manager_impl.validation lb # [ 18.325335] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.matching.stat_tag_matching_data.input: stat_tag_value_input lb # [ 18.328033] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.config.validators: envoy.config.validators.dynamic_modules, envoy.config.validators.minimum_clusters, envoy.config.validators.minimum_clusters_validator lb # [ 18.330752] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.retry_priorities: envoy.retry_priorities.previous_priorities lb # [ 18.332436] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.route.early_data_policy: envoy.route.early_data_policy.default lb # [ 18.334151] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.path.rewrite: envoy.path.rewrite.uri_template.uri_template_rewriter lb # [ 18.335995] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.wasm.runtime: envoy.wasm.runtime.null, envoy.wasm.runtime.v8 lb # [ 18.337826] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] quic.http_server_connection: quic.http_server_connection.default lb # [ 18.339514] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.dubbo_proxy.serializers: dubbo.hessian2 lb # [ 18.342248] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.config_mux: envoy.config_mux.delta_grpc_mux_factory, envoy.config_mux.grpc_mux_factory, envoy.config_mux.new_grpc_mux_factory, envoy.config_mux.sotw_grpc_mux_factory lb # [ 18.344941] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.quic.proof_source: envoy.quic.proof_source.filter_chain lb # [ 18.346670] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.quic.connection_debug_visitor: envoy.quic.connection_debug_visitor.basic, envoy.quic.connection_debug_visitor.quic_stats lb # [ 18.348976] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.udp_packet_writer: envoy.udp_packet_writer.default, envoy.udp_packet_writer.gso lb # [ 18.352092] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.matching.input_matchers: envoy.matching.input_matchers.generic_request_matcher, envoy.matching.matchers.cel_matcher, envoy.matching.matchers.consistent_hashing, envoy.matching.matchers.dynamic_modules, envoy.matching.matchers.ip, envoy.matching.matchers.metadata_matcher, envoy.matching.matchers.runtime_fraction lb # [ 18.356026] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.matching.network.input: envoy.matching.inputs.application_protocol, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.filter_state, envoy.matching.inputs.network_namespace, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.subject, envoy.matching.inputs.transport_protocol, envoy.matching.inputs.uri_san lb # [ 18.362088] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.http.custom_response: envoy.extensions.http.custom_response.local_response_policy, envoy.extensions.http.custom_response.redirect_policy lb # [ 18.366069] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.matching.http.input: envoy.matching.inputs.cel_data_input, envoy.matching.inputs.destination_ip, envoy.matching.inputs.destination_port, envoy.matching.inputs.direct_source_ip, envoy.matching.inputs.dns_san, envoy.matching.inputs.dynamic_metadata, envoy.matching.inputs.dynamic_module_data_input, envoy.matching.inputs.dynamic_module_string_data_input, envoy.matching.inputs.filter_state, envoy.matching.inputs.local_reply, envoy.matching.inputs.network_namespace, envoy.matching.inputs.request_headers, envoy.matching.inputs.request_trailers, envoy.matching.inputs.response_headers, envoy.matching.inputs.response_trailers, envoy.matching.inputs.server_name, envoy.matching.inputs.source_ip, envoy.matching.inputs.source_port, envoy.matching.inputs.source_type, envoy.matching.inputs.status_code_class_input, envoy.matching.inputs.status_code_input, envoy.matching.inputs.subject, envoy.matching.inputs.uri_san, query_params lb # [ 18.375630] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.rbac.principals: envoy.rbac.principals.mtls_authenticated lb # [ 18.377288] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.grpc_credentials: envoy.grpc_credentials.default, envoy.grpc_credentials.file_based_metadata lb # [ 18.379388] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.filters.http.upstream: envoy.buffer, envoy.ext_proc, envoy.extensions.filters.http.dynamic_modules, envoy.filters.http.admission_control, envoy.filters.http.ai_protocol_manager, envoy.filters.http.aws_lambda, envoy.filters.http.aws_request_signing, envoy.filters.http.body_size_limit, envoy.filters.http.buffer, envoy.filters.http.composite, envoy.filters.http.compressor, envoy.filters.http.credential_injector, envoy.filters.http.ext_proc, envoy.filters.http.header_mutation, envoy.filters.http.lua, envoy.filters.http.match_delegate, envoy.filters.http.upstream_codec, envoy.filters.http.upstream_rbac, envoy.filters.http.wasm lb # [ 18.386211] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.tracers.opentelemetry.resource_detectors: envoy.tracers.opentelemetry.resource_detectors.dynatrace, envoy.tracers.opentelemetry.resource_detectors.environment, envoy.tracers.opentelemetry.resource_detectors.static_config lb # [ 18.389440] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.filters.listener: envoy.filters.listener.dynamic_modules, envoy.filters.listener.http_inspector, envoy.filters.listener.local_ratelimit, envoy.filters.listener.original_dst, envoy.filters.listener.original_src, envoy.filters.listener.proxy_protocol, envoy.filters.listener.set_filter_state, envoy.filters.listener.tls_inspector, envoy.listener.http_inspector, envoy.listener.original_dst, envoy.listener.original_src, envoy.listener.proxy_protocol, envoy.listener.tls_inspector lb # [ 18.395996] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.string_matcher: envoy.string_matcher.lua lb # [ 18.397666] envoy[912]: [2026-11-07 15:07:53.315][912][info][main] [source/server/server.cc:467] envoy.stats_sinks: envoy.dog_statsd, envoy.graphite_statsd, envoy.metrics_service, envoy.open_telemetry_stat_sink, envoy.stat_sinks.dog_statsd, envoy.stat_sinks.dynamic_modules, envoy.stat_sinks.graphite_statsd, envoy.stat_sinks.hystrix, envoy.stat_sinks.metrics_service, envoy.stat_sinks.open_telemetry, envoy.stat_sinks.statsd, envoy.stat_sinks.wasm, envoy.statsd lb # [ 18.402233] envoy[912]: [2026-11-07 15:07:53.375][912][info][main] [source/server/server.cc:544] HTTP header map info: lb # [ 18.403526] envoy[912]: [2026-11-07 15:07:53.430][912][info][main] [source/server/server.cc:547] request header map: 648 bytes: :authority,:method,:path,:protocol,:scheme,accept,accept-encoding,access-control-request-headers,access-control-request-method,access-control-request-private-network,authentication,authorization,cache-control,cdn-loop,connection,content-encoding,content-length,content-type,expect,grpc-accept-encoding,grpc-timeout,if-match,if-modified-since,if-none-match,if-range,if-unmodified-since,keep-alive,origin,pragma,proxy-connection,proxy-status,referer,te,transfer-encoding,upgrade,user-agent,via,x-client-trace-id,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-downstream-service-cluster,x-envoy-downstream-service-node,x-envoy-expected-rq-timeout-ms,x-envoy-external-address,x-envoy-force-trace,x-envoy-hedge-on-per-try-timeout,x-envoy-internal,x-envoy-ip-tags,x-envoy-is-timeout-retry,x-envoy-max-retries,x-envoy-original-host,x-envoy-original-path,x-envoy-original-url,x-envoy-retriable-header-names,x-envoy-retriable-status-codes,x-envoy-retry-grpc-on,x-envoy-retry-on,x-envoy-upstream-alt-stat-name,x-envoy-upstream-rq-per-try-timeout-ms,x-envoy-upstream-rq-timeout-alt-response,x-envoy-upstream-rq-timeout-ms,x-envoy-upstream-stream-duration-ms,x-forwarded-client-cert,x-forwarded-for,x-forwarded-host,x-forwarded-port,x-forwarded-proto,x-request-id lb # [ 18.416222] envoy[912]: [2026-11-07 15:07:53.430][912][info][main] [source/server/server.cc:547] request trailer map: 104 bytes: lb # [ 18.417597] envoy[912]: [2026-11-07 15:07:53.430][912][info][main] [source/server/server.cc:547] response header map: 416 bytes: :status,access-control-allow-credentials,access-control-allow-headers,access-control-allow-methods,access-control-allow-origin,access-control-allow-private-network,access-control-expose-headers,access-control-max-age,age,cache-control,connection,content-encoding,content-length,content-type,date,etag,expires,grpc-message,grpc-status,keep-alive,last-modified,location,proxy-connection,proxy-status,server,transfer-encoding,upgrade,vary,via,x-envoy-attempt-count,x-envoy-decorator-operation,x-envoy-degraded,x-envoy-immediate-health-check-fail,x-envoy-ratelimited,x-envoy-upstream-canary,x-envoy-upstream-healthchecked-cluster,x-envoy-upstream-service-time,x-request-id lb # [ 18.427217] envoy[912]: [2026-11-07 15:07:53.430][912][info][main] [source/server/server.cc:547] response trailer map: 128 bytes: grpc-message,grpc-status lb # [ 18.437150] envoy[912]: [2026-11-07 15:07:53.705][912][info][main] [source/server/server.cc:989] runtime: {} lb # [ 18.440299] garage-setup-start[950]: ==== COMPUTATION OF A NEW PARTITION ASSIGNATION ==== lb # [ 18.441576] garage-setup-start[950]: Partitions are replicated 1 times on at least 1 distinct zones. lb # [ 18.443142] garage-setup-start[950]: Optimal partition size: 3.9 MB lb # [ 18.444098] garage-setup-start[950]: Usable capacity / total cluster capacity: 1000.0 MB / 1000.0 MB (100.0 %) lb # [ 18.445304] garage-setup-start[950]: Effective capacity (replication factor 1): 1000.0 MB lb # [ 18.446309] garage-setup-start[950]: test Tags Partitions Capacity Usable capacity lb # [ 18.447503] garage-setup-start[950]: b0fcf0e6f48469a7 256 (256 new) 1000.0 MB 1000.0 MB (100.0%) lb # [ 18.448715] garage-setup-start[950]: TOTAL 256 (256 unique) 1000.0 MB 1000.0 MB (100.0%) lb # [ 18.451295] envoy[912]: [2026-11-07 15:07:53.719][912][info][main] [source/server/server.cc:813] Starting admin HTTP server at 127.0.0.1:9901 lb # [ 18.453311] envoy[912]: [2026-11-07 15:07:53.721][912][info][admin] [source/server/admin/admin.cc:66] admin address: 127.0.0.1:9901 lb # [ 18.455239] envoy[912]: [2026-11-07 15:07:53.723][912][info][config] [source/server/configuration_impl.cc:181] loading tracing configuration lb # [ 18.456738] envoy[912]: [2026-11-07 15:07:53.723][912][info][config] [source/server/configuration_impl.cc:132] loading 0 static secret(s) lb # [ 18.458220] envoy[912]: [2026-11-07 15:07:53.723][912][info][config] [source/server/configuration_impl.cc:138] loading 2 cluster(s) lb # [ 18.473879] garage[913]: 2026-11-07T15:07:53.742253Z INFO garage_table::sync: (bucket_v2) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 18.477062] garage[913]: 2026-11-07T15:07:53.745107Z INFO garage_table::sync: bucket_v2: Adding full sync for ack layout version 1 lb # [ 18.478798] garage[913]: 2026-11-07T15:07:53.745138Z INFO garage_table::sync: (bucket_alias) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 18.481303] garage[913]: 2026-11-07T15:07:53.745146Z INFO garage_table::sync: bucket_alias: Adding full sync for ack layout version 1 lb # [ 18.483042] garage[913]: 2026-11-07T15:07:53.745158Z INFO garage_table::sync: (key) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 18.485570] garage[913]: 2026-11-07T15:07:53.745165Z INFO garage_table::sync: key: Adding full sync for ack layout version 1 lb # [ 18.487293] garage[913]: 2026-11-07T15:07:53.745176Z INFO garage_table::sync: (object) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 18.489870] garage[913]: 2026-11-07T15:07:53.745202Z INFO garage_table::sync: object: Adding full sync for ack layout version 1 lb # [ 18.491520] garage[913]: 2026-11-07T15:07:53.745219Z INFO garage_table::sync: (bucket_object_counter) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 18.496132] garage[913]: 2026-11-07T15:07:53.745237Z INFO garage_table::sync: bucket_object_counter: Adding full sync for ack layout version 1 lb # [ 18.497908] garage[913]: 2026-11-07T15:07:53.745253Z INFO garage_table::sync: (multipart_upload) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 18.500365] garage[913]: 2026-11-07T15:07:53.745270Z INFO garage_table::sync: multipart_upload: Adding full sync for ack layout version 1 lb # [ 18.502315] garage[913]: 2026-11-07T15:07:53.745287Z INFO garage_table::sync: (bucket_mpu_counter) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 18.505762] garage[913]: 2026-11-07T15:07:53.745304Z INFO garage_table::sync: bucket_mpu_counter: Adding full sync for ack layout version 1 lb # [ 18.507619] garage[913]: 2026-11-07T15:07:53.745320Z INFO garage_table::sync: (version) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 18.510197] garage[913]: 2026-11-07T15:07:53.745337Z INFO garage_table::sync: version: Adding full sync for ack layout version 1 lb # [ 18.511848] garage[913]: 2026-11-07T15:07:53.745352Z INFO garage_table::sync: (block_ref) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 18.514638] garage[913]: 2026-11-07T15:07:53.745370Z INFO garage_table::sync: block_ref: Adding full sync for ack layout version 1 lb # [ 18.516719] garage[913]: 2026-11-07T15:07:53.745386Z INFO garage_table::sync: (k2v_item) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 18.519699] garage[913]: 2026-11-07T15:07:53.745403Z INFO garage_table::sync: k2v_item: Adding full sync for ack layout version 1 lb # [ 18.521504] garage[913]: 2026-11-07T15:07:53.745418Z INFO garage_table::sync: (k2v_index_counter_v2) Layout versions changed (SyncLayoutDigest { current: 1, ack_map_min: 1, min_stored: 1 }), adding full sync to syncer todo list lb # [ 18.524121] garage[913]: 2026-11-07T15:07:53.745435Z INFO garage_table::sync: k2v_index_counter_v2: Adding full sync for ack layout version 1 lb # [ 18.525921] garage[913]: 2026-11-07T15:07:53.763059Z INFO garage_table::sync: bucket_v2: Completed full sync for ack layout version 1 lb # [ 18.527738] garage[913]: 2026-11-07T15:07:53.763087Z INFO garage_table::sync: bucket_alias: Completed full sync for ack layout version 1 lb # [ 18.530778] garage[913]: 2026-11-07T15:07:53.763105Z INFO garage_table::sync: key: Completed full sync for ack layout version 1 lb # [ 18.533290] garage[913]: 2026-11-07T15:07:53.787958Z INFO garage_table::sync: object: Completed full sync for ack layout version 1 lb # [ 18.535098] garage[913]: 2026-11-07T15:07:53.787979Z INFO garage_table::sync: bucket_object_counter: Completed full sync for ack layout version 1 lb # [ 18.536943] garage[913]: 2026-11-07T15:07:53.787988Z INFO garage_table::sync: multipart_upload: Completed full sync for ack layout version 1 lb # [ 18.538796] garage[913]: 2026-11-07T15:07:53.787996Z INFO garage_table::sync: bucket_mpu_counter: Completed full sync for ack layout version 1 lb # [ 18.540634] garage[913]: 2026-11-07T15:07:53.788003Z INFO garage_table::sync: version: Completed full sync for ack layout version 1 lb # [ 18.542481] garage[913]: 2026-11-07T15:07:53.788011Z INFO garage_table::sync: block_ref: Completed full sync for ack layout version 1 lb # [ 18.544288] garage[913]: 2026-11-07T15:07:53.788018Z INFO garage_table::sync: k2v_item: Completed full sync for ack layout version 1 lb # [ 18.546025] garage[913]: 2026-11-07T15:07:53.788027Z INFO garage_table::sync: k2v_index_counter_v2: Completed full sync for ack layout version 1 lb # [ 18.547819] garage[913]: 2026-11-07T15:07:53.801024Z INFO garage_net::netapp: Connection from f9e3e2c9ae339cdf closed lb # [ 18.549364] garage-setup-start[950]: New cluster layout with updated role assignment has been applied in cluster. lb # [ 18.550868] garage-setup-start[950]: Data will now be moved around between nodes accordingly. lb # [ 18.562925] envoy[912]: [2026-11-07 15:07:53.831][912][info][config] [source/server/configuration_impl.cc:148] loading 1 listener(s) lb # [ 18.565636] garage[913]: 2026-11-07T15:07:53.833794Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:60398, negotiating handshake... lb # [ 18.569204] garage[913]: 2026-11-07T15:07:53.837080Z INFO garage_net::netapp: Accepted connection from 4e5b1a2d63e45432 at 127.0.0.1:60398 lb # [ 18.573235] envoy[912]: [2026-11-07 15:07:53.841][912][info][config] [source/server/configuration_impl.cc:164] loading stats configuration lb # [ 18.575154] envoy[912]: [2026-11-07 15:07:53.843][912][warning][main] [source/server/server.cc:1059] There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. lb # [ 18.578747] envoy[912]: [2026-11-07 15:07:53.846][912][info][main] [source/server/server.cc:1098] starting main dispatch loop lb # [ 18.580147] envoy[912]: [2026-11-07 15:07:53.846][912][info][runtime] [source/common/runtime/runtime_impl.cc:567] RTDS has finished initialization lb # [ 18.581665] envoy[912]: [2026-11-07 15:07:53.846][912][info][upstream] [source/common/upstream/cluster_manager_impl.cc:228] cm init: initializing secondary clusters lb # [ 18.613813] garage-setup-start[954]: Key name: farm lb # [ 18.614592] garage-setup-start[954]: Key ID: GK0123456789abcdef01234567 lb # [ 18.615419] garage-setup-start[954]: Secret key: 0123456789abcdef0123456789abcdef0123456789abcdef0123456789abcdef lb # [ 18.616678] garage-setup-start[954]: Can create buckets: false lb # [ 18.618421] garage-setup-start[954]: Key-specific bucket aliases: lb # [ 18.619274] garage-setup-start[954]: Authorized buckets: lb # [ 18.620087] garage[913]: 2026-11-07T15:07:53.886752Z INFO garage_net::netapp: Connection from 4e5b1a2d63e45432 closed lb # [ 18.626757] garage[913]: 2026-11-07T15:07:53.895104Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:60406, negotiating handshake... lb # [ 18.629561] garage[913]: 2026-11-07T15:07:53.897885Z INFO garage_net::netapp: Accepted connection from c2a83f61ec8c25e3 at 127.0.0.1:60406 lb # [ 18.672509] garage-setup-start[958]: Bucket farm was created. lb # [ 18.674310] garage[913]: 2026-11-07T15:07:53.942730Z INFO garage_net::netapp: Connection from c2a83f61ec8c25e3 closed lb # [ 18.681077] garage[913]: 2026-11-07T15:07:53.949425Z INFO garage_net::netapp: Incoming connection from 127.0.0.1:60414, negotiating handshake... lb # [ 18.683845] garage[913]: 2026-11-07T15:07:53.952290Z INFO garage_net::netapp: Accepted connection from 8b1c2dd717062dc2 at 127.0.0.1:60414 lb # [ 18.726481] garage-setup-start[960]: New permissions for GK0123456789abcdef01234567 on farm: read true, write true, owner true. lb # [ 18.728965] garage[913]: 2026-11-07T15:07:53.997084Z INFO garage_net::netapp: Connection from 8b1c2dd717062dc2 closed lb # [ 18.733325] systemd[1]: Finished garage-setup.service. lb # [ 18.737769] systemd[1]: Starting niks3 server... lb # [ 18.935898] niks3-server[963]: 2026/11/07 15:07:54 INFO Loaded signing key name=farm-test-1 path=/nix/store/i8pw345f2cpx4hsyfpcgqv4nnm329abs-key lb # [ 18.949607] garage[913]: 2026-11-07T15:07:54.217951Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/?location= lb # [ 18.954878] garage[913]: 2026-11-07T15:07:54.223149Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) PUT /farm/nix-cache-info lb # [ 18.961944] niks3-server[963]: 2026/11/07 15:07:54 INFO Read proxy enabled — serving cache objects from S3 lb # [ 18.963871] niks3-server[963]: 2026/11/07 15:07:54 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 18.966397] niks3-server[963]: 2026/11/07 15:07:54 INFO systemd watchdog enabled interval=15s lb # [ 18.967454] niks3-server[963]: 2026/11/07 15:07:54 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 18.968877] systemd[1]: Started niks3 server. lb # [ 18.971034] systemd[1]: Reached target Multi-User System. lb # [ 18.971982] systemd[1]: Startup finished in 877ms (kernel) + 4.501s (initrd) + 13.592s (userspace) = 18.971s. worker2 # [ 19.051863] systemd[1]: scheduler-token.service: Scheduled restart job, restart counter is at 3. worker2 # [ 19.057673] systemd[1]: Starting scheduler-token.service... worker2 # [ 19.120107] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 19.123525] systemd[1]: Finished scheduler-token.service. worker2 # [ 19.126904] systemd[1]: scheduler-token.service: Consumed 34ms CPU time over 1.314s wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. lb: (finished: waiting for unit niks3.service, in 9.48 seconds) lb: waiting for TCP port 5751 on localhost lb # Connection to localhost (127.0.0.1) 5751 port [tcp/*] succeeded! lb: (finished: waiting for TCP port 5751 on localhost, in 0.05 seconds) lb: waiting for unit envoy.service lb: (finished: waiting for unit envoy.service, in 0.03 seconds) lb: waiting for TCP port 50051 on localhost worker1 # [ 20.431387] nix-grpc-daemon[529]: ts=2026-11-07T15:07:55Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" worker1 # [ 25.433174] nix-grpc-daemon[529]: ts=2026-11-07T15:08:00Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" lb # [ 28.973473] niks3-server[963]: 2026/11/07 15:08:04 INFO lead: acquired remote=192.168.1.3:42732 worker1 # [ 30.434228] nix-grpc-daemon[529]: ts=2026-11-07T15:08:05Z level=info event=scheduler_disconnected addr=lb:50051 error="failed to connect to all addresses; last error: UNKNOWN: ipv6:%5B2001:db8:1::2%5D:50051: Failed to connect to remote host: Connection refused" lb # [ 33.581280] envoy[912]: [2026-11-07 15:08:08.848][912][warning][config] [source/extensions/config_subscription/grpc/grpc_subscription_impl.cc:152] gRPC config: initial fetch timed out for type.googleapis.com/envoy.config.endpoint.v3.ClusterLoadAssignment lb # [ 33.588147] envoy[912]: [2026-11-07 15:08:08.848][912][info][upstream] [source/common/upstream/cluster_manager_impl.cc:251] cm init: all clusters initialized lb # [ 33.592124] envoy[912]: [2026-11-07 15:08:08.848][912][info][main] [source/server/server.cc:1078] all clusters initialized. initializing init manager lb # [ 33.597996] envoy[912]: [2026-11-07 15:08:08.866][912][info][config] [source/common/listener_manager/listener_manager_impl.cc:1149] all dependencies initialized. starting workers lb # Connection to localhost (::1) 50051 port [tcp/*] succeeded! lb # [ 33.638286] envoy[912]: conn peer=[::1]:49296 tls=TLSv1.2 subject="-" sni=- flags=- tls_fail="-" rx=0 tx=0 ms=2 lb: (finished: waiting for TCP port 50051 on localhost, in 13.50 seconds) worker2 # [ 33.753696] systemd[1]: Starting scheduler-token.service... worker2 # [ 33.794525] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 33.796223] systemd[1]: Finished scheduler-token.service. worker2 # [ 33.797287] systemd[1]: scheduler-token.service: Consumed 21ms CPU time over 43ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 33.802108] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 33.913156] nix-grpc-daemon[820]: ts=2026-11-07T15:08:09Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 33.924626] nix-grpc-daemon[820]: ts=2026-11-07T15:08:09Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 33.927830] nix-grpc-daemon[820]: ts=2026-11-07T15:08:09Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 33.955790] nix-grpc-daemon[820]: ts=2026-11-07T15:08:09Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 33.957422] systemd[1]: Started Nix worker-protocol over gRPC. subtest: extraSystems are advertised ??? Warning (UserWarning): retry(): The 'timeout_seconds' argument is deprecated. Use 'timeout' instead. File "/nix/store/nayp9npmgfxnqspz8a27fxin8v32dqbp-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/machine/__init__.py", line 179 worker2 # [ 34.006983] nix-grpc-daemon[820]: ts=2026-11-07T15:08:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.011207] nix-grpc-daemon[820]: ts=2026-11-07T15:08:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.212692] nix-grpc-daemon[820]: ts=2026-11-07T15:08:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.216527] nix-grpc-daemon[820]: ts=2026-11-07T15:08:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.419312] nix-grpc-daemon[820]: ts=2026-11-07T15:08:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.423436] nix-grpc-daemon[820]: ts=2026-11-07T15:08:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.623864] nix-grpc-daemon[820]: ts=2026-11-07T15:08:09Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.627688] nix-grpc-daemon[820]: ts=2026-11-07T15:08:09Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 34.828965] nix-grpc-daemon[820]: ts=2026-11-07T15:08:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 34.832937] nix-grpc-daemon[820]: ts=2026-11-07T15:08:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.034620] nix-grpc-daemon[820]: ts=2026-11-07T15:08:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.038558] nix-grpc-daemon[820]: ts=2026-11-07T15:08:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.239774] nix-grpc-daemon[820]: ts=2026-11-07T15:08:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.243652] nix-grpc-daemon[820]: ts=2026-11-07T15:08:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.434975] nix-grpc-daemon[529]: ts=2026-11-07T15:08:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.439561] nix-grpc-daemon[529]: ts=2026-11-07T15:08:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.444859] nix-grpc-daemon[820]: ts=2026-11-07T15:08:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.448832] nix-grpc-daemon[820]: ts=2026-11-07T15:08:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.639920] nix-grpc-daemon[529]: ts=2026-11-07T15:08:10Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.643754] nix-grpc-daemon[529]: ts=2026-11-07T15:08:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.650225] nix-grpc-daemon[820]: ts=2026-11-07T15:08:10Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.653928] nix-grpc-daemon[820]: ts=2026-11-07T15:08:10Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 35.844760] nix-grpc-daemon[529]: ts=2026-11-07T15:08:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 35.849101] nix-grpc-daemon[529]: ts=2026-11-07T15:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 35.854829] nix-grpc-daemon[820]: ts=2026-11-07T15:08:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 35.858671] nix-grpc-daemon[820]: ts=2026-11-07T15:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.049389] nix-grpc-daemon[529]: ts=2026-11-07T15:08:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.051197] nix-grpc-daemon[529]: ts=2026-11-07T15:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.061099] nix-grpc-daemon[820]: ts=2026-11-07T15:08:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.064223] nix-grpc-daemon[820]: ts=2026-11-07T15:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.252251] nix-grpc-daemon[529]: ts=2026-11-07T15:08:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.256240] nix-grpc-daemon[529]: ts=2026-11-07T15:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.262806] nix-grpc-daemon[820]: ts=2026-11-07T15:08:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.265394] nix-grpc-daemon[820]: ts=2026-11-07T15:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.457835] nix-grpc-daemon[529]: ts=2026-11-07T15:08:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.461590] nix-grpc-daemon[529]: ts=2026-11-07T15:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.464364] nix-grpc-daemon[820]: ts=2026-11-07T15:08:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.468191] nix-grpc-daemon[820]: ts=2026-11-07T15:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.662363] nix-grpc-daemon[529]: ts=2026-11-07T15:08:11Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.666222] nix-grpc-daemon[529]: ts=2026-11-07T15:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.668945] nix-grpc-daemon[820]: ts=2026-11-07T15:08:11Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.672879] nix-grpc-daemon[820]: ts=2026-11-07T15:08:11Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 36.867059] nix-grpc-daemon[529]: ts=2026-11-07T15:08:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 36.871134] nix-grpc-daemon[529]: ts=2026-11-07T15:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 36.873894] nix-grpc-daemon[820]: ts=2026-11-07T15:08:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 36.877701] nix-grpc-daemon[820]: ts=2026-11-07T15:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.071979] nix-grpc-daemon[529]: ts=2026-11-07T15:08:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.076150] nix-grpc-daemon[529]: ts=2026-11-07T15:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.080096] nix-grpc-daemon[820]: ts=2026-11-07T15:08:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.083229] nix-grpc-daemon[820]: ts=2026-11-07T15:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.277096] nix-grpc-daemon[529]: ts=2026-11-07T15:08:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.280926] nix-grpc-daemon[529]: ts=2026-11-07T15:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.280552] nix-grpc-daemon[820]: ts=2026-11-07T15:08:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.282492] nix-grpc-daemon[820]: ts=2026-11-07T15:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.482566] nix-grpc-daemon[529]: ts=2026-11-07T15:08:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.483145] nix-grpc-daemon[820]: ts=2026-11-07T15:08:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.484955] nix-grpc-daemon[820]: ts=2026-11-07T15:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.486320] nix-grpc-daemon[529]: ts=2026-11-07T15:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.685470] nix-grpc-daemon[820]: ts=2026-11-07T15:08:12Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.686795] nix-grpc-daemon[529]: ts=2026-11-07T15:08:12Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.687136] nix-grpc-daemon[820]: ts=2026-11-07T15:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.690748] nix-grpc-daemon[529]: ts=2026-11-07T15:08:12Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 37.887778] nix-grpc-daemon[820]: ts=2026-11-07T15:08:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 37.889704] nix-grpc-daemon[820]: ts=2026-11-07T15:08:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 37.891503] nix-grpc-daemon[529]: ts=2026-11-07T15:08:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 37.895350] nix-grpc-daemon[529]: ts=2026-11-07T15:08:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.091767] nix-grpc-daemon[820]: ts=2026-11-07T15:08:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.096163] nix-grpc-daemon[529]: ts=2026-11-07T15:08:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.095478] nix-grpc-daemon[820]: ts=2026-11-07T15:08:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.100126] nix-grpc-daemon[529]: ts=2026-11-07T15:08:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.296550] nix-grpc-daemon[820]: ts=2026-11-07T15:08:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.301211] nix-grpc-daemon[529]: ts=2026-11-07T15:08:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.300338] nix-grpc-daemon[820]: ts=2026-11-07T15:08:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.304966] nix-grpc-daemon[529]: ts=2026-11-07T15:08:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.500678] nix-grpc-daemon[820]: ts=2026-11-07T15:08:13Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.506818] nix-grpc-daemon[529]: ts=2026-11-07T15:08:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.503965] nix-grpc-daemon[820]: ts=2026-11-07T15:08:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.509930] nix-grpc-daemon[529]: ts=2026-11-07T15:08:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.706873] nix-grpc-daemon[529]: ts=2026-11-07T15:08:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.709136] nix-grpc-daemon[529]: ts=2026-11-07T15:08:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.705080] nix-grpc-daemon[820]: ts=2026-11-07T15:08:13Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.708814] nix-grpc-daemon[820]: ts=2026-11-07T15:08:13Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.910261] nix-grpc-daemon[529]: ts=2026-11-07T15:08:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 38.909851] nix-grpc-daemon[820]: ts=2026-11-07T15:08:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 38.914212] nix-grpc-daemon[529]: ts=2026-11-07T15:08:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 38.914413] nix-grpc-daemon[820]: ts=2026-11-07T15:08:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 38.973731] nix-grpc-daemon[529]: ts=2026-11-07T15:08:14Z level=info event=scheduler_take_over worker1 # [ 39.114882] nix-grpc-daemon[529]: ts=2026-11-07T15:08:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.115967] nix-grpc-daemon[820]: ts=2026-11-07T15:08:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.118877] nix-grpc-daemon[529]: ts=2026-11-07T15:08:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.119133] nix-grpc-daemon[820]: ts=2026-11-07T15:08:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.316938] nix-grpc-daemon[820]: ts=2026-11-07T15:08:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.319915] nix-grpc-daemon[529]: ts=2026-11-07T15:08:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.320740] nix-grpc-daemon[820]: ts=2026-11-07T15:08:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.323889] nix-grpc-daemon[529]: ts=2026-11-07T15:08:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.525520] nix-grpc-daemon[529]: ts=2026-11-07T15:08:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.521820] nix-grpc-daemon[820]: ts=2026-11-07T15:08:14Z level=info event=scheduler_connected addr=lb:50051 worker2 # [ 39.525697] nix-grpc-daemon[820]: ts=2026-11-07T15:08:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker1 # [ 39.529658] nix-grpc-daemon[529]: ts=2026-11-07T15:08:14Z level=info event=scheduler_disconnected addr=lb:50051 error="no healthy upstream" worker2 # [ 39.726774] nix-grpc-daemon[820]: ts=2026-11-07T15:08:14Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.730628] nix-grpc-daemon[529]: ts=2026-11-07T15:08:15Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 39.742587] nix-grpc-daemon[529]: ts=2026-11-07T15:08:15Z level=info event=worker_session_open cn=worker-1 peer=ipv4:192.168.1.2:56076 worker1 # [ 39.748506] nix-grpc-daemon[529]: ts=2026-11-07T15:08:15Z level=info event=worker_hello addr=192.168.1.3:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux max_jobs=1 running=0 worker1 # [ 39.759165] nix-grpc-daemon[529]: ts=2026-11-07T15:08:15Z level=info event=oidc_jwks provider=mock keys=1 worker1 # [ 39.761956] nix-grpc-daemon[529]: ts=2026-11-07T15:08:15Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:56076 worker1 # [ 39.765997] nix-grpc-daemon[529]: ts=2026-11-07T15:08:15Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux,riscv64-linux max_jobs=1 running=0 (finished: subtest: extraSystems are advertised, in 6.69 seconds) subtest: independent builds running 3 tests lb # [ 40.679229] systemd[1]: Created slice Slice /system/sshd-vsock. lb # [ 40.681306] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 40.684346] systemd[1]: Started SSH per-connection Daemon (vsock:2:0). lb # [ 40.754391] sshd-session[1056]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 40.760069] sshd-session[1056]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 40.765942] sshd-session[1056]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 40.783296] systemd[1]: Created slice Slice /user/0. lb # [ 40.787185] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 40.803805] systemd-logind[553]: New session '1' of user 'root' with class 'user' and type 'tty'. lb # [ 40.819262] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 40.824076] systemd[1]: Starting User Manager for UID 0... lb # [ 40.841865] (systemd)[1065]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 40.846626] systemd-logind[553]: New session '2' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 40.925901] systemd[1065]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 41.010158] systemd[1065]: Queued start job for default target Main User Target. lb # [ 41.013802] systemd[1065]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 41.016496] systemd[1065]: Created slice User Application Slice. lb # [ 41.018073] systemd[1065]: Started Daily Cleanup of User's Temporary Directories. lb # [ 41.019275] systemd[1065]: Reached target Paths. lb # [ 41.020108] systemd[1065]: Reached target Timers. lb # [ 41.022133] systemd[1065]: Starting D-Bus User Message Bus Socket... lb # [ 41.024636] systemd[1065]: Starting Create User Files and Directories... lb # [ 41.055234] systemd[1065]: Finished Create User Files and Directories. lb # [ 41.075722] systemd[1065]: Listening on D-Bus User Message Bus Socket. lb # [ 41.076822] systemd[1065]: Reached target Sockets. lb # [ 41.077739] systemd[1065]: Reached target Basic System. lb # [ 41.078661] systemd[1065]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 41.081174] systemd[1065]: Reached target Main User Target. lb # [ 41.083631] systemd[1065]: Startup finished in 216ms. lb # [ 41.084494] systemd[1]: Started User Manager for UID 0. lb # [ 41.087317] systemd[1]: Started Session 1 of User root. lb # [ 41.102855] sshd-session[1078]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 41.104780] sshd-session[1078]: Disconnected from user root UNKNOWN port 65535 lb # [ 41.106262] sshd-session[1056]: pam_unix(sshd:session): session closed for user root lb # [ 41.109562] systemd[1]: sshd-vsock@0-1-4:22-2:0.service: Deactivated successfully. lb # [ 41.113676] systemd[1]: session-1.scope: Deactivated successfully. lb # [ 41.117169] systemd-logind[553]: Session 1 logged out. Waiting for processes to exit. lb # [ 41.118926] systemd-logind[553]: Removed session 1. lb # [ 41.176373] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 41.180687] systemd[1]: Started SSH per-connection Daemon (vsock:2:1). lb # [ 41.230415] sshd-session[1083]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 41.235794] sshd-session[1083]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 41.241532] sshd-session[1083]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 41.247280] systemd-logind[553]: New session '3' of user 'root' with class 'user' and type 'tty'. lb # [ 41.252418] systemd[1]: Started Session 3 of User root. lb # [ 41.288827] sshd-session[1089]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 41.290786] sshd-session[1089]: Disconnected from user root UNKNOWN port 65535 lb # [ 41.292264] sshd-session[1083]: pam_unix(sshd:session): session closed for user root lb # [ 41.295595] systemd[1]: sshd-vsock@1-2-4:22-2:1.service: Deactivated successfully. lb # [ 41.299539] systemd[1]: session-3.scope: Deactivated successfully. lb # [ 41.301220] systemd[1]: session-3.scope: Consumed 21ms CPU time over 48ms wall clock time, 3.8M memory peak, 2.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 41.305207] systemd-logind[553]: Session 3 logged out. Waiting for processes to exit. lb # [ 41.306986] systemd-logind[553]: Removed session 3. lb # [ 41.879699] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 41.888692] systemd[1]: Started SSH per-connection Daemon (vsock:2:2). lb # [ 41.956676] sshd-session[1095]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 41.962074] sshd-session[1095]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 41.967902] sshd-session[1095]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 41.973940] systemd-logind[553]: New session '4' of user 'root' with class 'user' and type 'tty'. lb # [ 41.978409] systemd[1]: Started Session 4 of User root. lb # [ 42.002538] sshd-session[1101]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 42.004500] sshd-session[1101]: Disconnected from user root UNKNOWN port 65535 lb # [ 42.005886] sshd-session[1095]: pam_unix(sshd:session): session closed for user root lb # [ 42.008905] systemd[1]: sshd-vsock@2-3-4:22-2:2.service: Deactivated successfully. lb # [ 42.012695] systemd[1]: session-4.scope: Deactivated successfully. lb # [ 42.014391] systemd[1]: session-4.scope: Consumed 16ms CPU time over 35ms wall clock time, 3.1M memory peak, 2.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 42.018354] systemd-logind[553]: Session 4 logged out. Waiting for processes to exit. lb # [ 42.020260] systemd-logind[553]: Removed session 4. lb # [ 42.583320] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 42.593161] systemd[1]: Started SSH per-connection Daemon (vsock:2:3). lb # [ 42.669555] sshd-session[1106]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 42.674312] sshd-session[1106]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 42.680081] sshd-session[1106]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 42.686066] systemd-logind[553]: New session '5' of user 'root' with class 'user' and type 'tty'. lb # [ 42.690407] systemd[1]: Started Session 5 of User root. lb # [ 42.715255] sshd-session[1112]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 42.716467] sshd-session[1112]: Disconnected from user root UNKNOWN port 65535 lb # [ 42.717694] sshd-session[1106]: pam_unix(sshd:session): session closed for user root lb # [ 42.720397] systemd[1]: sshd-vsock@3-4-4:22-2:3.service: Deactivated successfully. lb # [ 42.724196] systemd[1]: session-5.scope: Deactivated successfully. lb # [ 42.725538] systemd[1]: session-5.scope: Consumed 16ms CPU time over 34ms wall clock time, 3.1M memory peak, 2.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 42.728177] systemd-logind[553]: Session 5 logged out. Waiting for processes to exit. lb # [ 42.731213] systemd-logind[553]: Removed session 5. lb # [ 43.283718] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 43.290880] systemd[1]: Started SSH per-connection Daemon (vsock:2:4). lb # [ 43.358328] sshd-session[1117]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 43.363235] sshd-session[1117]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 43.368277] sshd-session[1117]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 43.375281] systemd-logind[553]: New session '6' of user 'root' with class 'user' and type 'tty'. lb # [ 43.377405] systemd[1]: Started Session 6 of User root. lb # [ 43.401884] sshd-session[1123]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 43.403643] sshd-session[1123]: Disconnected from user root UNKNOWN port 65535 lb # [ 43.404856] sshd-session[1117]: pam_unix(sshd:session): session closed for user root lb # [ 43.407611] systemd[1]: sshd-vsock@4-5-4:22-2:4.service: Deactivated successfully. lb # [ 43.411398] systemd[1]: session-6.scope: Deactivated successfully. lb # [ 43.412745] systemd[1]: session-6.scope: Consumed 16ms CPU time over 34ms wall clock time, 3.1M memory peak, 2.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 43.416220] systemd-logind[553]: Session 6 logged out. Waiting for processes to exit. lb # [ 43.417723] systemd-logind[553]: Removed session 6. lb # [ 43.983533] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 43.993455] systemd[1]: Started SSH per-connection Daemon (vsock:2:5). lb # [ 44.063279] sshd-session[1128]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 44.068201] sshd-session[1128]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 44.073368] sshd-session[1128]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 44.078869] systemd-logind[553]: New session '7' of user 'root' with class 'user' and type 'tty'. lb # [ 44.083419] systemd[1]: Started Session 7 of User root. lb # [ 44.108715] sshd-session[1134]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 44.110485] sshd-session[1134]: Disconnected from user root UNKNOWN port 65535 lb # [ 44.111724] sshd-session[1128]: pam_unix(sshd:session): session closed for user root lb # [ 44.114975] systemd[1]: sshd-vsock@5-6-4:22-2:5.service: Deactivated successfully. lb # [ 44.118541] systemd[1]: session-7.scope: Deactivated successfully. lb # [ 44.119952] systemd[1]: session-7.scope: Consumed 16ms CPU time over 36ms wall clock time, 3.1M memory peak, 2.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 44.123619] systemd-logind[553]: Session 7 logged out. Waiting for processes to exit. lb # [ 44.125663] systemd-logind[553]: Removed session 7. lb # [ 44.687634] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 44.695307] systemd[1]: Started SSH per-connection Daemon (vsock:2:6). lb # [ 44.762355] sshd-session[1139]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 44.767315] sshd-session[1139]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 44.772322] sshd-session[1139]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 44.779473] systemd-logind[553]: New session '8' of user 'root' with class 'user' and type 'tty'. lb # [ 44.782414] systemd[1]: Started Session 8 of User root. lb # [ 44.806809] sshd-session[1145]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 44.808539] sshd-session[1145]: Disconnected from user root UNKNOWN port 65535 lb # [ 44.809719] sshd-session[1139]: pam_unix(sshd:session): session closed for user root lb # [ 44.812571] systemd[1]: sshd-vsock@6-7-4:22-2:6.service: Deactivated successfully. lb # [ 44.816400] systemd[1]: session-8.scope: Deactivated successfully. lb # [ 44.817756] systemd[1]: session-8.scope: Consumed 16ms CPU time over 34ms wall clock time, 3.1M memory peak, 2.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 44.821357] systemd-logind[553]: Session 8 logged out. Waiting for processes to exit. lb # [ 44.823191] systemd-logind[553]: Removed session 8. lb # [ 45.385835] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 45.393143] systemd[1]: Started SSH per-connection Daemon (vsock:2:7). lb # [ 45.459341] sshd-session[1150]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 45.463838] sshd-session[1150]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 45.468362] sshd-session[1150]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 45.475126] systemd-logind[553]: New session '9' of user 'root' with class 'user' and type 'tty'. lb # [ 45.478369] systemd[1]: Started Session 9 of User root. lb # [ 45.501774] sshd-session[1156]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 45.503103] sshd-session[1156]: Disconnected from user root UNKNOWN port 65535 lb # [ 45.504373] sshd-session[1150]: pam_unix(sshd:session): session closed for user root lb # [ 45.507218] systemd[1]: sshd-vsock@7-8-4:22-2:7.service: Deactivated successfully. lb # [ 45.510817] systemd[1]: session-9.scope: Deactivated successfully. lb # [ 45.512384] systemd[1]: session-9.scope: Consumed 16ms CPU time over 33ms wall clock time, 3.1M memory peak, 2.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 45.516161] systemd-logind[553]: Session 9 logged out. Waiting for processes to exit. lb # [ 45.517608] systemd-logind[553]: Removed session 9. lb # [ 46.089341] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 46.098269] systemd[1]: Started SSH per-connection Daemon (vsock:2:8). lb # [ 46.166247] sshd-session[1161]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 46.170784] sshd-session[1161]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 46.175336] sshd-session[1161]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 46.182238] systemd-logind[553]: New session '10' of user 'root' with class 'user' and type 'tty'. lb # [ 46.185378] systemd[1]: Started Session 10 of User root. lb # [ 46.209086] sshd-session[1167]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 46.210702] sshd-session[1167]: Disconnected from user root UNKNOWN port 65535 lb # [ 46.211982] sshd-session[1161]: pam_unix(sshd:session): session closed for user root lb # [ 46.214991] systemd[1]: sshd-vsock@8-9-4:22-2:8.service: Deactivated successfully. lb # [ 46.218669] systemd[1]: session-10.scope: Deactivated successfully. lb # [ 46.220258] systemd[1]: session-10.scope: Consumed 16ms CPU time over 34ms wall clock time, 3.1M memory peak, 2.9K incoming IP traffic, 486B outgoing IP traffic. lb # [ 46.223893] systemd-logind[553]: Session 10 logged out. Waiting for processes to exit. lb # [ 46.225464] systemd-logind[553]: Removed session 10. worker1 # [ 46.316801] nix-grpc-daemon[529]: ts=2026-11-07T15:08:21Z level=info event=eds_stream_open cn=lb-1 peer=ipv4:192.168.1.2:60234 lb # [ 46.789150] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 46.792110] systemd[1]: Started SSH per-connection Daemon (vsock:2:9). lb # [ 46.839525] sshd-session[1172]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 46.844566] sshd-session[1172]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 46.849627] sshd-session[1172]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 46.856225] systemd-logind[553]: New session '11' of user 'root' with class 'user' and type 'tty'. lb # [ 46.858363] systemd[1]: Started Session 11 of User root. lb # [ 46.882896] sshd-session[1178]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 46.884603] sshd-session[1178]: Disconnected from user root UNKNOWN port 65535 lb # [ 46.885786] sshd-session[1172]: pam_unix(sshd:session): session closed for user root lb # [ 46.888650] systemd[1]: sshd-vsock@9-10-4:22-2:9.service: Deactivated successfully. lb # [ 46.892483] systemd[1]: session-11.scope: Deactivated successfully. lb # [ 46.893865] systemd[1]: session-11.scope: Consumed 16ms CPU time over 35ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 46.897340] systemd-logind[553]: Session 11 logged out. Waiting for processes to exit. lb # [ 46.899193] systemd-logind[553]: Removed session 11. lb # [ 46.988552] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 46.997142] systemd[1]: Started SSH per-connection Daemon (vsock:2:10). lb # [ 47.054286] sshd-session[1183]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 47.059162] sshd-session[1183]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 47.063931] sshd-session[1183]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 47.070778] systemd-logind[553]: New session '12' of user 'root' with class 'user' and type 'tty'. lb # [ 47.074343] systemd[1]: Started Session 12 of User root. lb # [ 47.097335] sshd-session[1189]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 47.099164] sshd-session[1189]: Disconnected from user root UNKNOWN port 65535 lb # [ 47.100859] sshd-session[1183]: pam_unix(sshd:session): session closed for user root lb # [ 47.104424] systemd[1]: sshd-vsock@10-11-4:22-2:10.service: Deactivated successfully. lb # [ 47.107478] systemd[1]: session-12.scope: Deactivated successfully. lb # [ 47.108948] systemd[1]: session-12.scope: Consumed 16ms CPU time over 34ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 47.112309] systemd-logind[553]: Session 12 logged out. Waiting for processes to exit. lb # [ 47.114608] systemd-logind[553]: Removed session 12. worker1 # [ 47.199451] systemd[1]: Created slice Slice /system/sshd-vsock. worker1 # [ 47.202845] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 47.210285] systemd[1]: Started SSH per-connection Daemon (vsock:2:0). worker1 # [ 47.281434] sshd-session[919]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 47.286421] sshd-session[919]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 47.291335] sshd-session[919]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 47.304484] systemd[1]: Created slice Slice /user/0. worker1 # [ 47.306955] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 47.312397] systemd-logind[608]: New session '1' of user 'root' with class 'user' and type 'tty'. worker1 # [ 47.332307] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 47.337617] systemd[1]: Starting User Manager for UID 0... worker1 # [ 47.352504] (systemd)[927]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 47.356880] systemd-logind[608]: New session '2' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 47.432975] systemd[927]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 47.502442] systemd[927]: Queued start job for default target Main User Target. worker1 # [ 47.504729] systemd[927]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 47.507118] systemd[927]: Created slice User Application Slice. worker1 # [ 47.508056] systemd[927]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 47.509919] systemd[927]: Reached target Paths. worker1 # [ 47.510681] systemd[927]: Reached target Timers. worker1 # [ 47.512713] systemd[927]: Starting D-Bus User Message Bus Socket... worker1 # [ 47.514416] systemd[927]: Starting Create User Files and Directories... worker1 # [ 47.543239] systemd[927]: Finished Create User Files and Directories. worker1 # [ 47.561513] systemd[927]: Listening on D-Bus User Message Bus Socket. worker1 # [ 47.563143] systemd[927]: Reached target Sockets. worker1 # [ 47.563840] systemd[927]: Reached target Basic System. worker1 # [ 47.564647] systemd[927]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 47.565969] systemd[927]: Reached target Main User Target. worker1 # [ 47.567632] systemd[927]: Startup finished in 195ms. worker1 # [ 47.569632] systemd[1]: Started User Manager for UID 0. worker1 # [ 47.572239] systemd[1]: Started Session 1 of User root. worker1 # [ 47.586827] sshd-session[940]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 47.588461] sshd-session[940]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 47.589676] sshd-session[919]: pam_unix(sshd:session): session closed for user root worker1 # [ 47.592744] systemd[1]: sshd-vsock@0-1-5:22-2:0.service: Deactivated successfully. worker1 # [ 47.596818] systemd[1]: session-1.scope: Deactivated successfully. worker1 # [ 47.599152] systemd-logind[608]: Session 1 logged out. Waiting for processes to exit. worker1 # [ 47.601508] systemd-logind[608]: Removed session 1. worker1 # [ 47.697178] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 47.705874] systemd[1]: Started SSH per-connection Daemon (vsock:2:1). worker1 # [ 47.766427] sshd-session[945]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 47.770972] sshd-session[945]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 47.775713] sshd-session[945]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 47.781066] systemd-logind[608]: New session '3' of user 'root' with class 'user' and type 'tty'. worker1 # [ 47.784398] systemd[1]: Started Session 3 of User root. worker1 # [ 47.811755] sshd-session[951]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 47.812973] sshd-session[951]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 47.814223] sshd-session[945]: pam_unix(sshd:session): session closed for user root worker1 # [ 47.816923] systemd[1]: sshd-vsock@1-2-5:22-2:1.service: Deactivated successfully. worker1 # [ 47.820600] systemd[1]: session-3.scope: Deactivated successfully. worker1 # [ 47.822056] systemd[1]: session-3.scope: Consumed 19ms CPU time over 37ms wall clock time, 3.4M memory peak, 5.7K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 47.825752] systemd-logind[608]: Session 3 logged out. Waiting for processes to exit. worker1 # [ 47.827184] systemd-logind[608]: Removed session 3. worker1 # [ 47.897145] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 47.900627] systemd[1]: Started SSH per-connection Daemon (vsock:2:2). worker1 # [ 47.904272] systemd[1]: Started SSH per-connection Daemon (vsock:2:3). worker1 # [ 47.907664] systemd[1]: Started SSH per-connection Daemon (vsock:2:4). worker1 # [ 48.013771] sshd-session[956]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 48.017545] sshd-session[957]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 48.021249] sshd-session[958]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 48.027142] sshd-session[956]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 48.029123] sshd-session[957]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 48.032388] sshd-session[958]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 48.040172] sshd-session[956]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 48.043399] sshd-session[957]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 48.049741] sshd-session[958]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 48.052579] systemd-logind[608]: New session '4' of user 'root' with class 'user' and type 'tty'. worker1 # [ 48.056605] systemd[1]: Started Session 4 of User root. worker1 # [ 48.061241] systemd-logind[608]: New session '5' of user 'root' with class 'user' and type 'tty'. worker1 # [ 48.063183] systemd[1]: Started Session 5 of User root. worker1 # [ 48.066267] systemd-logind[608]: New session '6' of user 'root' with class 'user' and type 'tty'. worker1 # [ 48.071348] systemd[1]: Started Session 6 of User root. worker1 # [ 48.123494] sshd-session[974]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 48.125695] sshd-session[975]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 48.126884] sshd-session[975]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 48.128081] sshd-session[974]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 48.130138] sshd-session[956]: pam_unix(sshd:session): session closed for user root worker1 # [ 48.132107] sshd-session[957]: pam_unix(sshd:session): session closed for user root worker1 # [ 48.133978] sshd-session[976]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 48.135434] sshd-session[976]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 48.137986] sshd-session[958]: pam_unix(sshd:session): session closed for user root worker1 # [ 48.140261] systemd[1]: sshd-vsock@3-4-5:22-2:3.service: Deactivated successfully. worker1 # [ 48.143582] systemd[1]: sshd-vsock@2-3-5:22-2:2.service: Deactivated successfully. worker1 # [ 48.146525] systemd[1]: sshd-vsock@4-5-5:22-2:4.service: Deactivated successfully. worker1 # [ 48.150400] systemd[1]: session-6.scope: Deactivated successfully. worker1 # [ 48.152398] systemd[1]: session-4.scope: Deactivated successfully. worker1 # [ 48.154302] systemd[1]: session-5.scope: Deactivated successfully. worker1 # [ 48.157976] systemd-logind[608]: Session 5 logged out. Waiting for processes to exit. worker1 # [ 48.160772] systemd-logind[608]: Removed session 5. worker1 # [ 48.161674] systemd-logind[608]: Session 4 logged out. Waiting for processes to exit. worker1 # [ 48.163322] systemd-logind[608]: Removed session 4. worker1 # [ 48.164761] systemd-logind[608]: Session 6 logged out. Waiting for processes to exit. worker1 # [ 48.166158] systemd-logind[608]: Removed session 6. worker2 # [ 48.199856] systemd[1]: Created slice Slice /system/sshd-vsock. worker2 # [ 48.203706] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 48.210310] systemd[1]: Started SSH per-connection Daemon (vsock:2:0). worker2 # [ 48.293444] sshd-session[923]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 48.298136] sshd-session[923]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 48.304183] sshd-session[923]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 48.316383] systemd[1]: Created slice Slice /user/0. worker2 # [ 48.318824] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 48.328687] systemd-logind[555]: New session '1' of user 'root' with class 'user' and type 'tty'. worker2 # [ 48.347095] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 48.352162] systemd[1]: Starting User Manager for UID 0... worker2 # [ 48.368407] (systemd)[931]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 48.372781] systemd-logind[555]: New session '2' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 48.451076] systemd[931]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 48.528860] systemd[931]: Queued start job for default target Main User Target. worker2 # [ 48.531653] systemd[931]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 48.534124] systemd[931]: Created slice User Application Slice. worker2 # [ 48.535078] systemd[931]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 48.536132] systemd[931]: Reached target Paths. worker2 # [ 48.537211] systemd[931]: Reached target Timers. worker2 # [ 48.539718] systemd[931]: Starting D-Bus User Message Bus Socket... worker2 # [ 48.541230] systemd[931]: Starting Create User Files and Directories... worker2 # [ 48.570546] systemd[931]: Finished Create User Files and Directories. worker2 # [ 48.584715] systemd[931]: Listening on D-Bus User Message Bus Socket. worker2 # [ 48.585668] systemd[931]: Reached target Sockets. worker2 # [ 48.587323] systemd[931]: Reached target Basic System. worker2 # [ 48.588088] systemd[931]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 48.589395] systemd[931]: Reached target Main User Target. worker2 # [ 48.592099] systemd[931]: Startup finished in 203ms. worker2 # [ 48.592808] systemd[1]: Started User Manager for UID 0. worker2 # [ 48.594433] systemd[1]: Started Session 1 of User root. worker2 # [ 48.608467] sshd-session[944]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 48.610275] sshd-session[944]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 48.611548] sshd-session[923]: pam_unix(sshd:session): session closed for user root worker2 # [ 48.614448] systemd[1]: sshd-vsock@0-1-6:22-2:0.service: Deactivated successfully. worker2 # [ 48.617904] systemd[1]: session-1.scope: Deactivated successfully. worker2 # [ 48.621160] systemd-logind[555]: Session 1 logged out. Waiting for processes to exit. worker2 # [ 48.623216] systemd-logind[555]: Removed session 1. worker2 # [ 48.701048] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 48.708356] systemd[1]: Started SSH per-connection Daemon (vsock:2:1). worker2 # [ 48.716066] systemd[1]: Started SSH per-connection Daemon (vsock:2:2). worker2 # [ 48.717924] systemd[1]: Started SSH per-connection Daemon (vsock:2:3). worker2 # [ 48.826617] sshd-session[951]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 48.828721] sshd-session[950]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 48.832315] sshd-session[949]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 48.838632] sshd-session[950]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 48.841939] sshd-session[949]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 48.843344] sshd-session[951]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 48.852894] sshd-session[950]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 48.855291] sshd-session[949]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 48.857934] sshd-session[951]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 48.865124] systemd-logind[555]: New session '3' of user 'root' with class 'user' and type 'tty'. worker2 # [ 48.869245] systemd[1]: Started Session 3 of User root. worker2 # [ 48.873667] systemd-logind[555]: New session '4' of user 'root' with class 'user' and type 'tty'. worker2 # [ 48.877436] systemd[1]: Started Session 4 of User root. worker2 # [ 48.879169] systemd-logind[555]: New session '5' of user 'root' with class 'user' and type 'tty'. worker2 # [ 48.884783] systemd[1]: Started Session 5 of User root. worker2 # [ 48.935595] sshd-session[967]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 48.937226] sshd-session[967]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 48.939538] sshd-session[950]: pam_unix(sshd:session): session closed for user root worker2 # [ 48.943908] sshd-session[970]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 48.945624] sshd-session[970]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 48.947469] systemd[1]: sshd-vsock@2-3-6:22-2:2.service: Deactivated successfully. worker2 # [ 48.949300] sshd-session[969]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 48.951253] sshd-session[969]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 48.952590] sshd-session[951]: pam_unix(sshd:session): session closed for user root worker2 # [ 48.953842] sshd-session[949]: pam_unix(sshd:session): session closed for user root worker2 # [ 48.955553] systemd[1]: session-3.scope: Deactivated successfully. worker2 # [ 48.958734] systemd-logind[555]: Session 3 logged out. Waiting for processes to exit. worker2 # [ 48.961418] systemd-logind[555]: Removed session 3. worker2 # [ 48.964919] systemd[1]: sshd-vsock@3-4-6:22-2:3.service: Deactivated successfully. worker2 # [ 48.967702] systemd[1]: sshd-vsock@1-2-6:22-2:1.service: Deactivated successfully. worker2 # [ 48.971373] systemd[1]: session-4.scope: Deactivated successfully. worker2 # [ 48.973165] systemd[1]: session-5.scope: Deactivated successfully. worker2 # [ 48.976375] systemd-logind[555]: Session 5 logged out. Waiting for processes to exit. worker2 # [ 48.978397] systemd-logind[555]: Removed session 5. worker2 # [ 48.979859] systemd-logind[555]: Session 4 logged out. Waiting for processes to exit. worker2 # [ 48.982183] systemd-logind[555]: Removed session 4. lb # [ 48.999396] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 49.003260] systemd[1]: Started SSH per-connection Daemon (vsock:2:11). lb # [ 49.007280] systemd[1]: Started SSH per-connection Daemon (vsock:2:12). lb # [ 49.011052] systemd[1]: Started SSH per-connection Daemon (vsock:2:13). lb # [ 49.118785] sshd-session[1196]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 49.125559] sshd-session[1194]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 49.129462] sshd-session[1195]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 49.133305] sshd-session[1196]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 49.138227] sshd-session[1194]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 49.142957] sshd-session[1195]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 49.148267] sshd-session[1196]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 49.156079] sshd-session[1195]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 49.160285] systemd-logind[553]: New session '13' of user 'root' with class 'user' and type 'tty'. lb # [ 49.163801] sshd-session[1194]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 49.166358] systemd[1]: Started Session 13 of User root. lb # [ 49.176747] systemd-logind[553]: New session '14' of user 'root' with class 'user' and type 'tty'. lb # [ 49.179781] systemd[1]: Started Session 14 of User root. lb # [ 49.186159] systemd-logind[553]: New session '15' of user 'root' with class 'user' and type 'tty'. lb # [ 49.190388] systemd[1]: Started Session 15 of User root. lb # [ 49.230464] sshd-session[1212]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 49.232546] sshd-session[1212]: Disconnected from user root UNKNOWN port 65535 lb # [ 49.236219] sshd-session[1196]: pam_unix(sshd:session): session closed for user root lb # [ 49.241797] systemd[1]: sshd-vsock@13-14-4:22-2:13.service: Deactivated successfully. lb # [ 49.248466] systemd[1]: session-13.scope: Deactivated successfully. lb # [ 49.252309] systemd[1]: session-13.scope: Consumed 19ms CPU time over 86ms wall clock time, 3.2M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 49.256559] systemd-logind[553]: Session 13 logged out. Waiting for processes to exit. lb # [ 49.259396] sshd-session[1216]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 49.261321] sshd-session[1216]: Disconnected from user root UNKNOWN port 65535 lb # [ 49.263201] systemd-logind[553]: Removed session 13. lb # [ 49.265524] sshd-session[1194]: pam_unix(sshd:session): session closed for user root lb # [ 49.267614] sshd-session[1215]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 49.269159] sshd-session[1215]: Disconnected from user root UNKNOWN port 65535 lb # [ 49.271420] sshd-session[1195]: pam_unix(sshd:session): session closed for user root lb # [ 49.273265] systemd[1]: sshd-vsock@11-12-4:22-2:11.service: Deactivated successfully. lb # [ 49.277196] systemd[1]: session-15.scope: Deactivated successfully. lb # [ 49.278900] systemd[1]: session-15.scope: Consumed 17ms CPU time over 88ms wall clock time, 3.2M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 49.281614] systemd[1]: sshd-vsock@12-13-4:22-2:12.service: Deactivated successfully. lb # [ 49.285608] systemd[1]: session-14.scope: Deactivated successfully. lb # [ 49.287228] systemd[1]: session-14.scope: Consumed 17ms CPU time over 107ms wall clock time, 3.2M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 49.291463] systemd-logind[553]: Session 15 logged out. Waiting for processes to exit. lb # [ 49.294153] systemd-logind[553]: Removed session 15. lb # [ 49.295097] systemd-logind[553]: Session 14 logged out. Waiting for processes to exit. worker1 # [ 49.297586] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 49.296862] systemd-logind[553]: Removed session 14. worker1 # [ 49.302855] systemd[1]: Started SSH per-connection Daemon (vsock:2:5). worker1 # [ 49.316137] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 49.322212] systemd[1]: Started SSH per-connection Daemon (vsock:2:6). worker1 # [ 49.328295] systemd[1]: Started SSH per-connection Daemon (vsock:2:7). worker1 # [ 49.433629] sshd-session[992]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 49.440493] sshd-session[994]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 49.443564] sshd-session[992]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 49.446963] sshd-session[993]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 49.452630] sshd-session[994]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 49.457733] sshd-session[993]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 49.459962] sshd-session[992]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 49.471576] systemd-logind[608]: New session '7' of user 'root' with class 'user' and type 'tty'. worker1 # [ 49.473523] sshd-session[994]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 49.475881] systemd[1]: Started Session 7 of User root. worker1 # [ 49.483830] sshd-session[993]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 49.490314] systemd-logind[608]: New session '8' of user 'root' with class 'user' and type 'tty'. worker1 # [ 49.492868] systemd[1]: Started Session 8 of User root. worker1 # [ 49.500223] systemd-logind[608]: New session '9' of user 'root' with class 'user' and type 'tty'. worker1 # [ 49.505205] systemd[1]: Started Session 9 of User root. worker1 # [ 49.535424] sshd-session[1010]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 49.537231] sshd-session[1010]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 49.539328] sshd-session[992]: pam_unix(sshd:session): session closed for user root worker1 # [ 49.545136] systemd[1]: sshd-vsock@5-6-5:22-2:5.service: Deactivated successfully. worker1 # [ 49.549707] systemd[1]: session-7.scope: Deactivated successfully. worker1 # [ 49.552398] systemd[1]: session-7.scope: Consumed 16ms CPU time over 77ms wall clock time, 3.2M memory peak, 5.7K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 49.555401] systemd-logind[608]: Session 7 logged out. Waiting for processes to exit. worker1 # [ 49.559169] systemd-logind[608]: Removed session 7. worker1 # [ 49.562424] sshd-session[1012]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 49.564113] sshd-session[1012]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 49.566196] sshd-session[994]: pam_unix(sshd:session): session closed for user root worker1 # [ 49.569495] systemd[1]: sshd-vsock@7-8-5:22-2:7.service: Deactivated successfully. worker1 # [ 49.572114] sshd-session[1015]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 49.573373] sshd-session[1015]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 49.574793] sshd-session[993]: pam_unix(sshd:session): session closed for user root worker1 # [ 49.577576] systemd[1]: session-8.scope: Deactivated successfully. worker1 # [ 49.578541] systemd[1]: session-8.scope: Consumed 15ms CPU time over 84ms wall clock time, 3.1M memory peak, 5.7K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 49.582089] systemd-logind[608]: Session 8 logged out. Waiting for processes to exit. worker1 # [ 49.583506] systemd-logind[608]: Removed session 8. worker1 # [ 49.587256] systemd[1]: sshd-vsock@6-7-5:22-2:6.service: Deactivated successfully. worker1 # [ 49.590420] systemd[1]: session-9.scope: Deactivated successfully. worker1 # [ 49.591709] systemd[1]: session-9.scope: Consumed 15ms CPU time over 86ms wall clock time, 3.2M memory peak, 5.7K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 49.595185] systemd-logind[608]: Session 9 logged out. Waiting for processes to exit. worker1 # [ 49.596637] systemd-logind[608]: Removed session 9. client # [ 49.604464] systemd[1]: Created slice Slice /system/sshd-vsock. client # [ 49.609097] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 49.614517] systemd[1]: Started SSH per-connection Daemon (vsock:2:0). client # [ 49.689907] sshd-session[741]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 49.694980] sshd-session[741]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 49.700838] sshd-session[741]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 49.716944] systemd-logind[465]: New session '1' of user 'root' with class 'user' and type 'tty'. client # [ 49.720502] systemd[1]: Created slice Slice /user/0. client # [ 49.723153] systemd[1]: Starting User Runtime Directory /run/user/0... client # [ 49.746740] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 49.750750] systemd[1]: Starting User Manager for UID 0... client # [ 49.767428] (systemd)[750]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 49.771352] systemd-logind[465]: New session '2' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 49.848091] systemd[750]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 49.930143] systemd[750]: Queued start job for default target Main User Target. client # [ 49.932748] systemd[750]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 49.934963] systemd[750]: Created slice User Application Slice. client # [ 49.935969] systemd[750]: Started Daily Cleanup of User's Temporary Directories. client # [ 49.937194] systemd[750]: Reached target Paths. client # [ 49.938196] systemd[750]: Reached target Timers. client # [ 49.940724] systemd[750]: Starting D-Bus User Message Bus Socket... client # [ 49.941992] systemd[750]: Starting Create User Files and Directories... client # [ 49.967319] systemd[750]: Finished Create User Files and Directories. client # [ 49.983064] systemd[750]: Listening on D-Bus User Message Bus Socket. client # [ 49.984869] systemd[750]: Reached target Sockets. client # [ 49.985661] systemd[750]: Reached target Basic System. client # [ 49.986502] systemd[750]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 49.987804] systemd[750]: Reached target Main User Target. client # [ 49.988583] systemd[750]: Startup finished in 202ms. client # [ 49.991156] systemd[1]: Started User Manager for UID 0. client # [ 49.993361] systemd[1]: Started Session 1 of User root. client # [ 50.007960] sshd-session[763]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 50.009654] sshd-session[763]: Disconnected from user root UNKNOWN port 65535 client # [ 50.010944] sshd-session[741]: pam_unix(sshd:session): session closed for user root client # [ 50.014073] systemd[1]: sshd-vsock@0-1-3:22-2:0.service: Deactivated successfully. client # [ 50.017485] systemd[1]: session-1.scope: Deactivated successfully. client # [ 50.020542] systemd-logind[465]: Session 1 logged out. Waiting for processes to exit. client # [ 50.022675] systemd-logind[465]: Removed session 1. client # [ 50.103597] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 50.111322] systemd[1]: Started SSH per-connection Daemon (vsock:2:1). client # [ 50.119555] systemd[1]: Started SSH per-connection Daemon (vsock:2:2). client # [ 50.122582] systemd[1]: Started SSH per-connection Daemon (vsock:2:3). client # [ 50.227154] sshd-session[769]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 50.232225] sshd-session[768]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 50.238729] sshd-session[769]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 50.242840] sshd-session[768]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 50.250945] sshd-session[770]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 50.253073] sshd-session[769]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 50.259888] sshd-session[768]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 50.264071] systemd-logind[465]: New session '3' of user 'root' with class 'user' and type 'tty'. client # [ 50.265844] sshd-session[770]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 50.268337] systemd[1]: Started Session 3 of User root. client # [ 50.280202] systemd-logind[465]: New session '4' of user 'root' with class 'user' and type 'tty'. client # [ 50.283932] systemd[1]: Started Session 4 of User root. client # [ 50.289209] sshd-session[770]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 50.299043] systemd-logind[465]: New session '5' of user 'root' with class 'user' and type 'tty'. client # [ 50.304173] systemd[1]: Started Session 5 of User root. client # [ 50.598435] systemd[1]: Started Nix Daemon. worker1 # [ 50.739798] nix-grpc-daemon[529]: ts=2026-11-07T15:08:26Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 50.751536] systemd[1]: Started Nix Daemon. client # [ 50.829062] nix-daemon[806]: accepted connection from pid 788, user root (trusted) worker1 # [ 50.871406] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 50.884042] nix-grpc-daemon[529]: ts=2026-11-07T15:08:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 50.898811] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 22 ms (attempt 1/5) lb # [ 50.902830] garage[913]: 2026-11-07T15:08:26.169656Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nix-cache-info lb # [ 50.911233] garage[913]: 2026-11-07T15:08:26.179041Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/nix-cache-info worker1 # [ 50.924142] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 2/5) client # [ 50.941223] sshd-session[789]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 50.942560] sshd-session[789]: Disconnected from user root UNKNOWN port 65535 client # [ 50.944203] sshd-session[768]: pam_unix(sshd:session): session closed for user root client # [ 50.948191] systemd[1]: sshd-vsock@1-2-3:22-2:1.service: Deactivated successfully. client # [ 50.951867] systemd[1]: session-4.scope: Deactivated successfully. client # [ 50.957296] systemd-logind[465]: Session 4 logged out. Waiting for processes to exit. client # [ 50.958878] systemd-logind[465]: Removed session 4. worker1 # [ 50.964449] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 320 ms (attempt 3/5) client # [ 51.002883] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 51.008122] systemd[1]: Started SSH per-connection Daemon (vsock:2:4). worker2 # [ 51.044523] nix-grpc-daemon[820]: ts=2026-11-07T15:08:26Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 51.053151] nix-grpc-daemon[820]: ts=2026-11-07T15:08:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 51.065469] systemd[1]: Started Nix Daemon. client # [ 51.064282] sshd-session[829]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 51.069341] sshd-session[829]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 51.074808] sshd-session[829]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 51.081065] systemd-logind[465]: New session '6' of user 'root' with class 'user' and type 'tty'. client # [ 51.085081] systemd[1]: Started Session 6 of User root. worker2 # [ 51.187148] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) client # [ 51.200946] sshd-session[835]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 51.202756] sshd-session[835]: Disconnected from user root UNKNOWN port 65535 client # [ 51.204060] sshd-session[829]: pam_unix(sshd:session): session closed for user root worker2 # [ 51.208407] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 52 ms (attempt 1/5) client # [ 51.208069] systemd[1]: sshd-vsock@4-5-3:22-2:4.service: Deactivated successfully. client # [ 51.210481] systemd[1]: session-6.scope: Deactivated successfully. client # [ 51.213077] systemd-logind[465]: Session 6 logged out. Waiting for processes to exit. client # [ 51.215729] systemd-logind[465]: Removed session 6. lb # [ 51.215298] garage[913]: 2026-11-07T15:08:26.483006Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nix-cache-info lb # [ 51.222924] garage[913]: 2026-11-07T15:08:26.491348Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/nix-cache-info worker2 # [ 51.263878] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 104 ms (attempt 2/5) worker1 # [ 51.286701] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 220 ms (attempt 4/5) worker1 # [ 51.306349] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 51.313739] systemd[1]: Started SSH per-connection Daemon (vsock:2:8). worker2 # [ 51.370388] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 252 ms (attempt 3/5) worker1 # [ 51.382422] sshd-session[1036]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 51.387376] sshd-session[1036]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 51.392421] sshd-session[1036]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 51.398235] systemd-logind[608]: New session '10' of user 'root' with class 'user' and type 'tty'. worker1 # [ 51.402358] systemd[1]: Started Session 10 of User root. worker1 # [ 51.512273] nix-grpc-daemon[529]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 51.515050] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 51.520288] garage[913]: 2026-11-07T15:08:26.787034Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo lb # [ 51.526950] garage[913]: 2026-11-07T15:08:26.787645Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 51.536690] garage[913]: 2026-11-07T15:08:26.803888Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo lb # [ 51.543334] garage[913]: 2026-11-07T15:08:26.804339Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 51.549214] garage[913]: 2026-11-07T15:08:26.817013Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo lb # [ 51.557168] garage[913]: 2026-11-07T15:08:26.817445Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 51.563936] sshd-session[1042]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 51.565261] sshd-session[1042]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 51.566679] sshd-session[1036]: pam_unix(sshd:session): session closed for user root worker1 # [ 51.569245] nix-grpc-daemon[529]: ts=2026-11-07T15:08:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 51.572434] systemd[1]: sshd-vsock@8-9-5:22-2:8.service: Deactivated successfully. worker1 # [ 51.576343] systemd[1]: session-10.scope: Deactivated successfully. lb # [ 51.572296] garage[913]: 2026-11-07T15:08:26.840028Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo worker1 # [ 51.579521] systemd-logind[608]: Session 10 logged out. Waiting for processes to exit. worker1 # [ 51.581211] systemd-logind[608]: Removed session 10. lb # [ 51.578880] garage[913]: 2026-11-07T15:08:26.840491Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 51.586912] garage[913]: 2026-11-07T15:08:26.854635Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo lb # [ 51.592435] garage[913]: 2026-11-07T15:08:26.854978Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 51.600186] nix-grpc-daemon[820]: ts=2026-11-07T15:08:26Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 51.611179] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 51.619597] systemd[1]: Started SSH per-connection Daemon (vsock:2:4). worker2 # [ 51.625459] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker2 # [ 51.635674] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 731 ms (attempt 4/5) worker2 # [ 51.667848] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 61 ms (attempt 1/5) worker2 # [ 51.705850] sshd-session[997]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 51.710917] sshd-session[997]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 51.715953] sshd-session[997]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 51.722228] systemd-logind[555]: New session '6' of user 'root' with class 'user' and type 'tty'. worker2 # [ 51.725349] systemd[1]: Started Session 6 of User root. worker2 # [ 51.733656] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 79 ms (attempt 2/5) worker2 # [ 51.740966] sshd-session[1009]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 51.742554] sshd-session[1009]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 51.743836] sshd-session[997]: pam_unix(sshd:session): session closed for user root worker2 # [ 51.746666] systemd[1]: sshd-vsock@4-5-6:22-2:4.service: Deactivated successfully. worker2 # [ 51.750346] systemd[1]: session-6.scope: Deactivated successfully. worker2 # [ 51.753298] systemd-logind[555]: Session 6 logged out. Waiting for processes to exit. worker2 # [ 51.755211] systemd-logind[555]: Removed session 6. client # [ 51.802333] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 51.809632] systemd[1]: Started SSH per-connection Daemon (vsock:2:5). worker2 # [ 51.813239] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 36 ms (attempt 3/5) worker2 # [ 51.851113] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 430 ms (attempt 4/5) client # [ 51.880412] sshd-session[842]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 51.885276] sshd-session[842]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 51.890365] sshd-session[842]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 51.895663] systemd-logind[465]: New session '7' of user 'root' with class 'user' and type 'tty'. client # [ 51.900406] systemd[1]: Started Session 7 of User root. client # [ 51.995937] nix-daemon[806]: accepted connection from pid 850, user root (trusted) worker1 # [ 52.155699] nix-grpc-daemon[529]: ts=2026-11-07T15:08:27Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:60242 worker2 # [ 52.285105] nix-grpc-daemon[820]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 52.289226] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 52.300738] garage[913]: 2026-11-07T15:08:27.567757Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo lb # [ 52.307307] garage[913]: 2026-11-07T15:08:27.568281Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 52.314065] garage[913]: 2026-11-07T15:08:27.581635Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo lb # [ 52.320396] garage[913]: 2026-11-07T15:08:27.582110Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 52.332673] nix-grpc-daemon[529]: ts=2026-11-07T15:08:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 52.338373] garage[913]: 2026-11-07T15:08:27.606771Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo lb # [ 52.345873] garage[913]: 2026-11-07T15:08:27.613675Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 52.353558] garage[913]: 2026-11-07T15:08:27.620806Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo lb # [ 52.359725] garage[913]: 2026-11-07T15:08:27.621392Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 52.367949] nix-grpc-daemon[820]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 52.371747] nix-grpc-daemon[529]: ts=2026-11-07T15:08:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 worker2 # [ 52.371271] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 52.382270] garage[913]: 2026-11-07T15:08:27.648572Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo lb # [ 52.388639] garage[913]: 2026-11-07T15:08:27.649115Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 52.395129] garage[913]: 2026-11-07T15:08:27.663087Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo lb # [ 52.401354] garage[913]: 2026-11-07T15:08:27.669441Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 52.405941] nix-grpc-daemon[820]: ts=2026-11-07T15:08:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43034 lb # [ 52.406800] garage[913]: 2026-11-07T15:08:27.674725Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo lb # [ 52.412116] garage[913]: 2026-11-07T15:08:27.675049Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 52.409828] nix-grpc-daemon[820]: ts=2026-11-07T15:08:27Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43034 worker1 # [ 52.418281] nix-grpc-daemon[529]: ts=2026-11-07T15:08:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 52.418458] garage[913]: 2026-11-07T15:08:27.686184Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/qvaxly1kq8x16n7zm2l2wz72nmfiqs4c.narinfo lb # [ 52.420883] garage[913]: 2026-11-07T15:08:27.686381Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 52.422722] garage[913]: 2026-11-07T15:08:27.686437Z INFO garage_api_common::generic_server: 127.0.0.1:57872 (key GK0123456789abcdef01234567) HEAD /farm/pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo lb # [ 52.425234] garage[913]: 2026-11-07T15:08:27.686601Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 52.433652] nix-grpc-daemon[529]: ts=2026-11-07T15:08:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 52.440552] nix-grpc-daemon[529]: ts=2026-11-07T15:08:27Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 52.453359] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 52.467307] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 52.478795] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 52.491206] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 52.496849] nix-grpc-daemon[529]: ts=2026-11-07T15:08:27Z level=info event=niks3_push_started pid=1057 worker1 # [ 52.512851] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 52.644926] nix-grpc-daemon[1057]: time=2026-11-07T15:08:27.953Z level=INFO msg="Configuring client TLS" cert=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/worker1.pem key=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/worker1.key ca="" worker1 # [ 52.910110] nix-daemon[1026]: accepted connection from pid 1074, user nix-grpc-daemon (trusted) worker1 # [ 52.915276] nix-daemon[1026]: accepted connection from pid 1073, user nix-grpc-daemon (trusted) worker1 # [ 52.926279] nix-daemon[1026]: accepted connection from pid 1076, user nix-grpc-daemon (trusted) lb # [ 52.946865] niks3-server[963]: 2026/11/07 15:08:28 INFO Received push request method=POST path=/api/pushes lb # [ 52.957110] niks3-server[963]: 2026/11/07 15:08:28 INFO Received push request method=POST path=/api/pushes worker1 # [ 52.963490] nix-daemon[1026]: reaped child process 1084, status = succeeded worker1 # [ 52.964704] nix-daemon[1026]: reaped child process 1085, status = succeeded lb # [ 52.961443] niks3-server[963]: 2026/11/07 15:08:28 INFO Received push request method=POST path=/api/pushes worker1 # [ 52.965768] nix-daemon[1026]: reaped child process 1086, status = succeeded worker1 # [ 52.974198] nix-grpc-daemon[1057]: time=2026-11-07T15:08:28.282Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker1 # [ 52.975906] nix-grpc-daemon[1057]: time=2026-11-07T15:08:28.284Z level=INFO msg="Uploading 08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv (624B)" worker1 # [ 52.978474] nix-grpc-daemon[1057]: time=2026-11-07T15:08:28.286Z level=INFO msg="Uploading lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv (504B)" worker1 # [ 52.982121] nix-grpc-daemon[1057]: time=2026-11-07T15:08:28.286Z level=INFO msg="Uploading cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv (752B)" worker1 # [ 52.988843] nix-grpc-daemon[1057]: time=2026-11-07T15:08:28.297Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 52.991405] nix-grpc-daemon[1057]: time=2026-11-07T15:08:28.297Z level=INFO msg="Uploading pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv (512B)" worker1 # [ 52.995069] nix-grpc-daemon[1057]: time=2026-11-07T15:08:28.302Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 52.996533] nix-grpc-daemon[1057]: time=2026-11-07T15:08:28.302Z level=INFO msg="Uploading qvaxly1kq8x16n7zm2l2wz72nmfiqs4c-local-input-w1only (120B)" lb # [ 53.000517] garage[913]: 2026-11-07T15:08:28.267976Z INFO garage_api_common::generic_server: 192.168.1.3:39844 PUT /farm/nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6e1f715bc8ad4bee230a84f998fbc2839cfc99299db84274b7c907a80992df70 lb # [ 53.015286] garage[913]: 2026-11-07T15:08:28.282630Z INFO garage_api_common::generic_server: 192.168.1.3:39864 PUT /farm/pd51i21khb2xrd9paajf80pb96sw8zn0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5417f76fafcf8f1134031cb4bfffaf62f2d208f7822c7e8788e8c60f9ec1097f lb # [ 53.027334] garage[913]: 2026-11-07T15:08:28.283280Z INFO garage_api_common::generic_server: 192.168.1.3:39858 PUT /farm/nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3b49e62011bbd91bd4a30f472184a49daae152b6f81ced1b30e7f8ac3cfd4982 lb # [ 53.044311] garage[913]: 2026-11-07T15:08:28.312399Z INFO garage_api_common::generic_server: 192.168.1.3:39836 PUT /farm/08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b85ec7fb69f86b62646d679d2bfedc492ff0328112cba22807ae28590031f43a lb # [ 53.054754] garage[913]: 2026-11-07T15:08:28.322405Z INFO garage_api_common::generic_server: 192.168.1.3:39832 PUT /farm/nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6626653b7a819a5a4e557470ab66d03347c9a840945598a7ea75a41201e35c5c lb # [ 53.059983] garage[913]: 2026-11-07T15:08:28.328441Z INFO garage_api_common::generic_server: 192.168.1.3:39818 PUT /farm/lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f03d3b5b20ef417f11505fad5d7e746df8bf6e419503d28645064a298f10f4ac lb # [ 53.065534] garage[913]: 2026-11-07T15:08:28.333824Z INFO garage_api_common::generic_server: 192.168.1.3:39802 PUT /farm/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f8ecee2b0f4ceb17eb1005f1289237fbae5172fd3108d344eaa83a8d73da6417 lb # [ 53.070534] garage[913]: 2026-11-07T15:08:28.339003Z INFO garage_api_common::generic_server: 192.168.1.3:39800 PUT /farm/nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2c0d8b72a3e428de1a6bd8306a33d81925bb4d16fd260a819325dcae0ea18081 lb # [ 53.077319] garage[913]: 2026-11-07T15:08:28.345608Z INFO garage_api_common::generic_server: 192.168.1.3:39892 PUT /farm/qvaxly1kq8x16n7zm2l2wz72nmfiqs4c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=42e0099ebc90bcd50fa3d56029deea6e49ca24f9fc82a6901c94f269cad30b61 lb # [ 53.084205] garage[913]: 2026-11-07T15:08:28.351937Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 53.087557] garage[913]: 2026-11-07T15:08:28.352265Z INFO garage_api_common::generic_server: 127.0.0.1:57872 (key GK0123456789abcdef01234567) HEAD /farm/pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 53.090451] garage[913]: 2026-11-07T15:08:28.352465Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 53.095160] garage[913]: 2026-11-07T15:08:28.362748Z INFO garage_api_common::generic_server: 192.168.1.3:39878 PUT /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cdc6526eb92c81263160ff2b01a5cec40e478ea89656c336634bb17ea3d635ee lb # [ 53.100080] niks3-server[963]: 2026/11/07 15:08:28 INFO Received sign narinfos request method=POST path=/api/pushes/1/sign lb # [ 53.103060] niks3-server[963]: 2026/11/07 15:08:28 INFO Received sign narinfos request method=POST path=/api/pushes/3/sign lb # [ 53.107793] garage[913]: 2026-11-07T15:08:28.375198Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 53.110607] garage[913]: 2026-11-07T15:08:28.375928Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls lb # [ 53.114724] niks3-server[963]: 2026/11/07 15:08:28 INFO Received sign narinfos request method=POST path=/api/pushes/2/sign lb # [ 53.118435] garage[913]: 2026-11-07T15:08:28.386628Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls lb # [ 53.123104] garage[913]: 2026-11-07T15:08:28.390693Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 53.127377] niks3-server[963]: 2026/11/07 15:08:28 INFO Signed narinfos id=1 count=3 lb # [ 53.130419] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.ls lb # [ 53.131914] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst worker1 # [ 53.132189] nix-grpc-daemon[1057]: time=2026-11-07T15:08:28.439Z level=INFO msg="Uploading 3 narinfos" lb # [ 53.135156] garage[913]: 2026-11-07T15:08:28.402488Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 53.137646] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 53.139866] niks3-server[963]: 2026/11/07 15:08:28 INFO Signed narinfos id=3 count=1 worker1 # [ 53.141187] nix-grpc-daemon[1057]: time=2026-11-07T15:08:28.449Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.141875] garage[913]: 2026-11-07T15:08:28.409391Z INFO garage_api_common::generic_server: 192.168.1.3:39802 PUT /farm/pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=40e32fb3714047a9c1ac1fe48bae6a13eb16b2169f6165f569b4979757eb5744 worker1 # [ 53.146059] nix-grpc-daemon[1057]: time=2026-11-07T15:08:28.453Z level=INFO msg="Uploading 1 narinfos" lb # [ 53.146544] garage[913]: 2026-11-07T15:08:28.409640Z INFO garage_api_common::generic_server: 192.168.1.3:39892 PUT /farm/08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d3fd80259fd4a046ccfeb22624c5db71696474b3564cbe0c759350a75752b4d4 lb # [ 53.152922] niks3-server[963]: 2026/11/07 15:08:28 INFO Signed narinfos id=2 count=1 lb # [ 53.153949] garage[913]: 2026-11-07T15:08:28.420915Z INFO garage_api_common::generic_server: 192.168.1.3:39878 PUT /farm/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0f6654f37ac8c05217990b03a75bbc41be790bdcbdfd206d83a4c4296f7322e4 lb # [ 53.160733] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.ls lb # [ 53.162478] garage[913]: 2026-11-07T15:08:28.428531Z INFO garage_api_common::generic_server: 192.168.1.3:39818 PUT /farm/lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1d688eb7cb39bcbd00e9b4f5705cdaa4a19ed42b09c22da3f7f059c1e0bbb582 lb # [ 53.167544] niks3-server[963]: 2026/11/07 15:08:28 INFO Received complete push request method=POST path=/api/pushes/3/complete lb # [ 53.170474] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.ls lb # [ 53.173122] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 53.179251] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.ls lb # [ 53.183111] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 53.184904] garage[913]: 2026-11-07T15:08:28.450623Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 53.187395] garage[913]: 2026-11-07T15:08:28.450854Z INFO garage_api_common::generic_server: 192.168.1.3:39800 PUT /farm/qvaxly1kq8x16n7zm2l2wz72nmfiqs4c.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150828Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ac08bf2526314682e147fbce1f662dfc7b2314d4678a79591feb132d3f4634ed lb # [ 53.192911] niks3-server[963]: 2026/11/07 15:08:28 INFO Received complete push request method=POST path=/api/pushes/1/complete lb # [ 53.196147] garage[913]: 2026-11-07T15:08:28.463162Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/qvaxly1kq8x16n7zm2l2wz72nmfiqs4c.ls lb # [ 53.200149] garage[913]: 2026-11-07T15:08:28.468245Z INFO garage_api_common::generic_server: 127.0.0.1:57872 (key GK0123456789abcdef01234567) HEAD /farm/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo lb # [ 53.204097] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 53.207855] garage[913]: 2026-11-07T15:08:28.475992Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo lb # [ 53.210191] niks3-server[963]: 2026/11/07 15:08:28 INFO Received complete push request method=POST path=/api/pushes/2/complete lb # [ 53.213180] garage[913]: 2026-11-07T15:08:28.480786Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo lb # [ 53.216039] garage[913]: 2026-11-07T15:08:28.480978Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo lb # [ 53.218553] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=qvaxly1kq8x16n7zm2l2wz72nmfiqs4c.ls lb # [ 53.221609] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo lb # [ 53.224196] garage[913]: 2026-11-07T15:08:28.492161Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/qvaxly1kq8x16n7zm2l2wz72nmfiqs4c.narinfo lb # [ 53.228364] niks3-server[963]: 2026/11/07 15:08:28 INFO Completed push id=3 objects=3 duration=60.596807ms worker1 # [ 53.230270] nix-grpc-daemon[1057]: time=2026-11-07T15:08:28.538Z level=INFO msg="Upload complete. (580ms)" lb # [ 53.231758] niks3-server[963]: 2026/11/07 15:08:28 INFO Completed push id=1 objects=9 duration=38.747103ms lb # [ 53.234233] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo lb # [ 53.235859] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo lb # [ 53.237986] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker1 # [ 53.237966] nix-grpc-daemon[1057]: time=2026-11-07T15:08:28.543Z level=INFO msg="Upload complete. (583ms)" lb # [ 53.240718] niks3-server[963]: 2026/11/07 15:08:28 INFO Completed push id=2 objects=3 duration=32.741871ms lb # [ 53.242887] niks3-server[963]: 2026/11/07 15:08:28 INFO Registered completed upload object_key=qvaxly1kq8x16n7zm2l2wz72nmfiqs4c.narinfo worker1 # [ 53.243837] nix-grpc-daemon[529]: ts=2026-11-07T15:08:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=0 paths=1 nar_bytes_in=512 worker1 # [ 53.255931] nix-grpc-daemon[1057]: time=2026-11-07T15:08:28.551Z level=INFO msg="Upload complete. (590ms)" worker1 # [ 53.263640] nix-grpc-daemon[529]: ts=2026-11-07T15:08:28Z level=debug event=want client=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv cached=0 worker1 # [ 53.268553] nix-grpc-daemon[529]: ts=2026-11-07T15:08:28Z level=debug event=assigned drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 53.279248] nix-grpc-daemon[529]: ts=2026-11-07T15:08:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=0 paths=3 nar_bytes_in=1880 worker1 # [ 53.283989] nix-grpc-daemon[529]: ts=2026-11-07T15:08:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 53.288269] nix-grpc-daemon[529]: ts=2026-11-07T15:08:28Z level=debug event=want client=2 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv cached=0 worker2 # [ 53.289492] nix-grpc-daemon[820]: ts=2026-11-07T15:08:28Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43034 worker1 # [ 53.291324] nix-grpc-daemon[529]: ts=2026-11-07T15:08:28Z level=debug event=assigned drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 53.293532] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker1 # [ 53.299867] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) lb # [ 53.304874] garage[913]: 2026-11-07T15:08:28.572920Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker1 # [ 53.308112] nix-daemon[1026]: reaped child process 1051, status = succeeded worker1 # [ 53.308993] nix-daemon[1026]: reaped child process 1054, status = succeeded lb # [ 53.308644] garage[913]: 2026-11-07T15:08:28.576639Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) GET /farm/lqi1rvcqjj8q9l279yzgrgaghp394zs5.narinfo worker1 # [ 53.313980] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker2 # [ 53.310625] nix-grpc-daemon[820]: copying path '/nix/store/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv' from 'http://lb:5751'... lb # [ 53.318026] garage[913]: 2026-11-07T15:08:28.586187Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst lb # [ 53.321215] garage[913]: 2026-11-07T15:08:28.589419Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) GET /farm/nar/0bddczcnpndyzwmafx9yqfqrkrp1jg9rr5hsixz6rpy99kg84g1g.nar.zst worker2 # [ 53.349483] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker2 # [ 53.363228] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker1 # [ 53.378587] nix-grpc-daemon[529]: ts=2026-11-07T15:08:28Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=0 paths=1 nar_bytes_in=120 worker2 # [ 53.390067] nix-grpc-daemon[820]: ts=2026-11-07T15:08:28Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43034 worker1 # [ 53.393985] nix-daemon[1026]: reaped child process 1053, status = succeeded lb # [ 53.396896] garage[913]: 2026-11-07T15:08:28.664676Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/d272zwz8jz7m0glknby0ghkr6dy9vh2q.narinfo lb # [ 53.403435] garage[913]: 2026-11-07T15:08:28.665184Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 53.407860] garage[913]: 2026-11-07T15:08:28.671160Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd.narinfo lb # [ 53.414531] garage[913]: 2026-11-07T15:08:28.671612Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 53.419838] nix-grpc-daemon[820]: ts=2026-11-07T15:08:28Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 53.430735] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker2 # [ 53.442156] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker2 # [ 53.453202] nix-grpc-daemon[820]: ts=2026-11-07T15:08:28Z level=info event=niks3_push_started pid=1033 worker2 # [ 53.597632] nix-grpc-daemon[1033]: time=2026-11-07T15:08:28.809Z level=INFO msg="Configuring client TLS" cert=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/worker2.pem key=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/worker2.key ca="" worker2 # [ 53.692324] nix-daemon[986]: accepted connection from pid 1046, user nix-grpc-daemon (trusted) worker2 # [ 53.707761] nix-daemon[986]: reaped child process 1049, status = succeeded lb # [ 53.716444] niks3-server[963]: 2026/11/07 15:08:28 INFO Received push request method=POST path=/api/pushes lb # [ 53.959292] garage[913]: 2026-11-07T15:08:29.226800Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo lb # [ 53.965125] garage[913]: 2026-11-07T15:08:29.227328Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 53.989340] garage[913]: 2026-11-07T15:08:29.257065Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo lb # [ 53.995601] garage[913]: 2026-11-07T15:08:29.263654Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 54.056894] nix-grpc-daemon[1033]: time=2026-11-07T15:08:29.269Z level=INFO msg="Uploading 2 paths to lb (0 already cached)" worker2 # [ 54.058618] nix-grpc-daemon[1033]: time=2026-11-07T15:08:29.271Z level=INFO msg="Uploading d272zwz8jz7m0glknby0ghkr6dy9vh2q-local-input-w1only.drv (448B)" worker2 # [ 54.060514] nix-grpc-daemon[1033]: time=2026-11-07T15:08:29.273Z level=INFO msg="Uploading 6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd-uses-input-w1onlya.drv (592B)" lb # [ 54.074830] garage[913]: 2026-11-07T15:08:29.342490Z INFO garage_api_common::generic_server: 192.168.1.4:52802 PUT /farm/nar/1pkjvp002dh89xc56hjzswqy7vcih46zxqnfrs533mdkm7nbsisb.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150829Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2e9687885011151b3d1f70cca1379b44f17e9bd48fe1c3bcc6021924d0b64078 lb # [ 54.087629] garage[913]: 2026-11-07T15:08:29.355446Z INFO garage_api_common::generic_server: 192.168.1.4:52792 PUT /farm/d272zwz8jz7m0glknby0ghkr6dy9vh2q.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150829Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bf72c27ef0858c4640522f987e0029e3d54ef9922f78c880d3e8283039680952 lb # [ 54.101329] garage[913]: 2026-11-07T15:08:29.368929Z INFO garage_api_common::generic_server: 192.168.1.4:52818 PUT /farm/nar/00svy5dqwmlyn5dr0zadcbb4b1x0ddhvqmg61xfbmi05nnajs4mj.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150829Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a2812ece59c3585946cb54596ee73ce25ec76d568bea37c8a825cefcf2a566d8 lb # [ 54.116315] garage[913]: 2026-11-07T15:08:29.383674Z INFO garage_api_common::generic_server: 192.168.1.4:52828 PUT /farm/6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150829Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=034f124f13fc127d665cdc3de9fdd924b3e24df1795178f098e6e4a4f5564eb4 lb # [ 54.129180] garage[913]: 2026-11-07T15:08:29.395701Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/d272zwz8jz7m0glknby0ghkr6dy9vh2q.ls lb # [ 54.133766] garage[913]: 2026-11-07T15:08:29.396211Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/nar/1pkjvp002dh89xc56hjzswqy7vcih46zxqnfrs533mdkm7nbsisb.nar.zst lb # [ 54.144562] niks3-server[963]: 2026/11/07 15:08:29 INFO Received sign narinfos request method=POST path=/api/pushes/4/sign lb # [ 54.147126] garage[913]: 2026-11-07T15:08:29.414928Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd.ls lb # [ 54.149664] garage[913]: 2026-11-07T15:08:29.418107Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/nar/00svy5dqwmlyn5dr0zadcbb4b1x0ddhvqmg61xfbmi05nnajs4mj.nar.zst lb # [ 54.152924] niks3-server[963]: 2026/11/07 15:08:29 INFO Signed narinfos id=4 count=2 worker2 # [ 54.153158] nix-grpc-daemon[1033]: time=2026-11-07T15:08:29.364Z level=INFO msg="Uploading 2 narinfos" lb # [ 54.156060] garage[913]: 2026-11-07T15:08:29.423351Z INFO garage_api_common::generic_server: 192.168.1.4:52818 PUT /farm/d272zwz8jz7m0glknby0ghkr6dy9vh2q.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150829Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=11480cdc6a621b831721a2cf5d6831f32ded44bf587aa41cd1ee0e9a299da606 lb # [ 54.161147] garage[913]: 2026-11-07T15:08:29.423574Z INFO garage_api_common::generic_server: 192.168.1.4:52828 PUT /farm/6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150829Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cad3db9d678a1364f11ca09214eee15d84c7a262f56d1567393ad14c748dfa0f lb # [ 54.165990] niks3-server[963]: 2026/11/07 15:08:29 INFO Registered completed upload object_key=d272zwz8jz7m0glknby0ghkr6dy9vh2q.ls lb # [ 54.168578] niks3-server[963]: 2026/11/07 15:08:29 INFO Received complete push request method=POST path=/api/pushes/4/complete lb # [ 54.171546] niks3-server[963]: 2026/11/07 15:08:29 INFO Registered completed upload object_key=6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd.ls lb # [ 54.173851] garage[913]: 2026-11-07T15:08:29.442232Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/d272zwz8jz7m0glknby0ghkr6dy9vh2q.narinfo lb # [ 54.184061] niks3-server[963]: 2026/11/07 15:08:29 INFO Registered completed upload object_key=nar/1pkjvp002dh89xc56hjzswqy7vcih46zxqnfrs533mdkm7nbsisb.nar.zst lb # [ 54.186782] garage[913]: 2026-11-07T15:08:29.454800Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd.narinfo lb # [ 54.196677] niks3-server[963]: 2026/11/07 15:08:29 INFO Registered completed upload object_key=nar/00svy5dqwmlyn5dr0zadcbb4b1x0ddhvqmg61xfbmi05nnajs4mj.nar.zst lb # [ 54.210395] niks3-server[963]: 2026/11/07 15:08:29 INFO Completed push id=4 objects=6 duration=41.888564ms worker2 # [ 54.209179] nix-grpc-daemon[1033]: time=2026-11-07T15:08:29.421Z level=INFO msg="Upload complete. (606ms)" worker2 # [ 54.211649] nix-grpc-daemon[820]: ts=2026-11-07T15:08:29Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43034 duration_s=0 paths=2 nar_bytes_in=1040 worker2 # [ 54.218265] nix-daemon[986]: reaped child process 1029, status = succeeded lb # [ 54.221756] niks3-server[963]: 2026/11/07 15:08:29 INFO Registered completed upload object_key=d272zwz8jz7m0glknby0ghkr6dy9vh2q.narinfo worker1 # [ 54.223580] nix-grpc-daemon[529]: ts=2026-11-07T15:08:29Z level=debug event=want client=3 drv=6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd-uses-input-w1onlya.drv cached=0 lb # [ 54.232367] niks3-server[963]: 2026/11/07 15:08:29 INFO Registered completed upload object_key=6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd.narinfo worker1 # [ 54.358574] nix-daemon[1026]: reaped child process 1097, status = succeeded worker2 # [ 54.409732] nix-daemon[986]: reaped child process 1021, status = succeeded worker1 # [ 54.434614] nix-daemon[1026]: accepted connection from pid 1115, user nix-grpc-daemon (trusted) worker1 # [ 54.449042] nix-daemon[1026]: reaped child process 1118, status = succeeded lb # [ 54.453226] niks3-server[963]: 2026/11/07 15:08:29 INFO Received push request method=POST path=/api/pushes worker1 # [ 54.473418] nix-grpc-daemon[1057]: time=2026-11-07T15:08:29.781Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 54.476047] nix-grpc-daemon[1057]: time=2026-11-07T15:08:29.783Z level=INFO msg="Uploading 6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a (128B)" lb # [ 54.476282] garage[913]: 2026-11-07T15:08:29.743377Z INFO garage_api_common::generic_server: 192.168.1.3:39800 PUT /farm/log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150829Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=831261782ede03752afb14bf1e39d89a202ef392d0f43c597d0759636fe514a9 worker2 # [ 54.488810] nix-daemon[986]: accepted connection from pid 1060, user nix-grpc-daemon (trusted) lb # [ 54.491769] garage[913]: 2026-11-07T15:08:29.758695Z INFO garage_api_common::generic_server: 192.168.1.3:39818 PUT /farm/6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150829Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2985b1235dd3e027ade6942e8e7d0bb3bbebf38a29a25beb6aedffc8830caa4a worker2 # [ 54.502272] nix-daemon[986]: reaped child process 1063, status = succeeded lb # [ 54.502899] garage[913]: 2026-11-07T15:08:29.759225Z INFO garage_api_common::generic_server: 192.168.1.3:39800 PUT /farm/nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150829Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8a8fe4eb4ba230e16fb59737a21d00cc95072e1a3e402bf232175ee5d009da24 lb # [ 54.515555] niks3-server[963]: 2026/11/07 15:08:29 INFO Received push request method=POST path=/api/pushes lb # [ 54.522923] niks3-server[963]: 2026/11/07 15:08:29 INFO Received sign narinfos request method=POST path=/api/pushes/5/sign lb # [ 54.527139] garage[913]: 2026-11-07T15:08:29.794680Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 54.533763] garage[913]: 2026-11-07T15:08:29.800747Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 54.536831] garage[913]: 2026-11-07T15:08:29.801210Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 54.540928] niks3-server[963]: 2026/11/07 15:08:29 INFO Signed narinfos id=5 count=1 worker1 # [ 54.542120] nix-grpc-daemon[1057]: time=2026-11-07T15:08:29.850Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.542645] garage[913]: 2026-11-07T15:08:29.810879Z INFO garage_api_common::generic_server: 192.168.1.3:39800 PUT /farm/6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150829Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0dbca5d809cbe100a34ad7ca6cbd07852b758902a3b5bb8f1b7110c585cda66b lb # [ 54.547669] niks3-server[963]: 2026/11/07 15:08:29 INFO Registered completed upload object_key=nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst worker2 # [ 54.549512] nix-grpc-daemon[1033]: time=2026-11-07T15:08:29.762Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" lb # [ 54.550738] niks3-server[963]: 2026/11/07 15:08:29 INFO Received complete push request method=POST path=/api/pushes/5/complete worker2 # [ 54.550983] nix-grpc-daemon[1033]: time=2026-11-07T15:08:29.763Z level=INFO msg="Uploading qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a (128B)" lb # [ 54.553356] niks3-server[963]: 2026/11/07 15:08:29 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.ls lb # [ 54.555581] garage[913]: 2026-11-07T15:08:29.823547Z INFO garage_api_common::generic_server: 192.168.1.4:52818 PUT /farm/log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150829Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e8f4b8e5013a45c506e28b87148bf4edd2a17fe4fc6907c1cab543dc09df987c lb # [ 54.561433] garage[913]: 2026-11-07T15:08:29.829901Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo lb # [ 54.565145] niks3-server[963]: 2026/11/07 15:08:29 INFO Registered completed upload object_key=log/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv lb # [ 54.566880] garage[913]: 2026-11-07T15:08:29.833073Z INFO garage_api_common::generic_server: 192.168.1.4:52828 PUT /farm/nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150829Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0bb6cbeb4a990c75b07ac2cf74c88465dee45e49fcffe2b74f51490938ea6b8c lb # [ 54.572243] garage[913]: 2026-11-07T15:08:29.840380Z INFO garage_api_common::generic_server: 192.168.1.4:52792 PUT /farm/qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150829Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=50face8ca62f78ba2d21ab4e47caf31b372d1a01a481cec8e3119a96deccc1b0 lb # [ 54.577884] niks3-server[963]: 2026/11/07 15:08:29 INFO Completed push id=5 objects=4 duration=26.349997ms worker1 # [ 54.579135] nix-grpc-daemon[1057]: time=2026-11-07T15:08:29.887Z level=INFO msg="Upload complete. (257ms)" lb # [ 54.580041] niks3-server[963]: 2026/11/07 15:08:29 INFO Received sign narinfos request method=POST path=/api/pushes/6/sign lb # [ 54.581722] niks3-server[963]: 2026/11/07 15:08:29 INFO Signed narinfos id=6 count=1 lb # [ 54.584076] garage[913]: 2026-11-07T15:08:29.852074Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv lb # [ 54.587400] garage[913]: 2026-11-07T15:08:29.855870Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls worker2 # [ 54.586544] nix-grpc-daemon[1033]: time=2026-11-07T15:08:29.798Z level=INFO msg="Uploading 1 narinfos" lb # [ 54.590071] garage[913]: 2026-11-07T15:08:29.858402Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst worker1 # [ 54.586126] nix-grpc-daemon[529]: ts=2026-11-07T15:08:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=1 drv=pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv assign_id=1 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 lb # [ 54.594211] niks3-server[963]: 2026/11/07 15:08:29 INFO Registered completed upload object_key=6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo lb # [ 54.596211] garage[913]: 2026-11-07T15:08:29.862648Z INFO garage_api_common::generic_server: 192.168.1.4:52792 PUT /farm/qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150829Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2ee321645bc69df4b1a9bffaa6fc578d7bf01c329325d17bf5a1c84f8c05e099 worker1 # [ 54.598664] nix-grpc-daemon[529]: ts=2026-11-07T15:08:29Z level=debug event=assigned drv=6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd-uses-input-w1onlya.drv worker=192.168.1.3:50051 clients=1 lb # [ 54.603418] niks3-server[963]: 2026/11/07 15:08:29 INFO Received complete push request method=POST path=/api/pushes/6/complete lb # [ 54.605920] niks3-server[963]: 2026/11/07 15:08:29 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.ls lb # [ 54.609263] niks3-server[963]: 2026/11/07 15:08:29 INFO Registered completed upload object_key=log/lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv worker1 # [ 54.609093] nix-grpc-daemon[529]: ts=2026-11-07T15:08:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 54.611359] garage[913]: 2026-11-07T15:08:29.879579Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker2 # [ 54.609186] nix-grpc-daemon[820]: ts=2026-11-07T15:08:29Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43034 lb # [ 54.614515] niks3-server[963]: 2026/11/07 15:08:29 INFO Registered completed upload object_key=nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 54.617538] garage[913]: 2026-11-07T15:08:29.885241Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo worker1 # [ 54.620886] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) lb # [ 54.619960] garage[913]: 2026-11-07T15:08:29.885786Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) GET /farm/6zgzdy628dcdg0dbc5qi7nisk08n4kp2.narinfo lb # [ 54.622895] niks3-server[963]: 2026/11/07 15:08:29 INFO Completed push id=6 objects=4 duration=19.374529ms worker1 # [ 54.625171] nix-daemon[1026]: reaped child process 1095, status = succeeded lb # [ 54.625033] niks3-server[963]: 2026/11/07 15:08:29 INFO Registered completed upload object_key=qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo worker2 # [ 54.623427] nix-grpc-daemon[1033]: time=2026-11-07T15:08:29.834Z level=INFO msg="Upload complete. (247ms)" lb # [ 54.635067] garage[913]: 2026-11-07T15:08:29.903479Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd.narinfo worker2 # [ 54.628963] nix-grpc-daemon[820]: ts=2026-11-07T15:08:29Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43034 duration_s=1 drv=lqi1rvcqjj8q9l279yzgrgaghp394zs5-farm-a.drv assign_id=2 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 54.639787] nix-grpc-daemon[529]: ts=2026-11-07T15:08:29Z level=debug event=want client=2 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv cached=0 lb # [ 54.638283] garage[913]: 2026-11-07T15:08:29.906489Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) GET /farm/6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd.narinfo worker1 # [ 54.641780] nix-grpc-daemon[529]: ts=2026-11-07T15:08:29Z level=debug event=assigned drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 54.641830] nix-grpc-daemon[820]: copying path '/nix/store/6zgzdy628dcdg0dbc5qi7nisk08n4kp2-farm-a' from 'http://lb:5751'... lb # [ 54.644688] garage[913]: 2026-11-07T15:08:29.912430Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/d272zwz8jz7m0glknby0ghkr6dy9vh2q.narinfo worker2 # [ 54.644625] nix-grpc-daemon[820]: ts=2026-11-07T15:08:29Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43034 lb # [ 54.647042] garage[913]: 2026-11-07T15:08:29.912951Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) GET /farm/d272zwz8jz7m0glknby0ghkr6dy9vh2q.narinfo worker1 # [ 54.651649] nix-grpc-daemon[529]: copying path '/nix/store/d272zwz8jz7m0glknby0ghkr6dy9vh2q-local-input-w1only.drv' from 'http://lb:5751'... lb # [ 54.652479] garage[913]: 2026-11-07T15:08:29.920925Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 54.656653] garage[913]: 2026-11-07T15:08:29.924699Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo worker2 # [ 54.657070] nix-daemon[986]: reaped child process 1019, status = succeeded lb # [ 54.659149] garage[913]: 2026-11-07T15:08:29.924937Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) GET /farm/nar/0pbbxl4kxy7zl7x4lp43ywljwn82mxzna2wgpb1bz1z765nwp9ki.nar.zst lb # [ 54.662366] garage[913]: 2026-11-07T15:08:29.930602Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/00svy5dqwmlyn5dr0zadcbb4b1x0ddhvqmg61xfbmi05nnajs4mj.nar.zst lb # [ 54.665942] garage[913]: 2026-11-07T15:08:29.933994Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) GET /farm/08wvq73c5i2kpl6g578glyb1rcqhv2iw.narinfo lb # [ 54.669118] garage[913]: 2026-11-07T15:08:29.937588Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/nar/00svy5dqwmlyn5dr0zadcbb4b1x0ddhvqmg61xfbmi05nnajs4mj.nar.zst worker2 # [ 54.668129] nix-grpc-daemon[820]: copying path '/nix/store/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv' from 'http://lb:5751'... lb # [ 54.674025] garage[913]: 2026-11-07T15:08:29.942235Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst lb # [ 54.677239] garage[913]: 2026-11-07T15:08:29.945478Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/nar/1m1mvw8bmb91glp26qj699lxqv98q2iz8wm4ik3miz0xj6vi3mw6.nar.zst worker1 # [ 54.678518] nix-grpc-daemon[529]: copying path '/nix/store/6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd-uses-input-w1onlya.drv' from 'http://lb:5751'... lb # [ 54.682565] garage[913]: 2026-11-07T15:08:29.950790Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/1pkjvp002dh89xc56hjzswqy7vcih46zxqnfrs533mdkm7nbsisb.nar.zst lb # [ 54.685784] garage[913]: 2026-11-07T15:08:29.954255Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/nar/1pkjvp002dh89xc56hjzswqy7vcih46zxqnfrs533mdkm7nbsisb.nar.zst worker2 # [ 54.685183] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker2 # [ 54.689520] nix-grpc-daemon[820]: ts=2026-11-07T15:08:29Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 54.693475] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker1 # [ 54.695795] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker2 # [ 54.701538] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker2 # [ 54.704398] nix-grpc-daemon[820]: ts=2026-11-07T15:08:29Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43034 duration_s=0 paths=1 nar_bytes_out=128 worker1 # [ 54.708596] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker2 # [ 54.715141] nix-daemon[986]: reaped child process 1069, status = succeeded worker2 # [ 54.874493] nix-grpc-daemon[820]: ts=2026-11-07T15:08:30Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 54.879083] nix-grpc-daemon[820]: ts=2026-11-07T15:08:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 54.885520] nix-grpc-daemon[1033]: time=2026-11-07T15:08:30.098Z level=INFO msg="All 1 paths already cached" worker2 # [ 54.891332] nix-grpc-daemon[820]: ts=2026-11-07T15:08:30Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43034 lb # [ 54.897927] garage[913]: 2026-11-07T15:08:30.165627Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo lb # [ 54.906856] garage[913]: 2026-11-07T15:08:30.174600Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo lb # [ 54.913232] garage[913]: 2026-11-07T15:08:30.175978Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 54.919440] garage[913]: 2026-11-07T15:08:30.186681Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/pd51i21khb2xrd9paajf80pb96sw8zn0.narinfo worker2 # [ 54.926782] nix-grpc-daemon[820]: ts=2026-11-07T15:08:30Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 54.932577] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) lb # [ 54.936218] garage[913]: 2026-11-07T15:08:30.204324Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/9i2vr7cq49ilb06c3s8bk546dfckd18i.narinfo worker2 # [ 54.939470] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 0 ms (attempt 1/5) worker2 # [ 54.942533] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 112 ms (attempt 2/5) lb # [ 54.944683] garage[913]: 2026-11-07T15:08:30.211968Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 55.058179] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 303 ms (attempt 3/5) worker1 # [ 55.123542] nix-daemon[1026]: reaped child process 1129, status = succeeded worker1 # [ 55.200066] nix-daemon[1026]: accepted connection from pid 1145, user nix-grpc-daemon (trusted) worker1 # [ 55.213167] nix-daemon[1026]: reaped child process 1148, status = succeeded lb # [ 55.216347] niks3-server[963]: 2026/11/07 15:08:30 INFO Received push request method=POST path=/api/pushes worker1 # [ 55.227619] nix-grpc-daemon[1057]: time=2026-11-07T15:08:30.536Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 55.228888] garage[913]: 2026-11-07T15:08:30.496604Z INFO garage_api_common::generic_server: 192.168.1.3:39800 PUT /farm/9i2vr7cq49ilb06c3s8bk546dfckd18i.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150830Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=57d073e94bd671a02d69df53bddc63d178d584abf7a2ee1d383f8b332b92b94d lb # [ 55.242670] garage[913]: 2026-11-07T15:08:30.510659Z INFO garage_api_common::generic_server: 192.168.1.3:39818 PUT /farm/log/6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd-uses-input-w1onlya.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150830Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f597a274930a02b1d4dad373e37ebefe22c2d713c8bb74cfec39bcc2ef959f0d lb # [ 55.255133] garage[913]: 2026-11-07T15:08:30.523322Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/9i2vr7cq49ilb06c3s8bk546dfckd18i.ls lb # [ 55.264776] niks3-server[963]: 2026/11/07 15:08:30 INFO Received sign narinfos request method=POST path=/api/pushes/7/sign worker1 # [ 55.271577] nix-grpc-daemon[1057]: time=2026-11-07T15:08:30.580Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.270149] niks3-server[963]: 2026/11/07 15:08:30 INFO Signed narinfos id=7 count=1 lb # [ 55.273431] garage[913]: 2026-11-07T15:08:30.541203Z INFO garage_api_common::generic_server: 192.168.1.3:39818 PUT /farm/9i2vr7cq49ilb06c3s8bk546dfckd18i.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150830Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0318f9b92303b2ca26aea2f251a3576acc01708379889d7f1ef454bed83713d7 lb # [ 55.283243] garage[913]: 2026-11-07T15:08:30.551681Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/log/6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd-uses-input-w1onlya.drv lb # [ 55.290932] niks3-server[963]: 2026/11/07 15:08:30 INFO Received complete push request method=POST path=/api/pushes/7/complete worker2 # [ 55.363172] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 26 ms (attempt 4/5) worker2 # [ 55.391486] nix-grpc-daemon[820]: disabling binary cache 'https://cache.nixos.org' for 60 seconds lb # [ 55.392857] garage[913]: 2026-11-07T15:08:30.660634Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker2 # [ 55.394654] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 55.399513] garage[913]: 2026-11-07T15:08:30.661144Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 55.402946] nix-grpc-daemon[820]: copying path '/nix/store/pd51i21khb2xrd9paajf80pb96sw8zn0-farm-a.drv' from 'http://lb:5751'... lb # [ 55.414801] garage[913]: 2026-11-07T15:08:30.682663Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst lb # [ 55.421962] garage[913]: 2026-11-07T15:08:30.690230Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/nar/08mhnmxkz6k9gck9zisdh6jb3dqb53xqy0jak6cm9lpasdvr4sk7.nar.zst worker2 # [ 55.440366] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) lb # [ 55.455603] niks3-server[963]: 2026/11/07 15:08:30 INFO Registered completed upload object_key=9i2vr7cq49ilb06c3s8bk546dfckd18i.ls lb # [ 55.461210] garage[913]: 2026-11-07T15:08:30.728922Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/9i2vr7cq49ilb06c3s8bk546dfckd18i.narinfo lb # [ 55.476153] niks3-server[963]: 2026/11/07 15:08:30 INFO Registered completed upload object_key=log/6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd-uses-input-w1onlya.drv lb # [ 55.484059] niks3-server[963]: 2026/11/07 15:08:30 INFO Completed push id=7 objects=4 duration=193.125104ms worker1 # [ 55.486616] nix-grpc-daemon[1057]: time=2026-11-07T15:08:30.794Z level=INFO msg="Upload complete. (369ms)" lb # [ 55.491644] niks3-server[963]: 2026/11/07 15:08:30 INFO Registered completed upload object_key=9i2vr7cq49ilb06c3s8bk546dfckd18i.narinfo worker1 # [ 55.493689] nix-grpc-daemon[529]: ts=2026-11-07T15:08:30Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=0 drv=6zc1z8ns9imk1am6l5qcy0fdnkn9lkmd-uses-input-w1onlya.drv assign_id=3 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 55.505102] nix-grpc-daemon[529]: ts=2026-11-07T15:08:30Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 55.516372] nix-daemon[1026]: reaped child process 1127, status = succeeded worker2 # [ 55.522275] nix-grpc-daemon[820]: ts=2026-11-07T15:08:30Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 55.531664] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker2 # [ 55.594333] nix-daemon[986]: accepted connection from pid 1089, user nix-grpc-daemon (trusted) worker2 # [ 55.601836] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 40 ms (attempt 1/5) lb # [ 55.625419] niks3-server[963]: 2026/11/07 15:08:30 INFO Received push request method=POST path=/api/pushes worker2 # [ 55.628222] nix-daemon[986]: reaped child process 1100, status = succeeded worker2 # [ 55.639122] nix-grpc-daemon[1033]: time=2026-11-07T15:08:30.850Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 55.641092] nix-grpc-daemon[1033]: time=2026-11-07T15:08:30.850Z level=INFO msg="Uploading vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv (624B)" worker2 # [ 55.648126] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 183 ms (attempt 2/5) lb # [ 55.641954] garage[913]: 2026-11-07T15:08:30.909055Z INFO garage_api_common::generic_server: 192.168.1.4:52792 PUT /farm/nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150830Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=06f8217094dfe919ade6d236cc7ff94fb2a0278ba7bfb28718161a4d3727bfe6 lb # [ 55.657837] garage[913]: 2026-11-07T15:08:30.924684Z INFO garage_api_common::generic_server: 192.168.1.4:52828 PUT /farm/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150830Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a431f5b841eb4c69adb8df8b0378f6368efb78708b5fb06d08e64aa54bd9004b lb # [ 55.668765] garage[913]: 2026-11-07T15:08:30.925824Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 55.678677] niks3-server[963]: 2026/11/07 15:08:30 INFO Received sign narinfos request method=POST path=/api/pushes/8/sign lb # [ 55.683859] niks3-server[963]: 2026/11/07 15:08:30 INFO Registered completed upload object_key=nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 55.687962] garage[913]: 2026-11-07T15:08:30.955659Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls worker2 # [ 55.692988] nix-grpc-daemon[1033]: time=2026-11-07T15:08:30.905Z level=INFO msg="Uploading 1 narinfos" lb # [ 55.693963] niks3-server[963]: 2026/11/07 15:08:30 INFO Signed narinfos id=8 count=1 lb # [ 55.697754] garage[913]: 2026-11-07T15:08:30.965734Z INFO garage_api_common::generic_server: 192.168.1.4:52828 PUT /farm/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150830Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=87b81aaad1d8d7c1fc037f4d7918d901b0ba6f5926d2dbca34fca6e3bb1346e5 lb # [ 55.705828] niks3-server[963]: 2026/11/07 15:08:30 INFO Received complete push request method=POST path=/api/pushes/8/complete lb # [ 55.707540] garage[913]: 2026-11-07T15:08:30.975980Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker2 # [ 55.720849] nix-daemon[986]: reaped child process 1072, status = succeeded lb # [ 55.766079] niks3-server[963]: 2026/11/07 15:08:31 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.ls lb # [ 55.777616] niks3-server[963]: 2026/11/07 15:08:31 INFO Registered completed upload object_key=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker2 # [ 55.782841] nix-grpc-daemon[1033]: time=2026-11-07T15:08:30.995Z level=INFO msg="Upload complete. (329ms)" lb # [ 55.784359] niks3-server[963]: 2026/11/07 15:08:31 INFO Completed push id=8 objects=6 duration=79.173749ms worker2 # [ 55.785916] nix-grpc-daemon[820]: ts=2026-11-07T15:08:30Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43034 duration_s=0 paths=1 nar_bytes_in=624 worker1 # [ 55.803274] nix-grpc-daemon[529]: ts=2026-11-07T15:08:31Z level=debug event=want client=4 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv cached=0 worker1 # [ 55.808613] nix-grpc-daemon[529]: ts=2026-11-07T15:08:31Z level=debug event=assigned drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv worker=192.168.1.3:50051 clients=1 worker2 # [ 55.811333] nix-daemon[986]: reaped child process 1079, status = succeeded worker1 # [ 55.813926] nix-grpc-daemon[529]: ts=2026-11-07T15:08:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 55.822339] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) lb # [ 55.834390] garage[913]: 2026-11-07T15:08:31.102074Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo lb # [ 55.841143] garage[913]: 2026-11-07T15:08:31.109559Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8.narinfo worker1 # [ 55.851497] nix-grpc-daemon[529]: copying path '/nix/store/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv' from 'http://lb:5751'... lb # [ 55.856977] garage[913]: 2026-11-07T15:08:31.124319Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst lb # [ 55.863457] garage[913]: 2026-11-07T15:08:31.131882Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/nar/1190412lxhybpj2b0886g97h0cpm7xx8r4virf8q4n7i91409ivg.nar.zst worker1 # [ 55.879412] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 55.895582] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker2 # [ 55.857711] nix-daemon[986]: accepted connection from pid 1109, user nix-grpc-daemon (trusted) worker2 # [ 55.948574] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 100 ms (attempt 3/5) worker2 # [ 55.952789] nix-daemon[986]: reaped child process 1112, status = succeeded lb # [ 55.958892] niks3-server[963]: 2026/11/07 15:08:31 INFO Received push request method=POST path=/api/pushes worker2 # [ 55.967219] nix-grpc-daemon[1033]: time=2026-11-07T15:08:31.179Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 55.968662] nix-grpc-daemon[1033]: time=2026-11-07T15:08:31.181Z level=INFO msg="Uploading 2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b (176B)" lb # [ 55.973284] garage[913]: 2026-11-07T15:08:31.241055Z INFO garage_api_common::generic_server: 192.168.1.4:52828 PUT /farm/log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cdc6fa814d01ba9dbc0ea3d70f43093d6d6a4dcb5754b6d9d16241e9746d61bc lb # [ 55.987398] garage[913]: 2026-11-07T15:08:31.255135Z INFO garage_api_common::generic_server: 192.168.1.4:52818 PUT /farm/2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6f440b661dd1805b5388f3f797f19d58b777b43b199bdff6bf2dd075d1b81cb4 lb # [ 55.999753] garage[913]: 2026-11-07T15:08:31.267726Z INFO garage_api_common::generic_server: 192.168.1.4:52792 PUT /farm/nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3039fd258ca4c9161ab4d6adc5d84f7dae122fe83f934ccd375a65004fb8546f lb # [ 56.015413] garage[913]: 2026-11-07T15:08:31.282472Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 56.020317] niks3-server[963]: 2026/11/07 15:08:31 INFO Received sign narinfos request method=POST path=/api/pushes/9/sign worker2 # [ 56.023156] nix-grpc-daemon[1033]: time=2026-11-07T15:08:31.235Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.026795] niks3-server[963]: 2026/11/07 15:08:31 INFO Signed narinfos id=9 count=1 lb # [ 56.028946] garage[913]: 2026-11-07T15:08:31.294806Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 56.034505] garage[913]: 2026-11-07T15:08:31.302545Z INFO garage_api_common::generic_server: 192.168.1.4:52792 PUT /farm/2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=28b2d3e700d262996104473bbba9f75214c6ee224bae68dc9851a045d479e550 lb # [ 56.039930] niks3-server[963]: 2026/11/07 15:08:31 INFO Registered completed upload object_key=log/08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv lb # [ 56.043060] garage[913]: 2026-11-07T15:08:31.310753Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst worker2 # [ 56.039639] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 225 ms (attempt 4/5) lb # [ 56.045528] niks3-server[963]: 2026/11/07 15:08:31 INFO Received complete push request method=POST path=/api/pushes/9/complete lb # [ 56.048869] garage[913]: 2026-11-07T15:08:31.316537Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo lb # [ 56.051252] niks3-server[963]: 2026/11/07 15:08:31 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.ls lb # [ 56.054307] niks3-server[963]: 2026/11/07 15:08:31 INFO Completed push id=9 objects=8 duration=11.366249ms worker2 # [ 56.053231] nix-grpc-daemon[1033]: time=2026-11-07T15:08:31.265Z level=INFO msg="Upload complete. (337ms)" lb # [ 56.056225] niks3-server[963]: 2026/11/07 15:08:31 INFO Registered completed upload object_key=nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst lb # [ 56.059036] niks3-server[963]: 2026/11/07 15:08:31 INFO Registered completed upload object_key=2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo worker2 # [ 56.059621] nix-grpc-daemon[820]: ts=2026-11-07T15:08:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43034 duration_s=1 drv=08wvq73c5i2kpl6g578glyb1rcqhv2iw-farm-b.drv assign_id=4 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 56.069265] nix-grpc-daemon[529]: ts=2026-11-07T15:08:31Z level=debug event=want client=2 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv cached=0 worker1 # [ 56.073940] nix-grpc-daemon[529]: ts=2026-11-07T15:08:31Z level=debug event=assigned drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 56.073267] nix-grpc-daemon[820]: ts=2026-11-07T15:08:31Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 56.082881] nix-daemon[986]: reaped child process 1068, status = succeeded lb # [ 56.084254] garage[913]: 2026-11-07T15:08:31.352186Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo lb # [ 56.086955] garage[913]: 2026-11-07T15:08:31.355210Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) GET /farm/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx.narinfo worker2 # [ 56.089198] nix-grpc-daemon[820]: copying path '/nix/store/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv' from 'http://lb:5751'... lb # [ 56.095706] garage[913]: 2026-11-07T15:08:31.363463Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst lb # [ 56.098370] garage[913]: 2026-11-07T15:08:31.363963Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) GET /farm/nar/0w21abkvlzg18nqkl2x4zxs7d0376kbld1n0fkr68vcpqpq1g5zg.nar.zst worker2 # [ 56.107360] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker2 # [ 56.118047] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker2 # [ 56.272237] nix-grpc-daemon[820]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 56.275754] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 56.287283] garage[913]: 2026-11-07T15:08:31.554892Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/9i2vr7cq49ilb06c3s8bk546dfckd18i.narinfo lb # [ 56.294642] garage[913]: 2026-11-07T15:08:31.563048Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) GET /farm/9i2vr7cq49ilb06c3s8bk546dfckd18i.narinfo worker2 # [ 56.302298] nix-grpc-daemon[820]: copying path '/nix/store/9i2vr7cq49ilb06c3s8bk546dfckd18i-uses-input-w1onlya' from 'http://lb:5751'... lb # [ 56.310846] garage[913]: 2026-11-07T15:08:31.578635Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 56.318452] garage[913]: 2026-11-07T15:08:31.586321Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) GET /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker2 # [ 56.334078] nix-grpc-daemon[820]: ts=2026-11-07T15:08:31Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43034 duration_s=0 paths=1 nar_bytes_out=120 lb # [ 56.344143] garage[913]: 2026-11-07T15:08:31.612031Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo worker2 # [ 56.350185] nix-daemon[986]: reaped child process 1094, status = succeeded lb # [ 56.350527] garage[913]: 2026-11-07T15:08:31.618744Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 56.367947] garage[913]: 2026-11-07T15:08:31.635795Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo lb # [ 56.373854] garage[913]: 2026-11-07T15:08:31.636216Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 56.396337] nix-daemon[806]: reaped child process 853, status = succeeded client # [ 56.411257] sshd-session[848]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 56.413688] sshd-session[848]: Disconnected from user root UNKNOWN port 65535 client # [ 56.416512] sshd-session[842]: pam_unix(sshd:session): session closed for user root client # [ 56.422416] systemd[1]: sshd-vsock@5-6-3:22-2:5.service: Deactivated successfully. client # [ 56.426208] systemd[1]: session-7.scope: Deactivated successfully. client # [ 56.429776] systemd-logind[465]: Session 7 logged out. Waiting for processes to exit. client # [ 56.431520] systemd-logind[465]: Removed session 7. client # [ 56.510296] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 56.515725] systemd[1]: Started SSH per-connection Daemon (vsock:2:6). worker2 # [ 56.533845] nix-daemon[986]: reaped child process 1118, status = succeeded client # [ 56.576730] sshd-session[890]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 56.581728] sshd-session[890]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 56.587067] sshd-session[890]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 56.592595] systemd-logind[465]: New session '8' of user 'root' with class 'user' and type 'tty'. client # [ 56.596404] systemd[1]: Started Session 8 of User root. worker2 # [ 56.607434] nix-daemon[986]: accepted connection from pid 1135, user nix-grpc-daemon (trusted) worker2 # [ 56.620458] nix-daemon[986]: reaped child process 1138, status = succeeded lb # [ 56.629930] niks3-server[963]: 2026/11/07 15:08:31 INFO Received push request method=POST path=/api/pushes worker2 # [ 56.639671] nix-grpc-daemon[1033]: time=2026-11-07T15:08:31.852Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker2 # [ 56.641314] nix-grpc-daemon[1033]: time=2026-11-07T15:08:31.853Z level=INFO msg="Uploading dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top (232B)" lb # [ 56.646543] garage[913]: 2026-11-07T15:08:31.913703Z INFO garage_api_common::generic_server: 192.168.1.4:52792 PUT /farm/log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2b841a1f620188c5ad9338e361723fd86e5edb9b022a2b86ae05f915d2fe63e2 lb # [ 56.659821] garage[913]: 2026-11-07T15:08:31.927719Z INFO garage_api_common::generic_server: 192.168.1.4:52828 PUT /farm/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1e7f6995c1064088309d7c43214996150a829f8b75ac8ec20bcf4c94a3605d73 lb # [ 56.672681] garage[913]: 2026-11-07T15:08:31.940599Z INFO garage_api_common::generic_server: 192.168.1.4:52818 PUT /farm/nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=607efe2be5a3b867f6ee5fdd2f6ab6ba6b68900a932704b49e492c478439c92e lb # [ 56.687477] niks3-server[963]: 2026/11/07 15:08:31 INFO Received sign narinfos request method=POST path=/api/pushes/10/sign client # [ 56.692616] nix-daemon[806]: accepted connection from pid 898, user root (trusted) lb # [ 56.693134] garage[913]: 2026-11-07T15:08:31.959871Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker2 # [ 56.698278] nix-grpc-daemon[1033]: time=2026-11-07T15:08:31.910Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.700601] niks3-server[963]: 2026/11/07 15:08:31 INFO Signed narinfos id=10 count=1 lb # [ 56.702708] garage[913]: 2026-11-07T15:08:31.967975Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls lb # [ 56.709329] garage[913]: 2026-11-07T15:08:31.976237Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 56.711884] garage[913]: 2026-11-07T15:08:31.976868Z INFO garage_api_common::generic_server: 192.168.1.4:52818 PUT /farm/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=65c9e0535d2cd6b1fa5e80b529c7b13187570f164b4bb974c8f3b34956219b46 lb # [ 56.717236] niks3-server[963]: 2026/11/07 15:08:31 INFO Registered completed upload object_key=log/cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv worker1 # [ 56.720470] nix-daemon[1026]: reaped child process 1158, status = succeeded lb # [ 56.722326] niks3-server[963]: 2026/11/07 15:08:31 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.ls lb # [ 56.725680] garage[913]: 2026-11-07T15:08:31.993371Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo lb # [ 56.728104] niks3-server[963]: 2026/11/07 15:08:31 INFO Registered completed upload object_key=nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 56.731215] niks3-server[963]: 2026/11/07 15:08:31 INFO Received complete push request method=POST path=/api/pushes/10/complete lb # [ 56.733489] niks3-server[963]: 2026/11/07 15:08:32 INFO Registered completed upload object_key=dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo lb # [ 56.736258] niks3-server[963]: 2026/11/07 15:08:32 INFO Completed push id=10 objects=12 duration=5.873092ms worker2 # [ 56.736576] nix-grpc-daemon[1033]: time=2026-11-07T15:08:31.949Z level=INFO msg="Upload complete. (212ms)" worker2 # [ 56.742577] nix-grpc-daemon[820]: ts=2026-11-07T15:08:31Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43034 duration_s=0 drv=cs7l7i2nvvh5pcyf2vglzb4mlwzjklnx-farm-top.drv assign_id=6 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 56.758890] nix-daemon[986]: reaped child process 1116, status = succeeded client # [ 56.790689] sshd-session[791]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 56.792222] sshd-session[791]: Disconnected from user root UNKNOWN port 65535 client # [ 56.793445] sshd-session[770]: pam_unix(sshd:session): session closed for user root client # [ 56.799218] systemd[1]: sshd-vsock@3-4-3:22-2:3.service: Deactivated successfully. client # [ 56.805815] systemd[1]: session-5.scope: Deactivated successfully. client # [ 56.806760] systemd[1]: session-5.scope: Consumed 209ms CPU time over 6.501s wall clock time, 52M memory peak, 13.7K incoming IP traffic, 14K outgoing IP traffic. client # [ 56.810145] systemd-logind[465]: Session 5 logged out. Waiting for processes to exit. client # [ 56.812655] systemd-logind[465]: Removed session 5. worker1 # [ 56.819401] nix-daemon[1026]: accepted connection from pid 1176, user nix-grpc-daemon (trusted) worker1 # [ 56.833912] nix-daemon[1026]: reaped child process 1179, status = succeeded lb # [ 56.837297] niks3-server[963]: 2026/11/07 15:08:32 INFO Received push request method=POST path=/api/pushes worker2 # [ 56.842273] nix-grpc-daemon[820]: ts=2026-11-07T15:08:32Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43034 worker1 # [ 56.849292] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 56.853373] nix-grpc-daemon[1057]: time=2026-11-07T15:08:32.161Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 56.854916] nix-grpc-daemon[1057]: time=2026-11-07T15:08:32.161Z level=INFO msg="Uploading mrrcl9jb4hh6rly2df2vfym5sq1235hf-farm-b (176B)" lb # [ 56.853956] garage[913]: 2026-11-07T15:08:32.120880Z INFO garage_api_common::generic_server: 192.168.1.3:39818 PUT /farm/log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150832Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a0cb77f830dec2a3b152e9d6bb6b7346579512d628ad95aa19210ac8f971b2b1 worker1 # [ 56.870228] nix-grpc-daemon[1057]: time=2026-11-07T15:08:32.178Z level=INFO msg="All 1 paths already cached" lb # [ 56.870551] garage[913]: 2026-11-07T15:08:32.137838Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 56.875269] garage[913]: 2026-11-07T15:08:32.138455Z INFO garage_api_common::generic_server: 192.168.1.3:39800 PUT /farm/nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150832Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7f23a7d930fee061871828cc8aa1def2de1f73b68dd9539a2685688fb2ea16a5 lb # [ 56.887815] garage[913]: 2026-11-07T15:08:32.155697Z INFO garage_api_common::generic_server: 192.168.1.3:39878 PUT /farm/mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150832Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9a4976d159a0ee963e38b2e4dbdceaee046bd0b77d14444d39741b5b4384d65a lb # [ 56.893899] niks3-server[963]: 2026/11/07 15:08:32 INFO Registered completed upload object_key=log/vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv lb # [ 56.896852] niks3-server[963]: 2026/11/07 15:08:32 INFO Received sign narinfos request method=POST path=/api/pushes/11/sign worker1 # [ 56.898192] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 56.899742] garage[913]: 2026-11-07T15:08:32.167890Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 56.903137] niks3-server[963]: 2026/11/07 15:08:32 INFO Signed narinfos id=11 count=1 worker1 # [ 56.906428] nix-grpc-daemon[1057]: time=2026-11-07T15:08:32.213Z level=INFO msg="Uploading 1 narinfos" lb # [ 56.904168] garage[913]: 2026-11-07T15:08:32.171305Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst worker1 # [ 56.907600] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) client # [ 56.905128] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 56.907693] garage[913]: 2026-11-07T15:08:32.175300Z INFO garage_api_common::generic_server: 192.168.1.3:39878 PUT /farm/mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150832Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=81355cbfe3f72d75c6fd4d25c6f10a8b95514af15b23044e266a97781f313c6f lb # [ 56.913860] garage[913]: 2026-11-07T15:08:32.181989Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/fvrsn8qnp4wgqbhjj23ziwh8dwj0i8p9.narinfo client # [ 56.911864] systemd[1]: Started SSH per-connection Daemon (vsock:2:7). lb # [ 56.916124] garage[913]: 2026-11-07T15:08:32.182280Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 56.918721] niks3-server[963]: 2026/11/07 15:08:32 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.ls lb # [ 56.920205] niks3-server[963]: 2026/11/07 15:08:32 INFO Received complete push request method=POST path=/api/pushes/11/complete lb # [ 56.923721] garage[913]: 2026-11-07T15:08:32.191530Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo lb # [ 56.926809] niks3-server[963]: 2026/11/07 15:08:32 INFO Registered completed upload object_key=nar/1mgm44m4ndgi5l3yi2qv3v3sx48190m8d4ycw3r4pfzy4z1wq2s6.nar.zst worker1 # [ 56.930691] nix-grpc-daemon[1057]: time=2026-11-07T15:08:32.239Z level=INFO msg="All 1 paths already cached" lb # [ 56.929882] niks3-server[963]: 2026/11/07 15:08:32 INFO Completed push id=11 objects=8 duration=11.146109ms worker1 # [ 56.933457] nix-grpc-daemon[1057]: time=2026-11-07T15:08:32.241Z level=INFO msg="Upload complete. (223ms)" lb # [ 56.932078] niks3-server[963]: 2026/11/07 15:08:32 INFO Registered completed upload object_key=mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker1 # [ 56.935691] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=1 drv=vwnd00v6q8nvv6nb52vdjqfl5vdlzdd8-farm-b.drv assign_id=5 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 56.933909] nix-grpc-daemon[820]: ts=2026-11-07T15:08:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43034 worker1 # [ 56.941157] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 56.945965] nix-daemon[1026]: reaped child process 1156, status = succeeded worker2 # [ 56.943516] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker1 # [ 56.953689] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 56.956850] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 56.962264] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=0 paths=1 nar_bytes_out=176 worker2 # [ 56.961565] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker1 # [ 56.967774] nix-daemon[1026]: reaped child process 1184, status = succeeded client # [ 56.981614] sshd-session[915]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 56.987084] sshd-session[915]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 56.992433] sshd-session[915]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 56.999467] systemd-logind[465]: New session '9' of user 'root' with class 'user' and type 'tty'. client # [ 57.001670] systemd[1]: Started Session 9 of User root. worker2 # [ 57.063481] nix-daemon[986]: accepted connection from pid 1144, user nix-grpc-daemon (trusted) worker2 # [ 57.077099] nix-daemon[986]: reaped child process 1147, status = succeeded lb # [ 57.085099] niks3-server[963]: 2026/11/07 15:08:32 INFO Received push request method=POST path=/api/pushes worker2 # [ 57.093784] nix-grpc-daemon[1033]: time=2026-11-07T15:08:32.306Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 57.095656] nix-grpc-daemon[1033]: time=2026-11-07T15:08:32.307Z level=INFO msg="Uploading fvrsn8qnp4wgqbhjj23ziwh8dwj0i8p9-uses-input-w1onlyb.drv (592B)" lb # [ 57.098129] garage[913]: 2026-11-07T15:08:32.365975Z INFO garage_api_common::generic_server: 192.168.1.4:52818 PUT /farm/nar/140fp75jfd8ckfw24wcyv5zsx9ann9fc98sxc4rw4inwg7pjbyfn.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150832Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4fba9fae261a4ab45aed9b61d3a50d0f05b3f9650006f96d324accfe853c6806 lb # [ 57.113524] garage[913]: 2026-11-07T15:08:32.380840Z INFO garage_api_common::generic_server: 192.168.1.4:52828 PUT /farm/fvrsn8qnp4wgqbhjj23ziwh8dwj0i8p9.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150832Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=19ddeb8c4d7b4ff585eb238aa8a6c6f500715023142c0c4f8b75520bc4dd9839 lb # [ 57.126076] garage[913]: 2026-11-07T15:08:32.393385Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/nar/140fp75jfd8ckfw24wcyv5zsx9ann9fc98sxc4rw4inwg7pjbyfn.nar.zst lb # [ 57.133833] niks3-server[963]: 2026/11/07 15:08:32 INFO Received sign narinfos request method=POST path=/api/pushes/12/sign lb # [ 57.141119] garage[913]: 2026-11-07T15:08:32.407775Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/fvrsn8qnp4wgqbhjj23ziwh8dwj0i8p9.ls worker2 # [ 57.145373] nix-grpc-daemon[1033]: time=2026-11-07T15:08:32.357Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.146393] niks3-server[963]: 2026/11/07 15:08:32 INFO Signed narinfos id=12 count=1 lb # [ 57.150116] garage[913]: 2026-11-07T15:08:32.417387Z INFO garage_api_common::generic_server: 192.168.1.4:52828 PUT /farm/fvrsn8qnp4wgqbhjj23ziwh8dwj0i8p9.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150832Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0c390f953849bb32f666f84db99921c6a7897a50605369905a69191d3d0e4168 lb # [ 57.157463] niks3-server[963]: 2026/11/07 15:08:32 INFO Registered completed upload object_key=nar/140fp75jfd8ckfw24wcyv5zsx9ann9fc98sxc4rw4inwg7pjbyfn.nar.zst lb # [ 57.160770] niks3-server[963]: 2026/11/07 15:08:32 INFO Registered completed upload object_key=fvrsn8qnp4wgqbhjj23ziwh8dwj0i8p9.ls lb # [ 57.162439] niks3-server[963]: 2026/11/07 15:08:32 INFO Received complete push request method=POST path=/api/pushes/12/complete lb # [ 57.166491] garage[913]: 2026-11-07T15:08:32.434609Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/fvrsn8qnp4wgqbhjj23ziwh8dwj0i8p9.narinfo lb # [ 57.170617] niks3-server[963]: 2026/11/07 15:08:32 INFO Completed push id=12 objects=6 duration=10.093462ms worker2 # [ 57.169509] nix-grpc-daemon[1033]: time=2026-11-07T15:08:32.382Z level=INFO msg="Upload complete. (194ms)" lb # [ 57.172672] niks3-server[963]: 2026/11/07 15:08:32 INFO Registered completed upload object_key=fvrsn8qnp4wgqbhjj23ziwh8dwj0i8p9.narinfo worker2 # [ 57.174713] nix-grpc-daemon[820]: ts=2026-11-07T15:08:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43034 duration_s=0 paths=1 nar_bytes_in=592 worker1 # [ 57.184840] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=debug event=want client=5 drv=fvrsn8qnp4wgqbhjj23ziwh8dwj0i8p9-uses-input-w1onlyb.drv cached=0 client # [ 57.183449] sshd-session[926]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 57.181562] nix-grpc-daemon[820]: ts=2026-11-07T15:08:32Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:43034 client # [ 57.185471] sshd-session[926]: Disconnected from user root UNKNOWN port 65535 client # [ 57.187165] sshd-session[915]: pam_unix(sshd:session): session closed for user root worker1 # [ 57.189618] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=debug event=assigned drv=fvrsn8qnp4wgqbhjj23ziwh8dwj0i8p9-uses-input-w1onlyb.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 57.187439] nix-grpc-daemon[820]: ts=2026-11-07T15:08:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43034 client # [ 57.190314] systemd[1]: sshd-vsock@7-8-3:22-2:7.service: Deactivated successfully. client # [ 57.193343] systemd[1]: session-9.scope: Deactivated successfully. worker2 # [ 57.192208] nix-grpc-daemon[820]: ts=2026-11-07T15:08:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43034 client # [ 57.195446] systemd-logind[465]: Session 9 logged out. Waiting for processes to exit. client # [ 57.198891] systemd-logind[465]: Removed session 9. lb # [ 57.200639] garage[913]: 2026-11-07T15:08:32.468499Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo lb # [ 57.203180] garage[913]: 2026-11-07T15:08:32.471653Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) GET /farm/mrrcl9jb4hh6rly2df2vfym5sq1235hf.narinfo worker2 # [ 57.203517] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) client # [ 57.203525] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 57.206722] systemd[1]: Started SSH per-connection Daemon (vsock:2:8). worker2 # [ 57.213576] nix-grpc-daemon[1033]: time=2026-11-07T15:08:32.425Z level=INFO msg="All 1 paths already cached" worker2 # [ 57.216199] nix-daemon[986]: reaped child process 1140, status = succeeded worker2 # [ 57.218448] nix-grpc-daemon[820]: ts=2026-11-07T15:08:32Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 57.221558] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) lb # [ 57.227554] garage[913]: 2026-11-07T15:08:32.495650Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/qvaxly1kq8x16n7zm2l2wz72nmfiqs4c.narinfo lb # [ 57.232254] garage[913]: 2026-11-07T15:08:32.500208Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo lb # [ 57.234591] garage[913]: 2026-11-07T15:08:32.500410Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 57.237058] garage[913]: 2026-11-07T15:08:32.505260Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) GET /farm/qvaxly1kq8x16n7zm2l2wz72nmfiqs4c.narinfo worker2 # [ 57.238954] nix-grpc-daemon[820]: copying path '/nix/store/qvaxly1kq8x16n7zm2l2wz72nmfiqs4c-local-input-w1only' from 'http://lb:5751'... worker2 # [ 57.240659] nix-grpc-daemon[1033]: time=2026-11-07T15:08:32.453Z level=INFO msg="All 2 paths already cached" lb # [ 57.246196] garage[913]: 2026-11-07T15:08:32.513635Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 57.249110] garage[913]: 2026-11-07T15:08:32.514269Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) GET /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker1 # [ 57.255113] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 worker2 # [ 57.253250] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker1 # [ 57.260079] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) client # [ 57.257320] sshd-session[942]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 57.262242] sshd-session[942]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 57.267225] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) client # [ 57.267486] sshd-session[942]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 57.273060] systemd-logind[465]: New session '10' of user 'root' with class 'user' and type 'tty'. client # [ 57.277897] systemd[1]: Started Session 10 of User root. worker1 # [ 57.353179] nix-daemon[1026]: accepted connection from pid 1192, user nix-grpc-daemon (trusted) worker1 # [ 57.367354] nix-daemon[1026]: reaped child process 1195, status = succeeded lb # [ 57.372819] niks3-server[963]: 2026/11/07 15:08:32 INFO Received push request method=POST path=/api/pushes worker1 # [ 57.382446] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:32822 worker1 # [ 57.385222] nix-grpc-daemon[1057]: time=2026-11-07T15:08:32.693Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 57.386648] nix-grpc-daemon[1057]: time=2026-11-07T15:08:32.693Z level=INFO msg="Uploading bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv (752B)" lb # [ 57.384607] garage[913]: 2026-11-07T15:08:32.652297Z INFO garage_api_common::generic_server: 192.168.1.3:39878 PUT /farm/nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150832Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=695e9fd4b650499ac71d49351e6242f2d9f1099e151307b95e80ef40bd9155e4 lb # [ 57.401164] garage[913]: 2026-11-07T15:08:32.667487Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo lb # [ 57.406809] garage[913]: 2026-11-07T15:08:32.668077Z INFO garage_api_common::generic_server: 192.168.1.3:39800 PUT /farm/bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150832Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b6751b17eb5ad8715b63e31c7095419e1749f128fd212b4708c3db3cfc39cf84 lb # [ 57.421868] garage[913]: 2026-11-07T15:08:32.688328Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) GET /farm/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5.narinfo lb # [ 57.426467] garage[913]: 2026-11-07T15:08:32.688928Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 57.431313] niks3-server[963]: 2026/11/07 15:08:32 INFO Received sign narinfos request method=POST path=/api/pushes/13/sign worker1 # [ 57.438941] nix-grpc-daemon[1057]: time=2026-11-07T15:08:32.747Z level=INFO msg="Uploading 1 narinfos" lb # [ 57.437349] niks3-server[963]: 2026/11/07 15:08:32 INFO Signed narinfos id=13 count=1 lb # [ 57.440559] garage[913]: 2026-11-07T15:08:32.708080Z INFO garage_api_common::generic_server: 192.168.1.3:39800 PUT /farm/bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150832Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=04971551297ddd3b3991722ad69dba4fd49b589e1e801ad36edf27ba5114b316 lb # [ 57.445232] garage[913]: 2026-11-07T15:08:32.708596Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 57.448720] niks3-server[963]: 2026/11/07 15:08:32 INFO Registered completed upload object_key=nar/0d4r016fc570pq02p1j53gahxygvvyr62937d84sa58ri3rzk000.nar.zst lb # [ 57.450568] garage[913]: 2026-11-07T15:08:32.719039Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo lb # [ 57.454248] garage[913]: 2026-11-07T15:08:32.721857Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo lb # [ 57.457211] niks3-server[963]: 2026/11/07 15:08:32 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.ls lb # [ 57.459558] garage[913]: 2026-11-07T15:08:32.728026Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) GET /farm/2f96mrg6ljwjqld1y3yaibmb07jkz3by.narinfo lb # [ 57.463417] garage[913]: 2026-11-07T15:08:32.731071Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) GET /farm/qi07z82gylcaha6pl0vfp8s3j6f2gl91.narinfo lb # [ 57.465832] niks3-server[963]: 2026/11/07 15:08:32 INFO Received complete push request method=POST path=/api/pushes/13/complete lb # [ 57.468683] garage[913]: 2026-11-07T15:08:32.735847Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker1 # [ 57.471197] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:32822 lb # [ 57.472483] niks3-server[963]: 2026/11/07 15:08:32 INFO Completed push id=13 objects=9 duration=9.385551ms worker1 # [ 57.477407] nix-grpc-daemon[1057]: time=2026-11-07T15:08:32.784Z level=INFO msg="Upload complete. (203ms)" worker1 # [ 57.483929] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=0 paths=1 nar_bytes_in=752 worker1 # [ 57.491686] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=debug event=want client=6 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv cached=0 worker1 # [ 57.496185] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=debug event=assigned drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 57.500914] nix-grpc-daemon[529]: ts=2026-11-07T15:08:32Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 57.506229] nix-grpc-daemon[529]: copying path '/nix/store/qi07z82gylcaha6pl0vfp8s3j6f2gl91-farm-a' from 'http://lb:5751'... worker1 # [ 57.513813] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) lb # [ 57.511201] garage[913]: 2026-11-07T15:08:32.779635Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst lb # [ 57.515055] garage[913]: 2026-11-07T15:08:32.783393Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/nar/05mvm4xykg9y2d7fm3g502ld2ajkd821jwng7v5g8vd73ynsbnah.nar.zst worker1 # [ 57.518985] nix-daemon[1026]: reaped child process 1188, status = succeeded worker1 # [ 57.524754] nix-grpc-daemon[529]: copying path '/nix/store/2f96mrg6ljwjqld1y3yaibmb07jkz3by-farm-b' from 'http://lb:5751'... worker1 # [ 57.526941] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) lb # [ 57.528436] garage[913]: 2026-11-07T15:08:32.796648Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst worker1 # [ 57.533691] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) lb # [ 57.532312] garage[913]: 2026-11-07T15:08:32.800267Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/nar/0y3xlf15z3z540fgrc9sgnn2rl0aj3w6x9mjqd50hhqgmaxbiivd.nar.zst worker1 # [ 57.538311] nix-grpc-daemon[529]: copying path '/nix/store/dp6wdd8xfalk9qg1xqalcnk58hz7fnr5-farm-top' from 'http://lb:5751'... lb # [ 57.540190] garage[913]: 2026-11-07T15:08:32.808658Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst lb # [ 57.543431] garage[913]: 2026-11-07T15:08:32.811889Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/nar/0h4zvhqjxsvdqli2l6i5ajh5sh40hz57gzchdirnvbisq2aks0k8.nar.zst client # [ 57.572829] sshd-session[948]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 57.576748] sshd-session[948]: Disconnected from user root UNKNOWN port 65535 client # [ 57.579946] sshd-session[942]: pam_unix(sshd:session): session closed for user root client # [ 57.587554] systemd[1]: sshd-vsock@8-9-3:22-2:8.service: Deactivated successfully. client # [ 57.594951] systemd[1]: session-10.scope: Deactivated successfully. client # [ 57.597790] systemd[1]: session-10.scope: Consumed 93ms CPU time over 319ms wall clock time, 24.1M memory peak, 7.8K incoming IP traffic, 5.3K outgoing IP traffic. client # [ 57.604644] systemd-logind[465]: Session 10 logged out. Waiting for processes to exit. client # [ 57.611544] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 57.615954] systemd[1]: Started SSH per-connection Daemon (vsock:2:9). client # [ 57.618118] systemd-logind[465]: Removed session 10. client # [ 57.665393] sshd-session[964]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 57.670351] sshd-session[964]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 57.675703] sshd-session[964]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 57.683069] systemd-logind[465]: New session '11' of user 'root' with class 'user' and type 'tty'. client # [ 57.687402] systemd[1]: Started Session 11 of User root. lb # [ 57.750794] niks3-server[963]: 2026/11/07 15:08:33 INFO Registered completed upload object_key=bshr7sr3z72cf1fa1a1b8fifr45jgpsw.narinfo worker2 # [ 57.798197] nix-grpc-daemon[820]: ts=2026-11-07T15:08:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:57444 worker2 # [ 57.803151] nix-grpc-daemon[820]: ts=2026-11-07T15:08:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:57444 client # [ 57.812800] sshd-session[970]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 57.814693] sshd-session[970]: Disconnected from user root UNKNOWN port 65535 client # [ 57.815994] sshd-session[964]: pam_unix(sshd:session): session closed for user root client # [ 57.819370] systemd[1]: sshd-vsock@9-10-3:22-2:9.service: Deactivated successfully. client # [ 57.822753] systemd[1]: session-11.scope: Deactivated successfully. client # [ 57.824309] systemd[1]: session-11.scope: Consumed 80ms CPU time over 136ms wall clock time, 23.8M memory peak, 7.3K incoming IP traffic, 5.3K outgoing IP traffic. client # [ 57.828087] systemd-logind[465]: Session 11 logged out. Waiting for processes to exit. client # [ 57.829618] systemd-logind[465]: Removed session 11. client # [ 57.905627] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 57.911212] systemd[1]: Started SSH per-connection Daemon (vsock:2:10). client # [ 57.954653] sshd-session[984]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 57.959650] sshd-session[984]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 57.964890] sshd-session[984]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 57.971087] systemd-logind[465]: New session '12' of user 'root' with class 'user' and type 'tty'. client # [ 57.974355] systemd[1]: Started Session 12 of User root. lb # [ 58.025503] garage[913]: 2026-11-07T15:08:33.291690Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo lb # [ 58.031233] garage[913]: 2026-11-07T15:08:33.292340Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 58.115475] sshd-session[990]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 58.117320] sshd-session[990]: Disconnected from user root UNKNOWN port 65535 client # [ 58.118644] sshd-session[984]: pam_unix(sshd:session): session closed for user root client # [ 58.123073] systemd[1]: sshd-vsock@10-11-3:22-2:10.service: Deactivated successfully. client # [ 58.125573] systemd[1]: session-12.scope: Deactivated successfully. client # [ 58.128934] systemd-logind[465]: Session 12 logged out. Waiting for processes to exit. client # [ 58.130715] systemd-logind[465]: Removed session 12. client # [ 58.207993] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 58.211509] systemd[1]: Started SSH per-connection Daemon (vsock:2:11). client # [ 58.263927] sshd-session[997]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 58.269293] sshd-session[997]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 58.274749] sshd-session[997]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 58.281065] systemd-logind[465]: New session '13' of user 'root' with class 'user' and type 'tty'. client # [ 58.284366] systemd[1]: Started Session 13 of User root. lb # [ 58.316296] garage[913]: 2026-11-07T15:08:33.583916Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/lcigaln8jssac7f3f9qiwsvpv98jazmv.narinfo lb # [ 58.322941] garage[913]: 2026-11-07T15:08:33.591182Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 58.354863] nix-daemon[1026]: reaped child process 1207, status = succeeded worker2 # [ 58.401690] nix-grpc-daemon[820]: ts=2026-11-07T15:08:33Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 58.410641] nix-grpc-daemon[820]: ts=2026-11-07T15:08:33Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43034 worker1 # [ 58.429449] nix-daemon[1026]: accepted connection from pid 1224, user nix-grpc-daemon (trusted) worker2 # [ 58.430582] nix-grpc-daemon[1033]: time=2026-11-07T15:08:33.642Z level=INFO msg="All 1 paths already cached" worker1 # [ 58.438993] nix-grpc-daemon[529]: ts=2026-11-07T15:08:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 58.444367] nix-grpc-daemon[529]: ts=2026-11-07T15:08:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 58.447307] nix-daemon[1026]: reaped child process 1227, status = succeeded worker1 # [ 58.451485] nix-grpc-daemon[529]: ts=2026-11-07T15:08:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 58.453845] niks3-server[963]: 2026/11/07 15:08:33 INFO Received push request method=POST path=/api/pushes worker1 # [ 58.478186] nix-grpc-daemon[529]: ts=2026-11-07T15:08:33Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60242 worker2 # [ 58.476224] nix-grpc-daemon[820]: ts=2026-11-07T15:08:33Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43034 worker1 # [ 58.480400] nix-grpc-daemon[529]: ts=2026-11-07T15:08:33Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 58.484744] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker2 # [ 58.482888] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker1 # [ 58.486759] nix-grpc-daemon[1057]: time=2026-11-07T15:08:33.795Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 58.488413] nix-grpc-daemon[1057]: time=2026-11-07T15:08:33.795Z level=INFO msg="Uploading aayfavl0hksy8qs9qc49znrwnfc5d2sr-farm-top (232B)" worker1 # [ 58.494187] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker2 # [ 58.492024] nix-grpc-daemon[820]: ts=2026-11-07T15:08:33Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43034 duration_s=0 paths=1 nar_bytes_out=176 worker1 # [ 58.497945] nix-grpc-daemon[529]: ts=2026-11-07T15:08:33Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=0 paths=1 nar_bytes_out=128 lb # [ 58.489890] garage[913]: 2026-11-07T15:08:33.757496Z INFO garage_api_common::generic_server: 192.168.1.3:39800 PUT /farm/log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150833Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8a481c0e9e4414f2344fc646721eb928c33f5d75e0693421c78089562188b010 worker2 # [ 58.503091] nix-daemon[986]: reaped child process 1171, status = succeeded worker1 # [ 58.506943] nix-grpc-daemon[529]: ts=2026-11-07T15:08:33Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=0 paths=1 nar_bytes_out=232 worker1 # [ 58.511139] nix-daemon[1026]: reaped child process 1230, status = succeeded worker1 # [ 58.513496] nix-daemon[1026]: reaped child process 1231, status = succeeded lb # [ 58.507217] garage[913]: 2026-11-07T15:08:33.773631Z INFO garage_api_common::generic_server: 192.168.1.3:39818 PUT /farm/aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150833Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cf252337b7df714fdf8094f1b6ce53f871da88d9c73b98b96d61fbe8c12e7d1a lb # [ 58.520081] garage[913]: 2026-11-07T15:08:33.788047Z INFO garage_api_common::generic_server: 192.168.1.3:39878 PUT /farm/nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150833Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0d1ad27a6e1cce39efbc84fed5ade54d2e860f2d85ddbdf7e6548b2d42b63bae lb # [ 58.534946] niks3-server[963]: 2026/11/07 15:08:33 INFO Received sign narinfos request method=POST path=/api/pushes/14/sign lb # [ 58.537098] garage[913]: 2026-11-07T15:08:33.805239Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls worker1 # [ 58.542201] nix-grpc-daemon[1057]: time=2026-11-07T15:08:33.850Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.541501] garage[913]: 2026-11-07T15:08:33.808362Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv lb # [ 58.543984] niks3-server[963]: 2026/11/07 15:08:33 INFO Signed narinfos id=14 count=1 lb # [ 58.545516] garage[913]: 2026-11-07T15:08:33.813702Z INFO garage_api_common::generic_server: 192.168.1.3:39878 PUT /farm/aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150833Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c7cc71016a21bc638069bb9520462693f948bf296692fcffb7c6d50ef23e27e7 client # [ 58.546852] sshd-session[1003]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 58.548320] sshd-session[1003]: Disconnected from user root UNKNOWN port 65535 lb # [ 58.551119] garage[913]: 2026-11-07T15:08:33.819317Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst client # [ 58.549687] sshd-session[997]: pam_unix(sshd:session): session closed for user root lb # [ 58.554211] niks3-server[963]: 2026/11/07 15:08:33 INFO Received complete push request method=POST path=/api/pushes/14/complete client # [ 58.552728] systemd[1]: sshd-vsock@11-12-3:22-2:11.service: Deactivated successfully. lb # [ 58.555970] niks3-server[963]: 2026/11/07 15:08:33 INFO Registered completed upload object_key=log/bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv client # [ 58.556580] systemd[1]: session-13.scope: Deactivated successfully. lb # [ 58.558601] garage[913]: 2026-11-07T15:08:33.826576Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo client # [ 58.558324] systemd[1]: session-13.scope: Consumed 108ms CPU time over 273ms wall clock time, 54.3M memory peak, 25.4K incoming IP traffic, 17K outgoing IP traffic. lb # [ 58.563249] niks3-server[963]: 2026/11/07 15:08:33 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.ls client # [ 58.562269] systemd-logind[465]: Session 13 logged out. Waiting for processes to exit. client # [ 58.564255] systemd-logind[465]: Removed session 13. lb # [ 58.569282] niks3-server[963]: 2026/11/07 15:08:33 INFO Registered completed upload object_key=aayfavl0hksy8qs9qc49znrwnfc5d2sr.narinfo lb # [ 58.571321] envoy[912]: conn peer=[2001:db8:1::1]:44160 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=409 tx=334 ms=38 lb # [ 58.572928] envoy[912]: conn peer=[2001:db8:1::1]:40672 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2902 tx=1920 ms=3691 lb # [ 58.574949] envoy[912]: conn peer=[2001:db8:1::1]:44180 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=329 ms=823 lb # [ 58.576408] envoy[912]: conn peer=[2001:db8:1::1]:40684 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3746 tx=2034 ms=4202 lb # [ 58.578206] envoy[912]: conn peer=[2001:db8:1::1]:40668 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=6289 tx=4057 ms=6071 lb # [ 58.579790] envoy[912]: conn peer=[2001:db8:1::1]:44206 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=448 tx=378 ms=17 lb # [ 58.581308] envoy[912]: conn peer=[2001:db8:1::1]:44172 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3258 tx=2104 ms=2095 lb # [ 58.582816] envoy[912]: conn peer=[2001:db8:1::1]:44224 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=330 ms=47 lb # [ 58.584264] envoy[912]: conn peer=[2001:db8:1::1]:44238 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=382 tx=377 ms=71 lb # [ 58.586324] envoy[912]: conn peer=[2001:db8:1::1]:44254 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=384 tx=411 ms=67 worker1 # [ 58.587797] nix-grpc-daemon[1057]: time=2026-11-07T15:08:33.896Z level=INFO msg="Upload complete. (243ms)" lb # [ 58.587768] envoy[912]: conn peer=[2001:db8:1::1]:44220 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=1051 tx=2889 ms=139 lb # [ 58.589208] niks3-server[963]: 2026/11/07 15:08:33 INFO Registered completed upload object_key=nar/1r64sjcvz2vpjvwv3psvwf0bfifdzwiafvy1m89v5is1mm18ds87.nar.zst lb # [ 58.591248] niks3-server[963]: 2026/11/07 15:08:33 INFO Completed push id=14 objects=12 duration=31.860474ms test farm::independent::outputs_carry_the_cache_signature ... ok worker1 # [ 58.594330] nix-grpc-daemon[529]: ts=2026-11-07T15:08:33Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=1 drv=bshr7sr3z72cf1fa1a1b8fifr45jgpsw-farm-top.drv assign_id=8 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 58.603907] nix-grpc-daemon[529]: ts=2026-11-07T15:08:33Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 58.614959] nix-daemon[1026]: reaped child process 1205, status = succeeded worker1 # [ 58.618823] nix-grpc-daemon[529]: ts=2026-11-07T15:08:33Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 58.626142] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 58.633265] nix-grpc-daemon[529]: ts=2026-11-07T15:08:33Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=0 paths=1 nar_bytes_out=232 worker1 # [ 58.638763] nix-daemon[1026]: reaped child process 1234, status = succeeded worker2 # [ 58.670672] nix-daemon[986]: reaped child process 1156, status = succeeded client # [ 58.684152] nix-daemon[806]: reaped child process 810, status = succeeded client # [ 58.695213] sshd-session[786]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 58.696486] sshd-session[786]: Disconnected from user root UNKNOWN port 65535 client # [ 58.698342] sshd-session[769]: pam_unix(sshd:session): session closed for user root client # [ 58.701209] systemd[1]: sshd-vsock@2-3-3:22-2:2.service: Deactivated successfully. client # [ 58.704232] systemd[1]: session-3.scope: Deactivated successfully. client # [ 58.707269] systemd-logind[465]: Session 3 logged out. Waiting for processes to exit. client # [ 58.709470] systemd-logind[465]: Removed session 3. worker2 # [ 58.744935] nix-daemon[986]: accepted connection from pid 1174, user nix-grpc-daemon (trusted) worker2 # [ 58.758362] nix-daemon[986]: reaped child process 1177, status = succeeded lb # [ 58.766974] niks3-server[963]: 2026/11/07 15:08:34 INFO Received push request method=POST path=/api/pushes worker2 # [ 58.778790] nix-grpc-daemon[1033]: time=2026-11-07T15:08:33.991Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 58.783265] garage[913]: 2026-11-07T15:08:34.050893Z INFO garage_api_common::generic_server: 192.168.1.4:52828 PUT /farm/lcigaln8jssac7f3f9qiwsvpv98jazmv.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150834Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0c4a27fd838577afdb208c6cd4998d7ca484f9fbf191c9f1b2e2a2df8c10e89 lb # [ 58.797726] garage[913]: 2026-11-07T15:08:34.065397Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/lcigaln8jssac7f3f9qiwsvpv98jazmv.ls client # [ 58.807830] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 58.805846] garage[913]: 2026-11-07T15:08:34.072827Z INFO garage_api_common::generic_server: 192.168.1.4:52818 PUT /farm/log/fvrsn8qnp4wgqbhjj23ziwh8dwj0i8p9-uses-input-w1onlyb.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150834Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cc431dfca51614947125276a2ff6cc5f4f28f0265c413cf5994652bf3419c25d client # [ 58.815344] systemd[1]: Started SSH per-connection Daemon (vsock:2:12). lb # [ 58.820262] niks3-server[963]: 2026/11/07 15:08:34 INFO Received sign narinfos request method=POST path=/api/pushes/15/sign worker2 # [ 58.822651] nix-grpc-daemon[1033]: time=2026-11-07T15:08:34.035Z level=INFO msg="Uploading 1 narinfos" lb # [ 58.824333] niks3-server[963]: 2026/11/07 15:08:34 INFO Signed narinfos id=15 count=1 lb # [ 58.826310] niks3-server[963]: 2026/11/07 15:08:34 INFO Registered completed upload object_key=lcigaln8jssac7f3f9qiwsvpv98jazmv.ls lb # [ 58.831128] garage[913]: 2026-11-07T15:08:34.097650Z INFO garage_api_common::generic_server: 192.168.1.4:52818 PUT /farm/lcigaln8jssac7f3f9qiwsvpv98jazmv.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150834Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3fee3c4203ed115ca37ad9fead71abf82ebe5a6dc75900af87848396cb5951a9 lb # [ 58.841835] niks3-server[963]: 2026/11/07 15:08:34 INFO Received complete push request method=POST path=/api/pushes/15/complete lb # [ 58.843872] garage[913]: 2026-11-07T15:08:34.111895Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/log/fvrsn8qnp4wgqbhjj23ziwh8dwj0i8p9-uses-input-w1onlyb.drv lb # [ 58.847265] garage[913]: 2026-11-07T15:08:34.115697Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/lcigaln8jssac7f3f9qiwsvpv98jazmv.narinfo lb # [ 58.851551] niks3-server[963]: 2026/11/07 15:08:34 INFO Completed push id=15 objects=4 duration=10.880433ms worker2 # [ 58.850471] nix-grpc-daemon[1033]: time=2026-11-07T15:08:34.063Z level=INFO msg="Upload complete. (189ms)" lb # [ 58.853517] niks3-server[963]: 2026/11/07 15:08:34 INFO Registered completed upload object_key=log/fvrsn8qnp4wgqbhjj23ziwh8dwj0i8p9-uses-input-w1onlyb.drv lb # [ 58.855962] niks3-server[963]: 2026/11/07 15:08:34 INFO Registered completed upload object_key=lcigaln8jssac7f3f9qiwsvpv98jazmv.narinfo worker2 # [ 58.857664] nix-grpc-daemon[820]: ts=2026-11-07T15:08:34Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43034 duration_s=1 drv=fvrsn8qnp4wgqbhjj23ziwh8dwj0i8p9-uses-input-w1onlyb.drv assign_id=7 outputs=1 inputs=1 inputs_fetched=1 input_bytes=120 input_s=0 worker2 # [ 58.867351] nix-grpc-daemon[820]: ts=2026-11-07T15:08:34Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 58.879195] nix-daemon[986]: reaped child process 1151, status = succeeded worker1 # [ 58.884911] nix-grpc-daemon[529]: ts=2026-11-07T15:08:34Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60242 client # [ 58.883223] sshd-session[1027]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 58.887990] sshd-session[1027]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 58.894171] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) client # [ 58.892995] sshd-session[1027]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 58.899119] systemd-logind[465]: New session '14' of user 'root' with class 'user' and type 'tty'. client # [ 58.902353] systemd[1]: Started Session 14 of User root. worker1 # [ 58.910569] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 97 ms (attempt 1/5) client # [ 58.918263] sshd-session[1034]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 58.919932] sshd-session[1034]: Disconnected from user root UNKNOWN port 65535 client # [ 58.921265] sshd-session[1027]: pam_unix(sshd:session): session closed for user root client # [ 58.924139] systemd[1]: sshd-vsock@12-13-3:22-2:12.service: Deactivated successfully. client # [ 58.927289] systemd[1]: session-14.scope: Deactivated successfully. client # [ 58.929794] systemd-logind[465]: Session 14 logged out. Waiting for processes to exit. client # [ 58.932682] systemd-logind[465]: Removed session 14. client # [ 59.009080] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 59.011869] systemd[1]: Started SSH per-connection Daemon (vsock:2:13). worker1 # [ 59.014968] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 81 ms (attempt 2/5) client # [ 59.055556] sshd-session[1039]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 59.060181] sshd-session[1039]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 59.065685] sshd-session[1039]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 59.071068] systemd-logind[465]: New session '15' of user 'root' with class 'user' and type 'tty'. client # [ 59.075388] systemd[1]: Started Session 15 of User root. client # [ 59.091234] sshd-session[1045]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 59.092490] sshd-session[1045]: Disconnected from user root UNKNOWN port 65535 test farm::independent::build_hook_through_nix_daemon ... client # [ 59.093795] sshd-session[1039]: pam_unix(sshd:session): session closed for user root ok client # [ 59.096707] systemd[1]: sshd-vsock@13-14-3:22-2:13.service: Deactivated successfully. client # [ 59.099840] systemd[1]: session-15.scope: Deactivated successfully. client # [ 59.103275] systemd-logind[465]: Session 15 logged out. Waiting for processes to exit. client # [ 59.104811] systemd-logind[465]: Removed session 15. worker1 # [ 59.208993] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 54 ms (attempt 3/5) worker1 # [ 59.265568] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 284 ms (attempt 4/5) lb # [ 59.336468] systemd[1]: Stopping User Manager for UID 0... lb # [ 59.343548] systemd[1065]: Activating special unit Exit the Session... lb # [ 59.348372] systemd[1065]: Stopped target Main User Target. lb # [ 59.351598] systemd[1065]: Stopped target Basic System. lb # [ 59.355427] systemd[1065]: Stopped target Paths. lb # [ 59.358362] systemd[1065]: Stopped target Sockets. lb # [ 59.361943] systemd[1065]: Stopped target Timers. lb # [ 59.367834] systemd[1065]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 59.370698] systemd[1065]: Closed D-Bus User Message Bus Socket. lb # [ 59.374811] systemd[1065]: Stopped Create User Files and Directories. lb # [ 59.376991] systemd[1065]: Removed slice User Application Slice. lb # [ 59.380710] systemd[1065]: Reached target Shutdown. lb # [ 59.384326] systemd[1065]: Finished Exit the Session. lb # [ 59.387879] systemd[1065]: Reached target Exit the Session. lb # [ 59.394509] systemd-logind[553]: Removed session 2. lb # [ 59.396117] systemd[1]: user@0.service: Deactivated successfully. lb # [ 59.399151] systemd[1]: Stopped User Manager for UID 0. lb # [ 59.421989] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 59.439319] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 59.441756] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 59.442875] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 59.554251] nix-grpc-daemon[529]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 59.557566] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 59.567875] garage[913]: 2026-11-07T15:08:34.834142Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/lcigaln8jssac7f3f9qiwsvpv98jazmv.narinfo lb # [ 59.575510] garage[913]: 2026-11-07T15:08:34.842959Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/lcigaln8jssac7f3f9qiwsvpv98jazmv.narinfo worker1 # [ 59.586336] nix-grpc-daemon[529]: copying path '/nix/store/lcigaln8jssac7f3f9qiwsvpv98jazmv-uses-input-w1onlyb' from 'http://lb:5751'... lb # [ 59.593745] garage[913]: 2026-11-07T15:08:34.861044Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 59.601084] garage[913]: 2026-11-07T15:08:34.868869Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker1 # [ 59.617593] nix-grpc-daemon[529]: ts=2026-11-07T15:08:34Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=0 paths=1 nar_bytes_out=120 worker1 # [ 59.634692] nix-daemon[1026]: reaped child process 1236, status = succeeded client # [ 59.679573] sshd-session[896]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 59.682926] sshd-session[896]: Disconnected from user root UNKNOWN port 65535 client # [ 59.687344] sshd-session[890]: pam_unix(sshd:session): session closed for user root client # [ 59.693938] systemd[1]: sshd-vsock@6-7-3:22-2:6.service: Deactivated successfully. client # [ 59.700990] systemd[1]: session-8.scope: Deactivated successfully. client # [ 59.707442] systemd-logind[465]: Session 8 logged out. Waiting for processes to exit. client # [ 59.711141] systemd-logind[465]: Removed session 8. client # [ 59.714217] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 59.717468] systemd[1]: Started SSH per-connection Daemon (vsock:2:14). client # [ 59.762368] sshd-session[1055]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 59.767345] sshd-session[1055]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 59.772354] sshd-session[1055]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 59.778708] systemd-logind[465]: New session '16' of user 'root' with class 'user' and type 'tty'. client # [ 59.781235] systemd[1]: Started Session 16 of User root. client # [ 59.874402] nix-daemon[806]: accepted connection from pid 1063, user root (trusted) client # [ 59.954649] nix-daemon[806]: reaped child process 901, status = succeeded worker1 # [ 60.085956] nix-grpc-daemon[529]: ts=2026-11-07T15:08:35Z level=debug event=rpc_start method=StoreInfo cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 60.092821] nix-grpc-daemon[529]: ts=2026-11-07T15:08:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 60.098730] nix-grpc-daemon[1057]: time=2026-11-07T15:08:35.405Z level=INFO msg="All 1 paths already cached" worker2 # [ 60.102429] nix-grpc-daemon[820]: ts=2026-11-07T15:08:35Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 60.112972] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) lb # [ 60.128737] garage[913]: 2026-11-07T15:08:35.395719Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/9v7jp53xf86i7n5wpzz2h104g6rwdx4n.narinfo lb # [ 60.134625] garage[913]: 2026-11-07T15:08:35.396350Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 60.141589] nix-grpc-daemon[1033]: time=2026-11-07T15:08:35.353Z level=INFO msg="All 1 paths already cached" worker2 # [ 60.150179] nix-grpc-daemon[820]: ts=2026-11-07T15:08:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43034 worker2 # [ 60.160186] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker2 # [ 60.269266] nix-daemon[986]: accepted connection from pid 1183, user nix-grpc-daemon (trusted) worker2 # [ 60.285217] nix-daemon[986]: reaped child process 1186, status = succeeded lb # [ 60.293155] niks3-server[963]: 2026/11/07 15:08:35 INFO Received push request method=POST path=/api/pushes worker2 # [ 60.410195] nix-grpc-daemon[1033]: time=2026-11-07T15:08:35.622Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker2 # [ 60.417697] nix-grpc-daemon[1033]: time=2026-11-07T15:08:35.626Z level=INFO msg="Uploading 9v7jp53xf86i7n5wpzz2h104g6rwdx4n-uses-input-w1onlyc.drv (592B)" lb # [ 60.419305] garage[913]: 2026-11-07T15:08:35.686718Z INFO garage_api_common::generic_server: 192.168.1.4:52818 PUT /farm/nar/1ba3hpw4bl8n0sq7f68byznxcpynjj6mxxydsj2vc9pa6qdnm5vh.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150835Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4a8bff04a7aa93b3ce9a61fef17a7d3dc94a72b93f0f75d7c2afad6dde555ae2 lb # [ 60.433764] garage[913]: 2026-11-07T15:08:35.701050Z INFO garage_api_common::generic_server: 192.168.1.4:52828 PUT /farm/9v7jp53xf86i7n5wpzz2h104g6rwdx4n.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150835Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4f0e1bbd60c885dbe5ad3fabe1e5567951ce45e4ef407af4e11ac79159247fdf lb # [ 60.447905] niks3-server[963]: 2026/11/07 15:08:35 INFO Received sign narinfos request method=POST path=/api/pushes/16/sign lb # [ 60.452908] garage[913]: 2026-11-07T15:08:35.720693Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/1ba3hpw4bl8n0sq7f68byznxcpynjj6mxxydsj2vc9pa6qdnm5vh.nar.zst lb # [ 60.460213] niks3-server[963]: 2026/11/07 15:08:35 INFO Signed narinfos id=16 count=1 worker2 # [ 60.459181] nix-grpc-daemon[1033]: time=2026-11-07T15:08:35.671Z level=INFO msg="Uploading 1 narinfos" lb # [ 60.464293] garage[913]: 2026-11-07T15:08:35.732185Z INFO garage_api_common::generic_server: 192.168.1.4:52828 PUT /farm/9v7jp53xf86i7n5wpzz2h104g6rwdx4n.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150835Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=67234b70c82a9e22f3400df3238eff56486316c8064bed36288fefc623bf86d0 lb # [ 60.476798] niks3-server[963]: 2026/11/07 15:08:35 INFO Received complete push request method=POST path=/api/pushes/16/complete lb # [ 60.482455] garage[913]: 2026-11-07T15:08:35.750381Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/9v7jp53xf86i7n5wpzz2h104g6rwdx4n.ls lb # [ 60.486268] garage[913]: 2026-11-07T15:08:35.754345Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/9v7jp53xf86i7n5wpzz2h104g6rwdx4n.narinfo lb # [ 60.489556] niks3-server[963]: 2026/11/07 15:08:35 INFO Registered completed upload object_key=nar/1ba3hpw4bl8n0sq7f68byznxcpynjj6mxxydsj2vc9pa6qdnm5vh.nar.zst lb # [ 60.497944] niks3-server[963]: 2026/11/07 15:08:35 INFO Completed push id=16 objects=6 duration=21.475355ms worker2 # [ 60.497345] nix-grpc-daemon[1033]: time=2026-11-07T15:08:35.709Z level=INFO msg="Upload complete. (321ms)" lb # [ 60.504543] niks3-server[963]: 2026/11/07 15:08:35 INFO Registered completed upload object_key=9v7jp53xf86i7n5wpzz2h104g6rwdx4n.ls worker2 # [ 60.502563] nix-grpc-daemon[820]: ts=2026-11-07T15:08:35Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43034 duration_s=0 paths=1 nar_bytes_in=592 lb # [ 60.511731] niks3-server[963]: 2026/11/07 15:08:35 INFO Registered completed upload object_key=9v7jp53xf86i7n5wpzz2h104g6rwdx4n.narinfo worker2 # [ 60.517987] nix-daemon[986]: reaped child process 1181, status = succeeded worker1 # [ 60.518753] nix-grpc-daemon[529]: ts=2026-11-07T15:08:35Z level=debug event=want client=7 drv=9v7jp53xf86i7n5wpzz2h104g6rwdx4n-uses-input-w1onlyc.drv cached=0 worker1 # [ 60.524828] nix-grpc-daemon[529]: ts=2026-11-07T15:08:35Z level=debug event=assigned drv=9v7jp53xf86i7n5wpzz2h104g6rwdx4n-uses-input-w1onlyc.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 60.529805] nix-grpc-daemon[529]: ts=2026-11-07T15:08:35Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 60.539175] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) lb # [ 60.552227] garage[913]: 2026-11-07T15:08:35.819764Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/9v7jp53xf86i7n5wpzz2h104g6rwdx4n.narinfo lb # [ 60.559513] garage[913]: 2026-11-07T15:08:35.827196Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/9v7jp53xf86i7n5wpzz2h104g6rwdx4n.narinfo worker1 # [ 60.568272] nix-grpc-daemon[529]: copying path '/nix/store/9v7jp53xf86i7n5wpzz2h104g6rwdx4n-uses-input-w1onlyc.drv' from 'http://lb:5751'... lb # [ 60.574119] garage[913]: 2026-11-07T15:08:35.841178Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/1ba3hpw4bl8n0sq7f68byznxcpynjj6mxxydsj2vc9pa6qdnm5vh.nar.zst lb # [ 60.580932] garage[913]: 2026-11-07T15:08:35.847991Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/nar/1ba3hpw4bl8n0sq7f68byznxcpynjj6mxxydsj2vc9pa6qdnm5vh.nar.zst worker1 # [ 60.598300] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 60.612459] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) lb # [ 61.148233] garage[913]: 2026-11-07T15:08:36.415812Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/lwk8sldgz8538fsgiiqnva2cw8x0asgd.narinfo lb # [ 61.154065] garage[913]: 2026-11-07T15:08:36.416451Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 61.455842] nix-daemon[1026]: reaped child process 1251, status = succeeded worker1 # [ 61.531496] nix-daemon[1026]: accepted connection from pid 1267, user nix-grpc-daemon (trusted) worker1 # [ 61.545440] nix-daemon[1026]: reaped child process 1270, status = succeeded lb # [ 61.550564] niks3-server[963]: 2026/11/07 15:08:36 INFO Received push request method=POST path=/api/pushes worker1 # [ 61.561144] nix-grpc-daemon[1057]: time=2026-11-07T15:08:36.869Z level=INFO msg="Uploading 0 paths to lb (1 already cached)" lb # [ 61.562641] garage[913]: 2026-11-07T15:08:36.830225Z INFO garage_api_common::generic_server: 192.168.1.3:39878 PUT /farm/lwk8sldgz8538fsgiiqnva2cw8x0asgd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150836Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=672953a45afbf7a02290dc14556d1491165664a5859d5aab38f0c0072f325363 lb # [ 61.576226] garage[913]: 2026-11-07T15:08:36.844037Z INFO garage_api_common::generic_server: 192.168.1.3:39818 PUT /farm/log/9v7jp53xf86i7n5wpzz2h104g6rwdx4n-uses-input-w1onlyc.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150836Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=721e60f930e1a47270afcf49d3df3e6bd772aa88779af2b6f5d65f69d1bb8d82 lb # [ 61.590606] niks3-server[963]: 2026/11/07 15:08:36 INFO Received sign narinfos request method=POST path=/api/pushes/17/sign lb # [ 61.595373] garage[913]: 2026-11-07T15:08:36.862906Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/lwk8sldgz8538fsgiiqnva2cw8x0asgd.ls lb # [ 61.605430] garage[913]: 2026-11-07T15:08:36.872835Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/log/9v7jp53xf86i7n5wpzz2h104g6rwdx4n-uses-input-w1onlyc.drv lb # [ 61.610258] niks3-server[963]: 2026/11/07 15:08:36 INFO Signed narinfos id=17 count=1 worker1 # [ 61.614402] nix-grpc-daemon[1057]: time=2026-11-07T15:08:36.923Z level=INFO msg="Uploading 1 narinfos" lb # [ 61.615942] niks3-server[963]: 2026/11/07 15:08:36 INFO Registered completed upload object_key=log/9v7jp53xf86i7n5wpzz2h104g6rwdx4n-uses-input-w1onlyc.drv lb # [ 61.620321] garage[913]: 2026-11-07T15:08:36.888007Z INFO garage_api_common::generic_server: 192.168.1.3:39818 PUT /farm/lwk8sldgz8538fsgiiqnva2cw8x0asgd.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150836Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2c42ca32419ba47d1154e893dbeee54ca512202906c18802a536c97916d7bab7 lb # [ 61.628105] niks3-server[963]: 2026/11/07 15:08:36 INFO Registered completed upload object_key=lwk8sldgz8538fsgiiqnva2cw8x0asgd.ls lb # [ 61.630137] niks3-server[963]: 2026/11/07 15:08:36 INFO Received complete push request method=POST path=/api/pushes/17/complete worker1 # [ 61.630968] systemd[1]: Stopping User Manager for UID 0... lb # [ 61.633630] garage[913]: 2026-11-07T15:08:36.901565Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/lwk8sldgz8538fsgiiqnva2cw8x0asgd.narinfo lb # [ 61.637303] niks3-server[963]: 2026/11/07 15:08:36 INFO Completed push id=17 objects=4 duration=7.153982ms lb # [ 61.639289] niks3-server[963]: 2026/11/07 15:08:36 INFO Registered completed upload object_key=lwk8sldgz8538fsgiiqnva2cw8x0asgd.narinfo worker1 # [ 61.636990] systemd[927]: Activating special unit Exit the Session... worker1 # [ 61.643743] systemd[927]: Stopped target Main User Target. worker1 # [ 61.650686] nix-grpc-daemon[1057]: time=2026-11-07T15:08:36.947Z level=INFO msg="Upload complete. (214ms)" worker1 # [ 61.653212] systemd[927]: Stopped target Basic System. worker1 # [ 61.654443] nix-grpc-daemon[529]: ts=2026-11-07T15:08:36Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=1 drv=9v7jp53xf86i7n5wpzz2h104g6rwdx4n-uses-input-w1onlyc.drv assign_id=9 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 61.659687] systemd[927]: Stopped target Paths. worker1 # [ 61.660455] nix-grpc-daemon[529]: ts=2026-11-07T15:08:36Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 61.664821] systemd[927]: Stopped target Sockets. worker1 # [ 61.665905] systemd[927]: Stopped target Timers. worker1 # [ 61.668307] systemd[927]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 61.669298] systemd[927]: Closed D-Bus User Message Bus Socket. worker1 # [ 61.670194] systemd[927]: Stopped Create User Files and Directories. worker1 # [ 61.672251] systemd[927]: Removed slice User Application Slice. worker1 # [ 61.673409] systemd[927]: Reached target Shutdown. worker1 # [ 61.677413] systemd[927]: Finished Exit the Session. worker1 # [ 61.678328] systemd[927]: Reached target Exit the Session. worker1 # [ 61.681662] systemd-logind[608]: Removed session 2. worker1 # [ 61.682682] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 61.683629] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 61.678307] nix-grpc-daemon[820]: ts=2026-11-07T15:08:36Z level=debug event=rpc_start method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43034 worker1 # [ 61.685135] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 61.689250] nix-daemon[1026]: reaped child process 1249, status = succeeded worker2 # [ 61.688865] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker1 # [ 61.704559] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 61.706633] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 61.709218] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 61.706602] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 57 ms (attempt 1/5) worker2 # [ 61.770965] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 2/5) worker2 # [ 61.854601] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 144 ms (attempt 3/5) worker2 # [ 61.985555] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 61.994670] systemd[931]: Activating special unit Exit the Session... worker2 # [ 61.999940] systemd[931]: Stopped target Main User Target. worker2 # [ 62.006386] systemd[931]: Stopped target Basic System. worker2 # [ 62.011265] systemd[931]: Stopped target Paths. worker2 # [ 62.014969] systemd[931]: Stopped target Sockets. worker2 # [ 62.017868] systemd[931]: Stopped target Timers. worker2 # [ 62.019591] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 111 ms (attempt 4/5) worker2 # [ 62.027489] systemd[931]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 62.030445] systemd[931]: Closed D-Bus User Message Bus Socket. worker2 # [ 62.032967] systemd[931]: Stopped Create User Files and Directories. worker2 # [ 62.037387] systemd[931]: Removed slice User Application Slice. worker2 # [ 62.040606] systemd[931]: Reached target Shutdown. worker2 # [ 62.042307] systemd[931]: Finished Exit the Session. worker2 # [ 62.044275] systemd[931]: Reached target Exit the Session. worker2 # [ 62.047168] systemd-logind[555]: Removed session 2. worker2 # [ 62.048991] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 62.050764] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 62.057626] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 62.076648] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 62.078583] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 62.080083] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 62.128408] nix-grpc-daemon[820]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 62.129637] nix-grpc-daemon[820]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 62.137201] garage[913]: 2026-11-07T15:08:37.404724Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/lwk8sldgz8538fsgiiqnva2cw8x0asgd.narinfo lb # [ 62.146074] garage[913]: 2026-11-07T15:08:37.413443Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/lwk8sldgz8538fsgiiqnva2cw8x0asgd.narinfo worker2 # [ 62.152578] nix-grpc-daemon[820]: copying path '/nix/store/lwk8sldgz8538fsgiiqnva2cw8x0asgd-uses-input-w1onlyc' from 'http://lb:5751'... lb # [ 62.159947] garage[913]: 2026-11-07T15:08:37.427582Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst lb # [ 62.168428] garage[913]: 2026-11-07T15:08:37.435918Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) GET /farm/nar/08ghl87f009pwqz85nbqv9hm0ln6gai6ggzilfmw3qnkaalfi6ss.nar.zst worker2 # [ 62.178501] nix-grpc-daemon[820]: ts=2026-11-07T15:08:37Z level=info event=rpc method=FetchNars cn=ci-1 peer=ipv4:192.168.1.2:43034 duration_s=0 paths=1 nar_bytes_out=120 worker2 # [ 62.192910] nix-daemon[986]: reaped child process 1188, status = succeeded client # [ 62.250947] sshd-session[1061]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 62.254271] sshd-session[1061]: Disconnected from user root UNKNOWN port 65535 client # [ 62.257851] sshd-session[1055]: pam_unix(sshd:session): session closed for user root client # [ 62.265562] systemd[1]: sshd-vsock@14-15-3:22-2:14.service: Deactivated successfully. client # [ 62.273209] systemd[1]: session-16.scope: Deactivated successfully. client # [ 62.276524] systemd-logind[465]: Session 16 logged out. Waiting for processes to exit. client # [ 62.278329] systemd-logind[465]: Removed session 16. test farm::independent::an_input_only_one_worker_has_still_reaches_the_builder ... ok test result: ok. 3 passed; 0 failed; 0 ignored; 0 measured; 58 filtered out; finished in 21.65s (finished: subtest: independent builds, in 21.71 seconds) subtest: scheduler and lifecycle running 22 tests test farm::serial::a_deploy_mid_build_drains_and_the_new_generation_takes_over ... lb # [ 62.387485] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 62.395990] systemd[1]: Started SSH per-connection Daemon (vsock:2:14). lb # [ 62.466220] sshd-session[1237]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 62.471130] sshd-session[1237]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 62.477617] sshd-session[1237]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 62.494281] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 62.509270] systemd-logind[553]: New session '16' of user 'root' with class 'user' and type 'tty'. lb # [ 62.524615] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 62.527969] systemd[1]: Starting User Manager for UID 0... lb # [ 62.545294] (systemd)[1246]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 62.549458] systemd-logind[553]: New session '17' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 62.629280] systemd[1246]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 62.702600] systemd[1246]: Queued start job for default target Main User Target. lb # [ 62.704727] systemd[1246]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 62.707120] systemd[1246]: Created slice User Application Slice. lb # [ 62.708290] systemd[1246]: Started Daily Cleanup of User's Temporary Directories. lb # [ 62.710126] systemd[1246]: Reached target Paths. lb # [ 62.710853] systemd[1246]: Reached target Timers. lb # [ 62.713070] systemd[1246]: Starting D-Bus User Message Bus Socket... lb # [ 62.714815] systemd[1246]: Starting Create User Files and Directories... lb # [ 62.745849] systemd[1246]: Finished Create User Files and Directories. lb # [ 62.749259] systemd[1246]: Listening on D-Bus User Message Bus Socket. lb # [ 62.750323] systemd[1246]: Reached target Sockets. lb # [ 62.751259] systemd[1246]: Reached target Basic System. lb # [ 62.752282] systemd[1246]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 62.754223] systemd[1246]: Reached target Main User Target. lb # [ 62.755734] systemd[1246]: Startup finished in 190ms. lb # [ 62.757412] systemd[1]: Started User Manager for UID 0. lb # [ 62.760827] systemd[1]: Started Session 16 of User root. lb # [ 62.773838] sshd-session[1259]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 62.775610] sshd-session[1259]: Disconnected from user root UNKNOWN port 65535 lb # [ 62.776874] sshd-session[1237]: pam_unix(sshd:session): session closed for user root lb # [ 62.780223] systemd[1]: sshd-vsock@14-15-4:22-2:14.service: Deactivated successfully. lb # [ 62.783785] systemd[1]: session-16.scope: Deactivated successfully. lb # [ 62.786692] systemd-logind[553]: Session 16 logged out. Waiting for processes to exit. lb # [ 62.788821] systemd-logind[553]: Removed session 16. client # [ 62.836942] nix-daemon[806]: reaped child process 1066, status = succeeded lb # [ 62.887864] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 62.896926] systemd[1]: Started SSH per-connection Daemon (vsock:2:15). lb # [ 62.960221] sshd-session[1264]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 62.965203] sshd-session[1264]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 62.970672] sshd-session[1264]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 62.977240] systemd-logind[553]: New session '18' of user 'root' with class 'user' and type 'tty'. lb # [ 62.980427] systemd[1]: Started Session 18 of User root. lb # [ 63.005921] sshd-session[1270]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 63.007670] sshd-session[1270]: Disconnected from user root UNKNOWN port 65535 lb # [ 63.009056] sshd-session[1264]: pam_unix(sshd:session): session closed for user root lb # [ 63.012238] systemd[1]: sshd-vsock@15-16-4:22-2:15.service: Deactivated successfully. lb # [ 63.016331] systemd[1]: session-18.scope: Deactivated successfully. lb # [ 63.017769] systemd[1]: session-18.scope: Consumed 16ms CPU time over 37ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 63.021349] systemd-logind[553]: Session 18 logged out. Waiting for processes to exit. lb # [ 63.023200] systemd-logind[553]: Removed session 18. lb # [ 63.089304] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 63.097133] systemd[1]: Started SSH per-connection Daemon (vsock:2:16). lb # [ 63.149303] sshd-session[1275]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 63.154295] sshd-session[1275]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 63.159535] sshd-session[1275]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 63.166068] systemd-logind[553]: New session '19' of user 'root' with class 'user' and type 'tty'. lb # [ 63.169367] systemd[1]: Started Session 19 of User root. lb # [ 63.194829] sshd-session[1281]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 63.196501] sshd-session[1281]: Disconnected from user root UNKNOWN port 65535 lb # [ 63.197753] sshd-session[1275]: pam_unix(sshd:session): session closed for user root lb # [ 63.200773] systemd[1]: sshd-vsock@16-17-4:22-2:16.service: Deactivated successfully. lb # [ 63.204615] systemd[1]: session-19.scope: Deactivated successfully. lb # [ 63.206074] systemd[1]: session-19.scope: Consumed 16ms CPU time over 36ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 63.209700] systemd-logind[553]: Session 19 logged out. Waiting for processes to exit. lb # [ 63.211639] systemd-logind[553]: Removed session 19. worker1 # [ 63.292575] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 63.300366] systemd[1]: Started SSH per-connection Daemon (vsock:2:9). worker1 # [ 63.365303] sshd-session[1276]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 63.369828] sshd-session[1276]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 63.374598] sshd-session[1276]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 63.387056] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 63.392298] systemd-logind[608]: New session '11' of user 'root' with class 'user' and type 'tty'. worker1 # [ 63.408097] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 63.412245] systemd[1]: Starting User Manager for UID 0... worker1 # [ 63.425896] (systemd)[1284]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 63.429652] systemd-logind[608]: New session '12' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 63.502743] systemd[1284]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 63.567962] systemd[1284]: Queued start job for default target Main User Target. worker1 # [ 63.570690] systemd[1284]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 63.572911] systemd[1284]: Created slice User Application Slice. worker1 # [ 63.574129] systemd[1284]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 63.575092] systemd[1284]: Reached target Paths. worker1 # [ 63.575795] systemd[1284]: Reached target Timers. worker1 # [ 63.577717] systemd[1284]: Starting D-Bus User Message Bus Socket... worker1 # [ 63.579958] systemd[1284]: Starting Create User Files and Directories... worker1 # [ 63.603963] systemd[1284]: Finished Create User Files and Directories. worker1 # [ 63.607939] systemd[1284]: Listening on D-Bus User Message Bus Socket. worker1 # [ 63.609364] systemd[1284]: Reached target Sockets. worker1 # [ 63.610493] systemd[1284]: Reached target Basic System. worker1 # [ 63.611376] systemd[1284]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 63.614146] systemd[1284]: Reached target Main User Target. worker1 # [ 63.614929] systemd[1284]: Startup finished in 170ms. worker1 # [ 63.615704] systemd[1]: Started User Manager for UID 0. worker1 # [ 63.617350] systemd[1]: Started Session 11 of User root. worker1 # [ 63.630081] sshd-session[1297]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 63.631385] sshd-session[1297]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 63.632639] sshd-session[1276]: pam_unix(sshd:session): session closed for user root worker1 # [ 63.635523] systemd[1]: sshd-vsock@9-10-5:22-2:9.service: Deactivated successfully. worker1 # [ 63.638990] systemd[1]: session-11.scope: Deactivated successfully. worker1 # [ 63.642153] systemd-logind[608]: Session 11 logged out. Waiting for processes to exit. worker1 # [ 63.644144] systemd-logind[608]: Removed session 11. worker1 # [ 63.689383] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 63.693178] systemd[1]: Started SSH per-connection Daemon (vsock:2:10). worker1 # [ 63.736591] sshd-session[1302]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 63.741198] sshd-session[1302]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 63.745778] sshd-session[1302]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 63.752068] systemd-logind[608]: New session '13' of user 'root' with class 'user' and type 'tty'. worker1 # [ 63.755399] systemd[1]: Started Session 13 of User root. worker1 # [ 63.777574] sshd-session[1308]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 63.778874] sshd-session[1308]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 63.780139] sshd-session[1302]: pam_unix(sshd:session): session closed for user root worker1 # [ 63.782898] systemd[1]: sshd-vsock@10-11-5:22-2:10.service: Deactivated successfully. worker1 # [ 63.786503] systemd[1]: session-13.scope: Deactivated successfully. worker1 # [ 63.787948] systemd[1]: session-13.scope: Consumed 15ms CPU time over 32ms wall clock time, 3.1M memory peak, 17.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 63.791748] systemd-logind[608]: Session 13 logged out. Waiting for processes to exit. worker1 # [ 63.793182] systemd-logind[608]: Removed session 13. worker1 # [ 63.891558] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 63.900153] systemd[1]: Started SSH per-connection Daemon (vsock:2:11). worker1 # [ 63.958965] sshd-session[1313]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 63.963911] sshd-session[1313]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 63.968912] sshd-session[1313]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 63.975334] systemd-logind[608]: New session '14' of user 'root' with class 'user' and type 'tty'. worker1 # [ 63.978360] systemd[1]: Started Session 14 of User root. worker1 # [ 63.999791] sshd-session[1319]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 64.001458] sshd-session[1319]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 64.002699] sshd-session[1313]: pam_unix(sshd:session): session closed for user root worker1 # [ 64.005675] systemd[1]: sshd-vsock@11-12-5:22-2:11.service: Deactivated successfully. worker1 # [ 64.009315] systemd[1]: session-14.scope: Deactivated successfully. worker1 # [ 64.012312] systemd-logind[608]: Session 14 logged out. Waiting for processes to exit. worker1 # [ 64.014247] systemd-logind[608]: Removed session 14. worker2 # [ 64.092698] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 64.100978] systemd[1]: Started SSH per-connection Daemon (vsock:2:5). worker2 # [ 64.168305] sshd-session[1199]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 64.173290] sshd-session[1199]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 64.178335] sshd-session[1199]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 64.191147] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 64.197558] systemd-logind[555]: New session '7' of user 'root' with class 'user' and type 'tty'. worker2 # [ 64.213270] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 64.216989] systemd[1]: Starting User Manager for UID 0... worker2 # [ 64.233073] (systemd)[1207]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 64.237452] systemd-logind[555]: New session '8' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 64.311897] systemd[1207]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 64.381373] systemd[1207]: Queued start job for default target Main User Target. worker2 # [ 64.383619] systemd[1207]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 64.385951] systemd[1207]: Created slice User Application Slice. worker2 # [ 64.387062] systemd[1207]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 64.387984] systemd[1207]: Reached target Paths. worker2 # [ 64.389123] systemd[1207]: Reached target Timers. worker2 # [ 64.391076] systemd[1207]: Starting D-Bus User Message Bus Socket... worker2 # [ 64.392821] systemd[1207]: Starting Create User Files and Directories... worker2 # [ 64.418184] systemd[1207]: Finished Create User Files and Directories. worker2 # [ 64.421144] systemd[1207]: Listening on D-Bus User Message Bus Socket. worker2 # [ 64.422309] systemd[1207]: Reached target Sockets. worker2 # [ 64.423289] systemd[1207]: Reached target Basic System. worker2 # [ 64.424033] systemd[1207]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 64.426136] systemd[1207]: Reached target Main User Target. worker2 # [ 64.426834] systemd[1207]: Startup finished in 175ms. worker2 # [ 64.429083] systemd[1]: Started User Manager for UID 0. worker2 # [ 64.430427] systemd[1]: Started Session 7 of User root. worker2 # [ 64.443624] sshd-session[1220]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 64.445343] sshd-session[1220]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 64.446615] sshd-session[1199]: pam_unix(sshd:session): session closed for user root worker2 # [ 64.449392] systemd[1]: sshd-vsock@5-6-6:22-2:5.service: Deactivated successfully. worker2 # [ 64.453169] systemd[1]: session-7.scope: Deactivated successfully. worker2 # [ 64.456086] systemd-logind[555]: Session 7 logged out. Waiting for processes to exit. worker2 # [ 64.458246] systemd-logind[555]: Removed session 7. worker2 # [ 64.490525] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 64.494175] systemd[1]: Started SSH per-connection Daemon (vsock:2:6). worker2 # [ 64.539440] sshd-session[1225]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 64.544151] sshd-session[1225]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 64.549851] sshd-session[1225]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 64.556075] systemd-logind[555]: New session '9' of user 'root' with class 'user' and type 'tty'. worker2 # [ 64.559410] systemd[1]: Started Session 9 of User root. worker2 # [ 64.581396] sshd-session[1231]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 64.583141] sshd-session[1231]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 64.584467] sshd-session[1225]: pam_unix(sshd:session): session closed for user root worker2 # [ 64.587230] systemd[1]: sshd-vsock@6-7-6:22-2:6.service: Deactivated successfully. worker2 # [ 64.590898] systemd[1]: session-9.scope: Deactivated successfully. worker2 # [ 64.594158] systemd-logind[555]: Session 9 logged out. Waiting for processes to exit. worker2 # [ 64.595659] systemd-logind[555]: Removed session 9. lb # [ 64.702556] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 64.709148] systemd[1]: Started SSH per-connection Daemon (vsock:2:17). lb # [ 64.779716] sshd-session[1286]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 64.784789] sshd-session[1286]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 64.790306] sshd-session[1286]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 64.796261] systemd-logind[553]: New session '20' of user 'root' with class 'user' and type 'tty'. lb # [ 64.800412] systemd[1]: Started Session 20 of User root. lb # [ 64.826114] sshd-session[1292]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 64.827792] sshd-session[1292]: Disconnected from user root UNKNOWN port 65535 lb # [ 64.829155] sshd-session[1286]: pam_unix(sshd:session): session closed for user root lb # [ 64.832298] systemd[1]: sshd-vsock@17-18-4:22-2:17.service: Deactivated successfully. lb # [ 64.836145] systemd[1]: session-20.scope: Deactivated successfully. lb # [ 64.837626] systemd[1]: session-20.scope: Consumed 16ms CPU time over 36ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 64.841194] systemd-logind[553]: Session 20 logged out. Waiting for processes to exit. lb # [ 64.842882] systemd-logind[553]: Removed session 20. worker1 # [ 64.900967] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 64.908404] systemd[1]: Started SSH per-connection Daemon (vsock:2:12). worker1 # [ 64.976468] sshd-session[1325]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 64.980831] sshd-session[1325]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 64.985513] sshd-session[1325]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 64.991924] systemd-logind[608]: New session '15' of user 'root' with class 'user' and type 'tty'. worker1 # [ 64.994374] systemd[1]: Started Session 15 of User root. worker1 # [ 65.015843] sshd-session[1331]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 65.017526] sshd-session[1331]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 65.018713] sshd-session[1325]: pam_unix(sshd:session): session closed for user root worker1 # [ 65.021451] systemd[1]: sshd-vsock@12-13-5:22-2:12.service: Deactivated successfully. worker1 # [ 65.025318] systemd[1]: session-15.scope: Deactivated successfully. worker1 # [ 65.026648] systemd[1]: session-15.scope: Consumed 15ms CPU time over 31ms wall clock time, 3.1M memory peak, 17.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 65.029974] systemd-logind[608]: Session 15 logged out. Waiting for processes to exit. worker1 # [ 65.031806] systemd-logind[608]: Removed session 15. client # [ 65.094947] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 65.103398] systemd[1]: Started SSH per-connection Daemon (vsock:2:15). client # [ 65.166207] sshd-session[1083]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 65.171117] sshd-session[1083]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 65.176237] sshd-session[1083]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 65.183477] systemd-logind[465]: New session '17' of user 'root' with class 'user' and type 'tty'. client # [ 65.186365] systemd[1]: Started Session 17 of User root. client # [ 65.199275] sshd-session[1089]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 65.200544] sshd-session[1089]: Disconnected from user root UNKNOWN port 65535 client # [ 65.201739] sshd-session[1083]: pam_unix(sshd:session): session closed for user root client # [ 65.204775] systemd[1]: sshd-vsock@15-16-3:22-2:15.service: Deactivated successfully. client # [ 65.208630] systemd[1]: session-17.scope: Deactivated successfully. client # [ 65.212138] systemd-logind[465]: Session 17 logged out. Waiting for processes to exit. client # [ 65.214214] systemd-logind[465]: Removed session 17. client # [ 65.294336] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 65.298796] systemd[1]: Started SSH per-connection Daemon (vsock:2:16). client # [ 65.351736] sshd-session[1094]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 65.356728] sshd-session[1094]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 65.361931] sshd-session[1094]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 65.368715] systemd-logind[465]: New session '18' of user 'root' with class 'user' and type 'tty'. client # [ 65.371253] systemd[1]: Started Session 18 of User root. client # [ 65.392421] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.pem&client-key=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.key" --eval-store auto -f /nix/store/1d7a42y6p1ncxd03bdnj6lvs5y0kwr7g-slow.nix --argstr tag sw. client # [ 65.400598] sshd-session[1100]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 65.401811] sshd-session[1100]: Disconnected from user root UNKNOWN port 65535 client # [ 65.403488] sshd-session[1094]: pam_unix(sshd:session): session closed for user root client # [ 65.408218] systemd[1]: sshd-vsock@16-17-3:22-2:16.service: Deactivated successfully. client # [ 65.412150] systemd[1]: session-18.scope: Deactivated successfully. client # [ 65.416157] systemd-logind[465]: Session 18 logged out. Waiting for processes to exit. client # [ 65.419717] systemd-logind[465]: Removed session 18. worker1 # [ 65.502276] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 65.511292] systemd[1]: Started SSH per-connection Daemon (vsock:2:13). worker2 # [ 65.545542] nix-grpc-daemon[820]: ts=2026-11-07T15:08:40Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:43034 client # [ 65.547316] nix[1103]: don't know how to build these paths: client # [ 65.548629] nix[1103]: /nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker1 # [ 65.555535] nix-grpc-daemon[529]: ts=2026-11-07T15:08:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 65.558793] garage[913]: 2026-11-07T15:08:40.826046Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo lb # [ 65.566634] garage[913]: 2026-11-07T15:08:40.833194Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 65.571968] nix-grpc-daemon[820]: ts=2026-11-07T15:08:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:43034 lb # [ 65.577204] garage[913]: 2026-11-07T15:08:40.844831Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 65.582855] sshd-session[1336]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 65.582867] garage[913]: 2026-11-07T15:08:40.845279Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 65.587707] sshd-session[1336]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 65.592807] sshd-session[1336]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 65.591685] garage[913]: 2026-11-07T15:08:40.859440Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker1 # [ 65.597895] systemd-logind[608]: New session '16' of user 'root' with class 'user' and type 'tty'. lb # [ 65.597367] garage[913]: 2026-11-07T15:08:40.859915Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 65.602389] systemd[1]: Started Session 16 of User root. worker1 # [ 65.608304] nix-grpc-daemon[529]: ts=2026-11-07T15:08:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 65.611607] garage[913]: 2026-11-07T15:08:40.878861Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo lb # [ 65.617695] garage[913]: 2026-11-07T15:08:40.879391Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found client # [ 65.621431] nix[1103]: copying 1 paths to 'lb:50051'... worker1 # [ 65.630516] sshd-session[1342]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 65.624086] nix[1103]: copying path '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' to 'lb:50051'... worker1 # [ 65.631872] sshd-session[1342]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 65.625186] nix-grpc-daemon[820]: ts=2026-11-07T15:08:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43034 worker1 # [ 65.633661] sshd-session[1336]: pam_unix(sshd:session): session closed for user root worker1 # [ 65.636723] systemd[1]: sshd-vsock@13-14-5:22-2:13.service: Deactivated successfully. worker1 # [ 65.640538] systemd[1]: session-16.scope: Deactivated successfully. worker2 # [ 65.638864] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker1 # [ 65.643789] systemd-logind[608]: Session 16 logged out. Waiting for processes to exit. worker1 # [ 65.645958] systemd-logind[608]: Removed session 16. worker2 # [ 65.654264] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) worker2 # [ 65.701149] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 65.708073] systemd[1]: Started SSH per-connection Daemon (vsock:2:7). worker2 # [ 65.777079] nix-daemon[986]: accepted connection from pid 1241, user nix-grpc-daemon (trusted) worker2 # [ 65.798915] nix-daemon[986]: reaped child process 1245, status = succeeded lb # [ 65.801207] niks3-server[963]: 2026/11/07 15:08:41 INFO Received push request method=POST path=/api/pushes worker2 # [ 65.813951] nix-grpc-daemon[1033]: time=2026-11-07T15:08:41.026Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 65.815599] nix-grpc-daemon[1033]: time=2026-11-07T15:08:41.028Z level=INFO msg="Uploading q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv (416B)" worker2 # [ 65.823625] sshd-session[1242]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 65.828142] sshd-session[1242]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 65.820119] garage[913]: 2026-11-07T15:08:41.088356Z INFO garage_api_common::generic_server: 192.168.1.4:52828 PUT /farm/nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150841Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cd50fe0cd30af71d3c19fcb8e9aa95c9e92083f9ac553cb6f863f0287ff0a2b5 worker2 # [ 65.833941] sshd-session[1242]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 65.840246] systemd-logind[555]: New session '10' of user 'root' with class 'user' and type 'tty'. worker2 # [ 65.843272] systemd[1]: Started Session 10 of User root. lb # [ 65.835641] garage[913]: 2026-11-07T15:08:41.102737Z INFO garage_api_common::generic_server: 192.168.1.4:52818 PUT /farm/q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150841Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45e638cac27fe5fd2409ad5048c6c92a756f2a65f525a2f4f8477d4f4a6b475f lb # [ 65.846845] garage[913]: 2026-11-07T15:08:41.115267Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst lb # [ 65.857051] niks3-server[963]: 2026/11/07 15:08:41 INFO Received sign narinfos request method=POST path=/api/pushes/18/sign lb # [ 65.863135] garage[913]: 2026-11-07T15:08:41.130881Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls worker2 # [ 65.869359] nix-grpc-daemon[1033]: time=2026-11-07T15:08:41.081Z level=INFO msg="Uploading 1 narinfos" lb # [ 65.868559] niks3-server[963]: 2026/11/07 15:08:41 INFO Registered completed upload object_key=nar/1rby34xp94wipnqa4abnh2771jnqp34zv82lymaabrhj07vmwiix.nar.zst worker2 # [ 65.871949] sshd-session[1252]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 65.873220] niks3-server[963]: 2026/11/07 15:08:41 INFO Signed narinfos id=18 count=1 worker2 # [ 65.873684] sshd-session[1252]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 65.875030] sshd-session[1242]: pam_unix(sshd:session): session closed for user root worker2 # [ 65.878200] systemd[1]: sshd-vsock@7-8-6:22-2:7.service: Deactivated successfully. worker2 # [ 65.881573] systemd[1]: session-10.scope: Deactivated successfully. lb # [ 65.875941] garage[913]: 2026-11-07T15:08:41.143850Z INFO garage_api_common::generic_server: 192.168.1.4:52818 PUT /farm/q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150841Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a660db115f44512879eede8d2fc8188bcc4e6d98872e775d9af728594766af58 lb # [ 65.884854] niks3-server[963]: 2026/11/07 15:08:41 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.ls worker2 # [ 65.884869] systemd-logind[555]: Session 10 logged out. Waiting for processes to exit. worker2 # [ 65.887207] systemd-logind[555]: Removed session 10. lb # [ 65.888210] niks3-server[963]: 2026/11/07 15:08:41 INFO Received complete push request method=POST path=/api/pushes/18/complete lb # [ 65.891128] garage[913]: 2026-11-07T15:08:41.159244Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo lb # [ 65.896458] niks3-server[963]: 2026/11/07 15:08:41 INFO Completed push id=18 objects=3 duration=8.320332ms worker2 # [ 65.895166] nix-grpc-daemon[1033]: time=2026-11-07T15:08:41.107Z level=INFO msg="Upload complete. (229ms)" worker2 # [ 65.897189] nix-grpc-daemon[820]: ts=2026-11-07T15:08:41Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:43034 duration_s=0 paths=1 nar_bytes_in=416 lb # [ 65.903064] niks3-server[963]: 2026/11/07 15:08:41 INFO Registered completed upload object_key=q9pl41yvj7mi4fqnyiarzy5py0107h7b.narinfo worker2 # [ 65.903663] nix-daemon[986]: reaped child process 1237, status = succeeded worker1 # [ 65.909194] nix-grpc-daemon[529]: ts=2026-11-07T15:08:41Z level=debug event=want client=8 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv cached=0 worker2 # [ 65.912210] nix-grpc-daemon[820]: ts=2026-11-07T15:08:41Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43034 worker1 # [ 65.913942] nix-grpc-daemon[529]: ts=2026-11-07T15:08:41Z level=debug event=assigned drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv worker=192.168.1.4:50051 clients=1 worker2 # [ 65.916935] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) client # [ 65.920617] nix[1103]: building '/nix/store/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv' on lb:50051... worker2 # [ 65.922665] nix-daemon[986]: accepted connection from pid 820, user nix-grpc-daemon (trusted) lb # [ 66.299107] garage[913]: 2026-11-07T15:08:41.566604Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo lb # [ 66.304806] garage[913]: 2026-11-07T15:08:41.567226Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 66.406608] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 66.414399] systemd[1]: Started SSH per-connection Daemon (vsock:2:14). worker1 # [ 66.485606] sshd-session[1349]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 66.490121] sshd-session[1349]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 66.495899] sshd-session[1349]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 66.501339] systemd-logind[608]: New session '17' of user 'root' with class 'user' and type 'tty'. worker1 # [ 66.506341] systemd[1]: Started Session 17 of User root. worker1 # [ 66.529488] sshd-session[1355]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 66.530743] sshd-session[1355]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 66.532336] sshd-session[1349]: pam_unix(sshd:session): session closed for user root worker1 # [ 66.534860] systemd[1]: sshd-vsock@14-15-5:22-2:14.service: Deactivated successfully. worker1 # [ 66.538463] systemd[1]: session-17.scope: Deactivated successfully. worker1 # [ 66.541467] systemd-logind[608]: Session 17 logged out. Waiting for processes to exit. worker1 # [ 66.543245] systemd-logind[608]: Removed session 17. worker2 # [ 66.605192] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 66.609218] systemd[1]: Started SSH per-connection Daemon (vsock:2:8). worker2 # [ 66.688488] sshd-session[1276]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 66.695953] sshd-session[1276]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 66.704246] sshd-session[1276]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 66.712837] systemd-logind[555]: New session '11' of user 'root' with class 'user' and type 'tty'. worker2 # [ 66.714666] systemd[1]: Started Session 11 of User root. worker2 # [ 66.785200] sshd-session[1282]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 66.786466] sshd-session[1282]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 66.787541] sshd-session[1276]: pam_unix(sshd:session): session closed for user root worker2 # [ 66.797226] systemd[1]: sshd-vsock@8-9-6:22-2:8.service: Deactivated successfully. worker2 # [ 66.798444] systemd[1]: session-11.scope: Deactivated successfully. worker2 # [ 66.801889] systemd-logind[555]: Session 11 logged out. Waiting for processes to exit. worker1 # [ 66.806694] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 66.804480] systemd-logind[555]: Removed session 11. worker1 # [ 66.816441] systemd[1]: Started SSH per-connection Daemon (vsock:2:15). worker1 # [ 66.885973] sshd-session[1360]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 66.891118] sshd-session[1360]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 66.896765] sshd-session[1360]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 66.903076] systemd-logind[608]: New session '18' of user 'root' with class 'user' and type 'tty'. worker1 # [ 66.907349] systemd[1]: Started Session 18 of User root. worker1 # [ 66.930035] sshd-session[1366]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 66.931314] sshd-session[1366]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 66.932554] sshd-session[1360]: pam_unix(sshd:session): session closed for user root worker1 # [ 66.936220] systemd[1]: sshd-vsock@15-16-5:22-2:15.service: Deactivated successfully. worker1 # [ 66.939028] systemd[1]: session-18.scope: Deactivated successfully. worker1 # [ 66.941812] systemd-logind[608]: Session 18 logged out. Waiting for processes to exit. worker1 # [ 66.943871] systemd-logind[608]: Removed session 18. worker2 # [ 67.006095] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 67.008660] systemd[1]: Started SSH per-connection Daemon (vsock:2:9). worker2 # [ 67.083842] sshd-session[1287]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 67.089877] sshd-session[1287]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 67.097970] sshd-session[1287]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 67.107302] systemd-logind[555]: New session '12' of user 'root' with class 'user' and type 'tty'. worker2 # [ 67.109605] systemd[1]: Started Session 12 of User root. worker2 # [ 67.182358] sshd-session[1293]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 67.184454] sshd-session[1293]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 67.185479] sshd-session[1287]: pam_unix(sshd:session): session closed for user root worker2 # [ 67.192179] systemd[1]: sshd-vsock@9-10-6:22-2:9.service: Deactivated successfully. worker2 # [ 67.196713] systemd[1]: session-12.scope: Deactivated successfully. worker2 # [ 67.199631] systemd-logind[555]: Session 12 logged out. Waiting for processes to exit. worker2 # [ 67.207228] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 67.209092] systemd-logind[555]: Removed session 12. worker2 # [ 67.210306] systemd[1]: Started SSH per-connection Daemon (vsock:2:10). worker2 # [ 67.285621] sshd-session[1298]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 67.292061] sshd-session[1298]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 67.299462] sshd-session[1298]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 67.307868] systemd-logind[555]: New session '13' of user 'root' with class 'user' and type 'tty'. worker2 # [ 67.309897] systemd[1]: Started Session 13 of User root. lb # [ 68.572712] envoy[912]: conn peer=[2001:db8:1::1]:44214 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3598 tx=2314 ms=1472 lb # [ 68.576506] envoy[912]: conn peer=[2001:db8:1::1]:44262 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=437 tx=411 ms=26 lb # [ 68.579974] envoy[912]: conn peer=[2001:db8:1::1]:44266 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=330 ms=743 lb # [ 68.583507] envoy[912]: conn peer=[2001:db8:1::1]:44192 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3317 tx=2061 ms=2791 lb # [ 68.587274] envoy[912]: conn peer=[2001:db8:1::1]:44294 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=421 tx=329 ms=515 lb # [ 68.590769] envoy[912]: conn peer=[2001:db8:1::1]:44282 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=3266 tx=2057 ms=2110 worker2 # [ 69.464432] nixos[1307]: switching to system configuration /nix/store/qfc1563mm1d6y2j9ynl0kkvqp79aj66a-nixos-system-worker2-test worker2 # [ 69.470243] systemd[1]: Stopped target Local File Systems. worker2 # [ 69.471510] systemd[1]: Stopped target Remote File Systems. worker2 # [ 70.337827] systemd[1]: Reload requested from client PID 1307 ('.switch-to-conf') (unit session-13.scope)... worker2 # [ 70.339489] systemd[1]: Reloading... worker2 # [ 72.193284] systemd[1]: Reloading finished in 1850 ms. worker2 # [ 72.252481] systemd[1207]: Created slice User Core Session Slice. worker2 # [ 72.253873] systemd[1207]: Starting D-Bus User Message Bus... worker2 # [ 72.347465] dbus-broker-launch[1381]: Ignoring duplicate name 'org.freedesktop.import1' in service file '/nix/store/ng9h13d1wikyaz8rld7li056fvqxfmr1-system-path/share/dbus-1/services/org.freedesktop.import1.service' worker2 # [ 72.351314] dbus-broker-launch[1381]: Ignoring duplicate name 'org.freedesktop.machine1' in service file '/nix/store/ng9h13d1wikyaz8rld7li056fvqxfmr1-system-path/share/dbus-1/services/org.freedesktop.machine1.service' worker2 # [ 72.354090] dbus-broker-launch[1381]: Ignoring duplicate name 'org.freedesktop.portable1' in service file '/nix/store/ng9h13d1wikyaz8rld7li056fvqxfmr1-system-path/share/dbus-1/services/org.freedesktop.portable1.service' worker2 # [ 72.360759] dbus-broker-launch[1381]: Ignoring duplicate name 'org.freedesktop.systemd1' in service file '/nix/store/ng9h13d1wikyaz8rld7li056fvqxfmr1-system-path/share/dbus-1/services/org.freedesktop.systemd1.service' worker2 # [ 72.363302] systemd[1207]: Started D-Bus User Message Bus. worker2 # [ 72.364085] dbus-broker-launch[1381]: Policy to allow eavesdropping in /etc/dbus-1/session.conf +27: Eavesdropping is deprecated and ignored worker2 # [ 72.366548] dbus-broker-launch[1381]: Policy to allow eavesdropping in /etc/dbus-1/session.conf +29: Eavesdropping is deprecated and ignored worker2 # [ 72.370118] dbus-broker-launch[1381]: Ready worker2 # [ 72.689338] systemd[1207]: Reexecution requested from client PID 1380 ('switch-to-confi')... worker2 # [ 72.691179] systemd[1207]: Reexecuting. worker2 # [ 72.851574] systemd[1207]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 73.188481] systemd[1207]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 73.197479] systemd[1207]: Reload requested from client PID 1380 ('switch-to-confi')... worker2 # [ 73.199832] systemd[1207]: Reloading... worker2 # [ 73.593680] systemd[1207]: Reloading finished in 394 ms. worker2 # [ 73.599708] systemd[1207]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 73.604090] systemd[1207]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 73.610576] systemd[1207]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 73.630959] systemd[1]: Starting Re-setup tmpfiles on a system that is already running.... worker2 # [ 73.742216] systemd[1]: Finished Re-setup tmpfiles on a system that is already running.. worker2 # [ 73.745809] systemd[1]: Reached target Reactivate sysinit units. worker2 # [ 73.748355] dbus-broker-launch[525]: Caught SIGHUP, trigger reload. worker2 # [ 73.750353] systemd[1]: Reloading D-Bus System Message Bus... worker2 # [ 73.753496] systemd[1]: Reloading Nix worker-protocol over gRPC... worker2 # [ 73.778754] dbus-broker-launch[525]: Looking up NSS user entry for 'systemd-timesync'... worker2 # [ 73.780290] dbus-broker-launch[525]: NSS returned no entry for 'systemd-timesync' worker2 # [ 73.781627] dbus-broker-launch[525]: Invalid user-name in /nix/store/ng9h13d1wikyaz8rld7li056fvqxfmr1-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" worker2 # [ 73.786556] systemd[1]: Reloaded Nix worker-protocol over gRPC. worker2 # [ 73.798341] systemd[1]: Reloaded D-Bus System Message Bus. worker2 # [ 73.803473] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 73.805287] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki worker2 # [ 73.809931] systemd[1]: Reached target Local File Systems. worker2 # [ 73.814224] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore worker2 # [ 73.819389] systemd[1]: Starting Create SUID/SGID Wrappers... worker2 # [ 73.820476] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. worker2 # [ 73.822333] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 worker2 # [ 73.825421] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore worker2 # [ 73.826941] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 73.830366] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os worker2 # [ 73.834143] systemd[1]: Reached target Remote File Systems. worker2 # [ 73.973534] nix-grpc-daemon[820]: ts=2026-11-07T15:08:49Z level=info event=draining worker2 # [ 74.086069] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. worker2 # [ 74.089254] systemd[1]: Finished Create SUID/SGID Wrappers. worker2 # [ 74.092724] systemd[1]: Starting linger-users.service... worker2 # [ 74.093537] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 74.124712] systemd[1]: linger-users.service: Deactivated successfully. worker2 # [ 74.125771] systemd[1]: Finished linger-users.service. worker2 # [ 74.381063] nixos[1307]: finished switching to system configuration /nix/store/qfc1563mm1d6y2j9ynl0kkvqp79aj66a-nixos-system-worker2-test worker2 # [ 74.391378] sshd-session[1304]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 74.393180] sshd-session[1304]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 74.395414] sshd-session[1298]: pam_unix(sshd:session): session closed for user root worker2 # [ 74.401263] systemd[1]: sshd-vsock@10-11-6:22-2:10.service: Deactivated successfully. worker2 # [ 74.405819] systemd[1]: session-13.scope: Deactivated successfully. worker2 # [ 74.408377] systemd-logind[555]: Session 13 logged out. Waiting for processes to exit. worker2 # [ 74.414114] systemd-logind[555]: Removed session 13. worker2 # [ 74.421276] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 74.425167] systemd[1]: Started SSH per-connection Daemon (vsock:2:11). worker2 # [ 74.503795] sshd-session[1464]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 74.511041] sshd-session[1464]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 74.519241] sshd-session[1464]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 74.530856] systemd-logind[555]: New session '14' of user 'root' with class 'user' and type 'tty'. worker2 # [ 74.532166] systemd[1]: Started Session 14 of User root. worker2 # [ 74.607453] sshd-session[1470]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 74.609294] sshd-session[1470]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 74.610357] sshd-session[1464]: pam_unix(sshd:session): session closed for user root worker2 # [ 74.616798] systemd[1]: sshd-vsock@11-12-6:22-2:11.service: Deactivated successfully. worker2 # [ 74.621537] systemd[1]: session-14.scope: Deactivated successfully. worker2 # [ 74.626731] systemd-logind[555]: Session 14 logged out. Waiting for processes to exit. worker2 # [ 74.627829] systemd-logind[555]: Removed session 14. client # [ 74.718510] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 74.721835] systemd[1]: Started SSH per-connection Daemon (vsock:2:17). client # [ 74.770579] sshd-session[1116]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 74.775974] sshd-session[1116]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 74.781137] sshd-session[1116]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 74.788555] systemd-logind[465]: New session '19' of user 'root' with class 'user' and type 'tty'. client # [ 74.791443] systemd[1]: Started Session 19 of User root. worker1 # [ 74.924814] nix-grpc-daemon[529]: ts=2026-11-07T15:08:50Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 74.929470] nix-grpc-daemon[529]: ts=2026-11-07T15:08:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 74.933891] garage[913]: 2026-11-07T15:08:50.200805Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo lb # [ 74.943159] garage[913]: 2026-11-07T15:08:50.201413Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 74.947580] garage[913]: 2026-11-07T15:08:50.209658Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo lb # [ 74.954574] garage[913]: 2026-11-07T15:08:50.210857Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 74.958927] garage[913]: 2026-11-07T15:08:50.222295Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo lb # [ 74.964439] garage[913]: 2026-11-07T15:08:50.222773Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 74.973700] nix-grpc-daemon[529]: ts=2026-11-07T15:08:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 74.976820] garage[913]: 2026-11-07T15:08:50.244196Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo lb # [ 74.982471] garage[913]: 2026-11-07T15:08:50.244701Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 74.987868] garage[913]: 2026-11-07T15:08:50.255607Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo lb # [ 74.992415] garage[913]: 2026-11-07T15:08:50.255946Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 74.999529] nix-grpc-daemon[529]: ts=2026-11-07T15:08:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 75.001346] garage[913]: 2026-11-07T15:08:50.269305Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo lb # [ 75.005838] garage[913]: 2026-11-07T15:08:50.269692Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 75.011372] garage[913]: 2026-11-07T15:08:50.279806Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo lb # [ 75.015336] garage[913]: 2026-11-07T15:08:50.283748Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 75.021377] nix-grpc-daemon[529]: ts=2026-11-07T15:08:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 75.022620] garage[913]: 2026-11-07T15:08:50.290666Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo lb # [ 75.025162] garage[913]: 2026-11-07T15:08:50.290880Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 75.027601] garage[913]: 2026-11-07T15:08:50.295847Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo lb # [ 75.030090] garage[913]: 2026-11-07T15:08:50.296019Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 75.035785] nix-grpc-daemon[529]: ts=2026-11-07T15:08:50Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 75.037989] garage[913]: 2026-11-07T15:08:50.305792Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo lb # [ 75.040349] garage[913]: 2026-11-07T15:08:50.306004Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 75.042198] garage[913]: 2026-11-07T15:08:50.306068Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo lb # [ 75.044612] garage[913]: 2026-11-07T15:08:50.306219Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 75.046430] garage[913]: 2026-11-07T15:08:50.306267Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo lb # [ 75.048777] garage[913]: 2026-11-07T15:08:50.306392Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 75.055309] nix-grpc-daemon[529]: ts=2026-11-07T15:08:50Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 75.061635] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 75.069916] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) lb # [ 75.081865] systemd[1]: Stopping User Manager for UID 0... lb # [ 75.085783] systemd[1246]: Activating special unit Exit the Session... lb # [ 75.087628] systemd[1246]: Stopped target Main User Target. lb # [ 75.088955] systemd[1246]: Stopped target Basic System. lb # [ 75.091245] systemd[1246]: Stopped target Paths. lb # [ 75.092087] systemd[1246]: Stopped target Sockets. lb # [ 75.092797] systemd[1246]: Stopped target Timers. lb # [ 75.094232] systemd[1246]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 75.095708] systemd[1246]: Closed D-Bus User Message Bus Socket. lb # [ 75.096944] systemd[1246]: Stopped Create User Files and Directories. lb # [ 75.098530] systemd[1246]: Removed slice User Application Slice. lb # [ 75.099524] systemd[1246]: Reached target Shutdown. lb # [ 75.100444] systemd[1246]: Finished Exit the Session. lb # [ 75.101173] systemd[1246]: Reached target Exit the Session. lb # [ 75.106073] systemd-logind[553]: Removed session 17. lb # [ 75.109446] systemd[1]: user@0.service: Deactivated successfully. lb # [ 75.111327] systemd[1]: Stopped User Manager for UID 0. lb # [ 75.132324] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 75.148893] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 75.151256] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 75.152607] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 75.156087] nix-daemon[1026]: accepted connection from pid 1375, user nix-grpc-daemon (trusted) worker1 # [ 75.171441] nix-daemon[1026]: reaped child process 1378, status = succeeded lb # [ 75.174968] niks3-server[963]: 2026/11/07 15:08:50 INFO Received push request method=POST path=/api/pushes worker1 # [ 75.182376] nix-grpc-daemon[1057]: time=2026-11-07T15:08:50.490Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker1 # [ 75.187523] nix-grpc-daemon[1057]: time=2026-11-07T15:08:50.492Z level=INFO msg="Uploading s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv (528B)" worker1 # [ 75.189191] nix-grpc-daemon[1057]: time=2026-11-07T15:08:50.492Z level=INFO msg="Uploading w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv (768B)" lb # [ 75.185095] garage[913]: 2026-11-07T15:08:50.453021Z INFO garage_api_common::generic_server: 192.168.1.3:39818 PUT /farm/nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150850Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cbeb4b285230046e6133e5175b19ef99858da071378ba3b2a1838a83599eaa2f worker1 # [ 75.190703] nix-grpc-daemon[1057]: time=2026-11-07T15:08:50.492Z level=INFO msg="Uploading pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv (640B)" lb # [ 75.190711] garage[913]: 2026-11-07T15:08:50.459177Z INFO garage_api_common::generic_server: 192.168.1.3:39836 PUT /farm/pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150850Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=80d23408138764270f45787754c809356b0f157270f5d002d0e600d22d235a65 lb # [ 75.196474] garage[913]: 2026-11-07T15:08:50.464668Z INFO garage_api_common::generic_server: 192.168.1.3:39878 PUT /farm/nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150850Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=23ed539a5ef1880fc099bfc0b61736a56055d8d055bc2beca12514e35b8b6931 lb # [ 75.202022] garage[913]: 2026-11-07T15:08:50.470235Z INFO garage_api_common::generic_server: 192.168.1.3:39800 PUT /farm/nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150850Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fa7f93a6f6770e71386467f66af8e75b604952a1a2cbe19611da5c39dd2b00cf lb # [ 75.207248] garage[913]: 2026-11-07T15:08:50.475717Z INFO garage_api_common::generic_server: 192.168.1.3:39802 PUT /farm/s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150850Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=96c3080f84008071ab56a079e348b025312189a37be25f41d8a5e3d7d7a0dcce lb # [ 75.212479] garage[913]: 2026-11-07T15:08:50.480776Z INFO garage_api_common::generic_server: 192.168.1.3:39892 PUT /farm/w4kjbckcz25f2jivly0r4lbq18qf474f.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150850Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=981dd87dfcdb485a6e8995db2adf9dae043fb43a8b2ce7503321edf5cde13f8b lb # [ 75.220178] niks3-server[963]: 2026/11/07 15:08:50 INFO Received sign narinfos request method=POST path=/api/pushes/19/sign lb # [ 75.221636] garage[913]: 2026-11-07T15:08:50.488025Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 75.224054] garage[913]: 2026-11-07T15:08:50.488283Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 75.228295] garage[913]: 2026-11-07T15:08:50.496304Z INFO garage_api_common::generic_server: 127.0.0.1:56814 (key GK0123456789abcdef01234567) HEAD /farm/w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 75.231474] garage[913]: 2026-11-07T15:08:50.499793Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 75.234477] garage[913]: 2026-11-07T15:08:50.502945Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) HEAD /farm/s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 75.238965] niks3-server[963]: 2026/11/07 15:08:50 INFO Signed narinfos id=19 count=3 worker1 # [ 75.240370] nix-grpc-daemon[1057]: time=2026-11-07T15:08:50.548Z level=INFO msg="Uploading 3 narinfos" lb # [ 75.239985] garage[913]: 2026-11-07T15:08:50.507140Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 75.243703] niks3-server[963]: 2026/11/07 15:08:50 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.ls lb # [ 75.245179] garage[913]: 2026-11-07T15:08:50.507419Z INFO garage_api_common::generic_server: 192.168.1.3:39892 PUT /farm/s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150850Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=94c5487aa4e2982e6e58397e98007531b451dc1b2c3ac95868eb97b061993334 lb # [ 75.250079] garage[913]: 2026-11-07T15:08:50.518328Z INFO garage_api_common::generic_server: 192.168.1.3:39802 PUT /farm/pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150850Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b50b443d0b149a5319482c30fd910bce748ab2ab1a3652fdc7aeb347eb215ff1 lb # [ 75.255507] niks3-server[963]: 2026/11/07 15:08:50 INFO Registered completed upload object_key=nar/0n1m04akn0svzkx0szkj4q7kvaw06fa9yx6k2jibkbkkv85mm55n.nar.zst lb # [ 75.258774] niks3-server[963]: 2026/11/07 15:08:50 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.ls lb # [ 75.261374] niks3-server[963]: 2026/11/07 15:08:50 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.ls lb # [ 75.263028] garage[913]: 2026-11-07T15:08:50.529624Z INFO garage_api_common::generic_server: 192.168.1.3:39878 PUT /farm/w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150850Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae2f9a1a2c06e7cfd7d1ef1f8c8bc821870fcf9d7b5ca2ead1253e1127a49e64 lb # [ 75.271037] niks3-server[963]: 2026/11/07 15:08:50 INFO Registered completed upload object_key=nar/1crrgw2l7pdmf28ls634k8y85m0pc1v13pxxp4rd6yg5mk3kr5fs.nar.zst lb # [ 75.272780] niks3-server[963]: 2026/11/07 15:08:50 INFO Received complete push request method=POST path=/api/pushes/19/complete lb # [ 75.274226] garage[913]: 2026-11-07T15:08:50.538963Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo lb # [ 75.276650] garage[913]: 2026-11-07T15:08:50.539198Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo lb # [ 75.279978] niks3-server[963]: 2026/11/07 15:08:50 INFO Registered completed upload object_key=nar/111ql9hf3mg62sp5fwspqwm8cl88198mlcc1ij8flm7l424sz63r.nar.zst lb # [ 75.282952] niks3-server[963]: 2026/11/07 15:08:50 INFO Registered completed upload object_key=pmcfhwqsl1hiyc8gjd850vixdadvskwn.narinfo lb # [ 75.285694] garage[913]: 2026-11-07T15:08:50.553687Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo lb # [ 75.288660] niks3-server[963]: 2026/11/07 15:08:50 INFO Registered completed upload object_key=s7lncxagqa332zn7mhwmk3ry9d83sbvq.narinfo lb # [ 75.291394] niks3-server[963]: 2026/11/07 15:08:50 INFO Completed push id=19 objects=9 duration=21.835178ms worker1 # [ 75.293140] nix-grpc-daemon[1057]: time=2026-11-07T15:08:50.601Z level=INFO msg="Upload complete. (218ms)" lb # [ 75.293399] niks3-server[963]: 2026/11/07 15:08:50 INFO Registered completed upload object_key=w4kjbckcz25f2jivly0r4lbq18qf474f.narinfo worker1 # [ 75.295627] nix-grpc-daemon[529]: ts=2026-11-07T15:08:50Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=0 paths=3 nar_bytes_in=1936 worker1 # [ 75.303618] nix-grpc-daemon[529]: ts=2026-11-07T15:08:50Z level=debug event=want client=9 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv cached=0 worker1 # [ 75.305626] nix-grpc-daemon[529]: ts=2026-11-07T15:08:50Z level=debug event=assigned drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 75.307962] nix-grpc-daemon[529]: ts=2026-11-07T15:08:50Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 75.312579] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 75.314884] nix-daemon[1026]: reaped child process 1371, status = succeeded worker1 # [ 75.320151] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) lb # [ 76.358792] garage[913]: 2026-11-07T15:08:51.624951Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo lb # [ 76.364547] garage[913]: 2026-11-07T15:08:51.626692Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 76.536622] nix-daemon[1026]: reaped child process 1385, status = succeeded worker1 # [ 76.610528] nix-daemon[1026]: accepted connection from pid 1402, user nix-grpc-daemon (trusted) worker1 # [ 76.624307] nix-daemon[1026]: reaped child process 1405, status = succeeded lb # [ 76.629648] niks3-server[963]: 2026/11/07 15:08:51 INFO Received push request method=POST path=/api/pushes worker1 # [ 76.639610] nix-grpc-daemon[1057]: time=2026-11-07T15:08:51.948Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 76.641127] nix-grpc-daemon[1057]: time=2026-11-07T15:08:51.949Z level=INFO msg="Uploading zhl4afvdy7vs34m6ngc3z1xk04qgpcfs-farm-a (136B)" lb # [ 76.646870] garage[913]: 2026-11-07T15:08:51.914618Z INFO garage_api_common::generic_server: 192.168.1.3:39802 PUT /farm/nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150851Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c4e1b842ba26ddbd6de7de88e7a3460effe2ecc290875ea6fa47908bfbb69ccf lb # [ 76.659788] garage[913]: 2026-11-07T15:08:51.927725Z INFO garage_api_common::generic_server: 192.168.1.3:39878 PUT /farm/log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150851Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4d8885552b383df6ad1f03ad6d73b81abaa5a75cf1f0e0e5ddabe72637743709 lb # [ 76.674498] garage[913]: 2026-11-07T15:08:51.942264Z INFO garage_api_common::generic_server: 192.168.1.3:39892 PUT /farm/zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150851Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5c305aa48aae0a8b5587d67e500c6ae1294574cae45657e945b3079ce917352c lb # [ 76.689451] garage[913]: 2026-11-07T15:08:51.957289Z INFO garage_api_common::generic_server: 127.0.0.1:57858 (key GK0123456789abcdef01234567) HEAD /farm/nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 76.695382] niks3-server[963]: 2026/11/07 15:08:51 INFO Received sign narinfos request method=POST path=/api/pushes/20/sign lb # [ 76.701822] garage[913]: 2026-11-07T15:08:51.968435Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) HEAD /farm/zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 76.706221] garage[913]: 2026-11-07T15:08:51.968992Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 76.710818] niks3-server[963]: 2026/11/07 15:08:51 INFO Signed narinfos id=20 count=1 worker1 # [ 76.712729] nix-grpc-daemon[1057]: time=2026-11-07T15:08:52.021Z level=INFO msg="Uploading 1 narinfos" lb # [ 76.713058] niks3-server[963]: 2026/11/07 15:08:51 INFO Registered completed upload object_key=nar/0r0px9vw070lid3q4jhnmka11sk2y8kj26ysyvjy9dplavd7mdz4.nar.zst lb # [ 76.714806] garage[913]: 2026-11-07T15:08:51.981123Z INFO garage_api_common::generic_server: 192.168.1.3:39892 PUT /farm/zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150851Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ba6040b6ce181297aa856b07adfa94ac822daac2f38a2774d7632158fa78283e lb # [ 76.721050] niks3-server[963]: 2026/11/07 15:08:51 INFO Received complete push request method=POST path=/api/pushes/20/complete lb # [ 76.722695] niks3-server[963]: 2026/11/07 15:08:51 INFO Registered completed upload object_key=log/s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv lb # [ 76.725821] garage[913]: 2026-11-07T15:08:51.993820Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) HEAD /farm/zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo lb # [ 76.728838] niks3-server[963]: 2026/11/07 15:08:51 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.ls lb # [ 76.730697] niks3-server[963]: 2026/11/07 15:08:51 INFO Registered completed upload object_key=zhl4afvdy7vs34m6ngc3z1xk04qgpcfs.narinfo lb # [ 76.732459] niks3-server[963]: 2026/11/07 15:08:52 INFO Completed push id=20 objects=4 duration=11.916878ms worker1 # [ 76.734315] nix-grpc-daemon[1057]: time=2026-11-07T15:08:52.042Z level=INFO msg="Upload complete. (206ms)" worker1 # [ 76.741848] nix-grpc-daemon[529]: ts=2026-11-07T15:08:52Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=1 drv=s7lncxagqa332zn7mhwmk3ry9d83sbvq-farm-a.drv assign_id=11 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 76.754506] nix-grpc-daemon[529]: ts=2026-11-07T15:08:52Z level=debug event=want client=9 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv cached=0 worker1 # [ 76.760294] nix-grpc-daemon[529]: ts=2026-11-07T15:08:52Z level=debug event=assigned drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 76.766284] nix-grpc-daemon[529]: ts=2026-11-07T15:08:52Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 76.774391] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 76.782406] nix-daemon[1026]: reaped child process 1383, status = succeeded worker1 # [ 76.786748] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 77.132370] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 77.136546] systemd[1284]: Activating special unit Exit the Session... worker1 # [ 77.141283] systemd[1284]: Stopped target Main User Target. worker1 # [ 77.144930] systemd[1284]: Stopped target Basic System. worker1 # [ 77.147528] systemd[1284]: Stopped target Paths. worker1 # [ 77.151428] systemd[1284]: Stopped target Sockets. worker1 # [ 77.154354] systemd[1284]: Stopped target Timers. worker1 # [ 77.157447] systemd[1284]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 77.160879] systemd[1284]: Closed D-Bus User Message Bus Socket. worker1 # [ 77.165167] systemd[1284]: Stopped Create User Files and Directories. worker1 # [ 77.167860] systemd[1284]: Removed slice User Application Slice. worker1 # [ 77.173212] systemd[1284]: Reached target Shutdown. worker1 # [ 77.176934] systemd[1284]: Finished Exit the Session. worker1 # [ 77.181434] systemd[1284]: Reached target Exit the Session. worker1 # [ 77.185300] systemd-logind[608]: Removed session 12. worker1 # [ 77.186813] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 77.191376] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 77.201562] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 77.221555] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 77.223414] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 77.225060] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 77.791894] garage[913]: 2026-11-07T15:08:53.059412Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) HEAD /farm/l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo lb # [ 77.800565] garage[913]: 2026-11-07T15:08:53.067852Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 78.003218] nix-daemon[1026]: reaped child process 1412, status = succeeded worker1 # [ 78.078173] nix-daemon[1026]: accepted connection from pid 1432, user nix-grpc-daemon (trusted) worker1 # [ 78.091911] nix-daemon[1026]: reaped child process 1435, status = succeeded lb # [ 78.098389] niks3-server[963]: 2026/11/07 15:08:53 INFO Received push request method=POST path=/api/pushes worker1 # [ 78.110121] nix-grpc-daemon[1057]: time=2026-11-07T15:08:53.418Z level=INFO msg="Uploading 1 paths to lb (1 already cached)" worker1 # [ 78.111717] nix-grpc-daemon[1057]: time=2026-11-07T15:08:53.420Z level=INFO msg="Uploading l458nfm9f1f1zyghsy09ijx02qwk7v65-farm-b (184B)" lb # [ 78.116642] garage[913]: 2026-11-07T15:08:53.384198Z INFO garage_api_common::generic_server: 192.168.1.3:39892 PUT /farm/log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150853Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=84cfd817e1c6917d3815e2e0a7309cb15a01343295ebd93ed2491ccde866cc8d lb # [ 78.129229] garage[913]: 2026-11-07T15:08:53.397637Z INFO garage_api_common::generic_server: 192.168.1.3:39802 PUT /farm/l458nfm9f1f1zyghsy09ijx02qwk7v65.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150853Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=67f55f1e62171fe0609367afcc5513c6a3025fbd0f33c2a10b9a192dac75a9ca lb # [ 78.142929] garage[913]: 2026-11-07T15:08:53.410824Z INFO garage_api_common::generic_server: 192.168.1.3:39878 PUT /farm/nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150853Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d06a9abe21c43f2f47da130756a75ee9b3a8c18f9e91a9d91becd9bc5917756b lb # [ 78.160640] garage[913]: 2026-11-07T15:08:53.428023Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) HEAD /farm/log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 78.165744] niks3-server[963]: 2026/11/07 15:08:53 INFO Received sign narinfos request method=POST path=/api/pushes/21/sign lb # [ 78.169675] niks3-server[963]: 2026/11/07 15:08:53 INFO Signed narinfos id=21 count=1 lb # [ 78.173460] garage[913]: 2026-11-07T15:08:53.441162Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst worker1 # [ 78.180893] nix-grpc-daemon[1057]: time=2026-11-07T15:08:53.489Z level=INFO msg="Uploading 1 narinfos" lb # [ 78.180383] garage[913]: 2026-11-07T15:08:53.448493Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 78.183431] garage[913]: 2026-11-07T15:08:53.451607Z INFO garage_api_common::generic_server: 192.168.1.3:39878 PUT /farm/l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150853Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=296fb8b5d225c49e65b699564b5a16ff7655b3ac00df209740b780e107cd0189 lb # [ 78.188298] niks3-server[963]: 2026/11/07 15:08:53 INFO Registered completed upload object_key=log/pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv lb # [ 78.191958] niks3-server[963]: 2026/11/07 15:08:53 INFO Received complete push request method=POST path=/api/pushes/21/complete lb # [ 78.193531] niks3-server[963]: 2026/11/07 15:08:53 INFO Registered completed upload object_key=nar/0m50ra4cd4i97vcbcrdsw7xn8f0b3zc5pdyr2ab8kmp3hscd8j80.nar.zst lb # [ 78.197038] niks3-server[963]: 2026/11/07 15:08:53 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.ls lb # [ 78.198623] garage[913]: 2026-11-07T15:08:53.465053Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo lb # [ 78.201447] niks3-server[963]: 2026/11/07 15:08:53 INFO Completed push id=21 objects=8 duration=9.835887ms worker1 # [ 78.203217] nix-grpc-daemon[1057]: time=2026-11-07T15:08:53.511Z level=INFO msg="Upload complete. (208ms)" lb # [ 78.203531] niks3-server[963]: 2026/11/07 15:08:53 INFO Registered completed upload object_key=l458nfm9f1f1zyghsy09ijx02qwk7v65.narinfo worker1 # [ 78.210596] nix-grpc-daemon[529]: ts=2026-11-07T15:08:53Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=1 drv=pmcfhwqsl1hiyc8gjd850vixdadvskwn-farm-b.drv assign_id=12 outputs=1 inputs=1 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 78.224629] nix-grpc-daemon[529]: ts=2026-11-07T15:08:53Z level=debug event=want client=9 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv cached=0 worker1 # [ 78.229585] nix-grpc-daemon[529]: ts=2026-11-07T15:08:53Z level=debug event=assigned drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 78.234603] nix-grpc-daemon[529]: ts=2026-11-07T15:08:53Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 78.246262] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 78.249824] nix-daemon[1026]: reaped child process 1410, status = succeeded worker1 # [ 78.254174] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) lb # [ 79.051701] garage[913]: 2026-11-07T15:08:54.317304Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo lb # [ 79.058075] garage[913]: 2026-11-07T15:08:54.319034Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 79.269937] nix-daemon[1026]: reaped child process 1442, status = succeeded worker1 # [ 79.343874] nix-daemon[1026]: accepted connection from pid 1458, user nix-grpc-daemon (trusted) worker1 # [ 79.357118] nix-daemon[1026]: reaped child process 1461, status = succeeded lb # [ 79.363224] niks3-server[963]: 2026/11/07 15:08:54 INFO Received push request method=POST path=/api/pushes worker1 # [ 79.375159] nix-grpc-daemon[1057]: time=2026-11-07T15:08:54.683Z level=INFO msg="Uploading 1 paths to lb (2 already cached)" worker1 # [ 79.376661] nix-grpc-daemon[1057]: time=2026-11-07T15:08:54.685Z level=INFO msg="Uploading 08ap9ki0d5gixmyr2sac4hj06j9jsqhg-farm-top (240B)" lb # [ 79.381568] garage[913]: 2026-11-07T15:08:54.649151Z INFO garage_api_common::generic_server: 192.168.1.3:39878 PUT /farm/log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150854Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aa9a69ae37433f90c022eaaffa211209a6fff74f1766cef4a02e2ff143138f5b lb # [ 79.395931] garage[913]: 2026-11-07T15:08:54.663240Z INFO garage_api_common::generic_server: 192.168.1.3:39892 PUT /farm/08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150854Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=afa4b64120e8d1a039d4a5bde6c9ce7f57b2ff5f2ea2c971a0f137a5e6dba12a lb # [ 79.409119] garage[913]: 2026-11-07T15:08:54.677031Z INFO garage_api_common::generic_server: 192.168.1.3:39802 PUT /farm/nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150854Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e75e31e79b35d1f712e7e807b53c00919be2de4519787b8b68dfe865f82b83fb lb # [ 79.424118] niks3-server[963]: 2026/11/07 15:08:54 INFO Received sign narinfos request method=POST path=/api/pushes/22/sign lb # [ 79.426794] garage[913]: 2026-11-07T15:08:54.692304Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv lb # [ 79.433919] garage[913]: 2026-11-07T15:08:54.701632Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 79.439617] garage[913]: 2026-11-07T15:08:54.708038Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) HEAD /farm/08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 79.444479] niks3-server[963]: 2026/11/07 15:08:54 INFO Signed narinfos id=22 count=1 lb # [ 79.446475] niks3-server[963]: 2026/11/07 15:08:54 INFO Registered completed upload object_key=log/w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv worker1 # [ 79.448219] nix-grpc-daemon[1057]: time=2026-11-07T15:08:54.756Z level=INFO msg="Uploading 1 narinfos" lb # [ 79.448684] garage[913]: 2026-11-07T15:08:54.716865Z INFO garage_api_common::generic_server: 192.168.1.3:39802 PUT /farm/08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150854Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b71e11dbe2de5ad7fd1033068c2c43fbf906a96461bc1013b2cece3ec1b03336 lb # [ 79.453802] niks3-server[963]: 2026/11/07 15:08:54 INFO Registered completed upload object_key=nar/01f0abadm30zaav33qck3x7ypr9nn6rqh2vbrvih4gyb8c26x9in.nar.zst lb # [ 79.456751] niks3-server[963]: 2026/11/07 15:08:54 INFO Received complete push request method=POST path=/api/pushes/22/complete lb # [ 79.459139] niks3-server[963]: 2026/11/07 15:08:54 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.ls lb # [ 79.462111] garage[913]: 2026-11-07T15:08:54.730138Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) HEAD /farm/08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo lb # [ 79.465051] niks3-server[963]: 2026/11/07 15:08:54 INFO Completed push id=22 objects=12 duration=6.390198ms worker1 # [ 79.466971] nix-grpc-daemon[1057]: time=2026-11-07T15:08:54.775Z level=INFO msg="Upload complete. (205ms)" lb # [ 79.467148] niks3-server[963]: 2026/11/07 15:08:54 INFO Registered completed upload object_key=08ap9ki0d5gixmyr2sac4hj06j9jsqhg.narinfo worker1 # [ 79.473696] nix-grpc-daemon[529]: ts=2026-11-07T15:08:54Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 duration_s=1 drv=w4kjbckcz25f2jivly0r4lbq18qf474f-farm-top.drv assign_id=13 outputs=1 inputs=2 inputs_fetched=0 input_bytes=0 input_s=0 worker1 # [ 79.490537] nix-daemon[1026]: reaped child process 1440, status = succeeded client # [ 79.507854] sshd-session[1122]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 79.511308] sshd-session[1122]: Disconnected from user root UNKNOWN port 65535 client # [ 79.514880] sshd-session[1116]: pam_unix(sshd:session): session closed for user root client # [ 79.527336] systemd[1]: sshd-vsock@17-18-3:22-2:17.service: Deactivated successfully. client # [ 79.533523] systemd[1]: session-19.scope: Deactivated successfully. client # [ 79.536373] systemd[1]: session-19.scope: Consumed 161ms CPU time over 4.743s wall clock time, 44.4M memory peak, 12.8K incoming IP traffic, 13.9K outgoing IP traffic. client # [ 79.542690] systemd-logind[465]: Session 19 logged out. Waiting for processes to exit. client # [ 79.546566] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 79.549770] systemd[1]: Started SSH per-connection Daemon (vsock:2:18). client # [ 79.552174] systemd-logind[465]: Removed session 19. client # [ 79.601377] sshd-session[1141]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 79.606474] sshd-session[1141]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 79.611685] sshd-session[1141]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 79.618319] systemd-logind[465]: New session '20' of user 'root' with class 'user' and type 'tty'. client # [ 79.622416] systemd[1]: Started Session 20 of User root. client # [ 79.733839] sshd-session[1147]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 79.735267] sshd-session[1147]: Disconnected from user root UNKNOWN port 65535 client # [ 79.736634] sshd-session[1141]: pam_unix(sshd:session): session closed for user root client # [ 79.739931] systemd[1]: sshd-vsock@18-19-3:22-2:18.service: Deactivated successfully. client # [ 79.744340] systemd[1]: session-20.scope: Deactivated successfully. client # [ 79.747759] systemd-logind[465]: Session 20 logged out. Waiting for processes to exit. client # [ 79.749976] systemd-logind[465]: Removed session 20. worker2 # [ 79.826796] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 79.832104] systemd[1]: Started SSH per-connection Daemon (vsock:2:12). worker2 # [ 79.912398] sshd-session[1475]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 79.919087] sshd-session[1475]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 79.927323] sshd-session[1475]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 79.936372] systemd-logind[555]: New session '15' of user 'root' with class 'user' and type 'tty'. worker2 # [ 79.939756] systemd[1]: Started Session 15 of User root. worker2 # [ 80.012969] sshd-session[1481]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 80.015314] sshd-session[1481]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 80.016350] sshd-session[1475]: pam_unix(sshd:session): session closed for user root worker2 # [ 80.018276] systemd[1]: sshd-vsock@12-13-6:22-2:12.service: Deactivated successfully. worker2 # [ 80.021719] systemd[1]: session-15.scope: Deactivated successfully. worker2 # [ 80.025124] systemd-logind[555]: Session 15 logged out. Waiting for processes to exit. worker2 # [ 80.026625] systemd-logind[555]: Removed session 15. client # [ 80.130658] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 80.138865] systemd[1]: Started SSH per-connection Daemon (vsock:2:19). worker2 # [ 80.173633] nix-daemon[986]: reaped child process 1260, status = succeeded client # [ 80.206531] sshd-session[1154]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 80.211625] sshd-session[1154]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 80.216728] sshd-session[1154]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 80.223238] systemd-logind[465]: New session '21' of user 'root' with class 'user' and type 'tty'. client # [ 80.226430] systemd[1]: Started Session 21 of User root. worker2 # [ 80.251172] nix-daemon[986]: accepted connection from pid 1487, user nix-grpc-daemon (trusted) client # [ 80.249833] sshd-session[1160]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 80.251635] sshd-session[1160]: Disconnected from user root UNKNOWN port 65535 client # [ 80.252912] sshd-session[1154]: pam_unix(sshd:session): session closed for user root client # [ 80.256139] systemd[1]: sshd-vsock@19-20-3:22-2:19.service: Deactivated successfully. client # [ 80.259747] systemd[1]: session-21.scope: Deactivated successfully. client # [ 80.262436] systemd-logind[465]: Session 21 logged out. Waiting for processes to exit. worker2 # [ 80.264418] nix-daemon[986]: reaped child process 1490, status = succeeded client # [ 80.264746] systemd-logind[465]: Removed session 21. lb # [ 80.273104] niks3-server[963]: 2026/11/07 15:08:55 INFO Received push request method=POST path=/api/pushes worker2 # [ 80.281149] nix-grpc-daemon[1033]: time=2026-11-07T15:08:55.493Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 80.282666] nix-grpc-daemon[1033]: time=2026-11-07T15:08:55.495Z level=INFO msg="Uploading mlk55snqrikr02pwsxjamphvl61rvl0r-slow-sw (120B)" lb # [ 80.290750] garage[913]: 2026-11-07T15:08:55.557856Z INFO garage_api_common::generic_server: 192.168.1.4:52828 PUT /farm/nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150855Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d4b8d9e7e73f9565f1e4ac7f2d165853aaa96c43a0b8dfd31f7407ba56f30f4b lb # [ 80.303332] garage[913]: 2026-11-07T15:08:55.570799Z INFO garage_api_common::generic_server: 192.168.1.4:52818 PUT /farm/log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150855Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=60dca35b94ec73645e5e3c38fde0149cff00b0581a7de1a253f68adb04234358 lb # [ 80.317909] garage[913]: 2026-11-07T15:08:55.585362Z INFO garage_api_common::generic_server: 192.168.1.4:52792 PUT /farm/mlk55snqrikr02pwsxjamphvl61rvl0r.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150855Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=57ea859e0ca82392d8a85545ac1aa07a9c628e9264528be8d86abf0993ceb960 lb # [ 80.332144] garage[913]: 2026-11-07T15:08:55.600332Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 80.338209] garage[913]: 2026-11-07T15:08:55.605924Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) HEAD /farm/nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 80.344919] niks3-server[963]: 2026/11/07 15:08:55 INFO Received sign narinfos request method=POST path=/api/pushes/23/sign lb # [ 80.349655] garage[913]: 2026-11-07T15:08:55.617590Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 80.353048] niks3-server[963]: 2026/11/07 15:08:55 INFO Signed narinfos id=23 count=1 worker2 # [ 80.352114] nix-grpc-daemon[1033]: time=2026-11-07T15:08:55.564Z level=INFO msg="Uploading 1 narinfos" lb # [ 80.354677] garage[913]: 2026-11-07T15:08:55.622798Z INFO garage_api_common::generic_server: 192.168.1.4:52792 PUT /farm/mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150855Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=10065850e5b697020f88fc4f0b6214c6460b7e95b6a28d90183edcfc5d61d7bd lb # [ 80.359264] niks3-server[963]: 2026/11/07 15:08:55 INFO Registered completed upload object_key=nar/0vi6cx31wc05wns04pr5vr2bak9iib1idndvy6gik6c2rz9q8c19.nar.zst lb # [ 80.362841] niks3-server[963]: 2026/11/07 15:08:55 INFO Registered completed upload object_key=log/q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv lb # [ 80.365294] niks3-server[963]: 2026/11/07 15:08:55 INFO Received complete push request method=POST path=/api/pushes/23/complete lb # [ 80.368251] niks3-server[963]: 2026/11/07 15:08:55 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.ls lb # [ 80.370065] garage[913]: 2026-11-07T15:08:55.638405Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo lb # [ 80.373400] niks3-server[963]: 2026/11/07 15:08:55 INFO Completed push id=23 objects=4 duration=6.002997ms lb # [ 80.374762] niks3-server[963]: 2026/11/07 15:08:55 INFO Registered completed upload object_key=mlk55snqrikr02pwsxjamphvl61rvl0r.narinfo worker2 # [ 80.372135] nix-grpc-daemon[1033]: time=2026-11-07T15:08:55.584Z level=INFO msg="Upload complete. (221ms)" worker2 # [ 80.378970] nix-grpc-daemon[820]: ts=2026-11-07T15:08:55Z level=info event=rpc method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:43034 duration_s=14 drv=q9pl41yvj7mi4fqnyiarzy5py0107h7b-slow-sw.drv assign_id=10 outputs=1 inputs=0 inputs_fetched=0 input_bytes=0 input_s=0 worker2 # [ 80.396099] nix-daemon[986]: reaped child process 1258, status = succeeded client # [ 80.409350] systemd[1]: sw.service: Deactivated successfully. client # [ 80.411832] systemd[1]: sw.service: Consumed 142ms CPU time over 15.017s wall clock time, 39M memory peak, 8.8K incoming IP traffic, 8.6K outgoing IP traffic. client # [ 80.831801] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 80.840261] systemd[1]: Started SSH per-connection Daemon (vsock:2:20). client # [ 80.911450] sshd-session[1169]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 80.916641] sshd-session[1169]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 80.921810] sshd-session[1169]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 80.927781] systemd-logind[465]: New session '22' of user 'root' with class 'user' and type 'tty'. client # [ 80.932402] systemd[1]: Started Session 22 of User root. client # [ 80.956625] sshd-session[1175]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 80.958540] sshd-session[1175]: Disconnected from user root UNKNOWN port 65535 client # [ 80.959866] sshd-session[1169]: pam_unix(sshd:session): session closed for user root client # [ 80.963320] systemd[1]: sshd-vsock@20-21-3:22-2:20.service: Deactivated successfully. client # [ 80.967555] systemd[1]: session-22.scope: Deactivated successfully. client # [ 80.970589] systemd-logind[465]: Session 22 logged out. Waiting for processes to exit. client # [ 80.973180] systemd-logind[465]: Removed session 22. worker2 # [ 80.975615] nix-grpc-daemon[820]: ts=2026-11-07T15:08:56Z level=info event=signal_exit client # [ 81.028103] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 81.031235] systemd[1]: Started SSH per-connection Daemon (vsock:2:21). client # [ 81.078638] sshd-session[1181]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 81.083775] sshd-session[1181]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 81.088828] sshd-session[1181]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 81.095217] systemd-logind[465]: New session '23' of user 'root' with class 'user' and type 'tty'. client # [ 81.099431] systemd[1]: Started Session 23 of User root. client # [ 81.119930] sshd-session[1187]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 81.121703] sshd-session[1187]: Disconnected from user root UNKNOWN port 65535 client # [ 81.122966] sshd-session[1181]: pam_unix(sshd:session): session closed for user root client # [ 81.126176] systemd[1]: sshd-vsock@21-22-3:22-2:21.service: Deactivated successfully. client # [ 81.129779] systemd[1]: session-23.scope: Deactivated successfully. client # [ 81.133304] systemd-logind[465]: Session 23 logged out. Waiting for processes to exit. client # [ 81.134868] systemd-logind[465]: Removed session 23. worker2 # [ 81.235803] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 81.242763] systemd[1]: Started SSH per-connection Daemon (vsock:2:13). worker2 # [ 81.308895] sshd-session[1492]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 81.314196] sshd-session[1492]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 81.319441] sshd-session[1492]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 81.325232] systemd-logind[555]: New session '16' of user 'root' with class 'user' and type 'tty'. worker2 # [ 81.329367] systemd[1]: Started Session 16 of User root. worker2 # [ 81.357520] systemd[1]: Starting scheduler-token.service... worker2 # [ 81.392944] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 81.394554] systemd[1]: Finished scheduler-token.service. worker2 # [ 81.395800] systemd[1]: scheduler-token.service: Consumed 16ms CPU time over 37ms wall clock time, 2.3M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 82.976831] nix-grpc-daemon[820]: ts=2026-11-07T15:08:58Z level=info event=scheduler_restarting worker1 # [ 82.989517] nix-grpc-daemon[529]: ts=2026-11-07T15:08:58Z level=info event=worker_session_closed peer=ipv4:192.168.1.2:56076 worker1 # [ 82.996110] nix-grpc-daemon[529]: ts=2026-11-07T15:08:58Z level=info event=worker_gone addr=192.168.1.4:50051 worker2 # [ 82.999333] nix-grpc-daemon[820]: ts=2026-11-07T15:08:58Z level=info event=niks3_push_exited status=succeeded why="niks3 push exited" worker2 # [ 83.050831] nix-daemon[986]: reaped child process 1031, status = succeeded worker2 # [ 83.052248] nix-daemon[986]: reaped child process 1087, status = succeeded worker2 # [ 83.053238] nix-daemon[986]: reaped child process 1239, status = succeeded worker2 # [ 83.054633] nix-daemon[986]: reaped child process 1142, status = succeeded worker2 # [ 83.056843] nix-daemon[986]: reaped child process 988, status = succeeded worker2 # [ 83.058305] nix-daemon[986]: reaped child process 998, status = succeeded worker2 # [ 83.059250] nix-daemon[986]: reaped child process 1015, status = succeeded worker2 # [ 83.060124] nix-daemon[986]: reaped child process 1179, status = succeeded worker2 # [ 83.060904] nix-daemon[986]: reaped child process 1152, status = succeeded worker2 # [ 83.986790] systemd[1]: nix-grpc-daemon.service: Deactivated successfully. worker2 # [ 83.990194] systemd[1]: nix-grpc-daemon.service: Consumed 1.418s CPU time over 50.183s wall clock time, 58.2M memory peak, 113.9K incoming IP traffic, 170.9K outgoing IP traffic. worker2 # [ 84.003098] systemd[1]: nix-grpc-daemon.service: Scheduled restart job immediately on client request, restart counter is at 1. worker2 # [ 84.012486] systemd[1]: Starting scheduler-token.service... worker2 # [ 84.056818] systemd[1]: scheduler-token.service: Deactivated successfully. worker2 # [ 84.058563] systemd[1]: Finished scheduler-token.service. worker2 # [ 84.059869] systemd[1]: scheduler-token.service: Consumed 22ms CPU time over 46ms wall clock time, 2.1M memory peak, 925B incoming IP traffic, 452B outgoing IP traffic. worker2 # [ 84.064629] systemd[1]: Starting Nix worker-protocol over gRPC... worker2 # [ 84.146346] nix-grpc-daemon[1514]: ts=2026-11-07T15:08:59Z level=info event=warning msg="--niks3 http:// sends the bearer token in clear" worker2 # [ 84.151240] nix-grpc-daemon[1514]: ts=2026-11-07T15:08:59Z level=info event=oidc_provider name=mock issuer=http://192.168.1.2:8080/oidc worker2 # [ 84.153113] nix-grpc-daemon[1514]: ts=2026-11-07T15:08:59Z level=info event=roles builder=1 scheduler=1 scheduler_addr=lb:50051 advertise=192.168.1.4:50051 niks3=http://lb:5751 max_jobs=1 worker2 # [ 84.158777] nix-grpc-daemon[1514]: ts=2026-11-07T15:08:59Z level=info event=startup listen=[::]:50051 proxy_socket=/nix/var/nix/daemon-socket/socket worker2 # [ 84.165357] systemd[1]: Started Nix worker-protocol over gRPC. worker2 # [ 84.168403] sshd-session[1498]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 84.171221] sshd-session[1498]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 84.173260] sshd-session[1492]: pam_unix(sshd:session): session closed for user root worker2 # [ 84.175314] systemd[1]: sshd-vsock@13-14-6:22-2:13.service: Deactivated successfully. worker2 # [ 84.182638] systemd[1]: session-16.scope: Deactivated successfully. worker2 # [ 84.185299] systemd-logind[555]: Session 16 logged out. Waiting for processes to exit. worker2 # [ 84.192072] systemd-logind[555]: Removed session 16. worker2 # [ 84.211746] nix-grpc-daemon[1514]: ts=2026-11-07T15:08:59Z level=info event=scheduler_connected addr=lb:50051 worker1 # [ 84.218306] nix-grpc-daemon[529]: ts=2026-11-07T15:08:59Z level=info event=worker_session_open cn=oidc:mock:node:worker2 peer=ipv4:192.168.1.2:56076 worker1 # [ 84.223896] nix-grpc-daemon[529]: ts=2026-11-07T15:08:59Z level=info event=worker_hello addr=192.168.1.4:50051 systems=x86_64-linux,i686-linux,x86_64-v1-linux,x86_64-v2-linux,x86_64-v3-linux,x86_64-v4-linux,riscv64-linux max_jobs=1 running=0 lb # [ 84.240962] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 84.249624] systemd[1]: Started SSH per-connection Daemon (vsock:2:18). lb # [ 84.312546] sshd-session[1303]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 84.317893] sshd-session[1303]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 84.323628] sshd-session[1303]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 84.334278] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 84.343366] systemd-logind[553]: New session '21' of user 'root' with class 'user' and type 'tty'. lb # [ 84.360321] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 84.367286] systemd[1]: Starting User Manager for UID 0... lb # [ 84.387513] (systemd)[1311]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 84.391970] systemd-logind[553]: New session '22' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 84.468827] systemd[1311]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 84.539474] systemd[1311]: Queued start job for default target Main User Target. lb # [ 84.541709] systemd[1311]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 84.544094] systemd[1311]: Created slice User Application Slice. lb # [ 84.545117] systemd[1311]: Started Daily Cleanup of User's Temporary Directories. lb # [ 84.546202] systemd[1311]: Reached target Paths. lb # [ 84.547211] systemd[1311]: Reached target Timers. lb # [ 84.549661] systemd[1311]: Starting D-Bus User Message Bus Socket... lb # [ 84.550875] systemd[1311]: Starting Create User Files and Directories... lb # [ 84.578310] systemd[1311]: Finished Create User Files and Directories. lb # [ 84.582141] systemd[1311]: Listening on D-Bus User Message Bus Socket. lb # [ 84.583404] systemd[1311]: Reached target Sockets. lb # [ 84.584239] systemd[1311]: Reached target Basic System. lb # [ 84.586237] systemd[1]: Started User Manager for UID 0. lb # [ 84.586968] systemd[1311]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 84.588253] systemd[1311]: Reached target Main User Target. lb # [ 84.588992] systemd[1311]: Startup finished in 183ms. lb # [ 84.592411] systemd[1]: Started Session 21 of User root. lb # [ 84.618740] sshd-session[1325]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 84.620464] sshd-session[1325]: Disconnected from user root UNKNOWN port 65535 lb # [ 84.621760] sshd-session[1303]: pam_unix(sshd:session): session closed for user root lb # [ 84.625089] systemd[1]: sshd-vsock@18-19-4:22-2:18.service: Deactivated successfully. lb # [ 84.628721] systemd[1]: session-21.scope: Deactivated successfully. lb # [ 84.630257] systemd[1]: session-21.scope: Consumed 16ms CPU time over 37ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 84.633943] systemd-logind[553]: Session 21 logged out. Waiting for processes to exit. lb # [ 84.635623] systemd-logind[553]: Removed session 21. lb # [ 84.638761] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 84.642365] systemd[1]: Started SSH per-connection Daemon (vsock:2:19). lb # [ 84.690377] sshd-session[1330]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 84.695535] sshd-session[1330]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 84.700869] sshd-session[1330]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 84.707452] systemd-logind[553]: New session '23' of user 'root' with class 'user' and type 'tty'. lb # [ 84.710406] systemd[1]: Started Session 23 of User root. lb # [ 84.736374] sshd-session[1336]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 84.738245] sshd-session[1336]: Disconnected from user root UNKNOWN port 65535 lb # [ 84.739470] sshd-session[1330]: pam_unix(sshd:session): session closed for user root lb # [ 84.742457] systemd[1]: sshd-vsock@19-20-4:22-2:19.service: Deactivated successfully. lb # [ 84.746882] systemd[1]: session-23.scope: Deactivated successfully. lb # [ 84.748327] systemd[1]: session-23.scope: Consumed 16ms CPU time over 37ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 84.753264] systemd-logind[553]: Session 23 logged out. Waiting for processes to exit. lb # [ 84.755197] systemd-logind[553]: Removed session 23. worker1 # [ 84.843805] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 84.853130] systemd[1]: Started SSH per-connection Daemon (vsock:2:16). worker1 # [ 84.921823] sshd-session[1463]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 84.926783] sshd-session[1463]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 84.931979] sshd-session[1463]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 84.945570] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 84.950377] systemd-logind[608]: New session '19' of user 'root' with class 'user' and type 'tty'. worker1 # [ 84.968259] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 84.972588] systemd[1]: Starting User Manager for UID 0... worker1 # [ 84.987984] (systemd)[1471]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 84.992383] systemd-logind[608]: New session '20' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 85.065769] systemd[1471]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 85.131652] systemd[1471]: Queued start job for default target Main User Target. worker1 # [ 85.134624] systemd[1471]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 85.136950] systemd[1471]: Created slice User Application Slice. worker1 # [ 85.138059] systemd[1471]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 85.139844] systemd[1471]: Reached target Paths. worker1 # [ 85.140599] systemd[1471]: Reached target Timers. worker1 # [ 85.142152] systemd[1471]: Starting D-Bus User Message Bus Socket... worker1 # [ 85.143873] systemd[1471]: Starting Create User Files and Directories... worker1 # [ 85.171158] systemd[1471]: Finished Create User Files and Directories. worker1 # [ 85.176065] systemd[1471]: Listening on D-Bus User Message Bus Socket. worker1 # [ 85.177323] systemd[1471]: Reached target Sockets. worker1 # [ 85.178662] systemd[1471]: Reached target Basic System. worker1 # [ 85.179615] systemd[1471]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 85.182136] systemd[1471]: Reached target Main User Target. worker1 # [ 85.182957] systemd[1471]: Startup finished in 176ms. worker1 # [ 85.184157] systemd[1]: Started User Manager for UID 0. worker1 # [ 85.186240] systemd[1]: Started Session 19 of User root. worker1 # [ 85.209987] sshd-session[1484]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 85.211714] sshd-session[1484]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 85.213064] sshd-session[1463]: pam_unix(sshd:session): session closed for user root worker1 # [ 85.216057] systemd[1]: sshd-vsock@16-17-5:22-2:16.service: Deactivated successfully. worker1 # [ 85.219710] systemd[1]: session-19.scope: Deactivated successfully. worker1 # [ 85.221278] systemd[1]: session-19.scope: Consumed 15ms CPU time over 34ms wall clock time, 3.1M memory peak, 17.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 85.224926] systemd-logind[608]: Session 19 logged out. Waiting for processes to exit. worker1 # [ 85.227089] systemd-logind[608]: Removed session 19. ok test farm::serial::a_failed_upload_fails_the_build_instead_of_rebuilding_it ... worker1 # [ 85.242879] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 85.246444] systemd[1]: Started SSH per-connection Daemon (vsock:2:17). worker1 # [ 85.291851] sshd-session[1489]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 85.296715] sshd-session[1489]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 85.301883] sshd-session[1489]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 85.308242] systemd-logind[608]: New session '21' of user 'root' with class 'user' and type 'tty'. worker1 # [ 85.310397] systemd[1]: Started Session 21 of User root. worker1 # [ 85.331703] sshd-session[1495]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 85.333431] sshd-session[1495]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 85.334766] sshd-session[1489]: pam_unix(sshd:session): session closed for user root worker1 # [ 85.337697] systemd[1]: sshd-vsock@17-18-5:22-2:17.service: Deactivated successfully. worker1 # [ 85.341713] systemd[1]: session-21.scope: Deactivated successfully. worker1 # [ 85.344607] systemd-logind[608]: Session 21 logged out. Waiting for processes to exit. worker1 # [ 85.346252] systemd-logind[608]: Removed session 21. worker2 # [ 85.444879] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 85.454163] systemd[1]: Started SSH per-connection Daemon (vsock:2:14). worker2 # [ 85.523353] sshd-session[1568]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 85.528236] sshd-session[1568]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 85.533465] sshd-session[1568]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 85.540214] systemd-logind[555]: New session '17' of user 'root' with class 'user' and type 'tty'. worker2 # [ 85.543410] systemd[1]: Started Session 17 of User root. worker2 # [ 85.566371] sshd-session[1574]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 85.568089] sshd-session[1574]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 85.569289] sshd-session[1568]: pam_unix(sshd:session): session closed for user root worker2 # [ 85.572422] systemd[1]: sshd-vsock@14-15-6:22-2:14.service: Deactivated successfully. worker2 # [ 85.575916] systemd[1]: session-17.scope: Deactivated successfully. worker2 # [ 85.579260] systemd-logind[555]: Session 17 logged out. Waiting for processes to exit. worker2 # [ 85.580770] systemd-logind[555]: Removed session 17. lb # [ 85.646977] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 85.658312] systemd[1]: Started SSH per-connection Daemon (vsock:2:20). lb # [ 85.723842] sshd-session[1341]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 85.728929] sshd-session[1341]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 85.734409] sshd-session[1341]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 85.740268] systemd-logind[553]: New session '24' of user 'root' with class 'user' and type 'tty'. lb # [ 85.744362] systemd[1]: Started Session 24 of User root. lb # [ 85.771522] sshd-session[1347]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 85.773238] sshd-session[1347]: Disconnected from user root UNKNOWN port 65535 lb # [ 85.774666] sshd-session[1341]: pam_unix(sshd:session): session closed for user root lb # [ 85.777770] systemd[1]: sshd-vsock@20-21-4:22-2:20.service: Deactivated successfully. lb # [ 85.781518] systemd[1]: session-24.scope: Deactivated successfully. lb # [ 85.782981] systemd[1]: session-24.scope: Consumed 16ms CPU time over 38ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 85.786849] systemd-logind[553]: Session 24 logged out. Waiting for processes to exit. lb # [ 85.789186] systemd-logind[553]: Removed session 24. worker1 # [ 85.849772] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 85.858389] systemd[1]: Started SSH per-connection Daemon (vsock:2:18). worker1 # [ 85.929854] sshd-session[1501]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 85.934834] sshd-session[1501]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 85.939926] sshd-session[1501]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 85.945306] systemd-logind[608]: New session '22' of user 'root' with class 'user' and type 'tty'. worker1 # [ 85.949403] systemd[1]: Started Session 22 of User root. worker1 # [ 85.972958] sshd-session[1507]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 85.974752] sshd-session[1507]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 85.976139] sshd-session[1501]: pam_unix(sshd:session): session closed for user root worker1 # [ 85.978849] systemd[1]: sshd-vsock@18-19-5:22-2:18.service: Deactivated successfully. worker1 # [ 85.982508] systemd[1]: session-22.scope: Deactivated successfully. worker1 # [ 85.983969] systemd[1]: session-22.scope: Consumed 15ms CPU time over 34ms wall clock time, 3.1M memory peak, 17.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 85.987665] systemd-logind[608]: Session 22 logged out. Waiting for processes to exit. worker1 # [ 85.989647] systemd-logind[608]: Removed session 22. worker1 # [ 86.049061] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 86.052687] systemd[1]: Started SSH per-connection Daemon (vsock:2:19). worker1 # [ 86.098465] sshd-session[1512]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 86.103189] sshd-session[1512]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 86.108949] sshd-session[1512]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 86.115805] systemd-logind[608]: New session '23' of user 'root' with class 'user' and type 'tty'. worker1 # [ 86.118348] systemd[1]: Started Session 23 of User root. worker1 # [ 86.141915] sshd-session[1518]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 86.143630] sshd-session[1518]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 86.144910] sshd-session[1512]: pam_unix(sshd:session): session closed for user root worker1 # [ 86.147744] systemd[1]: sshd-vsock@19-20-5:22-2:19.service: Deactivated successfully. worker1 # [ 86.151586] systemd[1]: session-23.scope: Deactivated successfully. worker1 # [ 86.153135] systemd[1]: session-23.scope: Consumed 15ms CPU time over 34ms wall clock time, 3.1M memory peak, 17.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 86.156789] systemd-logind[608]: Session 23 logged out. Waiting for processes to exit. worker1 # [ 86.158804] systemd-logind[608]: Removed session 23. worker2 # [ 86.252237] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 86.260390] systemd[1]: Started SSH per-connection Daemon (vsock:2:15). worker2 # [ 86.326281] sshd-session[1580]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 86.331155] sshd-session[1580]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 86.336588] sshd-session[1580]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 86.343079] systemd-logind[555]: New session '18' of user 'root' with class 'user' and type 'tty'. worker2 # [ 86.346415] systemd[1]: Started Session 18 of User root. worker2 # [ 86.371505] sshd-session[1586]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 86.372741] sshd-session[1586]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 86.373971] sshd-session[1580]: pam_unix(sshd:session): session closed for user root worker2 # [ 86.376913] systemd[1]: sshd-vsock@15-16-6:22-2:15.service: Deactivated successfully. worker2 # [ 86.380596] systemd[1]: session-18.scope: Deactivated successfully. worker2 # [ 86.382086] systemd[1]: session-18.scope: Consumed 15ms CPU time over 35ms wall clock time, 3.1M memory peak, 1.9K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 86.385798] systemd-logind[555]: Session 18 logged out. Waiting for processes to exit. worker2 # [ 86.387373] systemd-logind[555]: Removed session 18. client # [ 86.453125] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 86.460334] systemd[1]: Started SSH per-connection Daemon (vsock:2:22). client # [ 86.526672] sshd-session[1192]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 86.531786] sshd-session[1192]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 86.536898] sshd-session[1192]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 86.544249] systemd-logind[465]: New session '24' of user 'root' with class 'user' and type 'tty'. client # [ 86.547392] systemd[1]: Started Session 24 of User root. client # [ 86.566461] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.pem&client-key=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.key" --eval-store auto -f /nix/store/1d7a42y6p1ncxd03bdnj6lvs5y0kwr7g-slow.nix --argstr tag pubdown. client # [ 86.576439] sshd-session[1198]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 86.578508] sshd-session[1198]: Disconnected from user root UNKNOWN port 65535 client # [ 86.580354] sshd-session[1192]: pam_unix(sshd:session): session closed for user root client # [ 86.582896] systemd[1]: sshd-vsock@22-23-3:22-2:22.service: Deactivated successfully. client # [ 86.588586] systemd[1]: session-24.scope: Deactivated successfully. client # [ 86.593752] systemd-logind[465]: Session 24 logged out. Waiting for processes to exit. client # [ 86.597278] systemd-logind[465]: Removed session 24. worker1 # [ 86.653483] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 86.662159] systemd[1]: Started SSH per-connection Daemon (vsock:2:20). worker1 # [ 86.713689] nix-grpc-daemon[529]: ts=2026-11-07T15:09:02Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60242 client # [ 86.712583] nix[1201]: don't know how to build these paths: client # [ 86.713761] nix[1201]: /nix/store/hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3-slow-pubdown.drv worker2 # [ 86.719794] nix-grpc-daemon[1514]: ts=2026-11-07T15:09:01Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 86.731286] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker1 # [ 86.736656] sshd-session[1523]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 86.740930] sshd-session[1523]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 86.746740] sshd-session[1523]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 86.753069] systemd-logind[608]: New session '24' of user 'root' with class 'user' and type 'tty'. worker2 # [ 86.749787] nix-grpc-daemon[1514]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 76 ms (attempt 1/5) worker1 # [ 86.756357] systemd[1]: Started Session 24 of User root. worker1 # [ 86.778706] sshd-session[1529]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 86.780464] sshd-session[1529]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 86.781778] sshd-session[1523]: pam_unix(sshd:session): session closed for user root worker1 # [ 86.785214] systemd[1]: sshd-vsock@20-21-5:22-2:20.service: Deactivated successfully. worker1 # [ 86.788364] systemd[1]: session-24.scope: Deactivated successfully. worker1 # [ 86.791498] systemd-logind[608]: Session 24 logged out. Waiting for processes to exit. worker1 # [ 86.793477] systemd-logind[608]: Removed session 24. worker2 # [ 86.833193] nix-grpc-daemon[1514]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 140 ms (attempt 2/5) worker2 # [ 86.853341] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 86.862838] systemd[1]: Started SSH per-connection Daemon (vsock:2:16). worker2 # [ 86.924386] sshd-session[1598]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 86.929438] sshd-session[1598]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 86.934765] sshd-session[1598]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 86.940266] systemd-logind[555]: New session '19' of user 'root' with class 'user' and type 'tty'. worker2 # [ 86.945356] systemd[1]: Started Session 19 of User root. worker2 # [ 86.967841] sshd-session[1604]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 86.969589] sshd-session[1604]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 86.970907] sshd-session[1598]: pam_unix(sshd:session): session closed for user root worker2 # [ 86.974867] nix-grpc-daemon[1514]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 105 ms (attempt 3/5) worker2 # [ 86.977616] systemd[1]: sshd-vsock@16-17-6:22-2:16.service: Deactivated successfully. worker2 # [ 86.981422] systemd[1]: session-19.scope: Deactivated successfully. worker2 # [ 86.984541] systemd-logind[555]: Session 19 logged out. Waiting for processes to exit. worker2 # [ 86.986325] systemd-logind[555]: Removed session 19. worker2 # [ 87.081766] nix-grpc-daemon[1514]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 519 ms (attempt 4/5) worker1 # [ 87.555851] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 87.564749] systemd[1]: Started SSH per-connection Daemon (vsock:2:21). worker2 # [ 87.603253] nix-grpc-daemon[1514]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 87.606410] nix-grpc-daemon[1514]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 87.618815] garage[913]: 2026-11-07T15:09:02.886022Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/5ggigdls27fnwnawdq2vhs4xcbfgkk8f.narinfo lb # [ 87.627116] garage[913]: 2026-11-07T15:09:02.894240Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 87.637871] nix-grpc-daemon[529]: ts=2026-11-07T15:09:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 87.640330] sshd-session[1534]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 87.645756] sshd-session[1534]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 87.641329] garage[913]: 2026-11-07T15:09:02.908664Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/5ggigdls27fnwnawdq2vhs4xcbfgkk8f.narinfo lb # [ 87.647053] garage[913]: 2026-11-07T15:09:02.909155Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 87.651799] sshd-session[1534]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 87.658237] systemd-logind[608]: New session '25' of user 'root' with class 'user' and type 'tty'. lb # [ 87.653062] garage[913]: 2026-11-07T15:09:02.920808Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/5ggigdls27fnwnawdq2vhs4xcbfgkk8f.narinfo worker1 # [ 87.661364] systemd[1]: Started Session 25 of User root. lb # [ 87.658700] garage[913]: 2026-11-07T15:09:02.921251Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 87.669482] nix-grpc-daemon[529]: ts=2026-11-07T15:09:02Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 87.672848] garage[913]: 2026-11-07T15:09:02.941085Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3.narinfo lb # [ 87.679742] garage[913]: 2026-11-07T15:09:02.948011Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 87.688291] sshd-session[1540]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 87.689848] sshd-session[1540]: Disconnected from user root UNKNOWN port 65535 client # [ 87.685241] nix[1201]: copying 1 paths to 'lb:50051'... worker1 # [ 87.691166] sshd-session[1534]: pam_unix(sshd:session): session closed for user root worker1 # [ 87.694325] systemd[1]: sshd-vsock@21-22-5:22-2:21.service: Deactivated successfully. client # [ 87.687714] nix[1201]: copying path '/nix/store/hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3-slow-pubdown.drv' to 'lb:50051'... worker2 # [ 87.688791] nix-grpc-daemon[1514]: ts=2026-11-07T15:09:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker1 # [ 87.697867] systemd[1]: session-25.scope: Deactivated successfully. worker1 # [ 87.701281] systemd-logind[608]: Session 25 logged out. Waiting for processes to exit. worker1 # [ 87.703713] systemd-logind[608]: Removed session 25. worker2 # [ 87.699729] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 87.755921] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 87.767170] systemd[1]: Started SSH per-connection Daemon (vsock:2:17). worker2 # [ 87.812125] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 87.826235] nix-grpc-daemon[1514]: ts=2026-11-07T15:09:03Z level=info event=niks3_push_started pid=1617 worker2 # [ 87.876036] sshd-session[1611]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 87.882729] sshd-session[1611]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 87.904138] sshd-session[1611]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 87.927208] systemd-logind[555]: New session '20' of user 'root' with class 'user' and type 'tty'. worker2 # [ 87.928560] systemd[1]: Started Session 20 of User root. worker2 # [ 87.954240] nix-grpc-daemon[1617]: time=2026-11-07T15:09:03.165Z level=INFO msg="Configuring client TLS" cert=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/worker2.pem key=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/worker2.key ca="" worker2 # [ 87.970424] sshd-session[1630]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 87.971968] sshd-session[1630]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 87.974726] sshd-session[1611]: pam_unix(sshd:session): session closed for user root worker2 # [ 87.977807] systemd[1]: sshd-vsock@17-18-6:22-2:17.service: Deactivated successfully. worker2 # [ 87.981378] systemd[1]: session-20.scope: Deactivated successfully. worker2 # [ 87.985470] systemd-logind[555]: Session 20 logged out. Waiting for processes to exit. worker2 # [ 87.988375] systemd-logind[555]: Removed session 20. worker2 # [ 88.062832] nix-daemon[986]: accepted connection from pid 1635, user nix-grpc-daemon (trusted) worker2 # [ 88.074456] nix-daemon[986]: reaped child process 1640, status = succeeded lb # [ 88.085333] niks3-server[963]: 2026/11/07 15:09:03 INFO Received push request method=POST path=/api/pushes worker2 # [ 88.094828] nix-grpc-daemon[1617]: time=2026-11-07T15:09:03.307Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 88.096568] nix-grpc-daemon[1617]: time=2026-11-07T15:09:03.309Z level=INFO msg="Uploading hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3-slow-pubdown.drv (440B)" lb # [ 88.105126] garage[913]: 2026-11-07T15:09:03.373459Z INFO garage_api_common::generic_server: 192.168.1.4:43390 PUT /farm/hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150903Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=25ee3c968994b704bf9851b59da392cba1736ab121f7210d235dad3b3921fcc0 lb # [ 88.116991] garage[913]: 2026-11-07T15:09:03.385401Z INFO garage_api_common::generic_server: 192.168.1.4:43386 PUT /farm/nar/05aqzrgs79n4j8n0wnrlc2a1v1w9ifcw7s5cf8d4xd0a6igfj462.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150903Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dde4ae77be9cff059b2952c6ba79cbcdeb248eb9539047959f486e22a82376df lb # [ 88.133079] garage[913]: 2026-11-07T15:09:03.401439Z INFO garage_api_common::generic_server: 127.0.0.1:52760 (key GK0123456789abcdef01234567) HEAD /farm/hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3.ls lb # [ 88.141715] niks3-server[963]: 2026/11/07 15:09:03 INFO Received sign narinfos request method=POST path=/api/pushes/24/sign lb # [ 88.146513] garage[913]: 2026-11-07T15:09:03.414472Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) HEAD /farm/nar/05aqzrgs79n4j8n0wnrlc2a1v1w9ifcw7s5cf8d4xd0a6igfj462.nar.zst worker2 # [ 88.152047] nix-grpc-daemon[1617]: time=2026-11-07T15:09:03.363Z level=INFO msg="Uploading 1 narinfos" lb # [ 88.153409] niks3-server[963]: 2026/11/07 15:09:03 INFO Signed narinfos id=24 count=1 lb # [ 88.156214] garage[913]: 2026-11-07T15:09:03.424085Z INFO garage_api_common::generic_server: 192.168.1.4:43386 PUT /farm/hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3.narinfo?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T150903Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7da8e78dffc33b50ab636c622f27681df9c28699eac015006d74f18a0fe10f57 lb # [ 88.165634] niks3-server[963]: 2026/11/07 15:09:03 INFO Registered completed upload object_key=hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3.ls lb # [ 88.168910] niks3-server[963]: 2026/11/07 15:09:03 INFO Received complete push request method=POST path=/api/pushes/24/complete lb # [ 88.171091] niks3-server[963]: 2026/11/07 15:09:03 INFO Registered completed upload object_key=nar/05aqzrgs79n4j8n0wnrlc2a1v1w9ifcw7s5cf8d4xd0a6igfj462.nar.zst lb # [ 88.173460] garage[913]: 2026-11-07T15:09:03.441684Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) HEAD /farm/hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3.narinfo lb # [ 88.176345] niks3-server[963]: 2026/11/07 15:09:03 INFO Completed push id=24 objects=3 duration=7.627786ms lb # [ 88.177779] niks3-server[963]: 2026/11/07 15:09:03 INFO Registered completed upload object_key=hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3.narinfo worker2 # [ 88.175824] nix-grpc-daemon[1617]: time=2026-11-07T15:09:03.387Z level=INFO msg="Upload complete. (216ms)" worker2 # [ 88.180447] nix-grpc-daemon[1514]: ts=2026-11-07T15:09:03Z level=info event=rpc method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 duration_s=0 paths=1 nar_bytes_in=440 worker2 # [ 88.193285] nix-daemon[986]: reaped child process 1609, status = succeeded worker1 # [ 88.196673] nix-grpc-daemon[529]: ts=2026-11-07T15:09:03Z level=debug event=want client=10 drv=hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3-slow-pubdown.drv cached=0 worker1 # [ 88.200830] nix-grpc-daemon[529]: ts=2026-11-07T15:09:03Z level=debug event=assigned drv=hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3-slow-pubdown.drv worker=192.168.1.3:50051 clients=1 worker1 # [ 88.205371] nix-grpc-daemon[529]: ts=2026-11-07T15:09:03Z level=debug event=rpc_start method=BuildDerivation cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 88.215563] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) lb # [ 88.226336] garage[913]: 2026-11-07T15:09:03.494150Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) HEAD /farm/hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3.narinfo lb # [ 88.231255] garage[913]: 2026-11-07T15:09:03.499699Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) GET /farm/hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3.narinfo worker1 # [ 88.239941] nix-grpc-daemon[529]: copying path '/nix/store/hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3-slow-pubdown.drv' from 'http://lb:5751'... lb # [ 88.245080] garage[913]: 2026-11-07T15:09:03.512709Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) HEAD /farm/nar/05aqzrgs79n4j8n0wnrlc2a1v1w9ifcw7s5cf8d4xd0a6igfj462.nar.zst lb # [ 88.250958] garage[913]: 2026-11-07T15:09:03.519007Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) GET /farm/nar/05aqzrgs79n4j8n0wnrlc2a1v1w9ifcw7s5cf8d4xd0a6igfj462.nar.zst worker1 # [ 88.264941] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) client # [ 88.276377] nix[1201]: building '/nix/store/hw47rxic1pqnb7y2nwk4y6wf5d0k2nm3-slow-pubdown.drv' on lb:50051... worker1 # [ 88.281475] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 88.558750] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 88.568247] systemd[1]: Started SSH per-connection Daemon (vsock:2:22). lb # [ 88.574286] envoy[912]: conn peer=[2001:db8:1::1]:35582 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=6391 tx=4004 ms=4566 lb # [ 88.578778] envoy[912]: conn peer=[2001:db8:1::1]:38184 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=2791 tx=1546 ms=14857 lb # [ 88.582598] envoy[912]: conn peer=[2001:db8:1::4]:36554 tls=TLSv1.3 subject="CN=worker-2" sni=- flags=- tls_fail="-" rx=25884 tx=1617 ms=48995 worker1 # [ 88.634487] sshd-session[1560]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 88.639082] sshd-session[1560]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 88.643595] sshd-session[1560]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 88.649066] systemd-logind[608]: New session '26' of user 'root' with class 'user' and type 'tty'. worker1 # [ 88.653396] systemd[1]: Started Session 26 of User root. worker1 # [ 88.675387] sshd-session[1566]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 88.677123] sshd-session[1566]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 88.678522] sshd-session[1560]: pam_unix(sshd:session): session closed for user root worker1 # [ 88.681548] systemd[1]: sshd-vsock@22-23-5:22-2:22.service: Deactivated successfully. worker1 # [ 88.685235] systemd[1]: session-26.scope: Deactivated successfully. worker1 # [ 88.688381] systemd-logind[608]: Session 26 logged out. Waiting for processes to exit. worker1 # [ 88.689922] systemd-logind[608]: Removed session 26. worker2 # [ 88.758345] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 88.768704] systemd[1]: Started SSH per-connection Daemon (vsock:2:18). worker2 # [ 88.841628] sshd-session[1642]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 88.847034] sshd-session[1642]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 88.852443] sshd-session[1642]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 88.859091] systemd-logind[555]: New session '21' of user 'root' with class 'user' and type 'tty'. worker2 # [ 88.862360] systemd[1]: Started Session 21 of User root. worker2 # [ 88.885615] sshd-session[1648]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 88.886917] sshd-session[1648]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 88.888232] sshd-session[1642]: pam_unix(sshd:session): session closed for user root worker2 # [ 88.891303] systemd[1]: sshd-vsock@18-19-6:22-2:18.service: Deactivated successfully. worker2 # [ 88.894916] systemd[1]: session-21.scope: Deactivated successfully. worker2 # [ 88.898096] systemd-logind[555]: Session 21 logged out. Waiting for processes to exit. worker2 # [ 88.899706] systemd-logind[555]: Removed session 21. lb # [ 89.255200] garage[913]: 2026-11-07T15:09:04.521940Z INFO garage_api_common::generic_server: 127.0.0.1:56818 (key GK0123456789abcdef01234567) HEAD /farm/5ggigdls27fnwnawdq2vhs4xcbfgkk8f.narinfo lb # [ 89.261820] garage[913]: 2026-11-07T15:09:04.522803Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 89.459863] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 89.464493] systemd[1]: Started SSH per-connection Daemon (vsock:2:23). worker1 # [ 89.541421] sshd-session[1580]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 89.548776] sshd-session[1580]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 89.557702] sshd-session[1580]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 89.567341] systemd-logind[608]: New session '27' of user 'root' with class 'user' and type 'tty'. worker1 # [ 89.569692] systemd[1]: Started Session 27 of User root. worker1 # [ 89.644397] sshd-session[1586]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 89.646291] sshd-session[1586]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 89.647310] sshd-session[1580]: pam_unix(sshd:session): session closed for user root worker1 # [ 89.655643] systemd[1]: sshd-vsock@23-24-5:22-2:23.service: Deactivated successfully. worker1 # [ 89.658842] systemd[1]: session-27.scope: Deactivated successfully. worker1 # [ 89.662915] systemd-logind[608]: Session 27 logged out. Waiting for processes to exit. worker1 # [ 89.664346] systemd-logind[608]: Removed session 27. worker2 # [ 89.659569] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 89.668328] systemd[1]: Started SSH per-connection Daemon (vsock:2:19). worker2 # [ 89.735736] sshd-session[1653]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 89.740975] sshd-session[1653]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 89.746437] sshd-session[1653]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 89.753237] systemd-logind[555]: New session '22' of user 'root' with class 'user' and type 'tty'. worker2 # [ 89.755410] systemd[1]: Started Session 22 of User root. worker2 # [ 89.778792] sshd-session[1659]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 89.780468] sshd-session[1659]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 89.781853] sshd-session[1653]: pam_unix(sshd:session): session closed for user root worker2 # [ 89.784907] systemd[1]: sshd-vsock@19-20-6:22-2:19.service: Deactivated successfully. worker2 # [ 89.788646] systemd[1]: session-22.scope: Deactivated successfully. worker2 # [ 89.791875] systemd-logind[555]: Session 22 logged out. Waiting for processes to exit. worker2 # [ 89.793466] systemd-logind[555]: Removed session 22. lb # [ 89.865580] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 89.873690] systemd[1]: Started SSH per-connection Daemon (vsock:2:21). lb # [ 89.942346] sshd-session[1352]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 89.947620] sshd-session[1352]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 89.952818] sshd-session[1352]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 89.958618] systemd-logind[553]: New session '25' of user 'root' with class 'user' and type 'tty'. lb # [ 89.962391] systemd[1]: Started Session 25 of User root. lb # [ 89.991975] sshd-session[1358]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 89.994130] sshd-session[1358]: Disconnected from user root UNKNOWN port 65535 lb # [ 89.995134] sshd-session[1352]: pam_unix(sshd:session): session closed for user root lb # [ 89.998754] systemd[1]: sshd-vsock@21-22-4:22-2:21.service: Deactivated successfully. lb # [ 90.003186] systemd[1]: session-25.scope: Deactivated successfully. lb # [ 90.006070] systemd-logind[553]: Session 25 logged out. Waiting for processes to exit. lb # [ 90.008919] systemd-logind[553]: Removed session 25. lb # [ 90.058711] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 90.062556] systemd[1]: Started SSH per-connection Daemon (vsock:2:22). lb # [ 90.110264] sshd-session[1366]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 90.115287] sshd-session[1366]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 90.120748] sshd-session[1366]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 90.127734] systemd-logind[553]: New session '26' of user 'root' with class 'user' and type 'tty'. lb # [ 90.130336] systemd[1]: Started Session 26 of User root. lb # [ 90.155524] sshd-session[1372]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 90.157300] sshd-session[1372]: Disconnected from user root UNKNOWN port 65535 lb # [ 90.158575] sshd-session[1366]: pam_unix(sshd:session): session closed for user root lb # [ 90.161496] systemd[1]: sshd-vsock@22-23-4:22-2:22.service: Deactivated successfully. lb # [ 90.165330] systemd[1]: session-26.scope: Deactivated successfully. lb # [ 90.168761] systemd-logind[553]: Session 26 logged out. Waiting for processes to exit. lb # [ 90.170256] systemd-logind[553]: Removed session 26. worker1 # [ 90.268314] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 90.271587] systemd[1]: Started SSH per-connection Daemon (vsock:2:24). worker1 # [ 90.348561] sshd-session[1591]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 90.355718] sshd-session[1591]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 90.364130] sshd-session[1591]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 90.374315] systemd-logind[608]: New session '28' of user 'root' with class 'user' and type 'tty'. worker1 # [ 90.377726] systemd[1]: Started Session 28 of User root. worker1 # [ 90.450757] sshd-session[1597]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 90.452393] sshd-session[1597]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 90.454595] sshd-session[1591]: pam_unix(sshd:session): session closed for user root worker1 # [ 90.458377] systemd[1]: sshd-vsock@24-25-5:22-2:24.service: Deactivated successfully. worker1 # [ 90.462376] systemd[1]: session-28.scope: Deactivated successfully. worker1 # [ 90.465366] systemd-logind[608]: Session 28 logged out. Waiting for processes to exit. worker1 # [ 90.467744] systemd-logind[608]: Removed session 28. worker1 # [ 90.503502] nix-daemon[1026]: reaped child process 1553, status = succeeded worker2 # [ 90.566458] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 90.574370] systemd[1]: Started SSH per-connection Daemon (vsock:2:20). worker1 # [ 90.577982] nix-daemon[1026]: accepted connection from pid 1603, user nix-grpc-daemon (trusted) worker1 # [ 90.590934] nix-daemon[1026]: reaped child process 1606, status = succeeded lb # [ 90.596903] niks3-server[963]: 2026/11/07 15:09:05 INFO Received push request method=POST path=/api/pushes worker1 # [ 90.606724] nix-grpc-daemon[1057]: time=2026-11-07T15:09:05.915Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 90.608198] nix-grpc-daemon[1057]: time=2026-11-07T15:09:05.916Z level=INFO msg="Uploading 5ggigdls27fnwnawdq2vhs4xcbfgkk8f-slow-pubdown (120B)" worker2 # [ 90.642719] sshd-session[1664]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 90.647865] sshd-session[1664]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 90.653269] sshd-session[1664]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 90.660259] systemd-logind[555]: New session '23' of user 'root' with class 'user' and type 'tty'. worker2 # [ 90.662555] systemd[1]: Started Session 23 of User root. worker2 # [ 90.685552] sshd-session[1670]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 90.687230] sshd-session[1670]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 90.688434] sshd-session[1664]: pam_unix(sshd:session): session closed for user root worker2 # [ 90.691568] systemd[1]: sshd-vsock@20-21-6:22-2:20.service: Deactivated successfully. worker2 # [ 90.695865] systemd[1]: session-23.scope: Deactivated successfully. worker2 # [ 90.698867] systemd-logind[555]: Session 23 logged out. Waiting for processes to exit. worker2 # [ 90.700462] systemd-logind[555]: Removed session 23. client # [ 90.768197] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 90.776096] systemd[1]: Started SSH per-connection Daemon (vsock:2:23). client # [ 90.841458] sshd-session[1214]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 90.846123] sshd-session[1214]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 90.851948] sshd-session[1214]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 90.857995] systemd-logind[465]: New session '25' of user 'root' with class 'user' and type 'tty'. client # [ 90.862456] systemd[1]: Started Session 25 of User root. client # [ 90.887613] sshd-session[1220]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 90.888913] sshd-session[1220]: Disconnected from user root UNKNOWN port 65535 client # [ 90.890358] sshd-session[1214]: pam_unix(sshd:session): session closed for user root client # [ 90.893727] systemd[1]: sshd-vsock@23-24-3:22-2:23.service: Deactivated successfully. client # [ 90.898207] systemd[1]: session-25.scope: Deactivated successfully. client # [ 90.900876] systemd-logind[465]: Session 25 logged out. Waiting for processes to exit. client # [ 90.903138] systemd-logind[465]: Removed session 25. client # [ 91.466451] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 91.475514] systemd[1]: Started SSH per-connection Daemon (vsock:2:24). client # [ 91.546886] sshd-session[1226]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 91.552217] sshd-session[1226]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 91.557453] sshd-session[1226]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 91.564250] systemd-logind[465]: New session '26' of user 'root' with class 'user' and type 'tty'. client # [ 91.567442] systemd[1]: Started Session 26 of User root. client # [ 91.591780] sshd-session[1232]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 91.593133] sshd-session[1232]: Disconnected from user root UNKNOWN port 65535 client # [ 91.594520] sshd-session[1226]: pam_unix(sshd:session): session closed for user root client # [ 91.597683] systemd[1]: sshd-vsock@24-25-3:22-2:24.service: Deactivated successfully. client # [ 91.601698] systemd[1]: session-26.scope: Deactivated successfully. client # [ 91.605192] systemd-logind[465]: Session 26 logged out. Waiting for processes to exit. client # [ 91.607078] systemd-logind[465]: Removed session 26. client # [ 92.169950] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 92.176966] systemd[1]: Started SSH per-connection Daemon (vsock:2:25). client # [ 92.251353] sshd-session[1238]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 92.256608] sshd-session[1238]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 92.261769] sshd-session[1238]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 92.269306] systemd-logind[465]: New session '27' of user 'root' with class 'user' and type 'tty'. client # [ 92.272378] systemd[1]: Started Session 27 of User root. client # [ 92.296265] sshd-session[1244]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 92.298158] sshd-session[1244]: Disconnected from user root UNKNOWN port 65535 client # [ 92.299526] sshd-session[1238]: pam_unix(sshd:session): session closed for user root client # [ 92.302913] systemd[1]: sshd-vsock@25-26-3:22-2:25.service: Deactivated successfully. client # [ 92.306762] systemd[1]: session-27.scope: Deactivated successfully. client # [ 92.310329] systemd-logind[465]: Session 27 logged out. Waiting for processes to exit. client # [ 92.311860] systemd-logind[465]: Removed session 27. [e2e] heartbeat t=30s client # [ 92.868647] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 92.877264] systemd[1]: Started SSH per-connection Daemon (vsock:2:26). client # [ 92.946412] sshd-session[1250]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 92.951780] sshd-session[1250]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 92.956920] sshd-session[1250]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 92.964397] systemd-logind[465]: New session '28' of user 'root' with class 'user' and type 'tty'. client # [ 92.967459] systemd[1]: Started Session 28 of User root. client # [ 92.993800] sshd-session[1256]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 92.995230] sshd-session[1256]: Disconnected from user root UNKNOWN port 65535 client # [ 92.996562] sshd-session[1250]: pam_unix(sshd:session): session closed for user root client # [ 92.999890] systemd[1]: sshd-vsock@26-27-3:22-2:26.service: Deactivated successfully. client # [ 93.004300] systemd[1]: session-28.scope: Deactivated successfully. client # [ 93.007843] systemd-logind[465]: Session 28 logged out. Waiting for processes to exit. client # [ 93.009799] systemd-logind[465]: Removed session 28. client # [ 93.568910] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 93.578919] systemd[1]: Started SSH per-connection Daemon (vsock:2:27). client # [ 93.658841] sshd-session[1262]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 93.664539] sshd-session[1262]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 93.669953] sshd-session[1262]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 93.675931] systemd-logind[465]: New session '29' of user 'root' with class 'user' and type 'tty'. client # [ 93.680362] systemd[1]: Started Session 29 of User root. client # [ 93.705717] sshd-session[1268]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 93.707561] sshd-session[1268]: Disconnected from user root UNKNOWN port 65535 client # [ 93.708868] sshd-session[1262]: pam_unix(sshd:session): session closed for user root client # [ 93.712279] systemd[1]: sshd-vsock@27-28-3:22-2:27.service: Deactivated successfully. client # [ 93.715907] systemd[1]: session-29.scope: Deactivated successfully. client # [ 93.718096] systemd-logind[465]: Session 29 logged out. Waiting for processes to exit. client # [ 93.721138] systemd-logind[465]: Removed session 29. client # [ 94.272378] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 94.279931] systemd[1]: Started SSH per-connection Daemon (vsock:2:28). client # [ 94.349348] sshd-session[1274]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 94.354132] sshd-session[1274]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 94.360239] sshd-session[1274]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 94.367241] systemd-logind[465]: New session '30' of user 'root' with class 'user' and type 'tty'. client # [ 94.370430] systemd[1]: Started Session 30 of User root. client # [ 94.395641] sshd-session[1280]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 94.396916] sshd-session[1280]: Disconnected from user root UNKNOWN port 65535 client # [ 94.398282] sshd-session[1274]: pam_unix(sshd:session): session closed for user root client # [ 94.401372] systemd[1]: sshd-vsock@28-29-3:22-2:28.service: Deactivated successfully. client # [ 94.405396] systemd[1]: session-30.scope: Deactivated successfully. client # [ 94.408676] systemd-logind[465]: Session 30 logged out. Waiting for processes to exit. client # [ 94.410455] systemd-logind[465]: Removed session 30. client # [ 94.973954] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 94.982652] systemd[1]: Started SSH per-connection Daemon (vsock:2:29). client # [ 95.052440] sshd-session[1286]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 95.057740] sshd-session[1286]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 95.063122] sshd-session[1286]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 95.070275] systemd-logind[465]: New session '31' of user 'root' with class 'user' and type 'tty'. client # [ 95.073526] systemd[1]: Started Session 31 of User root. client # [ 95.097906] sshd-session[1292]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 95.099735] sshd-session[1292]: Disconnected from user root UNKNOWN port 65535 client # [ 95.101159] sshd-session[1286]: pam_unix(sshd:session): session closed for user root client # [ 95.104298] systemd[1]: sshd-vsock@29-30-3:22-2:29.service: Deactivated successfully. client # [ 95.108333] systemd[1]: session-31.scope: Deactivated successfully. client # [ 95.111229] systemd-logind[465]: Session 31 logged out. Waiting for processes to exit. client # [ 95.113357] systemd-logind[465]: Removed session 31. client # [ 95.672461] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 95.682160] systemd[1]: Started SSH per-connection Daemon (vsock:2:30). client # [ 95.752368] sshd-session[1298]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 95.757631] sshd-session[1298]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 95.763078] sshd-session[1298]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 95.769070] systemd-logind[465]: New session '32' of user 'root' with class 'user' and type 'tty'. client # [ 95.773424] systemd[1]: Started Session 32 of User root. client # [ 95.798628] sshd-session[1304]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 95.799910] sshd-session[1304]: Disconnected from user root UNKNOWN port 65535 client # [ 95.801200] sshd-session[1298]: pam_unix(sshd:session): session closed for user root client # [ 95.804650] systemd[1]: sshd-vsock@30-31-3:22-2:30.service: Deactivated successfully. client # [ 95.808554] systemd[1]: session-32.scope: Deactivated successfully. client # [ 95.812165] systemd-logind[465]: Session 32 logged out. Waiting for processes to exit. client # [ 95.813480] systemd-logind[465]: Removed session 32. client # [ 96.372970] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 96.381752] systemd[1]: Started SSH per-connection Daemon (vsock:2:31). client # [ 96.452465] sshd-session[1310]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 96.457744] sshd-session[1310]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 96.463215] sshd-session[1310]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 96.470279] systemd-logind[465]: New session '33' of user 'root' with class 'user' and type 'tty'. client # [ 96.473454] systemd[1]: Started Session 33 of User root. client # [ 96.497860] sshd-session[1316]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 96.499701] sshd-session[1316]: Disconnected from user root UNKNOWN port 65535 client # [ 96.501100] sshd-session[1310]: pam_unix(sshd:session): session closed for user root client # [ 96.504299] systemd[1]: sshd-vsock@31-32-3:22-2:31.service: Deactivated successfully. client # [ 96.508289] systemd[1]: session-33.scope: Deactivated successfully. client # [ 96.511299] systemd-logind[465]: Session 33 logged out. Waiting for processes to exit. client # [ 96.513077] systemd-logind[465]: Removed session 33. client # [ 97.076287] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 97.083876] systemd[1]: Started SSH per-connection Daemon (vsock:2:32). client # [ 97.154238] sshd-session[1322]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 97.159483] sshd-session[1322]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 97.165202] sshd-session[1322]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 97.172138] systemd-logind[465]: New session '34' of user 'root' with class 'user' and type 'tty'. client # [ 97.175433] systemd[1]: Started Session 34 of User root. client # [ 97.197548] sshd-session[1328]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 97.198809] sshd-session[1328]: Disconnected from user root UNKNOWN port 65535 client # [ 97.200137] sshd-session[1322]: pam_unix(sshd:session): session closed for user root client # [ 97.202939] systemd[1]: sshd-vsock@32-33-3:22-2:32.service: Deactivated successfully. client # [ 97.206548] systemd[1]: session-34.scope: Deactivated successfully. client # [ 97.209513] systemd-logind[465]: Session 34 logged out. Waiting for processes to exit. client # [ 97.211473] systemd-logind[465]: Removed session 34. client # [ 97.778899] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 97.785778] systemd[1]: Started SSH per-connection Daemon (vsock:2:33). client # [ 97.855831] sshd-session[1334]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 97.860859] sshd-session[1334]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 97.865965] sshd-session[1334]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 97.871974] systemd-logind[465]: New session '35' of user 'root' with class 'user' and type 'tty'. client # [ 97.876358] systemd[1]: Started Session 35 of User root. client # [ 97.899753] sshd-session[1340]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 97.901594] sshd-session[1340]: Disconnected from user root UNKNOWN port 65535 client # [ 97.902879] sshd-session[1334]: pam_unix(sshd:session): session closed for user root client # [ 97.905864] systemd[1]: sshd-vsock@33-34-3:22-2:33.service: Deactivated successfully. client # [ 97.909776] systemd[1]: session-35.scope: Deactivated successfully. client # [ 97.913304] systemd-logind[465]: Session 35 logged out. Waiting for processes to exit. client # [ 97.914860] systemd-logind[465]: Removed session 35. client # [ 98.480298] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 98.489091] systemd[1]: Started SSH per-connection Daemon (vsock:2:34). client # [ 98.556734] sshd-session[1346]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 98.561831] sshd-session[1346]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 98.566869] sshd-session[1346]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 98.573710] systemd-logind[465]: New session '36' of user 'root' with class 'user' and type 'tty'. client # [ 98.576430] systemd[1]: Started Session 36 of User root. client # [ 98.599900] sshd-session[1352]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 98.601686] sshd-session[1352]: Disconnected from user root UNKNOWN port 65535 client # [ 98.602955] sshd-session[1346]: pam_unix(sshd:session): session closed for user root client # [ 98.605921] systemd[1]: sshd-vsock@34-35-3:22-2:34.service: Deactivated successfully. client # [ 98.609779] systemd[1]: session-36.scope: Deactivated successfully. client # [ 98.613199] systemd-logind[465]: Session 36 logged out. Waiting for processes to exit. client # [ 98.614851] systemd-logind[465]: Removed session 36. client # [ 99.181836] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 99.191588] systemd[1]: Started SSH per-connection Daemon (vsock:2:35). client # [ 99.263481] sshd-session[1358]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 99.268666] sshd-session[1358]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 99.273859] sshd-session[1358]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 99.279860] systemd-logind[465]: New session '37' of user 'root' with class 'user' and type 'tty'. client # [ 99.284429] systemd[1]: Started Session 37 of User root. client # [ 99.307696] sshd-session[1364]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 99.309526] sshd-session[1364]: Disconnected from user root UNKNOWN port 65535 client # [ 99.310974] sshd-session[1358]: pam_unix(sshd:session): session closed for user root client # [ 99.313972] systemd[1]: sshd-vsock@35-36-3:22-2:35.service: Deactivated successfully. client # [ 99.317774] systemd[1]: session-37.scope: Deactivated successfully. client # [ 99.321175] systemd-logind[465]: Session 37 logged out. Waiting for processes to exit. client # [ 99.322831] systemd-logind[465]: Removed session 37. client # [ 99.880299] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 99.889172] systemd[1]: Started SSH per-connection Daemon (vsock:2:36). client # [ 99.953519] sshd-session[1370]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 99.959176] sshd-session[1370]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 99.965839] sshd-session[1370]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 99.972186] systemd-logind[465]: New session '38' of user 'root' with class 'user' and type 'tty'. client # [ 99.976458] systemd[1]: Started Session 38 of User root. client # [ 100.003492] sshd-session[1376]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 100.005781] sshd-session[1376]: Disconnected from user root UNKNOWN port 65535 client # [ 100.007252] sshd-session[1370]: pam_unix(sshd:session): session closed for user root client # [ 100.011081] systemd[1]: sshd-vsock@36-37-3:22-2:36.service: Deactivated successfully. client # [ 100.015261] systemd[1]: session-38.scope: Deactivated successfully. client # [ 100.018902] systemd-logind[465]: Session 38 logged out. Waiting for processes to exit. client # [ 100.020685] systemd-logind[465]: Removed session 38. lb # [ 100.332837] systemd[1]: Stopping User Manager for UID 0... lb # [ 100.336600] systemd[1311]: Activating special unit Exit the Session... lb # [ 100.338282] systemd[1311]: Stopped target Main User Target. lb # [ 100.339070] systemd[1311]: Stopped target Basic System. lb # [ 100.339806] systemd[1311]: Stopped target Paths. lb # [ 100.340866] systemd[1311]: Stopped target Sockets. lb # [ 100.342312] systemd[1311]: Stopped target Timers. lb # [ 100.343050] systemd[1311]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 100.344774] systemd[1311]: Closed D-Bus User Message Bus Socket. lb # [ 100.346435] systemd[1311]: Stopped Create User Files and Directories. lb # [ 100.347873] systemd[1311]: Removed slice User Application Slice. lb # [ 100.348978] systemd[1311]: Reached target Shutdown. lb # [ 100.349819] systemd[1311]: Finished Exit the Session. lb # [ 100.350833] systemd[1311]: Reached target Exit the Session. lb # [ 100.359129] systemd-logind[553]: Removed session 22. lb # [ 100.362664] systemd[1]: user@0.service: Deactivated successfully. lb # [ 100.364486] systemd[1]: Stopped User Manager for UID 0. lb # [ 100.385160] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 100.403182] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 100.405537] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 100.406675] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 100.579910] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 100.589452] systemd[1]: Started SSH per-connection Daemon (vsock:2:37). worker1 # [ 100.634355] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 100.638750] systemd[1471]: Activating special unit Exit the Session... worker1 # [ 100.644767] systemd[1471]: Stopped target Main User Target. worker1 # [ 100.646985] systemd[1471]: Stopped target Basic System. worker1 # [ 100.652368] systemd[1471]: Stopped target Paths. worker1 # [ 100.655811] systemd[1471]: Stopped target Sockets. worker1 # [ 100.658285] systemd[1471]: Stopped target Timers. client # [ 100.656796] sshd-session[1382]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 100.662180] systemd[1471]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 100.661646] sshd-session[1382]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 100.665494] systemd[1471]: Closed D-Bus User Message Bus Socket. worker1 # [ 100.667807] systemd[1471]: Stopped Create User Files and Directories. client # [ 100.666704] sshd-session[1382]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 100.671777] systemd[1471]: Removed slice User Application Slice. worker1 # [ 100.674625] systemd[1471]: Reached target Shutdown. client # [ 100.673226] systemd-logind[465]: New session '39' of user 'root' with class 'user' and type 'tty'. worker1 # [ 100.677529] systemd[1471]: Finished Exit the Session. client # [ 100.676453] systemd[1]: Started Session 39 of User root. worker1 # [ 100.681688] systemd[1471]: Reached target Exit the Session. worker1 # [ 100.687975] systemd-logind[608]: Removed session 20. worker1 # [ 100.690922] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 100.694604] systemd[1]: Stopped User Manager for UID 0. client # [ 100.698316] sshd-session[1388]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 100.703562] systemd[1]: Stopping User Runtime Directory /run/user/0... client # [ 100.699925] sshd-session[1388]: Disconnected from user root UNKNOWN port 65535 client # [ 100.701262] sshd-session[1382]: pam_unix(sshd:session): session closed for user root client # [ 100.704398] systemd[1]: sshd-vsock@37-38-3:22-2:37.service: Deactivated successfully. client # [ 100.707663] systemd[1]: session-39.scope: Deactivated successfully. client # [ 100.710795] systemd-logind[465]: Session 39 logged out. Waiting for processes to exit. client # [ 100.712513] systemd-logind[465]: Removed session 39. worker1 # [ 100.725426] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 100.727395] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 100.728785] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 100.734714] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 100.743453] systemd[1207]: Activating special unit Exit the Session... worker2 # [ 100.749738] systemd[1207]: Stopped target Main User Target. worker2 # [ 100.754428] systemd[1207]: Stopped target Basic System. worker2 # [ 100.757443] systemd[1207]: Stopped target Paths. worker2 # [ 100.764170] systemd[1207]: Stopped target Sockets. worker2 # [ 100.767323] systemd[1207]: Stopped target Timers. worker2 # [ 100.769146] systemd[1207]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 100.774095] dbus-broker[1382]: Dispatched 607 messages @ 1(±2)μs / message. worker2 # [ 100.780425] systemd[1207]: Stopping D-Bus User Message Bus... worker2 # [ 100.782553] systemd[1207]: Stopped Create User Files and Directories. worker2 # [ 100.786480] systemd[1207]: Stopped D-Bus User Message Bus. worker2 # [ 100.791506] systemd[1207]: Removed slice User Core Session Slice. worker2 # [ 100.795130] systemd[1207]: Closed D-Bus User Message Bus Socket. worker2 # [ 100.797246] systemd[1207]: Removed slice User Application Slice. worker2 # [ 100.799187] systemd[1207]: Reached target Shutdown. worker2 # [ 100.801278] systemd[1207]: Finished Exit the Session. worker2 # [ 100.803305] systemd[1207]: Reached target Exit the Session. worker2 # [ 100.812911] systemd-logind[555]: Removed session 8. worker2 # [ 100.816363] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 100.818325] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 100.825212] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 100.844114] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 100.845777] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 100.847424] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 101.280523] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 101.289875] systemd[1]: Started SSH per-connection Daemon (vsock:2:38). client # [ 101.354922] sshd-session[1394]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 101.359124] sshd-session[1394]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 101.363948] sshd-session[1394]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 101.370070] systemd-logind[465]: New session '40' of user 'root' with class 'user' and type 'tty'. client # [ 101.373401] systemd[1]: Started Session 40 of User root. client # [ 101.393350] sshd-session[1400]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 101.395065] sshd-session[1400]: Disconnected from user root UNKNOWN port 65535 client # [ 101.396250] sshd-session[1394]: pam_unix(sshd:session): session closed for user root client # [ 101.398986] systemd[1]: sshd-vsock@38-39-3:22-2:38.service: Deactivated successfully. client # [ 101.402491] systemd[1]: session-40.scope: Deactivated successfully. client # [ 101.405622] systemd-logind[465]: Session 40 logged out. Waiting for processes to exit. client # [ 101.407775] systemd-logind[465]: Removed session 40. client # [ 101.986755] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 101.994798] systemd[1]: Started SSH per-connection Daemon (vsock:2:39). client # [ 102.061548] sshd-session[1406]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 102.066197] sshd-session[1406]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 102.071797] sshd-session[1406]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 102.077237] systemd-logind[465]: New session '41' of user 'root' with class 'user' and type 'tty'. client # [ 102.081411] systemd[1]: Started Session 41 of User root. client # [ 102.103495] sshd-session[1412]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 102.105207] sshd-session[1412]: Disconnected from user root UNKNOWN port 65535 client # [ 102.106563] sshd-session[1406]: pam_unix(sshd:session): session closed for user root client # [ 102.109421] systemd[1]: sshd-vsock@39-40-3:22-2:39.service: Deactivated successfully. client # [ 102.113125] systemd[1]: session-41.scope: Deactivated successfully. client # [ 102.116278] systemd-logind[465]: Session 41 logged out. Waiting for processes to exit. client # [ 102.118099] systemd-logind[465]: Removed session 41. client # [ 102.683370] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 102.692272] systemd[1]: Started SSH per-connection Daemon (vsock:2:40). client # [ 102.758930] sshd-session[1418]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 102.763887] sshd-session[1418]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 102.768934] sshd-session[1418]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 102.775227] systemd-logind[465]: New session '42' of user 'root' with class 'user' and type 'tty'. client # [ 102.778443] systemd[1]: Started Session 42 of User root. client # [ 102.800257] sshd-session[1424]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 102.801938] sshd-session[1424]: Disconnected from user root UNKNOWN port 65535 client # [ 102.803287] sshd-session[1418]: pam_unix(sshd:session): session closed for user root client # [ 102.806067] systemd[1]: sshd-vsock@40-41-3:22-2:40.service: Deactivated successfully. client # [ 102.809465] systemd[1]: session-42.scope: Deactivated successfully. client # [ 102.812562] systemd-logind[465]: Session 42 logged out. Waiting for processes to exit. client # [ 102.814797] systemd-logind[465]: Removed session 42. client # [ 103.387571] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 103.395066] systemd[1]: Started SSH per-connection Daemon (vsock:2:41). client # [ 103.461616] sshd-session[1430]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 103.466122] sshd-session[1430]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 103.471677] sshd-session[1430]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 103.477226] systemd-logind[465]: New session '43' of user 'root' with class 'user' and type 'tty'. client # [ 103.481440] systemd[1]: Started Session 43 of User root. client # [ 103.502986] sshd-session[1436]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 103.504694] sshd-session[1436]: Disconnected from user root UNKNOWN port 65535 client # [ 103.505939] sshd-session[1430]: pam_unix(sshd:session): session closed for user root client # [ 103.508837] systemd[1]: sshd-vsock@41-42-3:22-2:41.service: Deactivated successfully. client # [ 103.512425] systemd[1]: session-43.scope: Deactivated successfully. client # [ 103.515532] systemd-logind[465]: Session 43 logged out. Waiting for processes to exit. client # [ 103.517236] systemd-logind[465]: Removed session 43. client # [ 104.086352] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 104.094558] systemd[1]: Started SSH per-connection Daemon (vsock:2:42). client # [ 104.161803] sshd-session[1442]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 104.166667] sshd-session[1442]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 104.171809] sshd-session[1442]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 104.178066] systemd-logind[465]: New session '44' of user 'root' with class 'user' and type 'tty'. client # [ 104.181440] systemd[1]: Started Session 44 of User root. client # [ 104.203561] sshd-session[1448]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 104.204884] sshd-session[1448]: Disconnected from user root UNKNOWN port 65535 client # [ 104.206233] sshd-session[1442]: pam_unix(sshd:session): session closed for user root client # [ 104.208971] systemd[1]: sshd-vsock@42-43-3:22-2:42.service: Deactivated successfully. client # [ 104.212505] systemd[1]: session-44.scope: Deactivated successfully. client # [ 104.215610] systemd-logind[465]: Session 44 logged out. Waiting for processes to exit. client # [ 104.217347] systemd-logind[465]: Removed session 44. client # [ 104.787791] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 104.797148] systemd[1]: Started SSH per-connection Daemon (vsock:2:43). client # [ 104.865229] sshd-session[1454]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 104.869949] sshd-session[1454]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 104.874960] sshd-session[1454]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 104.880546] systemd-logind[465]: New session '45' of user 'root' with class 'user' and type 'tty'. client # [ 104.885431] systemd[1]: Started Session 45 of User root. client # [ 104.907642] sshd-session[1460]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 104.909377] sshd-session[1460]: Disconnected from user root UNKNOWN port 65535 client # [ 104.910658] sshd-session[1454]: pam_unix(sshd:session): session closed for user root client # [ 104.913532] systemd[1]: sshd-vsock@43-44-3:22-2:43.service: Deactivated successfully. client # [ 104.917303] systemd[1]: session-45.scope: Deactivated successfully. client # [ 104.920600] systemd-logind[465]: Session 45 logged out. Waiting for processes to exit. client # [ 104.922313] systemd-logind[465]: Removed session 45. client # [ 105.489343] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 105.498833] systemd[1]: Started SSH per-connection Daemon (vsock:2:44). client # [ 105.565761] sshd-session[1466]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 105.570696] sshd-session[1466]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 105.575792] sshd-session[1466]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 105.582100] systemd-logind[465]: New session '46' of user 'root' with class 'user' and type 'tty'. client # [ 105.585370] systemd[1]: Started Session 46 of User root. client # [ 105.607706] sshd-session[1472]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 105.609536] sshd-session[1472]: Disconnected from user root UNKNOWN port 65535 client # [ 105.610691] sshd-session[1466]: pam_unix(sshd:session): session closed for user root client # [ 105.613686] systemd[1]: sshd-vsock@44-45-3:22-2:44.service: Deactivated successfully. client # [ 105.617448] systemd[1]: session-46.scope: Deactivated successfully. client # [ 105.620894] systemd-logind[465]: Session 46 logged out. Waiting for processes to exit. client # [ 105.623098] systemd-logind[465]: Removed session 46. client # [ 106.192831] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 106.200243] systemd[1]: Started SSH per-connection Daemon (vsock:2:45). client # [ 106.267594] sshd-session[1478]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 106.272140] sshd-session[1478]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 106.277738] sshd-session[1478]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 106.284360] systemd-logind[465]: New session '47' of user 'root' with class 'user' and type 'tty'. client # [ 106.287360] systemd[1]: Started Session 47 of User root. client # [ 106.310400] sshd-session[1484]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 106.312138] sshd-session[1484]: Disconnected from user root UNKNOWN port 65535 client # [ 106.313460] sshd-session[1478]: pam_unix(sshd:session): session closed for user root client # [ 106.316296] systemd[1]: sshd-vsock@45-46-3:22-2:45.service: Deactivated successfully. client # [ 106.319737] systemd[1]: session-47.scope: Deactivated successfully. client # [ 106.323173] systemd-logind[465]: Session 47 logged out. Waiting for processes to exit. client # [ 106.324940] systemd-logind[465]: Removed session 47. client # [ 106.894358] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 106.901376] systemd[1]: Started SSH per-connection Daemon (vsock:2:46). client # [ 106.966308] sshd-session[1490]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 106.971254] sshd-session[1490]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 106.976536] sshd-session[1490]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 106.983068] systemd-logind[465]: New session '48' of user 'root' with class 'user' and type 'tty'. client # [ 106.986425] systemd[1]: Started Session 48 of User root. client # [ 107.008679] sshd-session[1496]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 107.010435] sshd-session[1496]: Disconnected from user root UNKNOWN port 65535 client # [ 107.011773] sshd-session[1490]: pam_unix(sshd:session): session closed for user root client # [ 107.014693] systemd[1]: sshd-vsock@46-47-3:22-2:46.service: Deactivated successfully. client # [ 107.018454] systemd[1]: session-48.scope: Deactivated successfully. client # [ 107.021818] systemd-logind[465]: Session 48 logged out. Waiting for processes to exit. client # [ 107.023396] systemd-logind[465]: Removed session 48. client # [ 107.592965] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 107.601907] systemd[1]: Started SSH per-connection Daemon (vsock:2:47). client # [ 107.670814] sshd-session[1502]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 107.675777] sshd-session[1502]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 107.680966] sshd-session[1502]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 107.687432] systemd-logind[465]: New session '49' of user 'root' with class 'user' and type 'tty'. client # [ 107.690295] systemd[1]: Started Session 49 of User root. client # [ 107.712972] sshd-session[1508]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 107.714741] sshd-session[1508]: Disconnected from user root UNKNOWN port 65535 client # [ 107.716168] sshd-session[1502]: pam_unix(sshd:session): session closed for user root client # [ 107.719313] systemd[1]: sshd-vsock@47-48-3:22-2:47.service: Deactivated successfully. client # [ 107.723163] systemd[1]: session-49.scope: Deactivated successfully. client # [ 107.725733] systemd-logind[465]: Session 49 logged out. Waiting for processes to exit. client # [ 107.728092] systemd-logind[465]: Removed session 49. client # [ 108.296239] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 108.302140] systemd[1]: Started SSH per-connection Daemon (vsock:2:48). client # [ 108.370313] sshd-session[1514]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 108.375231] sshd-session[1514]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 108.380337] sshd-session[1514]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 108.386072] systemd-logind[465]: New session '50' of user 'root' with class 'user' and type 'tty'. client # [ 108.390451] systemd[1]: Started Session 50 of User root. client # [ 108.412615] sshd-session[1520]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 108.414420] sshd-session[1520]: Disconnected from user root UNKNOWN port 65535 client # [ 108.415807] sshd-session[1514]: pam_unix(sshd:session): session closed for user root client # [ 108.418862] systemd[1]: sshd-vsock@48-49-3:22-2:48.service: Deactivated successfully. client # [ 108.422545] systemd[1]: session-50.scope: Deactivated successfully. client # [ 108.425849] systemd-logind[465]: Session 50 logged out. Waiting for processes to exit. client # [ 108.427485] systemd-logind[465]: Removed session 50. client # [ 108.997577] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 109.005259] systemd[1]: Started SSH per-connection Daemon (vsock:2:49). client # [ 109.073409] sshd-session[1526]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 109.078261] sshd-session[1526]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 109.083256] sshd-session[1526]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 109.089405] systemd-logind[465]: New session '51' of user 'root' with class 'user' and type 'tty'. client # [ 109.093404] systemd[1]: Started Session 51 of User root. client # [ 109.115628] sshd-session[1532]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 109.116871] sshd-session[1532]: Disconnected from user root UNKNOWN port 65535 client # [ 109.118316] sshd-session[1526]: pam_unix(sshd:session): session closed for user root client # [ 109.121254] systemd[1]: sshd-vsock@49-50-3:22-2:49.service: Deactivated successfully. client # [ 109.124798] systemd[1]: session-51.scope: Deactivated successfully. client # [ 109.128183] systemd-logind[465]: Session 51 logged out. Waiting for processes to exit. client # [ 109.130221] systemd-logind[465]: Removed session 51. client # [ 109.697393] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 109.707156] systemd[1]: Started SSH per-connection Daemon (vsock:2:50). client # [ 109.775930] sshd-session[1538]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 109.780840] sshd-session[1538]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 109.785986] sshd-session[1538]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 109.792066] systemd-logind[465]: New session '52' of user 'root' with class 'user' and type 'tty'. client # [ 109.795435] systemd[1]: Started Session 52 of User root. client # [ 109.817805] sshd-session[1544]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 109.819538] sshd-session[1544]: Disconnected from user root UNKNOWN port 65535 client # [ 109.820896] sshd-session[1538]: pam_unix(sshd:session): session closed for user root client # [ 109.823944] systemd[1]: sshd-vsock@50-51-3:22-2:50.service: Deactivated successfully. client # [ 109.827669] systemd[1]: session-52.scope: Deactivated successfully. client # [ 109.830980] systemd-logind[465]: Session 52 logged out. Waiting for processes to exit. client # [ 109.832663] systemd-logind[465]: Removed session 52. client # [ 110.399786] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 110.407980] systemd[1]: Started SSH per-connection Daemon (vsock:2:51). client # [ 110.475854] sshd-session[1550]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 110.480742] sshd-session[1550]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 110.485882] sshd-session[1550]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 110.492395] systemd-logind[465]: New session '53' of user 'root' with class 'user' and type 'tty'. client # [ 110.495364] systemd[1]: Started Session 53 of User root. client # [ 110.517525] sshd-session[1556]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 110.519317] sshd-session[1556]: Disconnected from user root UNKNOWN port 65535 client # [ 110.520540] sshd-session[1550]: pam_unix(sshd:session): session closed for user root client # [ 110.523427] systemd[1]: sshd-vsock@51-52-3:22-2:51.service: Deactivated successfully. client # [ 110.527111] systemd[1]: session-53.scope: Deactivated successfully. client # [ 110.530261] systemd-logind[465]: Session 53 logged out. Waiting for processes to exit. client # [ 110.532197] systemd-logind[465]: Removed session 53. client # [ 111.100224] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 111.109402] systemd[1]: Started SSH per-connection Daemon (vsock:2:52). client # [ 111.182332] sshd-session[1562]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 111.187183] sshd-session[1562]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 111.192298] sshd-session[1562]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 111.198988] systemd-logind[465]: New session '54' of user 'root' with class 'user' and type 'tty'. client # [ 111.201415] systemd[1]: Started Session 54 of User root. client # [ 111.223727] sshd-session[1568]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 111.225434] sshd-session[1568]: Disconnected from user root UNKNOWN port 65535 client # [ 111.226759] sshd-session[1562]: pam_unix(sshd:session): session closed for user root client # [ 111.229682] systemd[1]: sshd-vsock@52-53-3:22-2:52.service: Deactivated successfully. client # [ 111.233596] systemd[1]: session-54.scope: Deactivated successfully. client # [ 111.236892] systemd-logind[465]: Session 54 logged out. Waiting for processes to exit. client # [ 111.238794] systemd-logind[465]: Removed session 54. client # [ 111.803781] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 111.814159] systemd[1]: Started SSH per-connection Daemon (vsock:2:53). client # [ 111.882512] sshd-session[1574]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 111.887154] sshd-session[1574]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 111.892893] sshd-session[1574]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 111.899239] systemd-logind[465]: New session '55' of user 'root' with class 'user' and type 'tty'. client # [ 111.902432] systemd[1]: Started Session 55 of User root. client # [ 111.924842] sshd-session[1580]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 111.926621] sshd-session[1580]: Disconnected from user root UNKNOWN port 65535 client # [ 111.927954] sshd-session[1574]: pam_unix(sshd:session): session closed for user root client # [ 111.930858] systemd[1]: sshd-vsock@53-54-3:22-2:53.service: Deactivated successfully. client # [ 111.934559] systemd[1]: session-55.scope: Deactivated successfully. client # [ 111.937880] systemd-logind[465]: Session 55 logged out. Waiting for processes to exit. client # [ 111.940192] systemd-logind[465]: Removed session 55. client # [ 112.502844] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 112.511898] systemd[1]: Started SSH per-connection Daemon (vsock:2:54). client # [ 112.578759] sshd-session[1586]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 112.583648] sshd-session[1586]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 112.588683] sshd-session[1586]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 112.595066] systemd-logind[465]: New session '56' of user 'root' with class 'user' and type 'tty'. client # [ 112.598411] systemd[1]: Started Session 56 of User root. client # [ 112.620651] sshd-session[1592]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 112.622537] sshd-session[1592]: Disconnected from user root UNKNOWN port 65535 client # [ 112.623929] sshd-session[1586]: pam_unix(sshd:session): session closed for user root client # [ 112.626890] systemd[1]: sshd-vsock@54-55-3:22-2:54.service: Deactivated successfully. client # [ 112.630652] systemd[1]: session-56.scope: Deactivated successfully. client # [ 112.633951] systemd-logind[465]: Session 56 logged out. Waiting for processes to exit. client # [ 112.635761] systemd-logind[465]: Removed session 56. client # [ 113.208714] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 113.216603] systemd[1]: Started SSH per-connection Daemon (vsock:2:55). client # [ 113.284730] sshd-session[1598]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 113.289780] sshd-session[1598]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 113.294949] sshd-session[1598]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 113.301461] systemd-logind[465]: New session '57' of user 'root' with class 'user' and type 'tty'. client # [ 113.304439] systemd[1]: Started Session 57 of User root. client # [ 113.326674] sshd-session[1604]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 113.328464] sshd-session[1604]: Disconnected from user root UNKNOWN port 65535 client # [ 113.329749] sshd-session[1598]: pam_unix(sshd:session): session closed for user root client # [ 113.332727] systemd[1]: sshd-vsock@55-56-3:22-2:55.service: Deactivated successfully. client # [ 113.336953] systemd[1]: session-57.scope: Deactivated successfully. client # [ 113.340074] systemd-logind[465]: Session 57 logged out. Waiting for processes to exit. client # [ 113.341632] systemd-logind[465]: Removed session 57. client # [ 113.906464] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 113.913253] systemd[1]: Started SSH per-connection Daemon (vsock:2:56). client # [ 113.980628] sshd-session[1610]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 113.985587] sshd-session[1610]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 113.990694] sshd-session[1610]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 113.997242] systemd-logind[465]: New session '58' of user 'root' with class 'user' and type 'tty'. client # [ 114.000416] systemd[1]: Started Session 58 of User root. client # [ 114.022855] sshd-session[1616]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 114.024700] sshd-session[1616]: Disconnected from user root UNKNOWN port 65535 client # [ 114.026336] sshd-session[1610]: pam_unix(sshd:session): session closed for user root client # [ 114.028913] systemd[1]: sshd-vsock@56-57-3:22-2:56.service: Deactivated successfully. client # [ 114.032572] systemd[1]: session-58.scope: Deactivated successfully. client # [ 114.035843] systemd-logind[465]: Session 58 logged out. Waiting for processes to exit. client # [ 114.038121] systemd-logind[465]: Removed session 58. client # [ 114.609591] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 114.616979] systemd[1]: Started SSH per-connection Daemon (vsock:2:57). client # [ 114.683766] sshd-session[1622]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 114.688703] sshd-session[1622]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 114.693796] sshd-session[1622]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 114.700229] systemd-logind[465]: New session '59' of user 'root' with class 'user' and type 'tty'. client # [ 114.704271] systemd[1]: Started Session 59 of User root. client # [ 114.727129] sshd-session[1628]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 114.728424] sshd-session[1628]: Disconnected from user root UNKNOWN port 65535 client # [ 114.729722] sshd-session[1622]: pam_unix(sshd:session): session closed for user root client # [ 114.732659] systemd[1]: sshd-vsock@57-58-3:22-2:57.service: Deactivated successfully. client # [ 114.736363] systemd[1]: session-59.scope: Deactivated successfully. client # [ 114.739502] systemd-logind[465]: Session 59 logged out. Waiting for processes to exit. client # [ 114.741844] systemd-logind[465]: Removed session 59. client # [ 115.309325] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 115.316144] systemd[1]: Started SSH per-connection Daemon (vsock:2:58). client # [ 115.384521] sshd-session[1634]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 115.389127] sshd-session[1634]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 115.394454] sshd-session[1634]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 115.400068] systemd-logind[465]: New session '60' of user 'root' with class 'user' and type 'tty'. client # [ 115.404417] systemd[1]: Started Session 60 of User root. client # [ 115.426640] sshd-session[1640]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 115.428379] sshd-session[1640]: Disconnected from user root UNKNOWN port 65535 client # [ 115.429605] sshd-session[1634]: pam_unix(sshd:session): session closed for user root client # [ 115.432470] systemd[1]: sshd-vsock@58-59-3:22-2:58.service: Deactivated successfully. client # [ 115.436218] systemd[1]: session-60.scope: Deactivated successfully. client # [ 115.439583] systemd-logind[465]: Session 60 logged out. Waiting for processes to exit. client # [ 115.441304] systemd-logind[465]: Removed session 60. client # [ 116.009939] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 116.018482] systemd[1]: Started SSH per-connection Daemon (vsock:2:59). client # [ 116.085687] sshd-session[1646]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 116.090583] sshd-session[1646]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 116.095723] sshd-session[1646]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 116.101113] systemd-logind[465]: New session '61' of user 'root' with class 'user' and type 'tty'. client # [ 116.105348] systemd[1]: Started Session 61 of User root. client # [ 116.127692] sshd-session[1652]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 116.129505] sshd-session[1652]: Disconnected from user root UNKNOWN port 65535 client # [ 116.130757] sshd-session[1646]: pam_unix(sshd:session): session closed for user root client # [ 116.133896] systemd[1]: sshd-vsock@59-60-3:22-2:59.service: Deactivated successfully. client # [ 116.137667] systemd[1]: session-61.scope: Deactivated successfully. client # [ 116.141184] systemd-logind[465]: Session 61 logged out. Waiting for processes to exit. client # [ 116.142758] systemd-logind[465]: Removed session 61. client # [ 116.712423] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 116.720596] systemd[1]: Started SSH per-connection Daemon (vsock:2:60). client # [ 116.790331] sshd-session[1658]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 116.795274] sshd-session[1658]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 116.800547] sshd-session[1658]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 116.807083] systemd-logind[465]: New session '62' of user 'root' with class 'user' and type 'tty'. client # [ 116.810403] systemd[1]: Started Session 62 of User root. client # [ 116.833565] sshd-session[1664]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 116.835401] sshd-session[1664]: Disconnected from user root UNKNOWN port 65535 client # [ 116.836639] sshd-session[1658]: pam_unix(sshd:session): session closed for user root client # [ 116.839593] systemd[1]: sshd-vsock@60-61-3:22-2:60.service: Deactivated successfully. client # [ 116.843472] systemd[1]: session-62.scope: Deactivated successfully. client # [ 116.846901] systemd-logind[465]: Session 62 logged out. Waiting for processes to exit. client # [ 116.848442] systemd-logind[465]: Removed session 62. client # [ 117.415922] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 117.424170] systemd[1]: Started SSH per-connection Daemon (vsock:2:61). client # [ 117.492599] sshd-session[1670]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 117.497680] sshd-session[1670]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 117.503171] sshd-session[1670]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 117.510297] systemd-logind[465]: New session '63' of user 'root' with class 'user' and type 'tty'. client # [ 117.513392] systemd[1]: Started Session 63 of User root. client # [ 117.536362] sshd-session[1676]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 117.538132] sshd-session[1676]: Disconnected from user root UNKNOWN port 65535 client # [ 117.539433] sshd-session[1670]: pam_unix(sshd:session): session closed for user root client # [ 117.542338] systemd[1]: sshd-vsock@61-62-3:22-2:61.service: Deactivated successfully. client # [ 117.546293] systemd[1]: session-63.scope: Deactivated successfully. client # [ 117.549702] systemd-logind[465]: Session 63 logged out. Waiting for processes to exit. client # [ 117.551447] systemd-logind[465]: Removed session 63. client # [ 118.113427] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 118.123178] systemd[1]: Started SSH per-connection Daemon (vsock:2:62). client # [ 118.191628] sshd-session[1682]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 118.196613] sshd-session[1682]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 118.201845] sshd-session[1682]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 118.207242] systemd-logind[465]: New session '64' of user 'root' with class 'user' and type 'tty'. client # [ 118.212373] systemd[1]: Started Session 64 of User root. client # [ 118.235337] sshd-session[1688]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 118.237127] sshd-session[1688]: Disconnected from user root UNKNOWN port 65535 client # [ 118.238514] sshd-session[1682]: pam_unix(sshd:session): session closed for user root client # [ 118.241587] systemd[1]: sshd-vsock@62-63-3:22-2:62.service: Deactivated successfully. client # [ 118.245493] systemd[1]: session-64.scope: Deactivated successfully. client # [ 118.248918] systemd-logind[465]: Session 64 logged out. Waiting for processes to exit. client # [ 118.251192] systemd-logind[465]: Removed session 64. client # [ 118.815863] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 118.824701] systemd[1]: Started SSH per-connection Daemon (vsock:2:63). client # [ 118.895806] sshd-session[1694]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 118.900736] sshd-session[1694]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 118.905917] sshd-session[1694]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 118.912242] systemd-logind[465]: New session '65' of user 'root' with class 'user' and type 'tty'. client # [ 118.915380] systemd[1]: Started Session 65 of User root. client # [ 118.937673] sshd-session[1700]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 118.939376] sshd-session[1700]: Disconnected from user root UNKNOWN port 65535 client # [ 118.940616] sshd-session[1694]: pam_unix(sshd:session): session closed for user root client # [ 118.943625] systemd[1]: sshd-vsock@63-64-3:22-2:63.service: Deactivated successfully. client # [ 118.947317] systemd[1]: session-65.scope: Deactivated successfully. client # [ 118.950323] systemd-logind[465]: Session 65 logged out. Waiting for processes to exit. client # [ 118.951984] systemd-logind[465]: Removed session 65. client # [ 119.517186] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 119.525497] systemd[1]: Started SSH per-connection Daemon (vsock:2:64). client # [ 119.594263] sshd-session[1706]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 119.599280] sshd-session[1706]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 119.604491] sshd-session[1706]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 119.611254] systemd-logind[465]: New session '66' of user 'root' with class 'user' and type 'tty'. client # [ 119.613419] systemd[1]: Started Session 66 of User root. client # [ 119.635724] sshd-session[1712]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 119.637539] sshd-session[1712]: Disconnected from user root UNKNOWN port 65535 client # [ 119.638875] sshd-session[1706]: pam_unix(sshd:session): session closed for user root client # [ 119.641817] systemd[1]: sshd-vsock@64-65-3:22-2:64.service: Deactivated successfully. client # [ 119.645542] systemd[1]: session-66.scope: Deactivated successfully. client # [ 119.648844] systemd-logind[465]: Session 66 logged out. Waiting for processes to exit. client # [ 119.651112] systemd-logind[465]: Removed session 66. client # [ 120.219070] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 120.229179] systemd[1]: Started SSH per-connection Daemon (vsock:2:65). client # [ 120.297203] sshd-session[1718]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 120.301991] sshd-session[1718]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 120.307340] sshd-session[1718]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 120.313234] systemd-logind[465]: New session '67' of user 'root' with class 'user' and type 'tty'. client # [ 120.317346] systemd[1]: Started Session 67 of User root. client # [ 120.339709] sshd-session[1724]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 120.341482] sshd-session[1724]: Disconnected from user root UNKNOWN port 65535 client # [ 120.342795] sshd-session[1718]: pam_unix(sshd:session): session closed for user root client # [ 120.345694] systemd[1]: sshd-vsock@65-66-3:22-2:65.service: Deactivated successfully. client # [ 120.349447] systemd[1]: session-67.scope: Deactivated successfully. client # [ 120.352847] systemd-logind[465]: Session 67 logged out. Waiting for processes to exit. client # [ 120.355081] systemd-logind[465]: Removed session 67. client # [ 120.920466] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 120.927787] systemd[1]: Started SSH per-connection Daemon (vsock:2:66). client # [ 120.997657] sshd-session[1730]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 121.002718] sshd-session[1730]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 121.008069] sshd-session[1730]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 121.014721] systemd-logind[465]: New session '68' of user 'root' with class 'user' and type 'tty'. client # [ 121.017350] systemd[1]: Started Session 68 of User root. client # [ 121.040500] sshd-session[1736]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 121.041870] sshd-session[1736]: Disconnected from user root UNKNOWN port 65535 client # [ 121.043204] sshd-session[1730]: pam_unix(sshd:session): session closed for user root client # [ 121.046248] systemd[1]: sshd-vsock@66-67-3:22-2:66.service: Deactivated successfully. client # [ 121.049767] systemd[1]: session-68.scope: Deactivated successfully. client # [ 121.053184] systemd-logind[465]: Session 68 logged out. Waiting for processes to exit. client # [ 121.054944] systemd-logind[465]: Removed session 68. client # [ 121.620877] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 121.629690] systemd[1]: Started SSH per-connection Daemon (vsock:2:67). client # [ 121.698622] sshd-session[1742]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 121.703650] sshd-session[1742]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 121.708898] sshd-session[1742]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 121.715461] systemd-logind[465]: New session '69' of user 'root' with class 'user' and type 'tty'. client # [ 121.718378] systemd[1]: Started Session 69 of User root. client # [ 121.741524] sshd-session[1748]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 121.742810] sshd-session[1748]: Disconnected from user root UNKNOWN port 65535 client # [ 121.744274] sshd-session[1742]: pam_unix(sshd:session): session closed for user root client # [ 121.747240] systemd[1]: sshd-vsock@67-68-3:22-2:67.service: Deactivated successfully. client # [ 121.750694] systemd[1]: session-69.scope: Deactivated successfully. client # [ 121.754319] systemd-logind[465]: Session 69 logged out. Waiting for processes to exit. client # [ 121.755619] systemd-logind[465]: Removed session 69. client # [ 122.324345] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 122.332304] systemd[1]: Started SSH per-connection Daemon (vsock:2:68). [e2e] heartbeat t=60s client # [ 122.400794] sshd-session[1754]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 122.405779] sshd-session[1754]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 122.411194] sshd-session[1754]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 122.417067] systemd-logind[465]: New session '70' of user 'root' with class 'user' and type 'tty'. client # [ 122.421429] systemd[1]: Started Session 70 of User root. client # [ 122.443898] sshd-session[1760]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 122.445655] sshd-session[1760]: Disconnected from user root UNKNOWN port 65535 client # [ 122.447075] sshd-session[1754]: pam_unix(sshd:session): session closed for user root client # [ 122.449924] systemd[1]: sshd-vsock@68-69-3:22-2:68.service: Deactivated successfully. client # [ 122.453682] systemd[1]: session-70.scope: Deactivated successfully. client # [ 122.457246] systemd-logind[465]: Session 70 logged out. Waiting for processes to exit. client # [ 122.458837] systemd-logind[465]: Removed session 70. client # [ 123.024792] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 123.033293] systemd[1]: Started SSH per-connection Daemon (vsock:2:69). client # [ 123.102344] sshd-session[1766]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 123.107304] sshd-session[1766]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 123.112496] sshd-session[1766]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 123.119236] systemd-logind[465]: New session '71' of user 'root' with class 'user' and type 'tty'. client # [ 123.122357] systemd[1]: Started Session 71 of User root. client # [ 123.144769] sshd-session[1772]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 123.146531] sshd-session[1772]: Disconnected from user root UNKNOWN port 65535 client # [ 123.147868] sshd-session[1766]: pam_unix(sshd:session): session closed for user root client # [ 123.150931] systemd[1]: sshd-vsock@69-70-3:22-2:69.service: Deactivated successfully. client # [ 123.154654] systemd[1]: session-71.scope: Deactivated successfully. client # [ 123.158238] systemd-logind[465]: Session 71 logged out. Waiting for processes to exit. client # [ 123.159888] systemd-logind[465]: Removed session 71. client # [ 123.726329] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 123.735111] systemd[1]: Started SSH per-connection Daemon (vsock:2:70). client # [ 123.802343] sshd-session[1778]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 123.807231] sshd-session[1778]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 123.812821] sshd-session[1778]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 123.819071] systemd-logind[465]: New session '72' of user 'root' with class 'user' and type 'tty'. client # [ 123.822435] systemd[1]: Started Session 72 of User root. client # [ 123.844979] sshd-session[1784]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 123.846733] sshd-session[1784]: Disconnected from user root UNKNOWN port 65535 client # [ 123.848085] sshd-session[1778]: pam_unix(sshd:session): session closed for user root client # [ 123.851058] systemd[1]: sshd-vsock@70-71-3:22-2:70.service: Deactivated successfully. client # [ 123.854806] systemd[1]: session-72.scope: Deactivated successfully. client # [ 123.858186] systemd-logind[465]: Session 72 logged out. Waiting for processes to exit. client # [ 123.859823] systemd-logind[465]: Removed session 72. client # [ 124.426906] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 124.435827] systemd[1]: Started SSH per-connection Daemon (vsock:2:71). client # [ 124.506361] sshd-session[1790]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 124.511361] sshd-session[1790]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 124.516635] sshd-session[1790]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 124.523249] systemd-logind[465]: New session '73' of user 'root' with class 'user' and type 'tty'. client # [ 124.526451] systemd[1]: Started Session 73 of User root. client # [ 124.549547] sshd-session[1796]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 124.550808] sshd-session[1796]: Disconnected from user root UNKNOWN port 65535 client # [ 124.552142] sshd-session[1790]: pam_unix(sshd:session): session closed for user root client # [ 124.555131] systemd[1]: sshd-vsock@71-72-3:22-2:71.service: Deactivated successfully. client # [ 124.558756] systemd[1]: session-73.scope: Deactivated successfully. client # [ 124.562290] systemd-logind[465]: Session 73 logged out. Waiting for processes to exit. client # [ 124.563889] systemd-logind[465]: Removed session 73. client # [ 125.128463] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 125.138169] systemd[1]: Started SSH per-connection Daemon (vsock:2:72). client # [ 125.206351] sshd-session[1802]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 125.211247] sshd-session[1802]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 125.216469] sshd-session[1802]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 125.223087] systemd-logind[465]: New session '74' of user 'root' with class 'user' and type 'tty'. client # [ 125.225353] systemd[1]: Started Session 74 of User root. client # [ 125.247812] sshd-session[1808]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 125.249612] sshd-session[1808]: Disconnected from user root UNKNOWN port 65535 client # [ 125.250926] sshd-session[1802]: pam_unix(sshd:session): session closed for user root client # [ 125.253879] systemd[1]: sshd-vsock@72-73-3:22-2:72.service: Deactivated successfully. client # [ 125.257565] systemd[1]: session-74.scope: Deactivated successfully. client # [ 125.260884] systemd-logind[465]: Session 74 logged out. Waiting for processes to exit. client # [ 125.262618] systemd-logind[465]: Removed session 74. client # [ 125.828878] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 125.838844] systemd[1]: Started SSH per-connection Daemon (vsock:2:73). client # [ 125.905843] sshd-session[1814]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 125.910134] sshd-session[1814]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 125.914899] sshd-session[1814]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 125.921230] systemd-logind[465]: New session '75' of user 'root' with class 'user' and type 'tty'. client # [ 125.924345] systemd[1]: Started Session 75 of User root. client # [ 125.944800] sshd-session[1820]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 125.946519] sshd-session[1820]: Disconnected from user root UNKNOWN port 65535 client # [ 125.947823] sshd-session[1814]: pam_unix(sshd:session): session closed for user root client # [ 125.950624] systemd[1]: sshd-vsock@73-74-3:22-2:73.service: Deactivated successfully. client # [ 125.954472] systemd[1]: session-75.scope: Deactivated successfully. client # [ 125.957438] systemd-logind[465]: Session 75 logged out. Waiting for processes to exit. client # [ 125.959428] systemd-logind[465]: Removed session 75. client # [ 126.532325] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 126.539254] systemd[1]: Started SSH per-connection Daemon (vsock:2:74). client # [ 126.606269] sshd-session[1826]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 126.611122] sshd-session[1826]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 126.616230] sshd-session[1826]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 126.622324] systemd-logind[465]: New session '76' of user 'root' with class 'user' and type 'tty'. client # [ 126.626414] systemd[1]: Started Session 76 of User root. client # [ 126.648670] sshd-session[1832]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 126.650480] sshd-session[1832]: Disconnected from user root UNKNOWN port 65535 client # [ 126.651756] sshd-session[1826]: pam_unix(sshd:session): session closed for user root client # [ 126.654672] systemd[1]: sshd-vsock@74-75-3:22-2:74.service: Deactivated successfully. client # [ 126.658561] systemd[1]: session-76.scope: Deactivated successfully. client # [ 126.661960] systemd-logind[465]: Session 76 logged out. Waiting for processes to exit. client # [ 126.663651] systemd-logind[465]: Removed session 76. client # [ 127.233890] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 127.240951] systemd[1]: Started SSH per-connection Daemon (vsock:2:75). client # [ 127.310344] sshd-session[1838]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 127.315358] sshd-session[1838]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 127.320640] sshd-session[1838]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 127.327287] systemd-logind[465]: New session '77' of user 'root' with class 'user' and type 'tty'. client # [ 127.330298] systemd[1]: Started Session 77 of User root. client # [ 127.353597] sshd-session[1844]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 127.354887] sshd-session[1844]: Disconnected from user root UNKNOWN port 65535 client # [ 127.356218] sshd-session[1838]: pam_unix(sshd:session): session closed for user root client # [ 127.359248] systemd[1]: sshd-vsock@75-76-3:22-2:75.service: Deactivated successfully. client # [ 127.362762] systemd[1]: session-77.scope: Deactivated successfully. client # [ 127.366193] systemd-logind[465]: Session 77 logged out. Waiting for processes to exit. client # [ 127.367765] systemd-logind[465]: Removed session 77. client # [ 127.932507] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 127.941162] systemd[1]: Started SSH per-connection Daemon (vsock:2:76). client # [ 128.010545] sshd-session[1850]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 128.015666] sshd-session[1850]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 128.021142] sshd-session[1850]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 128.026613] systemd-logind[465]: New session '78' of user 'root' with class 'user' and type 'tty'. client # [ 128.031529] systemd[1]: Started Session 78 of User root. client # [ 128.054502] sshd-session[1856]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 128.056179] sshd-session[1856]: Disconnected from user root UNKNOWN port 65535 client # [ 128.057456] sshd-session[1850]: pam_unix(sshd:session): session closed for user root client # [ 128.060347] systemd[1]: sshd-vsock@76-77-3:22-2:76.service: Deactivated successfully. client # [ 128.063748] systemd[1]: session-78.scope: Deactivated successfully. client # [ 128.067280] systemd-logind[465]: Session 78 logged out. Waiting for processes to exit. client # [ 128.068609] systemd-logind[465]: Removed session 78. client # [ 128.634830] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 128.644164] systemd[1]: Started SSH per-connection Daemon (vsock:2:77). client # [ 128.713781] sshd-session[1862]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 128.718810] sshd-session[1862]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 128.724070] sshd-session[1862]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 128.730857] systemd-logind[465]: New session '79' of user 'root' with class 'user' and type 'tty'. client # [ 128.734378] systemd[1]: Started Session 79 of User root. client # [ 128.756592] sshd-session[1868]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 128.758363] sshd-session[1868]: Disconnected from user root UNKNOWN port 65535 client # [ 128.759729] sshd-session[1862]: pam_unix(sshd:session): session closed for user root client # [ 128.762708] systemd[1]: sshd-vsock@77-78-3:22-2:77.service: Deactivated successfully. client # [ 128.766786] systemd[1]: session-79.scope: Deactivated successfully. client # [ 128.769749] systemd-logind[465]: Session 79 logged out. Waiting for processes to exit. client # [ 128.771564] systemd-logind[465]: Removed session 79. client # [ 129.332377] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 129.336056] systemd[1]: Started SSH per-connection Daemon (vsock:2:78). client # [ 129.380585] sshd-session[1874]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 129.385114] sshd-session[1874]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 129.390493] sshd-session[1874]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 129.396228] systemd-logind[465]: New session '80' of user 'root' with class 'user' and type 'tty'. client # [ 129.400395] systemd[1]: Started Session 80 of User root. client # [ 129.421799] sshd-session[1880]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 129.423585] sshd-session[1880]: Disconnected from user root UNKNOWN port 65535 client # [ 129.424836] sshd-session[1874]: pam_unix(sshd:session): session closed for user root client # [ 129.427818] systemd[1]: sshd-vsock@78-79-3:22-2:78.service: Deactivated successfully. client # [ 129.431414] systemd[1]: session-80.scope: Deactivated successfully. client # [ 129.434413] systemd-logind[465]: Session 80 logged out. Waiting for processes to exit. client # [ 129.436184] systemd-logind[465]: Removed session 80. client # [ 130.035991] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 130.044669] systemd[1]: Started SSH per-connection Daemon (vsock:2:79). client # [ 130.114763] sshd-session[1886]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 130.119709] sshd-session[1886]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 130.124952] sshd-session[1886]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 130.131236] systemd-logind[465]: New session '81' of user 'root' with class 'user' and type 'tty'. client # [ 130.134372] systemd[1]: Started Session 81 of User root. client # [ 130.156333] sshd-session[1892]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 130.157988] sshd-session[1892]: Disconnected from user root UNKNOWN port 65535 client # [ 130.159286] sshd-session[1886]: pam_unix(sshd:session): session closed for user root client # [ 130.162218] systemd[1]: sshd-vsock@79-80-3:22-2:79.service: Deactivated successfully. client # [ 130.165638] systemd[1]: session-81.scope: Deactivated successfully. client # [ 130.168860] systemd-logind[465]: Session 81 logged out. Waiting for processes to exit. client # [ 130.170538] systemd-logind[465]: Removed session 81. client # [ 130.736324] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 130.745929] systemd[1]: Started SSH per-connection Daemon (vsock:2:80). client # [ 130.813420] sshd-session[1898]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 130.818357] sshd-session[1898]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 130.823411] sshd-session[1898]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 130.828597] systemd-logind[465]: New session '82' of user 'root' with class 'user' and type 'tty'. client # [ 130.833442] systemd[1]: Started Session 82 of User root. client # [ 130.855280] sshd-session[1904]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 130.857149] sshd-session[1904]: Disconnected from user root UNKNOWN port 65535 client # [ 130.858423] sshd-session[1898]: pam_unix(sshd:session): session closed for user root client # [ 130.861248] systemd[1]: sshd-vsock@80-81-3:22-2:80.service: Deactivated successfully. client # [ 130.864872] systemd[1]: session-82.scope: Deactivated successfully. client # [ 130.868416] systemd-logind[465]: Session 82 logged out. Waiting for processes to exit. client # [ 130.869812] systemd-logind[465]: Removed session 82. client # [ 131.439572] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 131.448103] systemd[1]: Started SSH per-connection Daemon (vsock:2:81). client # [ 131.516274] sshd-session[1910]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 131.521309] sshd-session[1910]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 131.526529] sshd-session[1910]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 131.533227] systemd-logind[465]: New session '83' of user 'root' with class 'user' and type 'tty'. client # [ 131.536352] systemd[1]: Started Session 83 of User root. client # [ 131.558692] sshd-session[1916]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 131.559896] sshd-session[1916]: Disconnected from user root UNKNOWN port 65535 client # [ 131.561222] sshd-session[1910]: pam_unix(sshd:session): session closed for user root client # [ 131.563927] systemd[1]: sshd-vsock@81-82-3:22-2:81.service: Deactivated successfully. client # [ 131.567599] systemd[1]: session-83.scope: Deactivated successfully. client # [ 131.570846] systemd-logind[465]: Session 83 logged out. Waiting for processes to exit. client # [ 131.573133] systemd-logind[465]: Removed session 83. client # [ 132.142154] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 132.149699] systemd[1]: Started SSH per-connection Daemon (vsock:2:82). client # [ 132.216829] sshd-session[1922]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 132.221892] sshd-session[1922]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 132.226941] sshd-session[1922]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 132.233640] systemd-logind[465]: New session '84' of user 'root' with class 'user' and type 'tty'. client # [ 132.236428] systemd[1]: Started Session 84 of User root. client # [ 132.257939] sshd-session[1928]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 132.259687] sshd-session[1928]: Disconnected from user root UNKNOWN port 65535 client # [ 132.260956] sshd-session[1922]: pam_unix(sshd:session): session closed for user root client # [ 132.263784] systemd[1]: sshd-vsock@82-83-3:22-2:82.service: Deactivated successfully. client # [ 132.267393] systemd[1]: session-84.scope: Deactivated successfully. client # [ 132.270648] systemd-logind[465]: Session 84 logged out. Waiting for processes to exit. client # [ 132.272682] systemd-logind[465]: Removed session 84. client # [ 132.842791] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 132.850661] systemd[1]: Started SSH per-connection Daemon (vsock:2:83). client # [ 132.918969] sshd-session[1934]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 132.924142] sshd-session[1934]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 132.929203] sshd-session[1934]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 132.935948] systemd-logind[465]: New session '85' of user 'root' with class 'user' and type 'tty'. client # [ 132.939409] systemd[1]: Started Session 85 of User root. client # [ 132.961625] sshd-session[1940]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 132.962891] sshd-session[1940]: Disconnected from user root UNKNOWN port 65535 client # [ 132.964215] sshd-session[1934]: pam_unix(sshd:session): session closed for user root client # [ 132.967309] systemd[1]: sshd-vsock@83-84-3:22-2:83.service: Deactivated successfully. client # [ 132.970598] systemd[1]: session-85.scope: Deactivated successfully. client # [ 132.973159] systemd-logind[465]: Session 85 logged out. Waiting for processes to exit. client # [ 132.975910] systemd-logind[465]: Removed session 85. client # [ 133.543354] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 133.549986] systemd[1]: Started SSH per-connection Daemon (vsock:2:84). client # [ 133.617400] sshd-session[1946]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 133.622331] sshd-session[1946]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 133.627429] sshd-session[1946]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 133.633065] systemd-logind[465]: New session '86' of user 'root' with class 'user' and type 'tty'. client # [ 133.637397] systemd[1]: Started Session 86 of User root. client # [ 133.659217] sshd-session[1952]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 133.660850] sshd-session[1952]: Disconnected from user root UNKNOWN port 65535 client # [ 133.662152] sshd-session[1946]: pam_unix(sshd:session): session closed for user root client # [ 133.665129] systemd[1]: sshd-vsock@84-85-3:22-2:84.service: Deactivated successfully. client # [ 133.668468] systemd[1]: session-86.scope: Deactivated successfully. client # [ 133.671582] systemd-logind[465]: Session 86 logged out. Waiting for processes to exit. client # [ 133.673319] systemd-logind[465]: Removed session 86. client # [ 134.244688] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 134.254896] systemd[1]: Started SSH per-connection Daemon (vsock:2:85). client # [ 134.321339] sshd-session[1958]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 134.326213] sshd-session[1958]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 134.331235] sshd-session[1958]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 134.336714] systemd-logind[465]: New session '87' of user 'root' with class 'user' and type 'tty'. client # [ 134.340393] systemd[1]: Started Session 87 of User root. client # [ 134.361860] sshd-session[1964]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 134.363570] sshd-session[1964]: Disconnected from user root UNKNOWN port 65535 client # [ 134.364904] sshd-session[1958]: pam_unix(sshd:session): session closed for user root client # [ 134.367811] systemd[1]: sshd-vsock@85-86-3:22-2:85.service: Deactivated successfully. client # [ 134.371400] systemd[1]: session-87.scope: Deactivated successfully. client # [ 134.374218] systemd-logind[465]: Session 87 logged out. Waiting for processes to exit. client # [ 134.376177] systemd-logind[465]: Removed session 87. client # [ 134.945372] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 134.953669] systemd[1]: Started SSH per-connection Daemon (vsock:2:86). client # [ 135.023277] sshd-session[1970]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 135.028306] sshd-session[1970]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 135.033422] sshd-session[1970]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 135.039061] systemd-logind[465]: New session '88' of user 'root' with class 'user' and type 'tty'. client # [ 135.043395] systemd[1]: Started Session 88 of User root. client # [ 135.065342] sshd-session[1976]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 135.066566] sshd-session[1976]: Disconnected from user root UNKNOWN port 65535 client # [ 135.067841] sshd-session[1970]: pam_unix(sshd:session): session closed for user root client # [ 135.070646] systemd[1]: sshd-vsock@86-87-3:22-2:86.service: Deactivated successfully. client # [ 135.074354] systemd[1]: session-88.scope: Deactivated successfully. client # [ 135.077273] systemd-logind[465]: Session 88 logged out. Waiting for processes to exit. client # [ 135.079099] systemd-logind[465]: Removed session 88. client # [ 135.646849] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 135.654978] systemd[1]: Started SSH per-connection Daemon (vsock:2:87). client # [ 135.722525] sshd-session[1982]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 135.727126] sshd-session[1982]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 135.732553] sshd-session[1982]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 135.738223] systemd-logind[465]: New session '89' of user 'root' with class 'user' and type 'tty'. client # [ 135.742436] systemd[1]: Started Session 89 of User root. client # [ 135.764207] sshd-session[1988]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 135.765987] sshd-session[1988]: Disconnected from user root UNKNOWN port 65535 client # [ 135.767349] sshd-session[1982]: pam_unix(sshd:session): session closed for user root client # [ 135.770371] systemd[1]: sshd-vsock@87-88-3:22-2:87.service: Deactivated successfully. client # [ 135.773661] systemd[1]: session-89.scope: Deactivated successfully. client # [ 135.776682] systemd-logind[465]: Session 89 logged out. Waiting for processes to exit. client # [ 135.778639] systemd-logind[465]: Removed session 89. client # [ 136.350306] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 136.357914] systemd[1]: Started SSH per-connection Daemon (vsock:2:88). client # [ 136.424569] sshd-session[1994]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 136.429727] sshd-session[1994]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 136.434890] sshd-session[1994]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 136.441067] systemd-logind[465]: New session '90' of user 'root' with class 'user' and type 'tty'. client # [ 136.444398] systemd[1]: Started Session 90 of User root. client # [ 136.465909] sshd-session[2000]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 136.467693] sshd-session[2000]: Disconnected from user root UNKNOWN port 65535 client # [ 136.468970] sshd-session[1994]: pam_unix(sshd:session): session closed for user root client # [ 136.471787] systemd[1]: sshd-vsock@88-89-3:22-2:88.service: Deactivated successfully. client # [ 136.475407] systemd[1]: session-90.scope: Deactivated successfully. client # [ 136.478639] systemd-logind[465]: Session 90 logged out. Waiting for processes to exit. client # [ 136.480377] systemd-logind[465]: Removed session 90. client # [ 137.051589] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 137.058308] systemd[1]: Started SSH per-connection Daemon (vsock:2:89). client # [ 137.126540] sshd-session[2006]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 137.131122] sshd-session[2006]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 137.136506] sshd-session[2006]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 137.141872] systemd-logind[465]: New session '91' of user 'root' with class 'user' and type 'tty'. client # [ 137.146407] systemd[1]: Started Session 91 of User root. client # [ 137.168212] sshd-session[2012]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 137.169837] sshd-session[2012]: Disconnected from user root UNKNOWN port 65535 client # [ 137.171154] sshd-session[2006]: pam_unix(sshd:session): session closed for user root client # [ 137.174066] systemd[1]: sshd-vsock@89-90-3:22-2:89.service: Deactivated successfully. client # [ 137.177485] systemd[1]: session-91.scope: Deactivated successfully. client # [ 137.180662] systemd-logind[465]: Session 91 logged out. Waiting for processes to exit. client # [ 137.182300] systemd-logind[465]: Removed session 91. client # [ 137.750374] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 137.759280] systemd[1]: Started SSH per-connection Daemon (vsock:2:90). client # [ 137.826748] sshd-session[2018]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 137.831752] sshd-session[2018]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 137.836807] sshd-session[2018]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 137.843066] systemd-logind[465]: New session '92' of user 'root' with class 'user' and type 'tty'. client # [ 137.846422] systemd[1]: Started Session 92 of User root. client # [ 137.867953] sshd-session[2024]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 137.869723] sshd-session[2024]: Disconnected from user root UNKNOWN port 65535 client # [ 137.871130] sshd-session[2018]: pam_unix(sshd:session): session closed for user root client # [ 137.873882] systemd[1]: sshd-vsock@90-91-3:22-2:90.service: Deactivated successfully. client # [ 137.877482] systemd[1]: session-92.scope: Deactivated successfully. client # [ 137.880623] systemd-logind[465]: Session 92 logged out. Waiting for processes to exit. client # [ 137.882313] systemd-logind[465]: Removed session 92. client # [ 138.450830] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 138.460160] systemd[1]: Started SSH per-connection Daemon (vsock:2:91). client # [ 138.526284] sshd-session[2030]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 138.531257] sshd-session[2030]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 138.536345] sshd-session[2030]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 138.541743] systemd-logind[465]: New session '93' of user 'root' with class 'user' and type 'tty'. client # [ 138.545397] systemd[1]: Started Session 93 of User root. client # [ 138.567216] sshd-session[2036]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 138.568736] sshd-session[2036]: Disconnected from user root UNKNOWN port 65535 client # [ 138.570105] sshd-session[2030]: pam_unix(sshd:session): session closed for user root client # [ 138.572905] systemd[1]: sshd-vsock@91-92-3:22-2:91.service: Deactivated successfully. client # [ 138.576462] systemd[1]: session-93.scope: Deactivated successfully. client # [ 138.579068] systemd-logind[465]: Session 93 logged out. Waiting for processes to exit. client # [ 138.581777] systemd-logind[465]: Removed session 93. client # [ 139.153472] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 139.162597] systemd[1]: Started SSH per-connection Daemon (vsock:2:92). client # [ 139.226717] sshd-session[2042]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 139.231650] sshd-session[2042]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 139.236686] sshd-session[2042]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 139.243067] systemd-logind[465]: New session '94' of user 'root' with class 'user' and type 'tty'. client # [ 139.246480] systemd[1]: Started Session 94 of User root. client # [ 139.268600] sshd-session[2048]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 139.269902] sshd-session[2048]: Disconnected from user root UNKNOWN port 65535 client # [ 139.271231] sshd-session[2042]: pam_unix(sshd:session): session closed for user root client # [ 139.274110] systemd[1]: sshd-vsock@92-93-3:22-2:92.service: Deactivated successfully. client # [ 139.277642] systemd[1]: session-94.scope: Deactivated successfully. client # [ 139.280895] systemd-logind[465]: Session 94 logged out. Waiting for processes to exit. client # [ 139.282610] systemd-logind[465]: Removed session 94. client # [ 139.855758] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 139.863145] systemd[1]: Started SSH per-connection Daemon (vsock:2:93). client # [ 139.927869] sshd-session[2054]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 139.932923] sshd-session[2054]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 139.937975] sshd-session[2054]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 139.944303] systemd-logind[465]: New session '95' of user 'root' with class 'user' and type 'tty'. client # [ 139.947332] systemd[1]: Started Session 95 of User root. client # [ 139.968907] sshd-session[2060]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 139.970591] sshd-session[2060]: Disconnected from user root UNKNOWN port 65535 client # [ 139.971892] sshd-session[2054]: pam_unix(sshd:session): session closed for user root client # [ 139.974698] systemd[1]: sshd-vsock@93-94-3:22-2:93.service: Deactivated successfully. client # [ 139.978420] systemd[1]: session-95.scope: Deactivated successfully. client # [ 139.981491] systemd-logind[465]: Session 95 logged out. Waiting for processes to exit. client # [ 139.983772] systemd-logind[465]: Removed session 95. client # [ 140.557286] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 140.563773] systemd[1]: Started SSH per-connection Daemon (vsock:2:94). client # [ 140.631545] sshd-session[2066]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 140.636557] sshd-session[2066]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 140.641644] sshd-session[2066]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 140.646739] systemd-logind[465]: New session '96' of user 'root' with class 'user' and type 'tty'. client # [ 140.651701] systemd[1]: Started Session 96 of User root. client # [ 140.672839] sshd-session[2072]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 140.674579] sshd-session[2072]: Disconnected from user root UNKNOWN port 65535 client # [ 140.675891] sshd-session[2066]: pam_unix(sshd:session): session closed for user root client # [ 140.678905] systemd[1]: sshd-vsock@94-95-3:22-2:94.service: Deactivated successfully. client # [ 140.682504] systemd[1]: session-96.scope: Deactivated successfully. client # [ 140.685637] systemd-logind[465]: Session 96 logged out. Waiting for processes to exit. client # [ 140.687302] systemd-logind[465]: Removed session 96. client # [ 141.258681] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 141.266138] systemd[1]: Started SSH per-connection Daemon (vsock:2:95). client # [ 141.332231] sshd-session[2078]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 141.337188] sshd-session[2078]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 141.342333] sshd-session[2078]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 141.348235] systemd-logind[465]: New session '97' of user 'root' with class 'user' and type 'tty'. client # [ 141.352351] systemd[1]: Started Session 97 of User root. client # [ 141.374506] sshd-session[2084]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 141.375757] sshd-session[2084]: Disconnected from user root UNKNOWN port 65535 client # [ 141.376984] sshd-session[2078]: pam_unix(sshd:session): session closed for user root client # [ 141.379826] systemd[1]: sshd-vsock@95-96-3:22-2:95.service: Deactivated successfully. client # [ 141.383356] systemd[1]: session-97.scope: Deactivated successfully. client # [ 141.386548] systemd-logind[465]: Session 97 logged out. Waiting for processes to exit. client # [ 141.388739] systemd-logind[465]: Removed session 97. client # [ 141.960231] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 141.967448] systemd[1]: Started SSH per-connection Daemon (vsock:2:96). client # [ 142.033980] sshd-session[2090]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 142.039045] sshd-session[2090]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 142.044154] sshd-session[2090]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 142.050557] systemd-logind[465]: New session '98' of user 'root' with class 'user' and type 'tty'. client # [ 142.053310] systemd[1]: Started Session 98 of User root. client # [ 142.075218] sshd-session[2096]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 142.076798] sshd-session[2096]: Disconnected from user root UNKNOWN port 65535 client # [ 142.078147] sshd-session[2090]: pam_unix(sshd:session): session closed for user root client # [ 142.081190] systemd[1]: sshd-vsock@96-97-3:22-2:96.service: Deactivated successfully. client # [ 142.084602] systemd[1]: session-98.scope: Deactivated successfully. client # [ 142.087737] systemd-logind[465]: Session 98 logged out. Waiting for processes to exit. client # [ 142.090097] systemd-logind[465]: Removed session 98. client # [ 142.659680] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 142.669152] systemd[1]: Started SSH per-connection Daemon (vsock:2:97). client # [ 142.740847] sshd-session[2102]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 142.745750] sshd-session[2102]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 142.750854] sshd-session[2102]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 142.757220] systemd-logind[465]: New session '99' of user 'root' with class 'user' and type 'tty'. client # [ 142.761360] systemd[1]: Started Session 99 of User root. client # [ 142.783327] sshd-session[2108]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 142.784995] sshd-session[2108]: Disconnected from user root UNKNOWN port 65535 client # [ 142.786281] sshd-session[2102]: pam_unix(sshd:session): session closed for user root client # [ 142.789173] systemd[1]: sshd-vsock@97-98-3:22-2:97.service: Deactivated successfully. client # [ 142.792617] systemd[1]: session-99.scope: Deactivated successfully. client # [ 142.795842] systemd-logind[465]: Session 99 logged out. Waiting for processes to exit. client # [ 142.797987] systemd-logind[465]: Removed session 99. client # [ 143.362280] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 143.370137] systemd[1]: Started SSH per-connection Daemon (vsock:2:98). client # [ 143.435467] sshd-session[2114]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 143.440113] sshd-session[2114]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 143.445472] sshd-session[2114]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 143.451066] systemd-logind[465]: New session '100' of user 'root' with class 'user' and type 'tty'. client # [ 143.455398] systemd[1]: Started Session 100 of User root. client # [ 143.477472] sshd-session[2120]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 143.478792] sshd-session[2120]: Disconnected from user root UNKNOWN port 65535 client # [ 143.480152] sshd-session[2114]: pam_unix(sshd:session): session closed for user root client # [ 143.482955] systemd[1]: sshd-vsock@98-99-3:22-2:98.service: Deactivated successfully. client # [ 143.486492] systemd[1]: session-100.scope: Deactivated successfully. client # [ 143.489651] systemd-logind[465]: Session 100 logged out. Waiting for processes to exit. client # [ 143.491366] systemd-logind[465]: Removed session 100. client # [ 144.063796] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 144.071745] systemd[1]: Started SSH per-connection Daemon (vsock:2:99). client # [ 144.141265] sshd-session[2126]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 144.146148] sshd-session[2126]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 144.151209] sshd-session[2126]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 144.158333] systemd-logind[465]: New session '101' of user 'root' with class 'user' and type 'tty'. client # [ 144.161365] systemd[1]: Started Session 101 of User root. client # [ 144.183347] sshd-session[2132]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 144.184576] sshd-session[2132]: Disconnected from user root UNKNOWN port 65535 client # [ 144.185848] sshd-session[2126]: pam_unix(sshd:session): session closed for user root client # [ 144.188664] systemd[1]: sshd-vsock@99-100-3:22-2:99.service: Deactivated successfully. client # [ 144.192706] systemd[1]: session-101.scope: Deactivated successfully. client # [ 144.195703] systemd-logind[465]: Session 101 logged out. Waiting for processes to exit. client # [ 144.197111] systemd-logind[465]: Removed session 101. client # [ 144.765284] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 144.773312] systemd[1]: Started SSH per-connection Daemon (vsock:2:100). client # [ 144.842302] sshd-session[2138]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 144.847187] sshd-session[2138]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 144.852322] sshd-session[2138]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 144.858679] systemd-logind[465]: New session '102' of user 'root' with class 'user' and type 'tty'. client # [ 144.861411] systemd[1]: Started Session 102 of User root. client # [ 144.883567] sshd-session[2144]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 144.884925] sshd-session[2144]: Disconnected from user root UNKNOWN port 65535 client # [ 144.886284] sshd-session[2138]: pam_unix(sshd:session): session closed for user root client # [ 144.889252] systemd[1]: sshd-vsock@100-101-3:22-2:100.service: Deactivated successfully. client # [ 144.892633] systemd[1]: session-102.scope: Deactivated successfully. client # [ 144.895372] systemd-logind[465]: Session 102 logged out. Waiting for processes to exit. client # [ 144.898125] systemd-logind[465]: Removed session 102. client # [ 145.462535] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 145.466059] systemd[1]: Started SSH per-connection Daemon (vsock:2:101). client # [ 145.510609] sshd-session[2150]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 145.515720] sshd-session[2150]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 145.520854] sshd-session[2150]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 145.527224] systemd-logind[465]: New session '103' of user 'root' with class 'user' and type 'tty'. client # [ 145.531331] systemd[1]: Started Session 103 of User root. client # [ 145.553531] sshd-session[2156]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 145.554912] sshd-session[2156]: Disconnected from user root UNKNOWN port 65535 client # [ 145.556297] sshd-session[2150]: pam_unix(sshd:session): session closed for user root client # [ 145.559175] systemd[1]: sshd-vsock@101-102-3:22-2:101.service: Deactivated successfully. client # [ 145.562772] systemd[1]: session-103.scope: Deactivated successfully. client # [ 145.565868] systemd-logind[465]: Session 103 logged out. Waiting for processes to exit. client # [ 145.567531] systemd-logind[465]: Removed session 103. client # [ 146.166272] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 146.174529] systemd[1]: Started SSH per-connection Daemon (vsock:2:102). client # [ 146.245846] sshd-session[2162]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 146.250818] sshd-session[2162]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 146.255848] sshd-session[2162]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 146.262224] systemd-logind[465]: New session '104' of user 'root' with class 'user' and type 'tty'. client # [ 146.265329] systemd[1]: Started Session 104 of User root. client # [ 146.287486] sshd-session[2168]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 146.288734] sshd-session[2168]: Disconnected from user root UNKNOWN port 65535 client # [ 146.290373] sshd-session[2162]: pam_unix(sshd:session): session closed for user root client # [ 146.292913] systemd[1]: sshd-vsock@102-103-3:22-2:102.service: Deactivated successfully. client # [ 146.296476] systemd[1]: session-104.scope: Deactivated successfully. client # [ 146.299619] systemd-logind[465]: Session 104 logged out. Waiting for processes to exit. client # [ 146.301894] systemd-logind[465]: Removed session 104. client # [ 146.868874] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 146.878564] systemd[1]: Started SSH per-connection Daemon (vsock:2:103). client # [ 146.944318] sshd-session[2174]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 146.949117] sshd-session[2174]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 146.954280] sshd-session[2174]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 146.959698] systemd-logind[465]: New session '105' of user 'root' with class 'user' and type 'tty'. client # [ 146.964421] systemd[1]: Started Session 105 of User root. client # [ 146.986582] sshd-session[2180]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 146.987861] sshd-session[2180]: Disconnected from user root UNKNOWN port 65535 client # [ 146.989204] sshd-session[2174]: pam_unix(sshd:session): session closed for user root client # [ 146.992156] systemd[1]: sshd-vsock@103-104-3:22-2:103.service: Deactivated successfully. client # [ 146.995550] systemd[1]: session-105.scope: Deactivated successfully. client # [ 146.998754] systemd-logind[465]: Session 105 logged out. Waiting for processes to exit. client # [ 147.000521] systemd-logind[465]: Removed session 105. client # [ 147.574221] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 147.582091] systemd[1]: Started SSH per-connection Daemon (vsock:2:104). client # [ 147.648275] sshd-session[2186]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 147.653094] sshd-session[2186]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 147.659053] sshd-session[2186]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 147.665235] systemd-logind[465]: New session '106' of user 'root' with class 'user' and type 'tty'. client # [ 147.668343] systemd[1]: Started Session 106 of User root. client # [ 147.689858] sshd-session[2192]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 147.691630] sshd-session[2192]: Disconnected from user root UNKNOWN port 65535 client # [ 147.692865] sshd-session[2186]: pam_unix(sshd:session): session closed for user root client # [ 147.695906] systemd[1]: sshd-vsock@104-105-3:22-2:104.service: Deactivated successfully. client # [ 147.699394] systemd[1]: session-106.scope: Deactivated successfully. client # [ 147.702524] systemd-logind[465]: Session 106 logged out. Waiting for processes to exit. client # [ 147.704247] systemd-logind[465]: Removed session 106. client # [ 148.270791] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 148.280145] systemd[1]: Started SSH per-connection Daemon (vsock:2:105). client # [ 148.346616] sshd-session[2198]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 148.351622] sshd-session[2198]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 148.356743] sshd-session[2198]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 148.363224] systemd-logind[465]: New session '107' of user 'root' with class 'user' and type 'tty'. client # [ 148.366361] systemd[1]: Started Session 107 of User root. client # [ 148.388317] sshd-session[2204]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 148.389923] sshd-session[2204]: Disconnected from user root UNKNOWN port 65535 client # [ 148.391211] sshd-session[2198]: pam_unix(sshd:session): session closed for user root client # [ 148.394418] systemd[1]: sshd-vsock@105-106-3:22-2:105.service: Deactivated successfully. client # [ 148.398240] systemd[1]: session-107.scope: Deactivated successfully. client # [ 148.401287] systemd-logind[465]: Session 107 logged out. Waiting for processes to exit. client # [ 148.403036] systemd-logind[465]: Removed session 107. client # [ 148.973284] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 148.979783] systemd[1]: Started SSH per-connection Daemon (vsock:2:106). client # [ 149.047185] sshd-session[2210]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 149.052090] sshd-session[2210]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 149.057208] sshd-session[2210]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 149.063258] systemd-logind[465]: New session '108' of user 'root' with class 'user' and type 'tty'. client # [ 149.066349] systemd[1]: Started Session 108 of User root. client # [ 149.088507] sshd-session[2216]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 149.089818] sshd-session[2216]: Disconnected from user root UNKNOWN port 65535 client # [ 149.091165] sshd-session[2210]: pam_unix(sshd:session): session closed for user root client # [ 149.093974] systemd[1]: sshd-vsock@106-107-3:22-2:106.service: Deactivated successfully. client # [ 149.097782] systemd[1]: session-108.scope: Deactivated successfully. client # [ 149.100893] systemd-logind[465]: Session 108 logged out. Waiting for processes to exit. client # [ 149.102711] systemd-logind[465]: Removed session 108. client # [ 149.674680] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 149.684141] systemd[1]: Started SSH per-connection Daemon (vsock:2:107). client # [ 149.753843] sshd-session[2222]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 149.758962] sshd-session[2222]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 149.764193] sshd-session[2222]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 149.770403] systemd-logind[465]: New session '109' of user 'root' with class 'user' and type 'tty'. client # [ 149.773357] systemd[1]: Started Session 109 of User root. client # [ 149.795319] sshd-session[2228]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 149.797079] sshd-session[2228]: Disconnected from user root UNKNOWN port 65535 client # [ 149.798529] sshd-session[2222]: pam_unix(sshd:session): session closed for user root client # [ 149.801427] systemd[1]: sshd-vsock@107-108-3:22-2:107.service: Deactivated successfully. client # [ 149.804797] systemd[1]: session-109.scope: Deactivated successfully. client # [ 149.807944] systemd-logind[465]: Session 109 logged out. Waiting for processes to exit. client # [ 149.809625] systemd-logind[465]: Removed session 109. client # [ 150.375293] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 150.383708] systemd[1]: Started SSH per-connection Daemon (vsock:2:108). client # [ 150.450877] sshd-session[2234]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 150.455956] sshd-session[2234]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 150.461080] sshd-session[2234]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 150.467570] systemd-logind[465]: New session '110' of user 'root' with class 'user' and type 'tty'. client # [ 150.470321] systemd[1]: Started Session 110 of User root. client # [ 150.492505] sshd-session[2240]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 150.493777] sshd-session[2240]: Disconnected from user root UNKNOWN port 65535 client # [ 150.495116] sshd-session[2234]: pam_unix(sshd:session): session closed for user root client # [ 150.497865] systemd[1]: sshd-vsock@108-109-3:22-2:108.service: Deactivated successfully. client # [ 150.501528] systemd[1]: session-110.scope: Deactivated successfully. client # [ 150.504713] systemd-logind[465]: Session 110 logged out. Waiting for processes to exit. client # [ 150.506851] systemd-logind[465]: Removed session 110. client # [ 151.074293] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 151.077200] systemd[1]: Started SSH per-connection Daemon (vsock:2:109). client # [ 151.123737] sshd-session[2246]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 151.128662] sshd-session[2246]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 151.133684] sshd-session[2246]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 151.140451] systemd-logind[465]: New session '111' of user 'root' with class 'user' and type 'tty'. client # [ 151.143421] systemd[1]: Started Session 111 of User root. client # [ 151.164942] sshd-session[2252]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 151.166642] sshd-session[2252]: Disconnected from user root UNKNOWN port 65535 client # [ 151.167907] sshd-session[2246]: pam_unix(sshd:session): session closed for user root client # [ 151.170885] systemd[1]: sshd-vsock@109-110-3:22-2:109.service: Deactivated successfully. client # [ 151.174524] systemd[1]: session-111.scope: Deactivated successfully. client # [ 151.177917] systemd-logind[465]: Session 111 logged out. Waiting for processes to exit. client # [ 151.179408] systemd-logind[465]: Removed session 111. client # [ 151.780183] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 151.786804] systemd[1]: Started SSH per-connection Daemon (vsock:2:110). client # [ 151.858853] sshd-session[2258]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 151.863864] sshd-session[2258]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 151.868892] sshd-session[2258]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 151.875068] systemd-logind[465]: New session '112' of user 'root' with class 'user' and type 'tty'. client # [ 151.878397] systemd[1]: Started Session 112 of User root. client # [ 151.900466] sshd-session[2264]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 151.901757] sshd-session[2264]: Disconnected from user root UNKNOWN port 65535 client # [ 151.903070] sshd-session[2258]: pam_unix(sshd:session): session closed for user root client # [ 151.905873] systemd[1]: sshd-vsock@110-111-3:22-2:110.service: Deactivated successfully. client # [ 151.909464] systemd[1]: session-112.scope: Deactivated successfully. client # [ 151.912593] systemd-logind[465]: Session 112 logged out. Waiting for processes to exit. client # [ 151.914233] systemd-logind[465]: Removed session 112. [e2e] heartbeat t=90s client # [ 152.502923] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 152.508288] systemd[1]: Started SSH per-connection Daemon (vsock:2:111). client # [ 152.575490] sshd-session[2270]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 152.582439] sshd-session[2270]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 152.590700] sshd-session[2270]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 152.598316] systemd-logind[465]: New session '113' of user 'root' with class 'user' and type 'tty'. client # [ 152.604469] systemd[1]: Started Session 113 of User root. client # [ 152.637121] sshd-session[2276]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 152.640670] sshd-session[2276]: Disconnected from user root UNKNOWN port 65535 client # [ 152.643197] sshd-session[2270]: pam_unix(sshd:session): session closed for user root client # [ 152.648412] systemd[1]: sshd-vsock@111-112-3:22-2:111.service: Deactivated successfully. client # [ 152.653887] systemd[1]: session-113.scope: Deactivated successfully. client # [ 152.658828] systemd-logind[465]: Session 113 logged out. Waiting for processes to exit. client # [ 152.662165] systemd-logind[465]: Removed session 113. client # [ 153.201622] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 153.205748] systemd[1]: Started SSH per-connection Daemon (vsock:2:112). client # [ 153.250417] sshd-session[2282]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 153.255062] sshd-session[2282]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 153.259702] sshd-session[2282]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 153.266071] systemd-logind[465]: New session '114' of user 'root' with class 'user' and type 'tty'. client # [ 153.269392] systemd[1]: Started Session 114 of User root. client # [ 153.289974] sshd-session[2288]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 153.291638] sshd-session[2288]: Disconnected from user root UNKNOWN port 65535 client # [ 153.292814] sshd-session[2282]: pam_unix(sshd:session): session closed for user root client # [ 153.295601] systemd[1]: sshd-vsock@112-113-3:22-2:112.service: Deactivated successfully. client # [ 153.299168] systemd[1]: session-114.scope: Deactivated successfully. client # [ 153.302273] systemd-logind[465]: Session 114 logged out. Waiting for processes to exit. client # [ 153.303840] systemd-logind[465]: Removed session 114. client # [ 153.908605] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 153.915350] systemd[1]: Started SSH per-connection Daemon (vsock:2:113). client # [ 153.980610] sshd-session[2294]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 153.985320] sshd-session[2294]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 153.990186] sshd-session[2294]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 153.996696] systemd-logind[465]: New session '115' of user 'root' with class 'user' and type 'tty'. client # [ 153.999310] systemd[1]: Started Session 115 of User root. client # [ 154.020623] sshd-session[2300]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 154.021891] sshd-session[2300]: Disconnected from user root UNKNOWN port 65535 client # [ 154.023218] sshd-session[2294]: pam_unix(sshd:session): session closed for user root client # [ 154.026136] systemd[1]: sshd-vsock@113-114-3:22-2:113.service: Deactivated successfully. client # [ 154.029608] systemd[1]: session-115.scope: Deactivated successfully. client # [ 154.032795] systemd-logind[465]: Session 115 logged out. Waiting for processes to exit. client # [ 154.034394] systemd-logind[465]: Removed session 115. client # [ 154.608409] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 154.616108] systemd[1]: Started SSH per-connection Daemon (vsock:2:114). client # [ 154.680538] sshd-session[2306]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 154.685139] sshd-session[2306]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 154.689841] sshd-session[2306]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 154.696236] systemd-logind[465]: New session '116' of user 'root' with class 'user' and type 'tty'. client # [ 154.698343] systemd[1]: Started Session 116 of User root. client # [ 154.719415] sshd-session[2312]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 154.720615] sshd-session[2312]: Disconnected from user root UNKNOWN port 65535 client # [ 154.721970] sshd-session[2306]: pam_unix(sshd:session): session closed for user root client # [ 154.724886] systemd[1]: sshd-vsock@114-115-3:22-2:114.service: Deactivated successfully. client # [ 154.728476] systemd[1]: session-116.scope: Deactivated successfully. client # [ 154.731620] systemd-logind[465]: Session 116 logged out. Waiting for processes to exit. client # [ 154.733268] systemd-logind[465]: Removed session 116. client # [ 155.308520] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 155.317982] systemd[1]: Started SSH per-connection Daemon (vsock:2:115). client # [ 155.381933] sshd-session[2318]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 155.386705] sshd-session[2318]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 155.391526] sshd-session[2318]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 155.398233] systemd-logind[465]: New session '117' of user 'root' with class 'user' and type 'tty'. client # [ 155.401358] systemd[1]: Started Session 117 of User root. client # [ 155.421970] sshd-session[2324]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 155.423653] sshd-session[2324]: Disconnected from user root UNKNOWN port 65535 client # [ 155.425360] sshd-session[2318]: pam_unix(sshd:session): session closed for user root client # [ 155.427876] systemd[1]: sshd-vsock@115-116-3:22-2:115.service: Deactivated successfully. client # [ 155.431485] systemd[1]: session-117.scope: Deactivated successfully. client # [ 155.434784] systemd-logind[465]: Session 117 logged out. Waiting for processes to exit. client # [ 155.436418] systemd-logind[465]: Removed session 117. client # [ 156.009290] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 156.018577] systemd[1]: Started SSH per-connection Daemon (vsock:2:116). client # [ 156.085254] sshd-session[2330]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 156.089862] sshd-session[2330]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 156.094641] sshd-session[2330]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 156.101046] systemd-logind[465]: New session '118' of user 'root' with class 'user' and type 'tty'. client # [ 156.103404] systemd[1]: Started Session 118 of User root. client # [ 156.124691] sshd-session[2336]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 156.125934] sshd-session[2336]: Disconnected from user root UNKNOWN port 65535 client # [ 156.127211] sshd-session[2330]: pam_unix(sshd:session): session closed for user root client # [ 156.130155] systemd[1]: sshd-vsock@116-117-3:22-2:116.service: Deactivated successfully. client # [ 156.133505] systemd[1]: session-118.scope: Deactivated successfully. client # [ 156.136747] systemd-logind[465]: Session 118 logged out. Waiting for processes to exit. client # [ 156.138924] systemd-logind[465]: Removed session 118. client # [ 156.711689] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 156.721152] systemd[1]: Started SSH per-connection Daemon (vsock:2:117). client # [ 156.789733] sshd-session[2342]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 156.794709] sshd-session[2342]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 156.800092] sshd-session[2342]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 156.806990] systemd-logind[465]: New session '119' of user 'root' with class 'user' and type 'tty'. client # [ 156.809314] systemd[1]: Started Session 119 of User root. client # [ 156.831829] sshd-session[2348]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 156.833500] sshd-session[2348]: Disconnected from user root UNKNOWN port 65535 client # [ 156.834881] sshd-session[2342]: pam_unix(sshd:session): session closed for user root client # [ 156.837975] systemd[1]: sshd-vsock@117-118-3:22-2:117.service: Deactivated successfully. client # [ 156.841607] systemd[1]: session-119.scope: Deactivated successfully. client # [ 156.844297] systemd-logind[465]: Session 119 logged out. Waiting for processes to exit. client # [ 156.846932] systemd-logind[465]: Removed session 119. client # [ 157.412398] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 157.420685] systemd[1]: Started SSH per-connection Daemon (vsock:2:118). client # [ 157.487932] sshd-session[2354]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 157.492958] sshd-session[2354]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 157.498296] sshd-session[2354]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 157.503599] systemd-logind[465]: New session '120' of user 'root' with class 'user' and type 'tty'. client # [ 157.508404] systemd[1]: Started Session 120 of User root. client # [ 157.530948] sshd-session[2360]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 157.532647] sshd-session[2360]: Disconnected from user root UNKNOWN port 65535 client # [ 157.533993] sshd-session[2354]: pam_unix(sshd:session): session closed for user root client # [ 157.536940] systemd[1]: sshd-vsock@118-119-3:22-2:118.service: Deactivated successfully. client # [ 157.540459] systemd[1]: session-120.scope: Deactivated successfully. client # [ 157.543553] systemd-logind[465]: Session 120 logged out. Waiting for processes to exit. client # [ 157.545307] systemd-logind[465]: Removed session 120. client # [ 158.114814] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 158.124142] systemd[1]: Started SSH per-connection Daemon (vsock:2:119). client # [ 158.189796] sshd-session[2366]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 158.194753] sshd-session[2366]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 158.199980] sshd-session[2366]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 158.206227] systemd-logind[465]: New session '121' of user 'root' with class 'user' and type 'tty'. client # [ 158.209539] systemd[1]: Started Session 121 of User root. client # [ 158.231906] sshd-session[2372]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 158.233666] sshd-session[2372]: Disconnected from user root UNKNOWN port 65535 client # [ 158.234934] sshd-session[2366]: pam_unix(sshd:session): session closed for user root client # [ 158.237926] systemd[1]: sshd-vsock@119-120-3:22-2:119.service: Deactivated successfully. client # [ 158.241491] systemd[1]: session-121.scope: Deactivated successfully. client # [ 158.244687] systemd-logind[465]: Session 121 logged out. Waiting for processes to exit. client # [ 158.246311] systemd-logind[465]: Removed session 121. client # [ 158.816374] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 158.825146] systemd[1]: Started SSH per-connection Daemon (vsock:2:120). client # [ 158.892335] sshd-session[2378]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 158.897195] sshd-session[2378]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 158.902457] sshd-session[2378]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 158.908073] systemd-logind[465]: New session '122' of user 'root' with class 'user' and type 'tty'. client # [ 158.912395] systemd[1]: Started Session 122 of User root. client # [ 158.934881] sshd-session[2384]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 158.936625] sshd-session[2384]: Disconnected from user root UNKNOWN port 65535 client # [ 158.937929] sshd-session[2378]: pam_unix(sshd:session): session closed for user root client # [ 158.940988] systemd[1]: sshd-vsock@120-121-3:22-2:120.service: Deactivated successfully. client # [ 158.944513] systemd[1]: session-122.scope: Deactivated successfully. client # [ 158.947694] systemd-logind[465]: Session 122 logged out. Waiting for processes to exit. client # [ 158.949510] systemd-logind[465]: Removed session 122. client # [ 159.517862] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 159.526594] systemd[1]: Started SSH per-connection Daemon (vsock:2:121). client # [ 159.593988] sshd-session[2390]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 159.598964] sshd-session[2390]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 159.604240] sshd-session[2390]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 159.610796] systemd-logind[465]: New session '123' of user 'root' with class 'user' and type 'tty'. client # [ 159.613421] systemd[1]: Started Session 123 of User root. client # [ 159.635779] sshd-session[2396]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 159.637567] sshd-session[2396]: Disconnected from user root UNKNOWN port 65535 client # [ 159.638989] sshd-session[2390]: pam_unix(sshd:session): session closed for user root client # [ 159.642340] systemd[1]: sshd-vsock@121-122-3:22-2:121.service: Deactivated successfully. client # [ 159.645621] systemd[1]: session-123.scope: Deactivated successfully. client # [ 159.648613] systemd-logind[465]: Session 123 logged out. Waiting for processes to exit. client # [ 159.650552] systemd-logind[465]: Removed session 123. client # [ 160.220450] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 160.227494] systemd[1]: Started SSH per-connection Daemon (vsock:2:122). client # [ 160.294505] sshd-session[2402]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 160.299127] sshd-session[2402]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 160.304854] sshd-session[2402]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 160.310315] systemd-logind[465]: New session '124' of user 'root' with class 'user' and type 'tty'. client # [ 160.314354] systemd[1]: Started Session 124 of User root. client # [ 160.336934] sshd-session[2408]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 160.338641] sshd-session[2408]: Disconnected from user root UNKNOWN port 65535 client # [ 160.339908] sshd-session[2402]: pam_unix(sshd:session): session closed for user root client # [ 160.342973] systemd[1]: sshd-vsock@122-123-3:22-2:122.service: Deactivated successfully. client # [ 160.346450] systemd[1]: session-124.scope: Deactivated successfully. client # [ 160.349564] systemd-logind[465]: Session 124 logged out. Waiting for processes to exit. client # [ 160.351231] systemd-logind[465]: Removed session 124. client # [ 160.920749] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 160.929844] systemd[1]: Started SSH per-connection Daemon (vsock:2:123). client # [ 160.996686] sshd-session[2414]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 161.001728] sshd-session[2414]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 161.006930] sshd-session[2414]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 161.012960] systemd-logind[465]: New session '125' of user 'root' with class 'user' and type 'tty'. client # [ 161.017360] systemd[1]: Started Session 125 of User root. client # [ 161.040036] sshd-session[2420]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 161.041883] sshd-session[2420]: Disconnected from user root UNKNOWN port 65535 client # [ 161.043211] sshd-session[2414]: pam_unix(sshd:session): session closed for user root client # [ 161.046726] systemd[1]: sshd-vsock@123-124-3:22-2:123.service: Deactivated successfully. client # [ 161.049749] systemd[1]: session-125.scope: Deactivated successfully. client # [ 161.052854] systemd-logind[465]: Session 125 logged out. Waiting for processes to exit. client # [ 161.054650] systemd-logind[465]: Removed session 125. client # [ 161.623322] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 161.631174] systemd[1]: Started SSH per-connection Daemon (vsock:2:124). client # [ 161.697836] sshd-session[2426]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 161.702792] sshd-session[2426]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 161.708072] sshd-session[2426]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 161.714722] systemd-logind[465]: New session '126' of user 'root' with class 'user' and type 'tty'. client # [ 161.718457] systemd[1]: Started Session 126 of User root. client # [ 161.741162] sshd-session[2432]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 161.742952] sshd-session[2432]: Disconnected from user root UNKNOWN port 65535 client # [ 161.744241] sshd-session[2426]: pam_unix(sshd:session): session closed for user root client # [ 161.747330] systemd[1]: sshd-vsock@124-125-3:22-2:124.service: Deactivated successfully. client # [ 161.750658] systemd[1]: session-126.scope: Deactivated successfully. client # [ 161.753705] systemd-logind[465]: Session 126 logged out. Waiting for processes to exit. client # [ 161.755996] systemd-logind[465]: Removed session 126. client # [ 162.323779] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 162.332465] systemd[1]: Started SSH per-connection Daemon (vsock:2:125). client # [ 162.401117] sshd-session[2438]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 162.406135] sshd-session[2438]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 162.411414] sshd-session[2438]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 162.417831] systemd-logind[465]: New session '127' of user 'root' with class 'user' and type 'tty'. client # [ 162.420421] systemd[1]: Started Session 127 of User root. client # [ 162.442893] sshd-session[2444]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 162.444563] sshd-session[2444]: Disconnected from user root UNKNOWN port 65535 client # [ 162.445814] sshd-session[2438]: pam_unix(sshd:session): session closed for user root client # [ 162.448829] systemd[1]: sshd-vsock@125-126-3:22-2:125.service: Deactivated successfully. client # [ 162.452462] systemd[1]: session-127.scope: Deactivated successfully. client # [ 162.455686] systemd-logind[465]: Session 127 logged out. Waiting for processes to exit. client # [ 162.457416] systemd-logind[465]: Removed session 127. client # [ 163.023405] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 163.033157] systemd[1]: Started SSH per-connection Daemon (vsock:2:126). client # [ 163.097687] sshd-session[2450]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 163.102751] sshd-session[2450]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 163.107925] sshd-session[2450]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 163.114165] systemd-logind[465]: New session '128' of user 'root' with class 'user' and type 'tty'. client # [ 163.117354] systemd[1]: Started Session 128 of User root. client # [ 163.139572] sshd-session[2456]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 163.141314] sshd-session[2456]: Disconnected from user root UNKNOWN port 65535 client # [ 163.142519] sshd-session[2450]: pam_unix(sshd:session): session closed for user root client # [ 163.145418] systemd[1]: sshd-vsock@126-127-3:22-2:126.service: Deactivated successfully. client # [ 163.149527] systemd[1]: session-128.scope: Deactivated successfully. client # [ 163.152163] systemd-logind[465]: Session 128 logged out. Waiting for processes to exit. client # [ 163.153828] systemd-logind[465]: Removed session 128. client # [ 163.728593] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 163.735846] systemd[1]: Started SSH per-connection Daemon (vsock:2:127). client # [ 163.803294] sshd-session[2462]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 163.808276] sshd-session[2462]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 163.813399] sshd-session[2462]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 163.819935] systemd-logind[465]: New session '129' of user 'root' with class 'user' and type 'tty'. client # [ 163.822352] systemd[1]: Started Session 129 of User root. client # [ 163.845581] sshd-session[2468]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 163.846814] sshd-session[2468]: Disconnected from user root UNKNOWN port 65535 client # [ 163.848133] sshd-session[2462]: pam_unix(sshd:session): session closed for user root client # [ 163.851269] systemd[1]: sshd-vsock@127-128-3:22-2:127.service: Deactivated successfully. client # [ 163.854696] systemd[1]: session-129.scope: Deactivated successfully. client # [ 163.857407] systemd-logind[465]: Session 129 logged out. Waiting for processes to exit. client # [ 163.860060] systemd-logind[465]: Removed session 129. client # [ 164.424366] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 164.428653] systemd[1]: Started SSH per-connection Daemon (vsock:2:128). client # [ 164.492531] sshd-session[2474]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 164.497582] sshd-session[2474]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 164.502900] sshd-session[2474]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 164.509066] systemd-logind[465]: New session '130' of user 'root' with class 'user' and type 'tty'. client # [ 164.512395] systemd[1]: Started Session 130 of User root. client # [ 164.534958] sshd-session[2480]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 164.536648] sshd-session[2480]: Disconnected from user root UNKNOWN port 65535 client # [ 164.537903] sshd-session[2474]: pam_unix(sshd:session): session closed for user root client # [ 164.540792] systemd[1]: sshd-vsock@128-129-3:22-2:128.service: Deactivated successfully. client # [ 164.544466] systemd[1]: session-130.scope: Deactivated successfully. client # [ 164.547709] systemd-logind[465]: Session 130 logged out. Waiting for processes to exit. client # [ 164.549966] systemd-logind[465]: Removed session 130. client # [ 165.129764] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 165.137577] systemd[1]: Started SSH per-connection Daemon (vsock:2:129). client # [ 165.205458] sshd-session[2486]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 165.210125] sshd-session[2486]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 165.215845] sshd-session[2486]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 165.221237] systemd-logind[465]: New session '131' of user 'root' with class 'user' and type 'tty'. client # [ 165.225260] systemd[1]: Started Session 131 of User root. client # [ 165.248223] sshd-session[2492]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 165.249609] sshd-session[2492]: Disconnected from user root UNKNOWN port 65535 client # [ 165.250886] sshd-session[2486]: pam_unix(sshd:session): session closed for user root client # [ 165.253861] systemd[1]: sshd-vsock@129-130-3:22-2:129.service: Deactivated successfully. client # [ 165.257461] systemd[1]: session-131.scope: Deactivated successfully. client # [ 165.260772] systemd-logind[465]: Session 131 logged out. Waiting for processes to exit. client # [ 165.262285] systemd-logind[465]: Removed session 131. client # [ 165.828484] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 165.837154] systemd[1]: Started SSH per-connection Daemon (vsock:2:130). client # [ 165.905307] sshd-session[2498]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 165.910292] sshd-session[2498]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 165.915593] sshd-session[2498]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 165.922066] systemd-logind[465]: New session '132' of user 'root' with class 'user' and type 'tty'. client # [ 165.924431] systemd[1]: Started Session 132 of User root. client # [ 165.947630] sshd-session[2504]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 165.948876] sshd-session[2504]: Disconnected from user root UNKNOWN port 65535 client # [ 165.950201] sshd-session[2498]: pam_unix(sshd:session): session closed for user root client # [ 165.953260] systemd[1]: sshd-vsock@130-131-3:22-2:130.service: Deactivated successfully. client # [ 165.956696] systemd[1]: session-132.scope: Deactivated successfully. client # [ 165.959356] systemd-logind[465]: Session 132 logged out. Waiting for processes to exit. client # [ 165.961604] systemd-logind[465]: Removed session 132. client # [ 166.530742] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 166.541397] systemd[1]: Started SSH per-connection Daemon (vsock:2:131). client # [ 166.606171] sshd-session[2510]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 166.611048] sshd-session[2510]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 166.616435] sshd-session[2510]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 166.622232] systemd-logind[465]: New session '133' of user 'root' with class 'user' and type 'tty'. client # [ 166.626400] systemd[1]: Started Session 133 of User root. client # [ 166.649270] sshd-session[2516]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 166.650942] sshd-session[2516]: Disconnected from user root UNKNOWN port 65535 client # [ 166.652424] sshd-session[2510]: pam_unix(sshd:session): session closed for user root client # [ 166.655493] systemd[1]: sshd-vsock@131-132-3:22-2:131.service: Deactivated successfully. client # [ 166.659052] systemd[1]: session-133.scope: Deactivated successfully. client # [ 166.662364] systemd-logind[465]: Session 133 logged out. Waiting for processes to exit. client # [ 166.664060] systemd-logind[465]: Removed session 133. client # [ 167.232327] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 167.241483] systemd[1]: Started SSH per-connection Daemon (vsock:2:132). client # [ 167.306358] sshd-session[2522]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 167.311351] sshd-session[2522]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 167.316607] sshd-session[2522]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 167.323232] systemd-logind[465]: New session '134' of user 'root' with class 'user' and type 'tty'. client # [ 167.325406] systemd[1]: Started Session 134 of User root. client # [ 167.348484] sshd-session[2528]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 167.349736] sshd-session[2528]: Disconnected from user root UNKNOWN port 65535 client # [ 167.351112] sshd-session[2522]: pam_unix(sshd:session): session closed for user root client # [ 167.354265] systemd[1]: sshd-vsock@132-133-3:22-2:132.service: Deactivated successfully. client # [ 167.358233] systemd[1]: session-134.scope: Deactivated successfully. client # [ 167.360419] systemd-logind[465]: Session 134 logged out. Waiting for processes to exit. client # [ 167.363206] systemd-logind[465]: Removed session 134. client # [ 167.936559] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 167.944508] systemd[1]: Started SSH per-connection Daemon (vsock:2:133). client # [ 168.011801] sshd-session[2534]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 168.016886] sshd-session[2534]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 168.022166] sshd-session[2534]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 168.028848] systemd-logind[465]: New session '135' of user 'root' with class 'user' and type 'tty'. client # [ 168.031343] systemd[1]: Started Session 135 of User root. client # [ 168.054526] sshd-session[2540]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 168.055812] sshd-session[2540]: Disconnected from user root UNKNOWN port 65535 client # [ 168.057168] sshd-session[2534]: pam_unix(sshd:session): session closed for user root client # [ 168.060119] systemd[1]: sshd-vsock@133-134-3:22-2:133.service: Deactivated successfully. client # [ 168.063619] systemd[1]: session-135.scope: Deactivated successfully. client # [ 168.066711] systemd-logind[465]: Session 135 logged out. Waiting for processes to exit. client # [ 168.068489] systemd-logind[465]: Removed session 135. client # [ 168.635609] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 168.644851] systemd[1]: Started SSH per-connection Daemon (vsock:2:134). client # [ 168.710502] sshd-session[2546]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 168.715631] sshd-session[2546]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 168.720986] sshd-session[2546]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 168.726228] systemd-logind[465]: New session '136' of user 'root' with class 'user' and type 'tty'. client # [ 168.731397] systemd[1]: Started Session 136 of User root. client # [ 168.753776] sshd-session[2552]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 168.755492] sshd-session[2552]: Disconnected from user root UNKNOWN port 65535 client # [ 168.756811] sshd-session[2546]: pam_unix(sshd:session): session closed for user root client # [ 168.759778] systemd[1]: sshd-vsock@134-135-3:22-2:134.service: Deactivated successfully. client # [ 168.763401] systemd[1]: session-136.scope: Deactivated successfully. client # [ 168.766514] systemd-logind[465]: Session 136 logged out. Waiting for processes to exit. client # [ 168.768167] systemd-logind[465]: Removed session 136. client # [ 169.337744] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 169.347269] systemd[1]: Started SSH per-connection Daemon (vsock:2:135). client # [ 169.414415] sshd-session[2558]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 169.419365] sshd-session[2558]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 169.424637] sshd-session[2558]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 169.431222] systemd-logind[465]: New session '137' of user 'root' with class 'user' and type 'tty'. client # [ 169.433348] systemd[1]: Started Session 137 of User root. client # [ 169.455779] sshd-session[2564]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 169.457572] sshd-session[2564]: Disconnected from user root UNKNOWN port 65535 client # [ 169.458862] sshd-session[2558]: pam_unix(sshd:session): session closed for user root client # [ 169.461978] systemd[1]: sshd-vsock@135-136-3:22-2:135.service: Deactivated successfully. client # [ 169.465591] systemd[1]: session-137.scope: Deactivated successfully. client # [ 169.468750] systemd-logind[465]: Session 137 logged out. Waiting for processes to exit. client # [ 169.470448] systemd-logind[465]: Removed session 137. client # [ 170.037486] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 170.046821] systemd[1]: Started SSH per-connection Daemon (vsock:2:136). client # [ 170.115871] sshd-session[2570]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 170.121113] sshd-session[2570]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 170.126400] sshd-session[2570]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 170.132066] systemd-logind[465]: New session '138' of user 'root' with class 'user' and type 'tty'. client # [ 170.136401] systemd[1]: Started Session 138 of User root. client # [ 170.158918] sshd-session[2576]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 170.160570] sshd-session[2576]: Disconnected from user root UNKNOWN port 65535 client # [ 170.161836] sshd-session[2570]: pam_unix(sshd:session): session closed for user root client # [ 170.164692] systemd[1]: sshd-vsock@136-137-3:22-2:136.service: Deactivated successfully. client # [ 170.168376] systemd[1]: session-138.scope: Deactivated successfully. client # [ 170.171566] systemd-logind[465]: Session 138 logged out. Waiting for processes to exit. client # [ 170.173333] systemd-logind[465]: Removed session 138. client # [ 170.740737] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 170.749403] systemd[1]: Started SSH per-connection Daemon (vsock:2:137). client # [ 170.816511] sshd-session[2582]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 170.821591] sshd-session[2582]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 170.826863] sshd-session[2582]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 170.832378] systemd-logind[465]: New session '139' of user 'root' with class 'user' and type 'tty'. client # [ 170.836407] systemd[1]: Started Session 139 of User root. client # [ 170.858929] sshd-session[2588]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 170.860636] sshd-session[2588]: Disconnected from user root UNKNOWN port 65535 client # [ 170.862083] sshd-session[2582]: pam_unix(sshd:session): session closed for user root client # [ 170.865116] systemd[1]: sshd-vsock@137-138-3:22-2:137.service: Deactivated successfully. client # [ 170.868633] systemd[1]: session-139.scope: Deactivated successfully. client # [ 170.872072] systemd-logind[465]: Session 139 logged out. Waiting for processes to exit. client # [ 170.873509] systemd-logind[465]: Removed session 139. client # [ 171.440429] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 171.449230] systemd[1]: Started SSH per-connection Daemon (vsock:2:138). client # [ 171.515927] sshd-session[2594]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 171.520962] sshd-session[2594]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 171.526206] sshd-session[2594]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 171.532776] systemd-logind[465]: New session '140' of user 'root' with class 'user' and type 'tty'. client # [ 171.535315] systemd[1]: Started Session 140 of User root. client # [ 171.557877] sshd-session[2600]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 171.559594] sshd-session[2600]: Disconnected from user root UNKNOWN port 65535 client # [ 171.560916] sshd-session[2594]: pam_unix(sshd:session): session closed for user root client # [ 171.563958] systemd[1]: sshd-vsock@138-139-3:22-2:138.service: Deactivated successfully. client # [ 171.567546] systemd[1]: session-140.scope: Deactivated successfully. client # [ 171.570876] systemd-logind[465]: Session 140 logged out. Waiting for processes to exit. client # [ 171.572401] systemd-logind[465]: Removed session 140. client # [ 172.141924] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 172.152185] systemd[1]: Started SSH per-connection Daemon (vsock:2:139). client # [ 172.219379] sshd-session[2606]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 172.224296] sshd-session[2606]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 172.229539] sshd-session[2606]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 172.235249] systemd-logind[465]: New session '141' of user 'root' with class 'user' and type 'tty'. client # [ 172.239401] systemd[1]: Started Session 141 of User root. client # [ 172.262478] sshd-session[2612]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 172.263728] sshd-session[2612]: Disconnected from user root UNKNOWN port 65535 client # [ 172.265077] sshd-session[2606]: pam_unix(sshd:session): session closed for user root client # [ 172.268082] systemd[1]: sshd-vsock@139-140-3:22-2:139.service: Deactivated successfully. client # [ 172.271590] systemd[1]: session-141.scope: Deactivated successfully. client # [ 172.274783] systemd-logind[465]: Session 141 logged out. Waiting for processes to exit. client # [ 172.276411] systemd-logind[465]: Removed session 141. client # [ 172.843412] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 172.852658] systemd[1]: Started SSH per-connection Daemon (vsock:2:140). client # [ 172.919995] sshd-session[2618]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 172.925076] sshd-session[2618]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 172.930433] sshd-session[2618]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 172.936069] systemd-logind[465]: New session '142' of user 'root' with class 'user' and type 'tty'. client # [ 172.940400] systemd[1]: Started Session 142 of User root. client # [ 172.963568] sshd-session[2624]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 172.964812] sshd-session[2624]: Disconnected from user root UNKNOWN port 65535 client # [ 172.966145] sshd-session[2618]: pam_unix(sshd:session): session closed for user root client # [ 172.969250] systemd[1]: sshd-vsock@140-141-3:22-2:140.service: Deactivated successfully. client # [ 172.972643] systemd[1]: session-142.scope: Deactivated successfully. client # [ 172.975177] systemd-logind[465]: Session 142 logged out. Waiting for processes to exit. client # [ 172.978107] systemd-logind[465]: Removed session 142. client # [ 173.544809] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 173.554235] systemd[1]: Started SSH per-connection Daemon (vsock:2:141). client # [ 173.623719] sshd-session[2630]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 173.628796] sshd-session[2630]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 173.634260] sshd-session[2630]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 173.639794] systemd-logind[465]: New session '143' of user 'root' with class 'user' and type 'tty'. client # [ 173.643400] systemd[1]: Started Session 143 of User root. client # [ 173.666556] sshd-session[2636]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 173.667917] sshd-session[2636]: Disconnected from user root UNKNOWN port 65535 client # [ 173.669206] sshd-session[2630]: pam_unix(sshd:session): session closed for user root client # [ 173.672257] systemd[1]: sshd-vsock@141-142-3:22-2:141.service: Deactivated successfully. client # [ 173.675651] systemd[1]: session-143.scope: Deactivated successfully. client # [ 173.678404] systemd-logind[465]: Session 143 logged out. Waiting for processes to exit. client # [ 173.681200] systemd-logind[465]: Removed session 143. client # [ 174.246478] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 174.255380] systemd[1]: Started SSH per-connection Daemon (vsock:2:142). client # [ 174.322626] sshd-session[2642]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 174.327740] sshd-session[2642]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 174.333130] sshd-session[2642]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 174.339698] systemd-logind[465]: New session '144' of user 'root' with class 'user' and type 'tty'. client # [ 174.342242] systemd[1]: Started Session 144 of User root. client # [ 174.364881] sshd-session[2648]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 174.366589] sshd-session[2648]: Disconnected from user root UNKNOWN port 65535 client # [ 174.367850] sshd-session[2642]: pam_unix(sshd:session): session closed for user root client # [ 174.370915] systemd[1]: sshd-vsock@142-143-3:22-2:142.service: Deactivated successfully. client # [ 174.374599] systemd[1]: session-144.scope: Deactivated successfully. client # [ 174.378148] systemd-logind[465]: Session 144 logged out. Waiting for processes to exit. client # [ 174.379670] systemd-logind[465]: Removed session 144. client # [ 174.948759] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 174.955831] systemd[1]: Started SSH per-connection Daemon (vsock:2:143). client # [ 175.023877] sshd-session[2654]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 175.028880] sshd-session[2654]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 175.034254] sshd-session[2654]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 175.040229] systemd-logind[465]: New session '145' of user 'root' with class 'user' and type 'tty'. client # [ 175.044500] systemd[1]: Started Session 145 of User root. client # [ 175.067601] sshd-session[2660]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 175.068875] sshd-session[2660]: Disconnected from user root UNKNOWN port 65535 client # [ 175.070235] sshd-session[2654]: pam_unix(sshd:session): session closed for user root client # [ 175.073310] systemd[1]: sshd-vsock@143-144-3:22-2:143.service: Deactivated successfully. client # [ 175.076606] systemd[1]: session-145.scope: Deactivated successfully. client # [ 175.079727] systemd-logind[465]: Session 145 logged out. Waiting for processes to exit. client # [ 175.081558] systemd-logind[465]: Removed session 145. client # [ 175.649404] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 175.659273] systemd[1]: Started SSH per-connection Daemon (vsock:2:144). client # [ 175.725503] sshd-session[2666]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 175.730193] sshd-session[2666]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 175.735978] sshd-session[2666]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 175.741157] systemd-logind[465]: New session '146' of user 'root' with class 'user' and type 'tty'. client # [ 175.746263] systemd[1]: Started Session 146 of User root. client # [ 175.769333] sshd-session[2672]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 175.771151] sshd-session[2672]: Disconnected from user root UNKNOWN port 65535 client # [ 175.772434] sshd-session[2666]: pam_unix(sshd:session): session closed for user root client # [ 175.775481] systemd[1]: sshd-vsock@144-145-3:22-2:144.service: Deactivated successfully. client # [ 175.779219] systemd[1]: session-146.scope: Deactivated successfully. client # [ 175.782510] systemd-logind[465]: Session 146 logged out. Waiting for processes to exit. client # [ 175.784276] systemd-logind[465]: Removed session 146. client # [ 176.350664] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 176.360262] systemd[1]: Started SSH per-connection Daemon (vsock:2:145). client # [ 176.428922] sshd-session[2678]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 176.434123] sshd-session[2678]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 176.439432] sshd-session[2678]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 176.446226] systemd-logind[465]: New session '147' of user 'root' with class 'user' and type 'tty'. client # [ 176.449406] systemd[1]: Started Session 147 of User root. client # [ 176.472561] sshd-session[2684]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 176.473898] sshd-session[2684]: Disconnected from user root UNKNOWN port 65535 client # [ 176.475222] sshd-session[2678]: pam_unix(sshd:session): session closed for user root client # [ 176.478227] systemd[1]: sshd-vsock@145-146-3:22-2:145.service: Deactivated successfully. client # [ 176.481991] systemd[1]: session-147.scope: Deactivated successfully. client # [ 176.484777] systemd-logind[465]: Session 147 logged out. Waiting for processes to exit. client # [ 176.487214] systemd-logind[465]: Removed session 147. client # [ 177.053361] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 177.062694] systemd[1]: Started SSH per-connection Daemon (vsock:2:146). client # [ 177.129869] sshd-session[2690]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 177.135072] sshd-session[2690]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 177.140475] sshd-session[2690]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 177.146906] systemd-logind[465]: New session '148' of user 'root' with class 'user' and type 'tty'. client # [ 177.149404] systemd[1]: Started Session 148 of User root. client # [ 177.172646] sshd-session[2696]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 177.173920] sshd-session[2696]: Disconnected from user root UNKNOWN port 65535 client # [ 177.175231] sshd-session[2690]: pam_unix(sshd:session): session closed for user root client # [ 177.178326] systemd[1]: sshd-vsock@146-147-3:22-2:146.service: Deactivated successfully. client # [ 177.181794] systemd[1]: session-148.scope: Deactivated successfully. client # [ 177.185168] systemd-logind[465]: Session 148 logged out. Waiting for processes to exit. client # [ 177.187193] systemd-logind[465]: Removed session 148. client # [ 177.752768] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 177.762442] systemd[1]: Started SSH per-connection Daemon (vsock:2:147). client # [ 177.828702] sshd-session[2702]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 177.833701] sshd-session[2702]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 177.839173] sshd-session[2702]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 177.845569] systemd-logind[465]: New session '149' of user 'root' with class 'user' and type 'tty'. client # [ 177.848361] systemd[1]: Started Session 149 of User root. client # [ 177.870891] sshd-session[2708]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 177.872632] sshd-session[2708]: Disconnected from user root UNKNOWN port 65535 client # [ 177.873984] sshd-session[2702]: pam_unix(sshd:session): session closed for user root client # [ 177.877060] systemd[1]: sshd-vsock@147-148-3:22-2:147.service: Deactivated successfully. client # [ 177.880571] systemd[1]: session-149.scope: Deactivated successfully. client # [ 177.883821] systemd-logind[465]: Session 149 logged out. Waiting for processes to exit. client # [ 177.885930] systemd-logind[465]: Removed session 149. client # [ 178.455466] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 178.463478] systemd[1]: Started SSH per-connection Daemon (vsock:2:148). client # [ 178.532362] sshd-session[2714]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 178.537400] sshd-session[2714]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 178.542612] sshd-session[2714]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 178.549071] systemd-logind[465]: New session '150' of user 'root' with class 'user' and type 'tty'. client # [ 178.552403] systemd[1]: Started Session 150 of User root. client # [ 178.575611] sshd-session[2720]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 178.576917] sshd-session[2720]: Disconnected from user root UNKNOWN port 65535 client # [ 178.578248] sshd-session[2714]: pam_unix(sshd:session): session closed for user root client # [ 178.581276] systemd[1]: sshd-vsock@148-149-3:22-2:148.service: Deactivated successfully. client # [ 178.584633] systemd[1]: session-150.scope: Deactivated successfully. client # [ 178.587405] systemd-logind[465]: Session 150 logged out. Waiting for processes to exit. client # [ 178.589997] systemd-logind[465]: Removed session 150. client # [ 179.154952] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 179.164269] systemd[1]: Started SSH per-connection Daemon (vsock:2:149). client # [ 179.231749] sshd-session[2726]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 179.236781] sshd-session[2726]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 179.242201] sshd-session[2726]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 179.247744] systemd-logind[465]: New session '151' of user 'root' with class 'user' and type 'tty'. client # [ 179.252395] systemd[1]: Started Session 151 of User root. client # [ 179.275608] sshd-session[2732]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 179.276940] sshd-session[2732]: Disconnected from user root UNKNOWN port 65535 client # [ 179.278258] sshd-session[2726]: pam_unix(sshd:session): session closed for user root client # [ 179.281245] systemd[1]: sshd-vsock@149-150-3:22-2:149.service: Deactivated successfully. client # [ 179.284686] systemd[1]: session-151.scope: Deactivated successfully. client # [ 179.287363] systemd-logind[465]: Session 151 logged out. Waiting for processes to exit. client # [ 179.289615] systemd-logind[465]: Removed session 151. client # [ 179.858456] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 179.866301] systemd[1]: Started SSH per-connection Daemon (vsock:2:150). client # [ 179.933412] sshd-session[2738]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 179.938406] sshd-session[2738]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 179.943867] sshd-session[2738]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 179.949288] systemd-logind[465]: New session '152' of user 'root' with class 'user' and type 'tty'. client # [ 179.953355] systemd[1]: Started Session 152 of User root. client # [ 179.976220] sshd-session[2744]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 179.977900] sshd-session[2744]: Disconnected from user root UNKNOWN port 65535 client # [ 179.979291] sshd-session[2738]: pam_unix(sshd:session): session closed for user root client # [ 179.982284] systemd[1]: sshd-vsock@150-151-3:22-2:150.service: Deactivated successfully. client # [ 179.985582] systemd[1]: session-152.scope: Deactivated successfully. client # [ 179.988456] systemd-logind[465]: Session 152 logged out. Waiting for processes to exit. client # [ 179.991243] systemd-logind[465]: Removed session 152. client # [ 180.558745] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 180.568931] systemd[1]: Started SSH per-connection Daemon (vsock:2:151). client # [ 180.636584] sshd-session[2750]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 180.641647] sshd-session[2750]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 180.647061] sshd-session[2750]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 180.653803] systemd-logind[465]: New session '153' of user 'root' with class 'user' and type 'tty'. client # [ 180.656529] systemd[1]: Started Session 153 of User root. client # [ 180.678855] sshd-session[2756]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 180.680626] sshd-session[2756]: Disconnected from user root UNKNOWN port 65535 client # [ 180.681957] sshd-session[2750]: pam_unix(sshd:session): session closed for user root client # [ 180.684908] systemd[1]: sshd-vsock@151-152-3:22-2:151.service: Deactivated successfully. client # [ 180.688568] systemd[1]: session-153.scope: Deactivated successfully. client # [ 180.691763] systemd-logind[465]: Session 153 logged out. Waiting for processes to exit. client # [ 180.693429] systemd-logind[465]: Removed session 153. client # [ 181.259294] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 181.269707] systemd[1]: Started SSH per-connection Daemon (vsock:2:152). client # [ 181.335915] sshd-session[2762]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 181.341067] sshd-session[2762]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 181.346418] sshd-session[2762]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 181.352680] systemd-logind[465]: New session '154' of user 'root' with class 'user' and type 'tty'. client # [ 181.355448] systemd[1]: Started Session 154 of User root. client # [ 181.378279] sshd-session[2768]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 181.380104] sshd-session[2768]: Disconnected from user root UNKNOWN port 65535 client # [ 181.381425] sshd-session[2762]: pam_unix(sshd:session): session closed for user root client # [ 181.384493] systemd[1]: sshd-vsock@152-153-3:22-2:152.service: Deactivated successfully. client # [ 181.388099] systemd[1]: session-154.scope: Deactivated successfully. client # [ 181.391101] systemd-logind[465]: Session 154 logged out. Waiting for processes to exit. client # [ 181.393213] systemd-logind[465]: Removed session 154. client # [ 181.962951] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 181.972152] systemd[1]: Started SSH per-connection Daemon (vsock:2:153). client # [ 182.040804] sshd-session[2774]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 182.045913] sshd-session[2774]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 182.051221] sshd-session[2774]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 182.058285] systemd-logind[465]: New session '155' of user 'root' with class 'user' and type 'tty'. client # [ 182.061415] systemd[1]: Started Session 155 of User root. client # [ 182.084560] sshd-session[2780]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 182.085912] sshd-session[2780]: Disconnected from user root UNKNOWN port 65535 client # [ 182.087253] sshd-session[2774]: pam_unix(sshd:session): session closed for user root client # [ 182.090237] systemd[1]: sshd-vsock@153-154-3:22-2:153.service: Deactivated successfully. client # [ 182.093690] systemd[1]: session-155.scope: Deactivated successfully. client # [ 182.096971] systemd-logind[465]: Session 155 logged out. Waiting for processes to exit. client # [ 182.099205] systemd-logind[465]: Removed session 155. [e2e] heartbeat t=120s client # [ 182.664179] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 182.673158] systemd[1]: Started SSH per-connection Daemon (vsock:2:154). client # [ 182.740624] sshd-session[2786]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 182.745678] sshd-session[2786]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 182.750979] sshd-session[2786]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 182.757243] systemd-logind[465]: New session '156' of user 'root' with class 'user' and type 'tty'. client # [ 182.760428] systemd[1]: Started Session 156 of User root. client # [ 182.783626] sshd-session[2792]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 182.784927] sshd-session[2792]: Disconnected from user root UNKNOWN port 65535 client # [ 182.786298] sshd-session[2786]: pam_unix(sshd:session): session closed for user root client # [ 182.789270] systemd[1]: sshd-vsock@154-155-3:22-2:154.service: Deactivated successfully. client # [ 182.792614] systemd[1]: session-156.scope: Deactivated successfully. client # [ 182.795433] systemd-logind[465]: Session 156 logged out. Waiting for processes to exit. client # [ 182.798103] systemd-logind[465]: Removed session 156. client # [ 183.366758] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 183.375195] systemd[1]: Started SSH per-connection Daemon (vsock:2:155). client # [ 183.442406] sshd-session[2798]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 183.447374] sshd-session[2798]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 183.452505] sshd-session[2798]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 183.457963] systemd-logind[465]: New session '157' of user 'root' with class 'user' and type 'tty'. client # [ 183.462354] systemd[1]: Started Session 157 of User root. client # [ 183.484911] sshd-session[2804]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 183.486586] sshd-session[2804]: Disconnected from user root UNKNOWN port 65535 client # [ 183.487862] sshd-session[2798]: pam_unix(sshd:session): session closed for user root client # [ 183.490887] systemd[1]: sshd-vsock@155-156-3:22-2:155.service: Deactivated successfully. client # [ 183.494420] systemd[1]: session-157.scope: Deactivated successfully. client # [ 183.497574] systemd-logind[465]: Session 157 logged out. Waiting for processes to exit. client # [ 183.499745] systemd-logind[465]: Removed session 157. client # [ 184.068353] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 184.076297] systemd[1]: Started SSH per-connection Daemon (vsock:2:156). client # [ 184.144376] sshd-session[2810]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 184.149371] sshd-session[2810]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 184.154819] sshd-session[2810]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 184.161228] systemd-logind[465]: New session '158' of user 'root' with class 'user' and type 'tty'. client # [ 184.163345] systemd[1]: Started Session 158 of User root. client # [ 184.186274] sshd-session[2816]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 184.188077] sshd-session[2816]: Disconnected from user root UNKNOWN port 65535 client # [ 184.189406] sshd-session[2810]: pam_unix(sshd:session): session closed for user root client # [ 184.192282] systemd[1]: sshd-vsock@156-157-3:22-2:156.service: Deactivated successfully. client # [ 184.195661] systemd[1]: session-158.scope: Deactivated successfully. client # [ 184.198846] systemd-logind[465]: Session 158 logged out. Waiting for processes to exit. client # [ 184.200482] systemd-logind[465]: Removed session 158. client # [ 184.767964] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 184.777172] systemd[1]: Started SSH per-connection Daemon (vsock:2:157). client # [ 184.845340] sshd-session[2822]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 184.850376] sshd-session[2822]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 184.855634] sshd-session[2822]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 184.862221] systemd-logind[465]: New session '159' of user 'root' with class 'user' and type 'tty'. client # [ 184.864373] systemd[1]: Started Session 159 of User root. client # [ 184.887608] sshd-session[2828]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 184.888937] sshd-session[2828]: Disconnected from user root UNKNOWN port 65535 client # [ 184.890307] sshd-session[2822]: pam_unix(sshd:session): session closed for user root client # [ 184.893244] systemd[1]: sshd-vsock@157-158-3:22-2:157.service: Deactivated successfully. client # [ 184.897135] systemd[1]: session-159.scope: Deactivated successfully. client # [ 184.900220] systemd-logind[465]: Session 159 logged out. Waiting for processes to exit. client # [ 184.902200] systemd-logind[465]: Removed session 159. client # [ 185.469315] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 185.476851] systemd[1]: Started SSH per-connection Daemon (vsock:2:158). client # [ 185.543693] sshd-session[2834]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 185.548703] sshd-session[2834]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 185.553969] sshd-session[2834]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 185.559364] systemd-logind[465]: New session '160' of user 'root' with class 'user' and type 'tty'. client # [ 185.564542] systemd[1]: Started Session 160 of User root. client # [ 185.587493] sshd-session[2840]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 185.588750] sshd-session[2840]: Disconnected from user root UNKNOWN port 65535 client # [ 185.590128] sshd-session[2834]: pam_unix(sshd:session): session closed for user root client # [ 185.593095] systemd[1]: sshd-vsock@158-159-3:22-2:158.service: Deactivated successfully. client # [ 185.596548] systemd[1]: session-160.scope: Deactivated successfully. client # [ 185.599715] systemd-logind[465]: Session 160 logged out. Waiting for processes to exit. client # [ 185.601292] systemd-logind[465]: Removed session 160. client # [ 186.171769] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 186.180094] systemd[1]: Started SSH per-connection Daemon (vsock:2:159). client # [ 186.245836] sshd-session[2846]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 186.250910] sshd-session[2846]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 186.256206] sshd-session[2846]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 186.261750] systemd-logind[465]: New session '161' of user 'root' with class 'user' and type 'tty'. client # [ 186.266401] systemd[1]: Started Session 161 of User root. client # [ 186.288958] sshd-session[2852]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 186.290699] sshd-session[2852]: Disconnected from user root UNKNOWN port 65535 client # [ 186.292085] sshd-session[2846]: pam_unix(sshd:session): session closed for user root client # [ 186.295225] systemd[1]: sshd-vsock@159-160-3:22-2:159.service: Deactivated successfully. client # [ 186.298748] systemd[1]: session-161.scope: Deactivated successfully. client # [ 186.301312] systemd-logind[465]: Session 161 logged out. Waiting for processes to exit. client # [ 186.304140] systemd-logind[465]: Removed session 161. client # [ 186.871402] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 186.880185] systemd[1]: Started SSH per-connection Daemon (vsock:2:160). client # [ 186.949919] sshd-session[2858]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 186.955156] sshd-session[2858]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 186.960554] sshd-session[2858]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 186.967072] systemd-logind[465]: New session '162' of user 'root' with class 'user' and type 'tty'. client # [ 186.970405] systemd[1]: Started Session 162 of User root. client # [ 186.993347] sshd-session[2864]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 186.995069] sshd-session[2864]: Disconnected from user root UNKNOWN port 65535 client # [ 186.996443] sshd-session[2858]: pam_unix(sshd:session): session closed for user root client # [ 186.999434] systemd[1]: sshd-vsock@160-161-3:22-2:160.service: Deactivated successfully. client # [ 187.003234] systemd[1]: session-162.scope: Deactivated successfully. client # [ 187.006420] systemd-logind[465]: Session 162 logged out. Waiting for processes to exit. client # [ 187.008184] systemd-logind[465]: Removed session 162. client # [ 187.574590] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 187.583366] systemd[1]: Started SSH per-connection Daemon (vsock:2:161). client # [ 187.649688] sshd-session[2870]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 187.654734] sshd-session[2870]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 187.660043] sshd-session[2870]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 187.666885] systemd-logind[465]: New session '163' of user 'root' with class 'user' and type 'tty'. client # [ 187.670333] systemd[1]: Started Session 163 of User root. client # [ 187.692727] sshd-session[2876]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 187.694451] sshd-session[2876]: Disconnected from user root UNKNOWN port 65535 client # [ 187.695731] sshd-session[2870]: pam_unix(sshd:session): session closed for user root client # [ 187.698682] systemd[1]: sshd-vsock@161-162-3:22-2:161.service: Deactivated successfully. client # [ 187.702371] systemd[1]: session-163.scope: Deactivated successfully. client # [ 187.705569] systemd-logind[465]: Session 163 logged out. Waiting for processes to exit. client # [ 187.707742] systemd-logind[465]: Removed session 163. client # [ 188.271595] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 188.276900] systemd[1]: Started SSH per-connection Daemon (vsock:2:162). client # [ 188.337554] sshd-session[2882]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 188.343980] sshd-session[2882]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 188.350216] sshd-session[2882]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 188.358378] systemd-logind[465]: New session '164' of user 'root' with class 'user' and type 'tty'. client # [ 188.362513] systemd[1]: Started Session 164 of User root. client # [ 188.391933] sshd-session[2888]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 188.394233] sshd-session[2888]: Disconnected from user root UNKNOWN port 65535 client # [ 188.395804] sshd-session[2882]: pam_unix(sshd:session): session closed for user root client # [ 188.399599] systemd[1]: sshd-vsock@162-163-3:22-2:162.service: Deactivated successfully. client # [ 188.404502] systemd[1]: session-164.scope: Deactivated successfully. client # [ 188.408715] systemd-logind[465]: Session 164 logged out. Waiting for processes to exit. client # [ 188.410519] systemd-logind[465]: Removed session 164. client # [ 188.973835] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 188.977914] systemd[1]: Started SSH per-connection Daemon (vsock:2:163). client # [ 189.023449] sshd-session[2894]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 189.028371] sshd-session[2894]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 189.033666] sshd-session[2894]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 189.040224] systemd-logind[465]: New session '165' of user 'root' with class 'user' and type 'tty'. client # [ 189.043345] systemd[1]: Started Session 165 of User root. client # [ 189.066096] sshd-session[2900]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 189.067308] sshd-session[2900]: Disconnected from user root UNKNOWN port 65535 client # [ 189.068549] sshd-session[2894]: pam_unix(sshd:session): session closed for user root client # [ 189.071508] systemd[1]: sshd-vsock@163-164-3:22-2:163.service: Deactivated successfully. client # [ 189.075159] systemd[1]: session-165.scope: Deactivated successfully. client # [ 189.078246] systemd-logind[465]: Session 165 logged out. Waiting for processes to exit. client # [ 189.079886] systemd-logind[465]: Removed session 165. client # [ 189.676606] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 189.680671] systemd[1]: Started SSH per-connection Daemon (vsock:2:164). client # [ 189.726924] sshd-session[2906]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 189.731857] sshd-session[2906]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 189.737244] sshd-session[2906]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 189.743545] systemd-logind[465]: New session '166' of user 'root' with class 'user' and type 'tty'. client # [ 189.746258] systemd[1]: Started Session 166 of User root. client # [ 189.769307] sshd-session[2912]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 189.770553] sshd-session[2912]: Disconnected from user root UNKNOWN port 65535 client # [ 189.771774] sshd-session[2906]: pam_unix(sshd:session): session closed for user root client # [ 189.774680] systemd[1]: sshd-vsock@164-165-3:22-2:164.service: Deactivated successfully. client # [ 189.778328] systemd[1]: session-166.scope: Deactivated successfully. client # [ 189.781289] systemd-logind[465]: Session 166 logged out. Waiting for processes to exit. client # [ 189.782949] systemd-logind[465]: Removed session 166. client # [ 190.376855] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 190.380803] systemd[1]: Started SSH per-connection Daemon (vsock:2:165). client # [ 190.427618] sshd-session[2918]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 190.432703] sshd-session[2918]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 190.437973] sshd-session[2918]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 190.444407] systemd-logind[465]: New session '167' of user 'root' with class 'user' and type 'tty'. client # [ 190.447334] systemd[1]: Started Session 167 of User root. client # [ 190.469610] sshd-session[2924]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 190.471381] sshd-session[2924]: Disconnected from user root UNKNOWN port 65535 client # [ 190.472616] sshd-session[2918]: pam_unix(sshd:session): session closed for user root client # [ 190.475542] systemd[1]: sshd-vsock@165-166-3:22-2:165.service: Deactivated successfully. client # [ 190.479314] systemd[1]: session-167.scope: Deactivated successfully. client # [ 190.482283] systemd-logind[465]: Session 167 logged out. Waiting for processes to exit. client # [ 190.483954] systemd-logind[465]: Removed session 167. client # [ 191.079708] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 191.083393] systemd[1]: Started SSH per-connection Daemon (vsock:2:166). client # [ 191.129527] sshd-session[2930]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 191.134570] sshd-session[2930]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 191.139888] sshd-session[2930]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 191.145110] systemd-logind[465]: New session '168' of user 'root' with class 'user' and type 'tty'. client # [ 191.150407] systemd[1]: Started Session 168 of User root. client # [ 191.172696] sshd-session[2936]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 191.174450] sshd-session[2936]: Disconnected from user root UNKNOWN port 65535 client # [ 191.175737] sshd-session[2930]: pam_unix(sshd:session): session closed for user root client # [ 191.178716] systemd[1]: sshd-vsock@166-167-3:22-2:166.service: Deactivated successfully. client # [ 191.182339] systemd[1]: session-168.scope: Deactivated successfully. client # [ 191.185631] systemd-logind[465]: Session 168 logged out. Waiting for processes to exit. client # [ 191.187183] systemd-logind[465]: Removed session 168. client # [ 191.782672] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 191.792318] systemd[1]: Started SSH per-connection Daemon (vsock:2:167). client # [ 191.858801] sshd-session[2942]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 191.863854] sshd-session[2942]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 191.869173] sshd-session[2942]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 191.875835] systemd-logind[465]: New session '169' of user 'root' with class 'user' and type 'tty'. client # [ 191.878551] systemd[1]: Started Session 169 of User root. client # [ 191.900773] sshd-session[2948]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 191.902513] sshd-session[2948]: Disconnected from user root UNKNOWN port 65535 client # [ 191.903764] sshd-session[2942]: pam_unix(sshd:session): session closed for user root client # [ 191.906803] systemd[1]: sshd-vsock@167-168-3:22-2:167.service: Deactivated successfully. client # [ 191.910372] systemd[1]: session-169.scope: Deactivated successfully. client # [ 191.913529] systemd-logind[465]: Session 169 logged out. Waiting for processes to exit. client # [ 191.915214] systemd-logind[465]: Removed session 169. client # [ 192.484371] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 192.493548] systemd[1]: Started SSH per-connection Daemon (vsock:2:168). client # [ 192.556763] sshd-session[2954]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 192.561793] sshd-session[2954]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 192.567128] sshd-session[2954]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 192.573236] systemd-logind[465]: New session '170' of user 'root' with class 'user' and type 'tty'. client # [ 192.576402] systemd[1]: Started Session 170 of User root. client # [ 192.599545] sshd-session[2960]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 192.600846] sshd-session[2960]: Disconnected from user root UNKNOWN port 65535 client # [ 192.602249] sshd-session[2954]: pam_unix(sshd:session): session closed for user root client # [ 192.605275] systemd[1]: sshd-vsock@168-169-3:22-2:168.service: Deactivated successfully. client # [ 192.608593] systemd[1]: session-170.scope: Deactivated successfully. client # [ 192.611286] systemd-logind[465]: Session 170 logged out. Waiting for processes to exit. client # [ 192.614068] systemd-logind[465]: Removed session 170. client # [ 193.187637] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 193.194336] systemd[1]: Started SSH per-connection Daemon (vsock:2:169). client # [ 193.264806] sshd-session[2966]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 193.269898] sshd-session[2966]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 193.275260] sshd-session[2966]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 193.281616] systemd-logind[465]: New session '171' of user 'root' with class 'user' and type 'tty'. client # [ 193.284354] systemd[1]: Started Session 171 of User root. client # [ 193.306824] sshd-session[2972]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 193.308540] sshd-session[2972]: Disconnected from user root UNKNOWN port 65535 client # [ 193.309800] sshd-session[2966]: pam_unix(sshd:session): session closed for user root client # [ 193.312711] systemd[1]: sshd-vsock@169-170-3:22-2:169.service: Deactivated successfully. client # [ 193.316689] systemd[1]: session-171.scope: Deactivated successfully. client # [ 193.319695] systemd-logind[465]: Session 171 logged out. Waiting for processes to exit. client # [ 193.321093] systemd-logind[465]: Removed session 171. client # [ 193.885374] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 193.894936] systemd[1]: Started SSH per-connection Daemon (vsock:2:170). client # [ 193.961862] sshd-session[2978]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 193.966893] sshd-session[2978]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 193.972207] sshd-session[2978]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 193.978445] systemd-logind[465]: New session '172' of user 'root' with class 'user' and type 'tty'. client # [ 193.981375] systemd[1]: Started Session 172 of User root. client # [ 194.003912] sshd-session[2984]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 194.005705] sshd-session[2984]: Disconnected from user root UNKNOWN port 65535 client # [ 194.007177] sshd-session[2978]: pam_unix(sshd:session): session closed for user root client # [ 194.010055] systemd[1]: sshd-vsock@170-171-3:22-2:170.service: Deactivated successfully. client # [ 194.013610] systemd[1]: session-172.scope: Deactivated successfully. client # [ 194.016773] systemd-logind[465]: Session 172 logged out. Waiting for processes to exit. client # [ 194.018966] systemd-logind[465]: Removed session 172. client # [ 194.588833] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 194.596282] systemd[1]: Started SSH per-connection Daemon (vsock:2:171). client # [ 194.666622] sshd-session[2990]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 194.671617] sshd-session[2990]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 194.676854] sshd-session[2990]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 194.683222] systemd-logind[465]: New session '173' of user 'root' with class 'user' and type 'tty'. client # [ 194.686410] systemd[1]: Started Session 173 of User root. client # [ 194.708817] sshd-session[2996]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 194.710545] sshd-session[2996]: Disconnected from user root UNKNOWN port 65535 client # [ 194.711828] sshd-session[2990]: pam_unix(sshd:session): session closed for user root client # [ 194.714805] systemd[1]: sshd-vsock@171-172-3:22-2:171.service: Deactivated successfully. client # [ 194.718443] systemd[1]: session-173.scope: Deactivated successfully. client # [ 194.721823] systemd-logind[465]: Session 173 logged out. Waiting for processes to exit. client # [ 194.723426] systemd-logind[465]: Removed session 173. client # [ 195.287289] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 195.295697] systemd[1]: Started SSH per-connection Daemon (vsock:2:172). client # [ 195.363307] sshd-session[3002]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 195.368300] sshd-session[3002]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 195.373539] sshd-session[3002]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 195.380212] systemd-logind[465]: New session '174' of user 'root' with class 'user' and type 'tty'. client # [ 195.382408] systemd[1]: Started Session 174 of User root. client # [ 195.404869] sshd-session[3008]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 195.406628] sshd-session[3008]: Disconnected from user root UNKNOWN port 65535 client # [ 195.407904] sshd-session[3002]: pam_unix(sshd:session): session closed for user root client # [ 195.410916] systemd[1]: sshd-vsock@172-173-3:22-2:172.service: Deactivated successfully. client # [ 195.414621] systemd[1]: session-174.scope: Deactivated successfully. client # [ 195.417785] systemd-logind[465]: Session 174 logged out. Waiting for processes to exit. client # [ 195.419662] systemd-logind[465]: Removed session 174. client # [ 195.990809] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 196.000452] systemd[1]: Started SSH per-connection Daemon (vsock:2:173). client # [ 196.067745] sshd-session[3014]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 196.072751] sshd-session[3014]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 196.078154] sshd-session[3014]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 196.084773] systemd-logind[465]: New session '175' of user 'root' with class 'user' and type 'tty'. client # [ 196.087328] systemd[1]: Started Session 175 of User root. client # [ 196.109803] sshd-session[3020]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 196.111548] sshd-session[3020]: Disconnected from user root UNKNOWN port 65535 client # [ 196.112808] sshd-session[3014]: pam_unix(sshd:session): session closed for user root client # [ 196.115694] systemd[1]: sshd-vsock@173-174-3:22-2:173.service: Deactivated successfully. client # [ 196.119433] systemd[1]: session-175.scope: Deactivated successfully. client # [ 196.122285] systemd-logind[465]: Session 175 logged out. Waiting for processes to exit. client # [ 196.124127] systemd-logind[465]: Removed session 175. client # [ 196.692157] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 196.699685] systemd[1]: Started SSH per-connection Daemon (vsock:2:174). client # [ 196.767429] sshd-session[3026]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 196.772431] sshd-session[3026]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 196.777776] sshd-session[3026]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 196.782871] systemd-logind[465]: New session '176' of user 'root' with class 'user' and type 'tty'. client # [ 196.787398] systemd[1]: Started Session 176 of User root. client # [ 196.809861] sshd-session[3032]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 196.811595] sshd-session[3032]: Disconnected from user root UNKNOWN port 65535 client # [ 196.813471] sshd-session[3026]: pam_unix(sshd:session): session closed for user root client # [ 196.816206] systemd[1]: sshd-vsock@174-175-3:22-2:174.service: Deactivated successfully. client # [ 196.819618] systemd[1]: session-176.scope: Deactivated successfully. client # [ 196.822938] systemd-logind[465]: Session 176 logged out. Waiting for processes to exit. client # [ 196.824604] systemd-logind[465]: Removed session 176. client # [ 197.396869] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 197.404146] systemd[1]: Started SSH per-connection Daemon (vsock:2:175). client # [ 197.469574] sshd-session[3038]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 197.474583] sshd-session[3038]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 197.479851] sshd-session[3038]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 197.486506] systemd-logind[465]: New session '177' of user 'root' with class 'user' and type 'tty'. client # [ 197.489354] systemd[1]: Started Session 177 of User root. client # [ 197.512247] sshd-session[3044]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 197.513820] sshd-session[3044]: Disconnected from user root UNKNOWN port 65535 client # [ 197.515198] sshd-session[3038]: pam_unix(sshd:session): session closed for user root client # [ 197.518310] systemd[1]: sshd-vsock@175-176-3:22-2:175.service: Deactivated successfully. client # [ 197.521734] systemd[1]: session-177.scope: Deactivated successfully. client # [ 197.524961] systemd-logind[465]: Session 177 logged out. Waiting for processes to exit. client # [ 197.527152] systemd-logind[465]: Removed session 177. client # [ 198.095312] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 198.103650] systemd[1]: Started SSH per-connection Daemon (vsock:2:176). client # [ 198.168711] sshd-session[3050]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 198.173654] sshd-session[3050]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 198.178715] sshd-session[3050]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 198.185049] systemd-logind[465]: New session '178' of user 'root' with class 'user' and type 'tty'. client # [ 198.187401] systemd[1]: Started Session 178 of User root. client # [ 198.209503] sshd-session[3056]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 198.210799] sshd-session[3056]: Disconnected from user root UNKNOWN port 65535 client # [ 198.212169] sshd-session[3050]: pam_unix(sshd:session): session closed for user root client # [ 198.215227] systemd[1]: sshd-vsock@176-177-3:22-2:176.service: Deactivated successfully. client # [ 198.218642] systemd[1]: session-178.scope: Deactivated successfully. client # [ 198.221864] systemd-logind[465]: Session 178 logged out. Waiting for processes to exit. client # [ 198.224110] systemd-logind[465]: Removed session 178. client # [ 198.797798] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 198.807347] systemd[1]: Started SSH per-connection Daemon (vsock:2:177). client # [ 198.874483] sshd-session[3062]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 198.879120] sshd-session[3062]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 198.884499] sshd-session[3062]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 198.890221] systemd-logind[465]: New session '179' of user 'root' with class 'user' and type 'tty'. client # [ 198.894326] systemd[1]: Started Session 179 of User root. client # [ 198.916263] sshd-session[3068]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 198.917947] sshd-session[3068]: Disconnected from user root UNKNOWN port 65535 client # [ 198.919301] sshd-session[3062]: pam_unix(sshd:session): session closed for user root client # [ 198.922268] systemd[1]: sshd-vsock@177-178-3:22-2:177.service: Deactivated successfully. client # [ 198.925754] systemd[1]: session-179.scope: Deactivated successfully. client # [ 198.928370] systemd-logind[465]: Session 179 logged out. Waiting for processes to exit. client # [ 198.930810] systemd-logind[465]: Removed session 179. client # [ 199.497525] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 199.506359] systemd[1]: Started SSH per-connection Daemon (vsock:2:178). client # [ 199.572299] sshd-session[3074]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 199.577189] sshd-session[3074]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 199.582273] sshd-session[3074]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 199.588685] systemd-logind[465]: New session '180' of user 'root' with class 'user' and type 'tty'. client # [ 199.591404] systemd[1]: Started Session 180 of User root. client # [ 199.613469] sshd-session[3080]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 199.614792] sshd-session[3080]: Disconnected from user root UNKNOWN port 65535 client # [ 199.616159] sshd-session[3074]: pam_unix(sshd:session): session closed for user root client # [ 199.618975] systemd[1]: sshd-vsock@178-179-3:22-2:178.service: Deactivated successfully. client # [ 199.622635] systemd[1]: session-180.scope: Deactivated successfully. client # [ 199.625869] systemd-logind[465]: Session 180 logged out. Waiting for processes to exit. client # [ 199.627574] systemd-logind[465]: Removed session 180. client # [ 200.201572] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 200.209147] systemd[1]: Started SSH per-connection Daemon (vsock:2:179). client # [ 200.275211] sshd-session[3086]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 200.279980] sshd-session[3086]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 200.285078] sshd-session[3086]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 200.291909] systemd-logind[465]: New session '181' of user 'root' with class 'user' and type 'tty'. client # [ 200.295336] systemd[1]: Started Session 181 of User root. client # [ 200.317548] sshd-session[3092]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 200.318869] sshd-session[3092]: Disconnected from user root UNKNOWN port 65535 client # [ 200.320164] sshd-session[3086]: pam_unix(sshd:session): session closed for user root client # [ 200.323104] systemd[1]: sshd-vsock@179-180-3:22-2:179.service: Deactivated successfully. client # [ 200.326639] systemd[1]: session-181.scope: Deactivated successfully. client # [ 200.329843] systemd-logind[465]: Session 181 logged out. Waiting for processes to exit. client # [ 200.331466] systemd-logind[465]: Removed session 181. client # [ 200.900370] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 200.909698] systemd[1]: Started SSH per-connection Daemon (vsock:2:180). client # [ 200.975590] sshd-session[3098]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 200.980128] sshd-session[3098]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 200.985610] sshd-session[3098]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 200.991071] systemd-logind[465]: New session '182' of user 'root' with class 'user' and type 'tty'. client # [ 200.995399] systemd[1]: Started Session 182 of User root. client # [ 201.017376] sshd-session[3104]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 201.019144] sshd-session[3104]: Disconnected from user root UNKNOWN port 65535 client # [ 201.020399] sshd-session[3098]: pam_unix(sshd:session): session closed for user root client # [ 201.023308] systemd[1]: sshd-vsock@180-181-3:22-2:180.service: Deactivated successfully. client # [ 201.026609] systemd[1]: session-182.scope: Deactivated successfully. client # [ 201.029446] systemd-logind[465]: Session 182 logged out. Waiting for processes to exit. client # [ 201.031619] systemd-logind[465]: Removed session 182. client # [ 201.603633] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 201.611530] systemd[1]: Started SSH per-connection Daemon (vsock:2:181). client # [ 201.679856] sshd-session[3110]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 201.684742] sshd-session[3110]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 201.689811] sshd-session[3110]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 201.696219] systemd-logind[465]: New session '183' of user 'root' with class 'user' and type 'tty'. client # [ 201.700249] systemd[1]: Started Session 183 of User root. client # [ 201.722218] sshd-session[3116]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 201.723863] sshd-session[3116]: Disconnected from user root UNKNOWN port 65535 client # [ 201.725197] sshd-session[3110]: pam_unix(sshd:session): session closed for user root client # [ 201.727983] systemd[1]: sshd-vsock@181-182-3:22-2:181.service: Deactivated successfully. client # [ 201.731612] systemd[1]: session-183.scope: Deactivated successfully. client # [ 201.734953] systemd-logind[465]: Session 183 logged out. Waiting for processes to exit. client # [ 201.736605] systemd-logind[465]: Removed session 183. client # [ 202.303361] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 202.310150] systemd[1]: Started SSH per-connection Daemon (vsock:2:182). client # [ 202.380430] sshd-session[3122]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 202.385240] sshd-session[3122]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 202.390359] sshd-session[3122]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 202.396675] systemd-logind[465]: New session '184' of user 'root' with class 'user' and type 'tty'. client # [ 202.399369] systemd[1]: Started Session 184 of User root. client # [ 202.421262] sshd-session[3128]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 202.422960] sshd-session[3128]: Disconnected from user root UNKNOWN port 65535 client # [ 202.424569] sshd-session[3122]: pam_unix(sshd:session): session closed for user root client # [ 202.427249] systemd[1]: sshd-vsock@182-183-3:22-2:182.service: Deactivated successfully. client # [ 202.430677] systemd[1]: session-184.scope: Deactivated successfully. client # [ 202.433331] systemd-logind[465]: Session 184 logged out. Waiting for processes to exit. client # [ 202.436101] systemd-logind[465]: Removed session 184. client # [ 203.006866] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 203.014408] systemd[1]: Started SSH per-connection Daemon (vsock:2:183). client # [ 203.082286] sshd-session[3134]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 203.087158] sshd-session[3134]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 203.092250] sshd-session[3134]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 203.098463] systemd-logind[465]: New session '185' of user 'root' with class 'user' and type 'tty'. client # [ 203.102352] systemd[1]: Started Session 185 of User root. client # [ 203.124334] sshd-session[3140]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 203.126119] sshd-session[3140]: Disconnected from user root UNKNOWN port 65535 client # [ 203.127365] sshd-session[3134]: pam_unix(sshd:session): session closed for user root client # [ 203.130277] systemd[1]: sshd-vsock@183-184-3:22-2:183.service: Deactivated successfully. client # [ 203.133631] systemd[1]: session-185.scope: Deactivated successfully. client # [ 203.136125] systemd-logind[465]: Session 185 logged out. Waiting for processes to exit. client # [ 203.138482] systemd-logind[465]: Removed session 185. client # [ 203.705550] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 203.714195] systemd[1]: Started SSH per-connection Daemon (vsock:2:184). client # [ 203.780627] sshd-session[3146]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 203.785634] sshd-session[3146]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 203.790730] sshd-session[3146]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 203.797043] systemd-logind[465]: New session '186' of user 'root' with class 'user' and type 'tty'. client # [ 203.799403] systemd[1]: Started Session 186 of User root. client # [ 203.821521] sshd-session[3152]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 203.822834] sshd-session[3152]: Disconnected from user root UNKNOWN port 65535 client # [ 203.824130] sshd-session[3146]: pam_unix(sshd:session): session closed for user root client # [ 203.826890] systemd[1]: sshd-vsock@184-185-3:22-2:184.service: Deactivated successfully. client # [ 203.830635] systemd[1]: session-186.scope: Deactivated successfully. client # [ 203.833792] systemd-logind[465]: Session 186 logged out. Waiting for processes to exit. client # [ 203.835961] systemd-logind[465]: Removed session 186. client # [ 204.408867] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 204.417954] systemd[1]: Started SSH per-connection Daemon (vsock:2:185). client # [ 204.482679] sshd-session[3158]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 204.487721] sshd-session[3158]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 204.492810] sshd-session[3158]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 204.499225] systemd-logind[465]: New session '187' of user 'root' with class 'user' and type 'tty'. client # [ 204.502332] systemd[1]: Started Session 187 of User root. client # [ 204.524461] sshd-session[3164]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 204.525818] sshd-session[3164]: Disconnected from user root UNKNOWN port 65535 client # [ 204.527124] sshd-session[3158]: pam_unix(sshd:session): session closed for user root client # [ 204.530054] systemd[1]: sshd-vsock@185-186-3:22-2:185.service: Deactivated successfully. client # [ 204.533608] systemd[1]: session-187.scope: Deactivated successfully. client # [ 204.536771] systemd-logind[465]: Session 187 logged out. Waiting for processes to exit. client # [ 204.538521] systemd-logind[465]: Removed session 187. client # [ 205.110492] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 205.117708] systemd[1]: Started SSH per-connection Daemon (vsock:2:186). client # [ 205.184661] sshd-session[3170]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 205.189601] sshd-session[3170]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 205.194800] sshd-session[3170]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 205.201067] systemd-logind[465]: New session '188' of user 'root' with class 'user' and type 'tty'. client # [ 205.204395] systemd[1]: Started Session 188 of User root. client # [ 205.226513] sshd-session[3176]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 205.227768] sshd-session[3176]: Disconnected from user root UNKNOWN port 65535 client # [ 205.229113] sshd-session[3170]: pam_unix(sshd:session): session closed for user root client # [ 205.232072] systemd[1]: sshd-vsock@186-187-3:22-2:186.service: Deactivated successfully. client # [ 205.235475] systemd[1]: session-188.scope: Deactivated successfully. client # [ 205.238076] systemd-logind[465]: Session 188 logged out. Waiting for processes to exit. client # [ 205.240283] systemd-logind[465]: Removed session 188. client # [ 205.809877] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 205.818727] systemd[1]: Started SSH per-connection Daemon (vsock:2:187). client # [ 205.885272] sshd-session[3182]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 205.890052] sshd-session[3182]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 205.895073] sshd-session[3182]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 205.901224] systemd-logind[465]: New session '189' of user 'root' with class 'user' and type 'tty'. client # [ 205.904363] systemd[1]: Started Session 189 of User root. client # [ 205.926519] sshd-session[3188]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 205.927872] sshd-session[3188]: Disconnected from user root UNKNOWN port 65535 client # [ 205.929208] sshd-session[3182]: pam_unix(sshd:session): session closed for user root client # [ 205.932066] systemd[1]: sshd-vsock@187-188-3:22-2:187.service: Deactivated successfully. client # [ 205.935513] systemd[1]: session-189.scope: Deactivated successfully. client # [ 205.938914] systemd-logind[465]: Session 189 logged out. Waiting for processes to exit. client # [ 205.940402] systemd-logind[465]: Removed session 189. client # [ 206.511395] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 206.521462] systemd[1]: Started SSH per-connection Daemon (vsock:2:188). client # [ 206.588631] sshd-session[3194]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 206.593115] sshd-session[3194]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 206.598590] sshd-session[3194]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 206.605028] systemd-logind[465]: New session '190' of user 'root' with class 'user' and type 'tty'. client # [ 206.607397] systemd[1]: Started Session 190 of User root. client # [ 206.629272] sshd-session[3200]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 206.630995] sshd-session[3200]: Disconnected from user root UNKNOWN port 65535 client # [ 206.632363] sshd-session[3194]: pam_unix(sshd:session): session closed for user root client # [ 206.635204] systemd[1]: sshd-vsock@188-189-3:22-2:188.service: Deactivated successfully. client # [ 206.638750] systemd[1]: session-190.scope: Deactivated successfully. client # [ 206.641920] systemd-logind[465]: Session 190 logged out. Waiting for processes to exit. client # [ 206.643569] systemd-logind[465]: Removed session 190. client # [ 207.211914] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 207.221257] systemd[1]: Started SSH per-connection Daemon (vsock:2:189). client # [ 207.288983] sshd-session[3206]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 207.293941] sshd-session[3206]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 207.299095] sshd-session[3206]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 207.305223] systemd-logind[465]: New session '191' of user 'root' with class 'user' and type 'tty'. client # [ 207.309259] systemd[1]: Started Session 191 of User root. client # [ 207.331358] sshd-session[3212]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 207.333107] sshd-session[3212]: Disconnected from user root UNKNOWN port 65535 client # [ 207.334358] sshd-session[3206]: pam_unix(sshd:session): session closed for user root client # [ 207.337235] systemd[1]: sshd-vsock@189-190-3:22-2:189.service: Deactivated successfully. client # [ 207.340639] systemd[1]: session-191.scope: Deactivated successfully. client # [ 207.343905] systemd-logind[465]: Session 191 logged out. Waiting for processes to exit. client # [ 207.345560] systemd-logind[465]: Removed session 191. client # [ 207.915370] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 207.923160] systemd[1]: Started SSH per-connection Daemon (vsock:2:190). client # [ 207.993429] sshd-session[3218]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 207.998259] sshd-session[3218]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 208.003360] sshd-session[3218]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 208.009233] systemd-logind[465]: New session '192' of user 'root' with class 'user' and type 'tty'. client # [ 208.013329] systemd[1]: Started Session 192 of User root. client # [ 208.035554] sshd-session[3224]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 208.036814] sshd-session[3224]: Disconnected from user root UNKNOWN port 65535 client # [ 208.038141] sshd-session[3218]: pam_unix(sshd:session): session closed for user root client # [ 208.040930] systemd[1]: sshd-vsock@190-191-3:22-2:190.service: Deactivated successfully. client # [ 208.044471] systemd[1]: session-192.scope: Deactivated successfully. client # [ 208.047687] systemd-logind[465]: Session 192 logged out. Waiting for processes to exit. client # [ 208.049397] systemd-logind[465]: Removed session 192. client # [ 208.615937] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 208.624659] systemd[1]: Started SSH per-connection Daemon (vsock:2:191). client # [ 208.691355] sshd-session[3230]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 208.696190] sshd-session[3230]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 208.701301] sshd-session[3230]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 208.707836] systemd-logind[465]: New session '193' of user 'root' with class 'user' and type 'tty'. client # [ 208.710360] systemd[1]: Started Session 193 of User root. client # [ 208.732578] sshd-session[3236]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 208.733865] sshd-session[3236]: Disconnected from user root UNKNOWN port 65535 client # [ 208.735202] sshd-session[3230]: pam_unix(sshd:session): session closed for user root client # [ 208.738060] systemd[1]: sshd-vsock@191-192-3:22-2:191.service: Deactivated successfully. client # [ 208.741575] systemd[1]: session-193.scope: Deactivated successfully. client # [ 208.744733] systemd-logind[465]: Session 193 logged out. Waiting for processes to exit. client # [ 208.746506] systemd-logind[465]: Removed session 193. client # [ 209.317438] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 209.327159] systemd[1]: Started SSH per-connection Daemon (vsock:2:192). client # [ 209.392886] sshd-session[3242]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 209.397880] sshd-session[3242]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 209.402958] sshd-session[3242]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 209.408239] systemd-logind[465]: New session '194' of user 'root' with class 'user' and type 'tty'. client # [ 209.413429] systemd[1]: Started Session 194 of User root. client # [ 209.435545] sshd-session[3248]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 209.436855] sshd-session[3248]: Disconnected from user root UNKNOWN port 65535 client # [ 209.438162] sshd-session[3242]: pam_unix(sshd:session): session closed for user root client # [ 209.441107] systemd[1]: sshd-vsock@192-193-3:22-2:192.service: Deactivated successfully. client # [ 209.444618] systemd[1]: session-194.scope: Deactivated successfully. client # [ 209.447734] systemd-logind[465]: Session 194 logged out. Waiting for processes to exit. client # [ 209.449498] systemd-logind[465]: Removed session 194. client # [ 210.019626] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 210.027335] systemd[1]: Started SSH per-connection Daemon (vsock:2:193). client # [ 210.099391] sshd-session[3254]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 210.104237] sshd-session[3254]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 210.109339] sshd-session[3254]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 210.115610] systemd-logind[465]: New session '195' of user 'root' with class 'user' and type 'tty'. client # [ 210.118336] systemd[1]: Started Session 195 of User root. client # [ 210.140562] sshd-session[3260]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 210.142326] sshd-session[3260]: Disconnected from user root UNKNOWN port 65535 client # [ 210.143585] sshd-session[3254]: pam_unix(sshd:session): session closed for user root client # [ 210.146437] systemd[1]: sshd-vsock@193-194-3:22-2:193.service: Deactivated successfully. client # [ 210.150098] systemd[1]: session-195.scope: Deactivated successfully. client # [ 210.153299] systemd-logind[465]: Session 195 logged out. Waiting for processes to exit. client # [ 210.155221] systemd-logind[465]: Removed session 195. client # [ 210.720319] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 210.730150] systemd[1]: Started SSH per-connection Daemon (vsock:2:194). client # [ 210.795951] sshd-session[3266]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 210.800984] sshd-session[3266]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 210.806266] sshd-session[3266]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 210.812236] systemd-logind[465]: New session '196' of user 'root' with class 'user' and type 'tty'. client # [ 210.815442] systemd[1]: Started Session 196 of User root. client # [ 210.837378] sshd-session[3272]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 210.839339] sshd-session[3272]: Disconnected from user root UNKNOWN port 65535 client # [ 210.840817] sshd-session[3266]: pam_unix(sshd:session): session closed for user root client # [ 210.843412] systemd[1]: sshd-vsock@194-195-3:22-2:194.service: Deactivated successfully. client # [ 210.846972] systemd[1]: session-196.scope: Deactivated successfully. client # [ 210.849987] systemd-logind[465]: Session 196 logged out. Waiting for processes to exit. client # [ 210.851848] systemd-logind[465]: Removed session 196. thread 'farm::serial::a_failed_upload_fails_the_build_instead_of_rebuilding_it' (580) panicked at harness.rs:258:9: [client] not true after 120s: sh -c '! systemctl is-active "$@"' sh pubdown last output (exit 1): active note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace FAILED test farm::serial::a_failing_build_is_counted_with_its_own_reason ... worker1 # [ 210.927858] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 210.938191] systemd[1]: Started SSH per-connection Daemon (vsock:2:25). worker1 # [ 211.010241] sshd-session[1612]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 211.015284] sshd-session[1612]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 211.020767] sshd-session[1612]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 211.030868] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 211.039349] systemd-logind[608]: New session '29' of user 'root' with class 'user' and type 'tty'. worker1 # [ 211.055142] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 211.059771] systemd[1]: Starting User Manager for UID 0... worker1 # [ 211.075619] (systemd)[1620]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 211.079709] systemd-logind[608]: New session '30' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 211.155497] systemd[1620]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 211.225485] systemd[1620]: Queued start job for default target Main User Target. worker1 # [ 211.227708] systemd[1620]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 211.229978] systemd[1620]: Created slice User Application Slice. worker1 # [ 211.231199] systemd[1620]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 211.232896] systemd[1620]: Reached target Paths. worker1 # [ 211.233667] systemd[1620]: Reached target Timers. worker1 # [ 211.235131] systemd[1620]: Starting D-Bus User Message Bus Socket... worker1 # [ 211.237103] systemd[1620]: Starting Create User Files and Directories... worker1 # [ 211.264255] systemd[1620]: Finished Create User Files and Directories. worker1 # [ 211.267675] systemd[1620]: Listening on D-Bus User Message Bus Socket. worker1 # [ 211.268640] systemd[1620]: Reached target Sockets. worker1 # [ 211.269716] systemd[1620]: Reached target Basic System. worker1 # [ 211.271572] systemd[1620]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 211.273965] systemd[1620]: Reached target Main User Target. worker1 # [ 211.274796] systemd[1620]: Startup finished in 176ms. worker1 # [ 211.275614] systemd[1]: Started User Manager for UID 0. worker1 # [ 211.278554] systemd[1]: Started Session 29 of User root. worker1 # [ 211.300518] sshd-session[1633]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 211.301906] sshd-session[1633]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 211.303309] sshd-session[1612]: pam_unix(sshd:session): session closed for user root worker1 # [ 211.306348] systemd[1]: sshd-vsock@25-26-5:22-2:25.service: Deactivated successfully. worker1 # [ 211.309822] systemd[1]: session-29.scope: Deactivated successfully. worker1 # [ 211.313166] systemd-logind[608]: Session 29 logged out. Waiting for processes to exit. worker1 # [ 211.315223] systemd-logind[608]: Removed session 29. worker2 # [ 211.327485] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 211.337875] systemd[1]: Started SSH per-connection Daemon (vsock:2:21). worker2 # [ 211.408745] sshd-session[1685]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 211.414234] sshd-session[1685]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 211.420086] sshd-session[1685]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 211.431504] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 211.440817] systemd-logind[555]: New session '24' of user 'root' with class 'user' and type 'tty'. worker2 # [ 211.457620] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 211.462876] systemd[1]: Starting User Manager for UID 0... worker2 # [ 211.480108] (systemd)[1694]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 211.484942] systemd-logind[555]: New session '25' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 211.564211] systemd[1694]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 211.638621] systemd[1694]: Queued start job for default target Main User Target. worker2 # [ 211.640756] systemd[1694]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 211.643102] systemd[1694]: Created slice User Application Slice. worker2 # [ 211.643973] systemd[1694]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 211.644994] systemd[1694]: Reached target Paths. worker2 # [ 211.646510] systemd[1694]: Reached target Timers. worker2 # [ 211.648697] systemd[1694]: Starting D-Bus User Message Bus Socket... worker2 # [ 211.650152] systemd[1694]: Starting Create User Files and Directories... worker2 # [ 211.677298] systemd[1694]: Finished Create User Files and Directories. worker2 # [ 211.680298] systemd[1694]: Listening on D-Bus User Message Bus Socket. worker2 # [ 211.681685] systemd[1694]: Reached target Sockets. worker2 # [ 211.682461] systemd[1694]: Reached target Basic System. worker2 # [ 211.683654] systemd[1694]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 211.685946] systemd[1694]: Reached target Main User Target. worker2 # [ 211.687973] systemd[1694]: Startup finished in 185ms. worker2 # [ 211.688843] systemd[1]: Started User Manager for UID 0. worker2 # [ 211.690090] systemd[1]: Started Session 24 of User root. worker2 # [ 211.715582] sshd-session[1707]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 211.716894] sshd-session[1707]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 211.718286] sshd-session[1685]: pam_unix(sshd:session): session closed for user root worker2 # [ 211.722041] systemd[1]: sshd-vsock@21-22-6:22-2:21.service: Deactivated successfully. worker2 # [ 211.725537] systemd[1]: session-24.scope: Deactivated successfully. worker2 # [ 211.728268] systemd-logind[555]: Session 24 logged out. Waiting for processes to exit. worker2 # [ 211.731095] systemd-logind[555]: Removed session 24. lb # [ 211.830097] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 211.840157] systemd[1]: Started SSH per-connection Daemon (vsock:2:23). lb # [ 211.904952] sshd-session[1402]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 211.909475] sshd-session[1402]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 211.915598] sshd-session[1402]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 211.932282] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 211.944310] systemd-logind[553]: New session '27' of user 'root' with class 'user' and type 'tty'. lb # [ 211.958608] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 211.962392] systemd[1]: Starting User Manager for UID 0... lb # [ 211.978568] (systemd)[1411]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 211.983121] systemd-logind[553]: New session '28' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 212.062214] systemd[1411]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 212.133386] systemd[1411]: Queued start job for default target Main User Target. lb # [ 212.135650] systemd[1411]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 212.138078] systemd[1411]: Created slice User Application Slice. lb # [ 212.139245] systemd[1411]: Started Daily Cleanup of User's Temporary Directories. lb # [ 212.140227] systemd[1411]: Reached target Paths. lb # [ 212.141631] systemd[1411]: Reached target Timers. lb # [ 212.143072] systemd[1411]: Starting D-Bus User Message Bus Socket... lb # [ 212.145257] systemd[1411]: Starting Create User Files and Directories... lb # [ 212.174956] systemd[1411]: Finished Create User Files and Directories. lb # [ 212.176933] systemd[1411]: Listening on D-Bus User Message Bus Socket. lb # [ 212.178148] systemd[1411]: Reached target Sockets. lb # [ 212.179072] systemd[1411]: Reached target Basic System. lb # [ 212.180823] systemd[1411]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 212.182126] systemd[1411]: Reached target Main User Target. lb # [ 212.182869] systemd[1411]: Startup finished in 185ms. lb # [ 212.183574] systemd[1]: Started User Manager for UID 0. lb # [ 212.187391] systemd[1]: Started Session 27 of User root. lb # [ 212.214180] sshd-session[1424]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 212.215889] sshd-session[1424]: Disconnected from user root UNKNOWN port 65535 lb # [ 212.217172] sshd-session[1402]: pam_unix(sshd:session): session closed for user root lb # [ 212.220415] systemd[1]: sshd-vsock@23-24-4:22-2:23.service: Deactivated successfully. lb # [ 212.224413] systemd[1]: session-27.scope: Deactivated successfully. lb # [ 212.225818] systemd[1]: session-27.scope: Consumed 16ms CPU time over 38ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 212.229361] systemd-logind[553]: Session 27 logged out. Waiting for processes to exit. lb # [ 212.231208] systemd-logind[553]: Removed session 27. worker1 # [ 212.331632] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 212.340782] systemd[1]: Started SSH per-connection Daemon (vsock:2:26). [e2e] heartbeat t=150s worker1 # [ 212.411249] sshd-session[1639]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 212.416254] sshd-session[1639]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 212.421923] sshd-session[1639]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 212.428233] systemd-logind[608]: New session '31' of user 'root' with class 'user' and type 'tty'. worker1 # [ 212.431370] systemd[1]: Started Session 31 of User root. worker1 # [ 212.456583] sshd-session[1645]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 212.457893] sshd-session[1645]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 212.459519] sshd-session[1639]: pam_unix(sshd:session): session closed for user root worker1 # [ 212.463065] systemd[1]: sshd-vsock@26-27-5:22-2:26.service: Deactivated successfully. worker1 # [ 212.465729] systemd[1]: session-31.scope: Deactivated successfully. worker1 # [ 212.467372] systemd[1]: session-31.scope: Consumed 15ms CPU time over 35ms wall clock time, 3.1M memory peak, 17.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 212.470876] systemd-logind[608]: Session 31 logged out. Waiting for processes to exit. worker1 # [ 212.472901] systemd-logind[608]: Removed session 31. worker1 # [ 212.528861] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 212.532643] systemd[1]: Started SSH per-connection Daemon (vsock:2:27). worker1 # [ 212.581152] sshd-session[1650]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 212.586180] sshd-session[1650]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 212.591953] sshd-session[1650]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 212.598110] systemd-logind[608]: New session '32' of user 'root' with class 'user' and type 'tty'. worker1 # [ 212.601415] systemd[1]: Started Session 32 of User root. worker1 # [ 212.625669] sshd-session[1656]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 212.627436] sshd-session[1656]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 212.628699] sshd-session[1650]: pam_unix(sshd:session): session closed for user root worker1 # [ 212.631853] systemd[1]: sshd-vsock@27-28-5:22-2:27.service: Deactivated successfully. worker1 # [ 212.635502] systemd[1]: session-32.scope: Deactivated successfully. worker1 # [ 212.636959] systemd[1]: session-32.scope: Consumed 15ms CPU time over 35ms wall clock time, 3.1M memory peak, 17.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 212.640710] systemd-logind[608]: Session 32 logged out. Waiting for processes to exit. worker1 # [ 212.642227] systemd-logind[608]: Removed session 32. worker2 # [ 212.730791] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 212.739371] systemd[1]: Started SSH per-connection Daemon (vsock:2:22). worker2 # [ 212.808337] sshd-session[1713]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 212.813121] sshd-session[1713]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 212.819334] sshd-session[1713]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 212.825448] systemd-logind[555]: New session '26' of user 'root' with class 'user' and type 'tty'. worker2 # [ 212.830419] systemd[1]: Started Session 26 of User root. worker2 # [ 212.857677] sshd-session[1719]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 212.859183] sshd-session[1719]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 212.860351] sshd-session[1713]: pam_unix(sshd:session): session closed for user root worker2 # [ 212.863404] systemd[1]: sshd-vsock@22-23-6:22-2:22.service: Deactivated successfully. worker2 # [ 212.867564] systemd[1]: session-26.scope: Deactivated successfully. worker2 # [ 212.869098] systemd[1]: session-26.scope: Consumed 17ms CPU time over 38ms wall clock time, 3.1M memory peak, 7.4K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 212.872899] systemd-logind[555]: Session 26 logged out. Waiting for processes to exit. worker2 # [ 212.874533] systemd-logind[555]: Removed session 26. worker1 # [ 212.935503] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 212.943177] systemd[1]: Started SSH per-connection Daemon (vsock:2:28). worker1 # [ 213.014302] sshd-session[1661]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 213.019378] sshd-session[1661]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 213.024829] sshd-session[1661]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 213.031251] systemd-logind[608]: New session '33' of user 'root' with class 'user' and type 'tty'. worker1 # [ 213.034413] systemd[1]: Started Session 33 of User root. worker1 # [ 213.058744] sshd-session[1667]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 213.060476] sshd-session[1667]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 213.061742] sshd-session[1661]: pam_unix(sshd:session): session closed for user root worker1 # [ 213.064742] systemd[1]: sshd-vsock@28-29-5:22-2:28.service: Deactivated successfully. worker1 # [ 213.068462] systemd[1]: session-33.scope: Deactivated successfully. worker1 # [ 213.069861] systemd[1]: session-33.scope: Consumed 15ms CPU time over 35ms wall clock time, 3.1M memory peak, 17.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 213.073893] systemd-logind[608]: Session 33 logged out. Waiting for processes to exit. worker1 # [ 213.075418] systemd-logind[608]: Removed session 33. worker2 # [ 213.135429] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 213.142461] systemd[1]: Started SSH per-connection Daemon (vsock:2:23). worker2 # [ 213.214902] sshd-session[1724]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 213.220336] sshd-session[1724]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 213.226074] sshd-session[1724]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 213.233261] systemd-logind[555]: New session '27' of user 'root' with class 'user' and type 'tty'. worker2 # [ 213.236375] systemd[1]: Started Session 27 of User root. worker2 # [ 213.263525] sshd-session[1730]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 213.265382] sshd-session[1730]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 213.266739] sshd-session[1724]: pam_unix(sshd:session): session closed for user root worker2 # [ 213.270297] systemd[1]: sshd-vsock@23-24-6:22-2:23.service: Deactivated successfully. worker2 # [ 213.274296] systemd[1]: session-27.scope: Deactivated successfully. worker2 # [ 213.275678] systemd[1]: session-27.scope: Consumed 17ms CPU time over 38ms wall clock time, 3.1M memory peak, 7.4K incoming IP traffic, 509B outgoing IP traffic. worker2 # [ 213.279360] systemd-logind[555]: Session 27 logged out. Waiting for processes to exit. worker2 # [ 213.281234] systemd-logind[555]: Removed session 27. client # [ 213.331850] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 213.341375] systemd[1]: Started SSH per-connection Daemon (vsock:2:195). client # [ 213.407802] sshd-session[3278]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 213.412725] sshd-session[3278]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 213.417847] sshd-session[3278]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 213.424225] systemd-logind[465]: New session '197' of user 'root' with class 'user' and type 'tty'. client # [ 213.427541] systemd[1]: Started Session 197 of User root. worker1 # [ 213.543883] nix-grpc-daemon[529]: ts=2026-11-07T15:11:08Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60242 worker2 # [ 213.544932] nix-grpc-daemon[1514]: ts=2026-11-07T15:11:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44924 lb # [ 213.560880] garage[913]: 2026-11-07T15:11:08.828376Z INFO garage_api_common::generic_server: 127.0.0.1:60516 (key GK0123456789abcdef01234567) HEAD /farm/4cr20ic7bag014wvhfx2jks2l9lagg3j.narinfo lb # [ 213.568262] garage[913]: 2026-11-07T15:11:08.835461Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 213.577488] nix-grpc-daemon[529]: ts=2026-11-07T15:11:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 213.585184] garage[913]: 2026-11-07T15:11:08.853307Z INFO garage_api_common::generic_server: 127.0.0.1:60516 (key GK0123456789abcdef01234567) HEAD /farm/4cr20ic7bag014wvhfx2jks2l9lagg3j.narinfo lb # [ 213.591442] garage[913]: 2026-11-07T15:11:08.859856Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 213.600139] garage[913]: 2026-11-07T15:11:08.867603Z INFO garage_api_common::generic_server: 127.0.0.1:60516 (key GK0123456789abcdef01234567) HEAD /farm/4cr20ic7bag014wvhfx2jks2l9lagg3j.narinfo lb # [ 213.605785] garage[913]: 2026-11-07T15:11:08.867998Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 213.612547] nix-grpc-daemon[1514]: ts=2026-11-07T15:11:08Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44924 lb # [ 213.620692] garage[913]: 2026-11-07T15:11:08.889080Z INFO garage_api_common::generic_server: 127.0.0.1:60516 (key GK0123456789abcdef01234567) HEAD /farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.narinfo lb # [ 213.627113] garage[913]: 2026-11-07T15:11:08.895308Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 213.635414] nix-grpc-daemon[1514]: ts=2026-11-07T15:11:08Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 213.648832] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 213.665286] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 213.781771] nix-daemon[986]: accepted connection from pid 1741, user nix-grpc-daemon (trusted) worker2 # [ 213.797827] nix-daemon[986]: reaped child process 1744, status = succeeded lb # [ 213.809283] niks3-server[963]: 2026/11/07 15:11:09 INFO Received push request method=POST path=/api/pushes worker2 # [ 213.818917] nix-grpc-daemon[1617]: time=2026-11-07T15:11:09.030Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 213.820451] nix-grpc-daemon[1617]: time=2026-11-07T15:11:09.030Z level=INFO msg="Uploading j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv (400B)" worker2 # [ 213.824255] nix-grpc-daemon[1617]: time=2026-11-07T15:11:09.036Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=da675494943220effbf676587cb20875ff3aeac5216a587b5bffd3cc3ad01875\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=da675494943220effbf676587cb20875ff3aeac5216a587b5bffd3cc3ad01875" worker2 # [ 213.833927] nix-grpc-daemon[1617]: time=2026-11-07T15:11:09.046Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4c407b366a5b3bed07ec41fd7a35099afd3e3e41af89be889b51a07c410abb50\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4c407b366a5b3bed07ec41fd7a35099afd3e3e41af89be889b51a07c410abb50" worker2 # [ 213.939329] nix-grpc-daemon[1617]: time=2026-11-07T15:11:09.151Z level=WARN msg="Request failed, retrying" attempt=2 backoff=190.217909ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=da675494943220effbf676587cb20875ff3aeac5216a587b5bffd3cc3ad01875\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=da675494943220effbf676587cb20875ff3aeac5216a587b5bffd3cc3ad01875" worker2 # [ 213.962159] nix-grpc-daemon[1617]: time=2026-11-07T15:11:09.174Z level=WARN msg="Request failed, retrying" attempt=2 backoff=215.213875ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4c407b366a5b3bed07ec41fd7a35099afd3e3e41af89be889b51a07c410abb50\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4c407b366a5b3bed07ec41fd7a35099afd3e3e41af89be889b51a07c410abb50" worker2 # [ 214.156602] nix-grpc-daemon[1617]: time=2026-11-07T15:11:09.368Z level=WARN msg="Request failed, retrying" attempt=3 backoff=421.590409ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=da675494943220effbf676587cb20875ff3aeac5216a587b5bffd3cc3ad01875\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=da675494943220effbf676587cb20875ff3aeac5216a587b5bffd3cc3ad01875" worker2 # [ 214.183314] nix-grpc-daemon[1617]: time=2026-11-07T15:11:09.395Z level=WARN msg="Request failed, retrying" attempt=3 backoff=375.295554ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4c407b366a5b3bed07ec41fd7a35099afd3e3e41af89be889b51a07c410abb50\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4c407b366a5b3bed07ec41fd7a35099afd3e3e41af89be889b51a07c410abb50" worker2 # [ 215.591293] nix-grpc-daemon[1617]: time=2026-11-07T15:11:10.802Z level=WARN msg="Request failed, retrying" attempt=4 backoff=844.654641ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=da675494943220effbf676587cb20875ff3aeac5216a587b5bffd3cc3ad01875\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=da675494943220effbf676587cb20875ff3aeac5216a587b5bffd3cc3ad01875" worker2 # [ 216.440349] nix-grpc-daemon[1617]: time=2026-11-07T15:11:11.652Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.575776166s error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=da675494943220effbf676587cb20875ff3aeac5216a587b5bffd3cc3ad01875\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=da675494943220effbf676587cb20875ff3aeac5216a587b5bffd3cc3ad01875" worker2 # [ 217.639546] nix-grpc-daemon[1617]: time=2026-11-07T15:11:12.851Z level=WARN msg="Request failed, retrying" attempt=4 backoff=832.646414ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4c407b366a5b3bed07ec41fd7a35099afd3e3e41af89be889b51a07c410abb50\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4c407b366a5b3bed07ec41fd7a35099afd3e3e41af89be889b51a07c410abb50" worker2 # [ 219.495383] nix-grpc-daemon[1617]: time=2026-11-07T15:11:14.706Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.750779269s error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4c407b366a5b3bed07ec41fd7a35099afd3e3e41af89be889b51a07c410abb50\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4c407b366a5b3bed07ec41fd7a35099afd3e3e41af89be889b51a07c410abb50" worker2 # [ 221.251598] nix-grpc-daemon[1617]: time=2026-11-07T15:11:16.462Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=da675494943220effbf676587cb20875ff3aeac5216a587b5bffd3cc3ad01875\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 221.281559] nix-daemon[986]: reaped child process 1737, status = succeeded worker1 # [ 221.782711] nix-grpc-daemon[529]: ts=2026-11-07T15:11:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 221.794169] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 221.810453] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 221.923060] nix-daemon[1026]: accepted connection from pid 1679, user nix-grpc-daemon (trusted) worker1 # [ 221.936829] nix-daemon[1026]: reaped child process 1682, status = succeeded lb # [ 221.945486] niks3-server[963]: 2026/11/07 15:11:17 INFO Received push request method=POST path=/api/pushes worker1 # [ 221.955541] nix-grpc-daemon[1057]: time=2026-11-07T15:11:17.264Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 221.957081] nix-grpc-daemon[1057]: time=2026-11-07T15:11:17.265Z level=INFO msg="Uploading j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv (400B)" worker1 # [ 221.962056] nix-grpc-daemon[1057]: time=2026-11-07T15:11:17.270Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb3968f880e2f36e37c5f55fee89d40d7c0794b8ae49fb52c3ee706399d92617\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb3968f880e2f36e37c5f55fee89d40d7c0794b8ae49fb52c3ee706399d92617" worker1 # [ 221.971394] nix-grpc-daemon[1057]: time=2026-11-07T15:11:17.279Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=127f57cc0d4abc62718365ec9b991efeab36c8b0008285cf7bcdb190edb26ba1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=127f57cc0d4abc62718365ec9b991efeab36c8b0008285cf7bcdb190edb26ba1" worker1 # [ 222.076651] nix-grpc-daemon[1057]: time=2026-11-07T15:11:17.384Z level=WARN msg="Request failed, retrying" attempt=2 backoff=215.764456ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=127f57cc0d4abc62718365ec9b991efeab36c8b0008285cf7bcdb190edb26ba1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=127f57cc0d4abc62718365ec9b991efeab36c8b0008285cf7bcdb190edb26ba1" worker1 # [ 222.093532] nix-grpc-daemon[1057]: time=2026-11-07T15:11:17.385Z level=WARN msg="Request failed, retrying" attempt=2 backoff=191.615383ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb3968f880e2f36e37c5f55fee89d40d7c0794b8ae49fb52c3ee706399d92617\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb3968f880e2f36e37c5f55fee89d40d7c0794b8ae49fb52c3ee706399d92617" worker1 # [ 222.272480] nix-grpc-daemon[1057]: time=2026-11-07T15:11:17.581Z level=WARN msg="Request failed, retrying" attempt=3 backoff=379.85638ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb3968f880e2f36e37c5f55fee89d40d7c0794b8ae49fb52c3ee706399d92617\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb3968f880e2f36e37c5f55fee89d40d7c0794b8ae49fb52c3ee706399d92617" worker1 # [ 222.298439] nix-grpc-daemon[1057]: time=2026-11-07T15:11:17.607Z level=WARN msg="Request failed, retrying" attempt=3 backoff=392.396623ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=127f57cc0d4abc62718365ec9b991efeab36c8b0008285cf7bcdb190edb26ba1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=127f57cc0d4abc62718365ec9b991efeab36c8b0008285cf7bcdb190edb26ba1" lb # [ 222.336809] systemd[1]: Stopping User Manager for UID 0... lb # [ 222.343517] systemd[1411]: Activating special unit Exit the Session... lb # [ 222.347736] systemd[1411]: Stopped target Main User Target. lb # [ 222.349943] systemd[1411]: Stopped target Basic System. lb # [ 222.353842] systemd[1411]: Stopped target Paths. lb # [ 222.357666] systemd[1411]: Stopped target Sockets. lb # [ 222.360725] systemd[1411]: Stopped target Timers. lb # [ 222.363352] systemd[1411]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 222.367421] systemd[1411]: Closed D-Bus User Message Bus Socket. lb # [ 222.369581] systemd[1411]: Stopped Create User Files and Directories. lb # [ 222.372635] systemd[1411]: Removed slice User Application Slice. lb # [ 222.376824] systemd[1411]: Reached target Shutdown. lb # [ 222.379770] systemd[1411]: Finished Exit the Session. lb # [ 222.383463] systemd[1411]: Reached target Exit the Session. lb # [ 222.390627] systemd-logind[553]: Removed session 28. lb # [ 222.393383] systemd[1]: user@0.service: Deactivated successfully. lb # [ 222.396853] systemd[1]: Stopped User Manager for UID 0. lb # [ 222.419991] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 222.438965] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 222.441244] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 222.442281] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 223.128995] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 223.137533] systemd[1620]: Activating special unit Exit the Session... worker1 # [ 223.142641] systemd[1620]: Stopped target Main User Target. worker1 # [ 223.145544] systemd[1620]: Stopped target Basic System. worker1 # [ 223.149903] systemd[1620]: Stopped target Paths. worker1 # [ 223.153320] systemd[1620]: Stopped target Sockets. worker1 # [ 223.156355] systemd[1620]: Stopped target Timers. worker1 # [ 223.159727] systemd[1620]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 223.163300] systemd[1620]: Closed D-Bus User Message Bus Socket. worker1 # [ 223.166504] systemd[1620]: Stopped Create User Files and Directories. worker1 # [ 223.171831] systemd[1620]: Removed slice User Application Slice. worker1 # [ 223.174809] systemd[1620]: Reached target Shutdown. worker1 # [ 223.176757] systemd[1620]: Finished Exit the Session. worker1 # [ 223.178738] systemd[1620]: Reached target Exit the Session. worker1 # [ 223.182612] systemd-logind[608]: Removed session 30. worker1 # [ 223.189991] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 223.193688] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 223.202951] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 223.220843] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 223.222674] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 223.224200] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 223.484866] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 223.492517] systemd[1694]: Activating special unit Exit the Session... worker2 # [ 223.497888] systemd[1694]: Stopped target Main User Target. worker2 # [ 223.500369] systemd[1694]: Stopped target Basic System. worker2 # [ 223.503980] systemd[1694]: Stopped target Paths. worker2 # [ 223.508527] systemd[1694]: Stopped target Sockets. worker2 # [ 223.511343] systemd[1694]: Stopped target Timers. worker2 # [ 223.514614] systemd[1694]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 223.517434] systemd[1694]: Closed D-Bus User Message Bus Socket. worker2 # [ 223.522599] systemd[1694]: Stopped Create User Files and Directories. worker2 # [ 223.525356] systemd[1694]: Removed slice User Application Slice. worker2 # [ 223.528469] systemd[1694]: Reached target Shutdown. worker2 # [ 223.532691] systemd[1694]: Finished Exit the Session. worker2 # [ 223.534937] systemd[1694]: Reached target Exit the Session. worker2 # [ 223.539675] systemd-logind[555]: Removed session 25. worker2 # [ 223.543494] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 223.546953] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 223.558307] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 223.576884] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 223.578651] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 223.580223] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 223.719890] nix-grpc-daemon[1057]: time=2026-11-07T15:11:19.027Z level=WARN msg="Request failed, retrying" attempt=4 backoff=841.923806ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=127f57cc0d4abc62718365ec9b991efeab36c8b0008285cf7bcdb190edb26ba1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=127f57cc0d4abc62718365ec9b991efeab36c8b0008285cf7bcdb190edb26ba1" worker1 # [ 224.564965] nix-grpc-daemon[1057]: time=2026-11-07T15:11:19.873Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.707582347s error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=127f57cc0d4abc62718365ec9b991efeab36c8b0008285cf7bcdb190edb26ba1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=127f57cc0d4abc62718365ec9b991efeab36c8b0008285cf7bcdb190edb26ba1" worker1 # [ 225.767956] nix-grpc-daemon[1057]: time=2026-11-07T15:11:21.075Z level=WARN msg="Request failed, retrying" attempt=4 backoff=796.552896ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb3968f880e2f36e37c5f55fee89d40d7c0794b8ae49fb52c3ee706399d92617\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb3968f880e2f36e37c5f55fee89d40d7c0794b8ae49fb52c3ee706399d92617" worker1 # [ 227.624170] nix-grpc-daemon[1057]: time=2026-11-07T15:11:22.931Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.618007473s error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb3968f880e2f36e37c5f55fee89d40d7c0794b8ae49fb52c3ee706399d92617\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb3968f880e2f36e37c5f55fee89d40d7c0794b8ae49fb52c3ee706399d92617" worker1 # [ 229.248682] nix-grpc-daemon[1057]: time=2026-11-07T15:11:24.554Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb3968f880e2f36e37c5f55fee89d40d7c0794b8ae49fb52c3ee706399d92617\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 229.276393] nix-daemon[1026]: reaped child process 1675, status = succeeded worker2 # [ 230.252693] nix-grpc-daemon[1514]: ts=2026-11-07T15:11:25Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 230.266369] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 230.383141] nix-daemon[986]: accepted connection from pid 1752, user nix-grpc-daemon (trusted) worker2 # [ 230.398962] nix-daemon[986]: reaped child process 1755, status = succeeded lb # [ 230.407799] niks3-server[963]: 2026/11/07 15:11:25 INFO Received push request method=POST path=/api/pushes worker2 # [ 230.415242] nix-grpc-daemon[1617]: time=2026-11-07T15:11:25.627Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 230.417432] nix-grpc-daemon[1617]: time=2026-11-07T15:11:25.629Z level=INFO msg="Uploading j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv (400B)" worker2 # [ 230.421673] nix-grpc-daemon[1617]: time=2026-11-07T15:11:25.634Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=936ab825a03b6bc247f4cb6bf0aa467679a13874f651bdb99454bc0bef76d8b2\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=936ab825a03b6bc247f4cb6bf0aa467679a13874f651bdb99454bc0bef76d8b2" worker2 # [ 230.430568] nix-grpc-daemon[1617]: time=2026-11-07T15:11:25.634Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c757464d6624f7e89440927786bf181382639c928989bc23d5021d6d02bd9413\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c757464d6624f7e89440927786bf181382639c928989bc23d5021d6d02bd9413" worker2 # [ 230.525272] nix-grpc-daemon[1617]: time=2026-11-07T15:11:25.737Z level=WARN msg="Request failed, retrying" attempt=2 backoff=183.911426ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c757464d6624f7e89440927786bf181382639c928989bc23d5021d6d02bd9413\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c757464d6624f7e89440927786bf181382639c928989bc23d5021d6d02bd9413" worker2 # [ 230.534818] nix-grpc-daemon[1617]: time=2026-11-07T15:11:25.737Z level=WARN msg="Request failed, retrying" attempt=2 backoff=181.732425ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=936ab825a03b6bc247f4cb6bf0aa467679a13874f651bdb99454bc0bef76d8b2\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=936ab825a03b6bc247f4cb6bf0aa467679a13874f651bdb99454bc0bef76d8b2" worker2 # [ 230.712851] nix-grpc-daemon[1617]: time=2026-11-07T15:11:25.925Z level=WARN msg="Request failed, retrying" attempt=3 backoff=439.529347ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=936ab825a03b6bc247f4cb6bf0aa467679a13874f651bdb99454bc0bef76d8b2\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=936ab825a03b6bc247f4cb6bf0aa467679a13874f651bdb99454bc0bef76d8b2" worker2 # [ 230.734683] nix-grpc-daemon[1617]: time=2026-11-07T15:11:25.925Z level=WARN msg="Request failed, retrying" attempt=3 backoff=399.532928ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c757464d6624f7e89440927786bf181382639c928989bc23d5021d6d02bd9413\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c757464d6624f7e89440927786bf181382639c928989bc23d5021d6d02bd9413" worker2 # [ 232.166925] nix-grpc-daemon[1617]: time=2026-11-07T15:11:27.378Z level=WARN msg="Request failed, retrying" attempt=4 backoff=773.580517ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=936ab825a03b6bc247f4cb6bf0aa467679a13874f651bdb99454bc0bef76d8b2\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=936ab825a03b6bc247f4cb6bf0aa467679a13874f651bdb99454bc0bef76d8b2" worker2 # [ 232.944475] nix-grpc-daemon[1617]: time=2026-11-07T15:11:28.156Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.671766391s error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=936ab825a03b6bc247f4cb6bf0aa467679a13874f651bdb99454bc0bef76d8b2\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=936ab825a03b6bc247f4cb6bf0aa467679a13874f651bdb99454bc0bef76d8b2" worker2 # [ 234.214867] nix-grpc-daemon[1617]: time=2026-11-07T15:11:29.426Z level=WARN msg="Request failed, retrying" attempt=4 backoff=755.974431ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c757464d6624f7e89440927786bf181382639c928989bc23d5021d6d02bd9413\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c757464d6624f7e89440927786bf181382639c928989bc23d5021d6d02bd9413" worker2 # [ 236.010216] nix-grpc-daemon[1617]: time=2026-11-07T15:11:31.222Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.557149615s error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c757464d6624f7e89440927786bf181382639c928989bc23d5021d6d02bd9413\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c757464d6624f7e89440927786bf181382639c928989bc23d5021d6d02bd9413" worker2 # [ 237.571925] nix-grpc-daemon[1617]: time=2026-11-07T15:11:32.783Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c757464d6624f7e89440927786bf181382639c928989bc23d5021d6d02bd9413\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 237.601559] nix-daemon[986]: reaped child process 1750, status = succeeded worker2 # [ 239.598637] nix-grpc-daemon[1514]: ts=2026-11-07T15:11:34Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 239.610630] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 239.720494] nix-daemon[986]: accepted connection from pid 1759, user nix-grpc-daemon (trusted) worker2 # [ 239.733623] nix-daemon[986]: reaped child process 1762, status = succeeded lb # [ 239.744443] niks3-server[963]: 2026/11/07 15:11:35 INFO Received push request method=POST path=/api/pushes worker2 # [ 239.750276] nix-grpc-daemon[1617]: time=2026-11-07T15:11:34.962Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 239.752449] nix-grpc-daemon[1617]: time=2026-11-07T15:11:34.964Z level=INFO msg="Uploading j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv (400B)" worker2 # [ 239.755457] nix-grpc-daemon[1617]: time=2026-11-07T15:11:34.968Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d56fec6f8bb6d8cd79b07732faf181c960cd2c0b37c0e778b08451ad49ac4bde\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d56fec6f8bb6d8cd79b07732faf181c960cd2c0b37c0e778b08451ad49ac4bde" worker2 # [ 239.764564] nix-grpc-daemon[1617]: time=2026-11-07T15:11:34.968Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=34e6c472fae9a3a9b27d47e7b78c4f3d6cbbbd7d3517ef0f5dfd78b0e4298d26\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=34e6c472fae9a3a9b27d47e7b78c4f3d6cbbbd7d3517ef0f5dfd78b0e4298d26" worker2 # [ 239.858283] nix-grpc-daemon[1617]: time=2026-11-07T15:11:35.070Z level=WARN msg="Request failed, retrying" attempt=2 backoff=207.580616ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=34e6c472fae9a3a9b27d47e7b78c4f3d6cbbbd7d3517ef0f5dfd78b0e4298d26\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=34e6c472fae9a3a9b27d47e7b78c4f3d6cbbbd7d3517ef0f5dfd78b0e4298d26" worker2 # [ 240.871205] nix-grpc-daemon[1617]: time=2026-11-07T15:11:36.082Z level=WARN msg="Request failed, retrying" attempt=2 backoff=191.867195ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d56fec6f8bb6d8cd79b07732faf181c960cd2c0b37c0e778b08451ad49ac4bde\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d56fec6f8bb6d8cd79b07732faf181c960cd2c0b37c0e778b08451ad49ac4bde" worker2 # [ 242.086762] nix-grpc-daemon[1617]: time=2026-11-07T15:11:37.298Z level=WARN msg="Request failed, retrying" attempt=3 backoff=410.113877ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d56fec6f8bb6d8cd79b07732faf181c960cd2c0b37c0e778b08451ad49ac4bde\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d56fec6f8bb6d8cd79b07732faf181c960cd2c0b37c0e778b08451ad49ac4bde" [e2e] heartbeat t=180s worker2 # [ 242.500703] nix-grpc-daemon[1617]: time=2026-11-07T15:11:37.713Z level=WARN msg="Request failed, retrying" attempt=4 backoff=729.817944ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d56fec6f8bb6d8cd79b07732faf181c960cd2c0b37c0e778b08451ad49ac4bde\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d56fec6f8bb6d8cd79b07732faf181c960cd2c0b37c0e778b08451ad49ac4bde" worker2 # [ 244.198892] nix-grpc-daemon[1617]: time=2026-11-07T15:11:39.410Z level=WARN msg="Request failed, retrying" attempt=3 backoff=369.951728ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=34e6c472fae9a3a9b27d47e7b78c4f3d6cbbbd7d3517ef0f5dfd78b0e4298d26\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=34e6c472fae9a3a9b27d47e7b78c4f3d6cbbbd7d3517ef0f5dfd78b0e4298d26" worker2 # [ 244.573363] nix-grpc-daemon[1617]: time=2026-11-07T15:11:39.785Z level=WARN msg="Request failed, retrying" attempt=4 backoff=801.978022ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=34e6c472fae9a3a9b27d47e7b78c4f3d6cbbbd7d3517ef0f5dfd78b0e4298d26\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=34e6c472fae9a3a9b27d47e7b78c4f3d6cbbbd7d3517ef0f5dfd78b0e4298d26" worker2 # [ 246.311171] nix-grpc-daemon[1617]: time=2026-11-07T15:11:41.522Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.481607812s error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d56fec6f8bb6d8cd79b07732faf181c960cd2c0b37c0e778b08451ad49ac4bde\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d56fec6f8bb6d8cd79b07732faf181c960cd2c0b37c0e778b08451ad49ac4bde" worker2 # [ 246.438530] nix-grpc-daemon[1617]: time=2026-11-07T15:11:41.650Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.643499657s error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=34e6c472fae9a3a9b27d47e7b78c4f3d6cbbbd7d3517ef0f5dfd78b0e4298d26\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=34e6c472fae9a3a9b27d47e7b78c4f3d6cbbbd7d3517ef0f5dfd78b0e4298d26" worker2 # [ 249.126489] nix-grpc-daemon[1617]: time=2026-11-07T15:11:44.338Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d56fec6f8bb6d8cd79b07732faf181c960cd2c0b37c0e778b08451ad49ac4bde\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 249.140384] nix-daemon[986]: reaped child process 1757, status = succeeded worker2 # [ 253.141789] nix-grpc-daemon[1514]: ts=2026-11-07T15:11:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 253.154675] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 253.262248] nix-daemon[986]: accepted connection from pid 1766, user nix-grpc-daemon (trusted) worker2 # [ 253.275290] nix-daemon[986]: reaped child process 1769, status = succeeded lb # [ 253.285548] niks3-server[963]: 2026/11/07 15:11:48 INFO Received push request method=POST path=/api/pushes worker2 # [ 253.292689] nix-grpc-daemon[1617]: time=2026-11-07T15:11:48.504Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 253.294819] nix-grpc-daemon[1617]: time=2026-11-07T15:11:48.504Z level=INFO msg="Uploading j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv (400B)" worker2 # [ 253.297711] nix-grpc-daemon[1617]: time=2026-11-07T15:11:48.510Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=96b7add2fe3ee3e42a673224094881bb42db37d3b782c7f821d6a6f3e05129a0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=96b7add2fe3ee3e42a673224094881bb42db37d3b782c7f821d6a6f3e05129a0" worker2 # [ 253.306840] nix-grpc-daemon[1617]: time=2026-11-07T15:11:48.510Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f96960945090ffef6d3c77338972e83e93b3f87a7e5a1b53d3492565311e87b3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f96960945090ffef6d3c77338972e83e93b3f87a7e5a1b53d3492565311e87b3" worker2 # [ 253.402371] nix-grpc-daemon[1617]: time=2026-11-07T15:11:48.614Z level=WARN msg="Request failed, retrying" attempt=2 backoff=181.039389ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=96b7add2fe3ee3e42a673224094881bb42db37d3b782c7f821d6a6f3e05129a0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=96b7add2fe3ee3e42a673224094881bb42db37d3b782c7f821d6a6f3e05129a0" worker2 # [ 253.424229] nix-grpc-daemon[1617]: time=2026-11-07T15:11:48.636Z level=WARN msg="Request failed, retrying" attempt=2 backoff=200.251252ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f96960945090ffef6d3c77338972e83e93b3f87a7e5a1b53d3492565311e87b3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f96960945090ffef6d3c77338972e83e93b3f87a7e5a1b53d3492565311e87b3" worker2 # [ 253.609796] nix-grpc-daemon[1617]: time=2026-11-07T15:11:48.822Z level=WARN msg="Request failed, retrying" attempt=3 backoff=409.790775ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=96b7add2fe3ee3e42a673224094881bb42db37d3b782c7f821d6a6f3e05129a0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=96b7add2fe3ee3e42a673224094881bb42db37d3b782c7f821d6a6f3e05129a0" worker2 # [ 254.695170] nix-grpc-daemon[1617]: time=2026-11-07T15:11:49.906Z level=WARN msg="Request failed, retrying" attempt=3 backoff=376.720582ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f96960945090ffef6d3c77338972e83e93b3f87a7e5a1b53d3492565311e87b3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f96960945090ffef6d3c77338972e83e93b3f87a7e5a1b53d3492565311e87b3" worker2 # [ 256.104300] nix-grpc-daemon[1617]: time=2026-11-07T15:11:51.314Z level=WARN msg="Request failed, retrying" attempt=4 backoff=878.57038ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=96b7add2fe3ee3e42a673224094881bb42db37d3b782c7f821d6a6f3e05129a0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=96b7add2fe3ee3e42a673224094881bb42db37d3b782c7f821d6a6f3e05129a0" worker2 # [ 256.985538] nix-grpc-daemon[1617]: time=2026-11-07T15:11:52.197Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.588966054s error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=96b7add2fe3ee3e42a673224094881bb42db37d3b782c7f821d6a6f3e05129a0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=96b7add2fe3ee3e42a673224094881bb42db37d3b782c7f821d6a6f3e05129a0" worker2 # [ 258.150923] nix-grpc-daemon[1617]: time=2026-11-07T15:11:53.362Z level=WARN msg="Request failed, retrying" attempt=4 backoff=836.060163ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f96960945090ffef6d3c77338972e83e93b3f87a7e5a1b53d3492565311e87b3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f96960945090ffef6d3c77338972e83e93b3f87a7e5a1b53d3492565311e87b3" worker2 # [ 260.007456] nix-grpc-daemon[1617]: time=2026-11-07T15:11:55.219Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.542007803s error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f96960945090ffef6d3c77338972e83e93b3f87a7e5a1b53d3492565311e87b3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f96960945090ffef6d3c77338972e83e93b3f87a7e5a1b53d3492565311e87b3" worker2 # [ 261.555771] nix-grpc-daemon[1617]: time=2026-11-07T15:11:56.765Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=96b7add2fe3ee3e42a673224094881bb42db37d3b782c7f821d6a6f3e05129a0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 261.582759] nix-daemon[986]: reaped child process 1764, status = succeeded worker2 # [ 265.561608] nix-grpc-daemon[1514]: ts=2026-11-07T15:12:00Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 265.575569] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 265.688913] nix-daemon[986]: accepted connection from pid 1773, user nix-grpc-daemon (trusted) worker2 # [ 265.702356] nix-daemon[986]: reaped child process 1776, status = succeeded lb # [ 265.712477] niks3-server[963]: 2026/11/07 15:12:00 INFO Received push request method=POST path=/api/pushes worker2 # [ 265.721811] nix-grpc-daemon[1617]: time=2026-11-07T15:12:00.934Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 265.723348] nix-grpc-daemon[1617]: time=2026-11-07T15:12:00.936Z level=INFO msg="Uploading j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv (400B)" worker2 # [ 265.727493] nix-grpc-daemon[1617]: time=2026-11-07T15:12:00.940Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3103b69064b9f12ac87c023a0af5186557254f939253a4a542be3d2b25b9710c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3103b69064b9f12ac87c023a0af5186557254f939253a4a542be3d2b25b9710c" worker2 # [ 265.735750] nix-grpc-daemon[1617]: time=2026-11-07T15:12:00.940Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3d92655851903925dc2f64270b391eebeee64f81f2c70dfaeb48b000f7db333\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3d92655851903925dc2f64270b391eebeee64f81f2c70dfaeb48b000f7db333" worker2 # [ 265.832948] nix-grpc-daemon[1617]: time=2026-11-07T15:12:01.045Z level=WARN msg="Request failed, retrying" attempt=2 backoff=194.839391ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3d92655851903925dc2f64270b391eebeee64f81f2c70dfaeb48b000f7db333\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3d92655851903925dc2f64270b391eebeee64f81f2c70dfaeb48b000f7db333" worker2 # [ 265.855451] nix-grpc-daemon[1617]: time=2026-11-07T15:12:01.045Z level=WARN msg="Request failed, retrying" attempt=2 backoff=203.430485ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3103b69064b9f12ac87c023a0af5186557254f939253a4a542be3d2b25b9710c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3103b69064b9f12ac87c023a0af5186557254f939253a4a542be3d2b25b9710c" worker2 # [ 266.033499] nix-grpc-daemon[1617]: time=2026-11-07T15:12:01.245Z level=WARN msg="Request failed, retrying" attempt=3 backoff=385.303373ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3d92655851903925dc2f64270b391eebeee64f81f2c70dfaeb48b000f7db333\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3d92655851903925dc2f64270b391eebeee64f81f2c70dfaeb48b000f7db333" worker2 # [ 266.445710] nix-grpc-daemon[1617]: time=2026-11-07T15:12:01.658Z level=WARN msg="Request failed, retrying" attempt=4 backoff=740.725177ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3d92655851903925dc2f64270b391eebeee64f81f2c70dfaeb48b000f7db333\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3d92655851903925dc2f64270b391eebeee64f81f2c70dfaeb48b000f7db333" worker2 # [ 268.134826] nix-grpc-daemon[1617]: time=2026-11-07T15:12:03.346Z level=WARN msg="Request failed, retrying" attempt=3 backoff=389.685761ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3103b69064b9f12ac87c023a0af5186557254f939253a4a542be3d2b25b9710c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3103b69064b9f12ac87c023a0af5186557254f939253a4a542be3d2b25b9710c" worker2 # [ 268.528385] nix-grpc-daemon[1617]: time=2026-11-07T15:12:03.740Z level=WARN msg="Request failed, retrying" attempt=4 backoff=772.048012ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3103b69064b9f12ac87c023a0af5186557254f939253a4a542be3d2b25b9710c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3103b69064b9f12ac87c023a0af5186557254f939253a4a542be3d2b25b9710c" worker2 # [ 270.247371] nix-grpc-daemon[1617]: time=2026-11-07T15:12:05.458Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.685498706s error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3d92655851903925dc2f64270b391eebeee64f81f2c70dfaeb48b000f7db333\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3d92655851903925dc2f64270b391eebeee64f81f2c70dfaeb48b000f7db333" worker2 # [ 271.335422] nix-grpc-daemon[1617]: time=2026-11-07T15:12:06.547Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.601192508s error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3103b69064b9f12ac87c023a0af5186557254f939253a4a542be3d2b25b9710c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3103b69064b9f12ac87c023a0af5186557254f939253a4a542be3d2b25b9710c" [e2e] heartbeat t=210s worker2 # [ 272.942320] nix-grpc-daemon[1617]: time=2026-11-07T15:12:08.153Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3d92655851903925dc2f64270b391eebeee64f81f2c70dfaeb48b000f7db333\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 272.970715] nix-daemon[986]: reaped child process 1771, status = succeeded worker2 # [ 276.968898] nix-grpc-daemon[1514]: ts=2026-11-07T15:12:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 276.979692] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 277.087234] nix-daemon[986]: accepted connection from pid 1780, user nix-grpc-daemon (trusted) worker2 # [ 277.100430] nix-daemon[986]: reaped child process 1783, status = succeeded lb # [ 277.110345] niks3-server[963]: 2026/11/07 15:12:12 INFO Received push request method=POST path=/api/pushes worker2 # [ 277.114722] nix-grpc-daemon[1617]: time=2026-11-07T15:12:12.327Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 277.116818] nix-grpc-daemon[1617]: time=2026-11-07T15:12:12.328Z level=INFO msg="Uploading j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv (400B)" worker2 # [ 277.120062] nix-grpc-daemon[1617]: time=2026-11-07T15:12:12.332Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=477c6419980877ff1e08cb1cf6e940b781037ba87627cef3415d3bdb03c49e35\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=477c6419980877ff1e08cb1cf6e940b781037ba87627cef3415d3bdb03c49e35" worker2 # [ 277.129141] nix-grpc-daemon[1617]: time=2026-11-07T15:12:12.341Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8824a5055f3ca0f1efd1c258554622a04b83cb6de81bcdbb35e546624f94705e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8824a5055f3ca0f1efd1c258554622a04b83cb6de81bcdbb35e546624f94705e" worker2 # [ 277.234396] nix-grpc-daemon[1617]: time=2026-11-07T15:12:12.446Z level=WARN msg="Request failed, retrying" attempt=2 backoff=188.379642ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=477c6419980877ff1e08cb1cf6e940b781037ba87627cef3415d3bdb03c49e35\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=477c6419980877ff1e08cb1cf6e940b781037ba87627cef3415d3bdb03c49e35" worker2 # [ 277.256972] nix-grpc-daemon[1617]: time=2026-11-07T15:12:12.468Z level=WARN msg="Request failed, retrying" attempt=2 backoff=219.363092ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8824a5055f3ca0f1efd1c258554622a04b83cb6de81bcdbb35e546624f94705e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8824a5055f3ca0f1efd1c258554622a04b83cb6de81bcdbb35e546624f94705e" worker2 # [ 277.448901] nix-grpc-daemon[1617]: time=2026-11-07T15:12:12.661Z level=WARN msg="Request failed, retrying" attempt=3 backoff=434.609407ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=477c6419980877ff1e08cb1cf6e940b781037ba87627cef3415d3bdb03c49e35\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=477c6419980877ff1e08cb1cf6e940b781037ba87627cef3415d3bdb03c49e35" worker2 # [ 278.503587] nix-grpc-daemon[1617]: time=2026-11-07T15:12:13.715Z level=WARN msg="Request failed, retrying" attempt=3 backoff=393.178404ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8824a5055f3ca0f1efd1c258554622a04b83cb6de81bcdbb35e546624f94705e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8824a5055f3ca0f1efd1c258554622a04b83cb6de81bcdbb35e546624f94705e" worker2 # [ 279.911497] nix-grpc-daemon[1617]: time=2026-11-07T15:12:15.123Z level=WARN msg="Request failed, retrying" attempt=4 backoff=745.817327ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8824a5055f3ca0f1efd1c258554622a04b83cb6de81bcdbb35e546624f94705e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8824a5055f3ca0f1efd1c258554622a04b83cb6de81bcdbb35e546624f94705e" worker2 # [ 280.661462] nix-grpc-daemon[1617]: time=2026-11-07T15:12:15.873Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.509244388s error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8824a5055f3ca0f1efd1c258554622a04b83cb6de81bcdbb35e546624f94705e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8824a5055f3ca0f1efd1c258554622a04b83cb6de81bcdbb35e546624f94705e" worker2 # [ 282.023446] nix-grpc-daemon[1617]: time=2026-11-07T15:12:17.235Z level=WARN msg="Request failed, retrying" attempt=4 backoff=791.097954ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=477c6419980877ff1e08cb1cf6e940b781037ba87627cef3415d3bdb03c49e35\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=477c6419980877ff1e08cb1cf6e940b781037ba87627cef3415d3bdb03c49e35" worker2 # [ 282.817495] nix-grpc-daemon[1617]: time=2026-11-07T15:12:18.029Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.599794912s error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=477c6419980877ff1e08cb1cf6e940b781037ba87627cef3415d3bdb03c49e35\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=477c6419980877ff1e08cb1cf6e940b781037ba87627cef3415d3bdb03c49e35" worker2 # [ 284.422858] nix-grpc-daemon[1617]: time=2026-11-07T15:12:19.634Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=477c6419980877ff1e08cb1cf6e940b781037ba87627cef3415d3bdb03c49e35\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 284.452668] nix-daemon[986]: reaped child process 1778, status = succeeded worker1 # [ 288.450879] nix-grpc-daemon[529]: ts=2026-11-07T15:12:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 288.464725] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 288.574951] nix-daemon[1026]: accepted connection from pid 1695, user nix-grpc-daemon (trusted) worker1 # [ 288.588738] nix-daemon[1026]: reaped child process 1698, status = succeeded lb # [ 288.595629] niks3-server[963]: 2026/11/07 15:12:23 INFO Received push request method=POST path=/api/pushes worker1 # [ 288.602769] nix-grpc-daemon[1057]: time=2026-11-07T15:12:23.911Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 288.604678] nix-grpc-daemon[1057]: time=2026-11-07T15:12:23.913Z level=INFO msg="Uploading j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv (400B)" worker1 # [ 288.608079] nix-grpc-daemon[1057]: time=2026-11-07T15:12:23.916Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91cb6740b1ce6846395ea59864bfe3487c92f14396ef5f33333a2177f1392c7d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91cb6740b1ce6846395ea59864bfe3487c92f14396ef5f33333a2177f1392c7d" worker1 # [ 288.617174] nix-grpc-daemon[1057]: time=2026-11-07T15:12:23.916Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=27f647fa194015eeb51f5cd15a1a44615383941d17b1124a71322869378d083b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=27f647fa194015eeb51f5cd15a1a44615383941d17b1124a71322869378d083b" worker1 # [ 288.712093] nix-grpc-daemon[1057]: time=2026-11-07T15:12:24.020Z level=WARN msg="Request failed, retrying" attempt=2 backoff=218.191702ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=27f647fa194015eeb51f5cd15a1a44615383941d17b1124a71322869378d083b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=27f647fa194015eeb51f5cd15a1a44615383941d17b1124a71322869378d083b" worker1 # [ 288.728397] nix-grpc-daemon[1057]: time=2026-11-07T15:12:24.020Z level=WARN msg="Request failed, retrying" attempt=2 backoff=202.599123ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91cb6740b1ce6846395ea59864bfe3487c92f14396ef5f33333a2177f1392c7d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91cb6740b1ce6846395ea59864bfe3487c92f14396ef5f33333a2177f1392c7d" worker1 # [ 288.919697] nix-grpc-daemon[1057]: time=2026-11-07T15:12:24.228Z level=WARN msg="Request failed, retrying" attempt=3 backoff=388.277828ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91cb6740b1ce6846395ea59864bfe3487c92f14396ef5f33333a2177f1392c7d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91cb6740b1ce6846395ea59864bfe3487c92f14396ef5f33333a2177f1392c7d" worker1 # [ 288.944956] nix-grpc-daemon[1057]: time=2026-11-07T15:12:24.253Z level=WARN msg="Request failed, retrying" attempt=3 backoff=409.060278ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=27f647fa194015eeb51f5cd15a1a44615383941d17b1124a71322869378d083b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=27f647fa194015eeb51f5cd15a1a44615383941d17b1124a71322869378d083b" worker1 # [ 290.344408] nix-grpc-daemon[1057]: time=2026-11-07T15:12:25.652Z level=WARN msg="Request failed, retrying" attempt=4 backoff=841.40931ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91cb6740b1ce6846395ea59864bfe3487c92f14396ef5f33333a2177f1392c7d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91cb6740b1ce6846395ea59864bfe3487c92f14396ef5f33333a2177f1392c7d" worker1 # [ 291.188711] nix-grpc-daemon[1057]: time=2026-11-07T15:12:26.497Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.4680131s error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91cb6740b1ce6846395ea59864bfe3487c92f14396ef5f33333a2177f1392c7d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91cb6740b1ce6846395ea59864bfe3487c92f14396ef5f33333a2177f1392c7d" worker1 # [ 292.456352] nix-grpc-daemon[1057]: time=2026-11-07T15:12:27.764Z level=WARN msg="Request failed, retrying" attempt=4 backoff=768.10546ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=27f647fa194015eeb51f5cd15a1a44615383941d17b1124a71322869378d083b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=27f647fa194015eeb51f5cd15a1a44615383941d17b1124a71322869378d083b" worker1 # [ 294.247953] nix-grpc-daemon[1057]: time=2026-11-07T15:12:29.555Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.595187836s error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=27f647fa194015eeb51f5cd15a1a44615383941d17b1124a71322869378d083b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=27f647fa194015eeb51f5cd15a1a44615383941d17b1124a71322869378d083b" worker1 # [ 295.850606] nix-grpc-daemon[1057]: time=2026-11-07T15:12:31.156Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91cb6740b1ce6846395ea59864bfe3487c92f14396ef5f33333a2177f1392c7d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 295.877793] nix-daemon[1026]: reaped child process 1693, status = succeeded worker2 # [ 299.853712] nix-grpc-daemon[1514]: ts=2026-11-07T15:12:35Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 299.866349] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 299.974855] nix-daemon[986]: accepted connection from pid 1787, user nix-grpc-daemon (trusted) worker2 # [ 299.988426] nix-daemon[986]: reaped child process 1790, status = succeeded lb # [ 299.998754] niks3-server[963]: 2026/11/07 15:12:35 INFO Received push request method=POST path=/api/pushes worker2 # [ 300.004524] nix-grpc-daemon[1617]: time=2026-11-07T15:12:35.216Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 300.006657] nix-grpc-daemon[1617]: time=2026-11-07T15:12:35.218Z level=INFO msg="Uploading j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv (400B)" worker2 # [ 300.010313] nix-grpc-daemon[1617]: time=2026-11-07T15:12:35.222Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=219bc93d8cdf80434f82d7af883d603b4c367a6a663232c9471182ddead80028\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=219bc93d8cdf80434f82d7af883d603b4c367a6a663232c9471182ddead80028" worker2 # [ 300.018946] nix-grpc-daemon[1617]: time=2026-11-07T15:12:35.222Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e803fa04fd920699f4bc7d7a00d652f729c3272488ad1061f6c262b7eb78c2c4\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e803fa04fd920699f4bc7d7a00d652f729c3272488ad1061f6c262b7eb78c2c4" worker2 # [ 300.115720] nix-grpc-daemon[1617]: time=2026-11-07T15:12:35.327Z level=WARN msg="Request failed, retrying" attempt=2 backoff=198.304108ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=219bc93d8cdf80434f82d7af883d603b4c367a6a663232c9471182ddead80028\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=219bc93d8cdf80434f82d7af883d603b4c367a6a663232c9471182ddead80028" worker2 # [ 300.137291] nix-grpc-daemon[1617]: time=2026-11-07T15:12:35.328Z level=WARN msg="Request failed, retrying" attempt=2 backoff=198.265157ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e803fa04fd920699f4bc7d7a00d652f729c3272488ad1061f6c262b7eb78c2c4\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e803fa04fd920699f4bc7d7a00d652f729c3272488ad1061f6c262b7eb78c2c4" worker2 # [ 300.318744] nix-grpc-daemon[1617]: time=2026-11-07T15:12:35.531Z level=WARN msg="Request failed, retrying" attempt=3 backoff=402.372461ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e803fa04fd920699f4bc7d7a00d652f729c3272488ad1061f6c262b7eb78c2c4\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e803fa04fd920699f4bc7d7a00d652f729c3272488ad1061f6c262b7eb78c2c4" worker2 # [ 300.339848] nix-grpc-daemon[1617]: time=2026-11-07T15:12:35.551Z level=WARN msg="Request failed, retrying" attempt=3 backoff=400.723888ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=219bc93d8cdf80434f82d7af883d603b4c367a6a663232c9471182ddead80028\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=219bc93d8cdf80434f82d7af883d603b4c367a6a663232c9471182ddead80028" worker2 # [ 301.799300] nix-grpc-daemon[1617]: time=2026-11-07T15:12:37.010Z level=WARN msg="Request failed, retrying" attempt=4 backoff=770.41556ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e803fa04fd920699f4bc7d7a00d652f729c3272488ad1061f6c262b7eb78c2c4\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e803fa04fd920699f4bc7d7a00d652f729c3272488ad1061f6c262b7eb78c2c4" [e2e] heartbeat t=240s worker2 # [ 302.573349] nix-grpc-daemon[1617]: time=2026-11-07T15:12:37.785Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.616175707s error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e803fa04fd920699f4bc7d7a00d652f729c3272488ad1061f6c262b7eb78c2c4\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e803fa04fd920699f4bc7d7a00d652f729c3272488ad1061f6c262b7eb78c2c4" worker2 # [ 303.847296] nix-grpc-daemon[1617]: time=2026-11-07T15:12:39.059Z level=WARN msg="Request failed, retrying" attempt=4 backoff=812.426124ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=219bc93d8cdf80434f82d7af883d603b4c367a6a663232c9471182ddead80028\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=219bc93d8cdf80434f82d7af883d603b4c367a6a663232c9471182ddead80028" worker2 # [ 305.702745] nix-grpc-daemon[1617]: time=2026-11-07T15:12:40.914Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.4517711s error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=219bc93d8cdf80434f82d7af883d603b4c367a6a663232c9471182ddead80028\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=219bc93d8cdf80434f82d7af883d603b4c367a6a663232c9471182ddead80028" worker2 # [ 307.159903] nix-grpc-daemon[1617]: time=2026-11-07T15:12:42.371Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=219bc93d8cdf80434f82d7af883d603b4c367a6a663232c9471182ddead80028\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 307.190238] nix-daemon[986]: reaped child process 1785, status = succeeded worker2 # [ 311.185721] nix-grpc-daemon[1514]: ts=2026-11-07T15:12:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 311.198718] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 311.306415] nix-daemon[986]: accepted connection from pid 1795, user nix-grpc-daemon (trusted) worker2 # [ 311.319440] nix-daemon[986]: reaped child process 1798, status = succeeded lb # [ 311.329896] niks3-server[963]: 2026/11/07 15:12:46 INFO Received push request method=POST path=/api/pushes worker2 # [ 311.337031] nix-grpc-daemon[1617]: time=2026-11-07T15:12:46.549Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 311.338926] nix-grpc-daemon[1617]: time=2026-11-07T15:12:46.549Z level=INFO msg="Uploading j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv (400B)" worker2 # [ 311.341730] nix-grpc-daemon[1617]: time=2026-11-07T15:12:46.554Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2e0e1ac59689f883cd1f75709e9df08e03e5028006c6faf41fad0f4f23f3e6f0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2e0e1ac59689f883cd1f75709e9df08e03e5028006c6faf41fad0f4f23f3e6f0" worker2 # [ 311.350083] nix-grpc-daemon[1617]: time=2026-11-07T15:12:46.554Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31d0d10ecff8409f3ef49f1f453128298eb34047dbd4d860e0df83b18df78e91\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31d0d10ecff8409f3ef49f1f453128298eb34047dbd4d860e0df83b18df78e91" lb # [ 311.399481] postgres[782]: [782] LOG: checkpoint starting: time worker2 # [ 311.446602] nix-grpc-daemon[1617]: time=2026-11-07T15:12:46.658Z level=WARN msg="Request failed, retrying" attempt=2 backoff=182.836674ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2e0e1ac59689f883cd1f75709e9df08e03e5028006c6faf41fad0f4f23f3e6f0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2e0e1ac59689f883cd1f75709e9df08e03e5028006c6faf41fad0f4f23f3e6f0" worker2 # [ 311.466763] nix-grpc-daemon[1617]: time=2026-11-07T15:12:46.659Z level=WARN msg="Request failed, retrying" attempt=2 backoff=217.974474ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31d0d10ecff8409f3ef49f1f453128298eb34047dbd4d860e0df83b18df78e91\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31d0d10ecff8409f3ef49f1f453128298eb34047dbd4d860e0df83b18df78e91" worker2 # [ 311.634250] nix-grpc-daemon[1617]: time=2026-11-07T15:12:46.846Z level=WARN msg="Request failed, retrying" attempt=3 backoff=395.645841ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2e0e1ac59689f883cd1f75709e9df08e03e5028006c6faf41fad0f4f23f3e6f0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2e0e1ac59689f883cd1f75709e9df08e03e5028006c6faf41fad0f4f23f3e6f0" worker2 # [ 312.139859] nix-grpc-daemon[1617]: time=2026-11-07T15:12:47.352Z level=WARN msg="Request failed, retrying" attempt=4 backoff=814.845607ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2e0e1ac59689f883cd1f75709e9df08e03e5028006c6faf41fad0f4f23f3e6f0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2e0e1ac59689f883cd1f75709e9df08e03e5028006c6faf41fad0f4f23f3e6f0" worker2 # [ 313.703784] nix-grpc-daemon[1617]: time=2026-11-07T15:12:48.915Z level=WARN msg="Request failed, retrying" attempt=3 backoff=437.539266ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31d0d10ecff8409f3ef49f1f453128298eb34047dbd4d860e0df83b18df78e91\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31d0d10ecff8409f3ef49f1f453128298eb34047dbd4d860e0df83b18df78e91" worker2 # [ 314.144265] nix-grpc-daemon[1617]: time=2026-11-07T15:12:49.356Z level=WARN msg="Request failed, retrying" attempt=4 backoff=765.335693ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31d0d10ecff8409f3ef49f1f453128298eb34047dbd4d860e0df83b18df78e91\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31d0d10ecff8409f3ef49f1f453128298eb34047dbd4d860e0df83b18df78e91" worker2 # [ 315.943200] nix-grpc-daemon[1617]: time=2026-11-07T15:12:51.154Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.498004952s error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31d0d10ecff8409f3ef49f1f453128298eb34047dbd4d860e0df83b18df78e91\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31d0d10ecff8409f3ef49f1f453128298eb34047dbd4d860e0df83b18df78e91" worker2 # [ 317.031416] nix-grpc-daemon[1617]: time=2026-11-07T15:12:52.243Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.608846909s error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2e0e1ac59689f883cd1f75709e9df08e03e5028006c6faf41fad0f4f23f3e6f0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2e0e1ac59689f883cd1f75709e9df08e03e5028006c6faf41fad0f4f23f3e6f0" worker2 # [ 318.645845] nix-grpc-daemon[1617]: time=2026-11-07T15:12:53.856Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31d0d10ecff8409f3ef49f1f453128298eb34047dbd4d860e0df83b18df78e91\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 318.674136] nix-daemon[986]: reaped child process 1793, status = succeeded worker2 # [ 322.671693] nix-grpc-daemon[1514]: ts=2026-11-07T15:12:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 322.683617] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 322.794091] nix-daemon[986]: accepted connection from pid 1802, user nix-grpc-daemon (trusted) worker2 # [ 322.806394] nix-daemon[986]: reaped child process 1805, status = succeeded lb # [ 322.815366] niks3-server[963]: 2026/11/07 15:12:58 INFO Received push request method=POST path=/api/pushes worker2 # [ 322.824155] nix-grpc-daemon[1617]: time=2026-11-07T15:12:58.036Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 322.826305] nix-grpc-daemon[1617]: time=2026-11-07T15:12:58.038Z level=INFO msg="Uploading j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv (400B)" worker2 # [ 322.829922] nix-grpc-daemon[1617]: time=2026-11-07T15:12:58.042Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=39607e5d7b5ff33fe47de09f9cae277a092b324dbc3adc1feb4faef1fda5f253\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=39607e5d7b5ff33fe47de09f9cae277a092b324dbc3adc1feb4faef1fda5f253" worker2 # [ 322.838619] nix-grpc-daemon[1617]: time=2026-11-07T15:12:58.042Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e413ac412605f15fddc64cefbf5acae6f71df50ad3f7f5455af629bb61b256d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e413ac412605f15fddc64cefbf5acae6f71df50ad3f7f5455af629bb61b256d" worker2 # [ 322.934257] nix-grpc-daemon[1617]: time=2026-11-07T15:12:58.146Z level=WARN msg="Request failed, retrying" attempt=2 backoff=200.632881ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e413ac412605f15fddc64cefbf5acae6f71df50ad3f7f5455af629bb61b256d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e413ac412605f15fddc64cefbf5acae6f71df50ad3f7f5455af629bb61b256d" worker2 # [ 322.951248] nix-grpc-daemon[1617]: time=2026-11-07T15:12:58.163Z level=WARN msg="Request failed, retrying" attempt=2 backoff=195.169318ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=39607e5d7b5ff33fe47de09f9cae277a092b324dbc3adc1feb4faef1fda5f253\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=39607e5d7b5ff33fe47de09f9cae277a092b324dbc3adc1feb4faef1fda5f253" worker2 # [ 323.150311] nix-grpc-daemon[1617]: time=2026-11-07T15:12:58.362Z level=WARN msg="Request failed, retrying" attempt=3 backoff=382.645683ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=39607e5d7b5ff33fe47de09f9cae277a092b324dbc3adc1feb4faef1fda5f253\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=39607e5d7b5ff33fe47de09f9cae277a092b324dbc3adc1feb4faef1fda5f253" worker2 # [ 324.198936] nix-grpc-daemon[1617]: time=2026-11-07T15:12:59.410Z level=WARN msg="Request failed, retrying" attempt=3 backoff=371.381142ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e413ac412605f15fddc64cefbf5acae6f71df50ad3f7f5455af629bb61b256d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e413ac412605f15fddc64cefbf5acae6f71df50ad3f7f5455af629bb61b256d" worker2 # [ 325.607439] nix-grpc-daemon[1617]: time=2026-11-07T15:13:00.819Z level=WARN msg="Request failed, retrying" attempt=4 backoff=856.780124ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=39607e5d7b5ff33fe47de09f9cae277a092b324dbc3adc1feb4faef1fda5f253\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=39607e5d7b5ff33fe47de09f9cae277a092b324dbc3adc1feb4faef1fda5f253" worker2 # [ 326.468233] nix-grpc-daemon[1617]: time=2026-11-07T15:13:01.680Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.757243465s error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=39607e5d7b5ff33fe47de09f9cae277a092b324dbc3adc1feb4faef1fda5f253\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=39607e5d7b5ff33fe47de09f9cae277a092b324dbc3adc1feb4faef1fda5f253" worker2 # [ 327.655164] nix-grpc-daemon[1617]: time=2026-11-07T15:13:02.866Z level=WARN msg="Request failed, retrying" attempt=4 backoff=782.70337ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e413ac412605f15fddc64cefbf5acae6f71df50ad3f7f5455af629bb61b256d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e413ac412605f15fddc64cefbf5acae6f71df50ad3f7f5455af629bb61b256d" worker2 # [ 329.447421] nix-grpc-daemon[1617]: time=2026-11-07T15:13:04.659Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.653702981s error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e413ac412605f15fddc64cefbf5acae6f71df50ad3f7f5455af629bb61b256d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e413ac412605f15fddc64cefbf5acae6f71df50ad3f7f5455af629bb61b256d" worker2 # [ 331.107717] nix-grpc-daemon[1617]: time=2026-11-07T15:13:06.317Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=39607e5d7b5ff33fe47de09f9cae277a092b324dbc3adc1feb4faef1fda5f253\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 331.134883] nix-daemon[986]: reaped child process 1800, status = succeeded [e2e] heartbeat t=270s thread 'farm::serial::a_failing_build_is_counted_with_its_own_reason' (1369) panicked at harness.rs:194:5: [client] timed out after 120s: nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.pem&client-key=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.key' --eval-store auto -f /nix/store/3z0lamkv4gpnrdqizxifk3q5bqyha1b6-fail.nix --argstr tag boom don't know how to build these paths: /nix/store/j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv copying 1 paths to 'lb:50051'... copying path '/nix/store/j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv' to 'lb:50051'... lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151109Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=da675494943220effbf676587cb20875ff3aeac5216a587b5bffd3cc3ad01875": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151117Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb3968f880e2f36e37c5f55fee89d40d7c0794b8ae49fb52c3ee706399d92617": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151125Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c757464d6624f7e89440927786bf181382639c928989bc23d5021d6d02bd9413": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151135Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d56fec6f8bb6d8cd79b07732faf181c960cd2c0b37c0e778b08451ad49ac4bde": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151148Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=96b7add2fe3ee3e42a673224094881bb42db37d3b782c7f821d6a6f3e05129a0": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151200Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3d92655851903925dc2f64270b391eebeee64f81f2c70dfaeb48b000f7db333": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151212Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=477c6419980877ff1e08cb1cf6e940b781037ba87627cef3415d3bdb03c49e35": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151223Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91cb6740b1ce6846395ea59864bfe3487c92f14396ef5f33333a2177f1392c7d": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151235Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=219bc93d8cdf80434f82d7af883d603b4c367a6a663232c9471182ddead80028": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151246Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31d0d10ecff8409f3ef49f1f453128298eb34047dbd4d860e0df83b18df78e91": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151258Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=39607e5d7b5ff33fe47de09f9cae277a092b324dbc3adc1feb4faef1fda5f253": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying FAILED test farm::serial::a_niks3_restart_does_not_cost_the_leader_its_role ... client # [ 333.351738] sshd-session[3284]: Connection closed by UNKNOWN port 65535 client # [ 333.358975] sshd-session[3278]: pam_unix(sshd:session): session closed for user root client # [ 333.367229] systemd[1]: sshd-vsock@195-196-3:22-2:195.service: Deactivated successfully. worker1 # [ 333.373894] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 333.378418] systemd-logind[465]: Session 197 logged out. Waiting for processes to exit. worker1 # [ 333.385760] systemd[1]: Started SSH per-connection Daemon (vsock:2:29). worker1 # [ 333.451438] sshd-session[1701]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 333.456428] sshd-session[1701]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 333.461765] sshd-session[1701]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 333.471818] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 333.481885] systemd-logind[608]: New session '34' of user 'root' with class 'user' and type 'tty'. worker1 # [ 333.495762] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 333.500130] systemd[1]: Starting User Manager for UID 0... worker1 # [ 333.516277] (systemd)[1709]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 333.520728] systemd-logind[608]: New session '35' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 333.596683] systemd[1709]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 333.666672] systemd[1709]: Queued start job for default target Main User Target. worker1 # [ 333.669623] systemd[1709]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 333.672812] systemd[1709]: Created slice User Application Slice. worker1 # [ 333.673701] systemd[1709]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 333.674685] systemd[1709]: Reached target Paths. worker1 # [ 333.675345] systemd[1709]: Reached target Timers. worker1 # [ 333.677069] systemd[1709]: Starting D-Bus User Message Bus Socket... worker1 # [ 333.678889] systemd[1709]: Starting Create User Files and Directories... worker1 # [ 333.703583] systemd[1709]: Finished Create User Files and Directories. worker1 # [ 333.706490] systemd[1709]: Listening on D-Bus User Message Bus Socket. worker1 # [ 333.707685] systemd[1709]: Reached target Sockets. worker1 # [ 333.709094] systemd[1709]: Reached target Basic System. worker1 # [ 333.709828] systemd[1709]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 333.711302] systemd[1709]: Reached target Main User Target. worker1 # [ 333.713122] systemd[1709]: Startup finished in 177ms. worker1 # [ 333.713860] systemd[1]: Started User Manager for UID 0. worker1 # [ 333.717237] systemd[1]: Started Session 34 of User root. worker1 # [ 333.740521] sshd-session[1722]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 333.742171] sshd-session[1722]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 333.743434] sshd-session[1701]: pam_unix(sshd:session): session closed for user root worker1 # [ 333.746407] systemd[1]: sshd-vsock@29-30-5:22-2:29.service: Deactivated successfully. worker1 # [ 333.750245] systemd[1]: session-34.scope: Deactivated successfully. worker1 # [ 333.753494] systemd-logind[608]: Session 34 logged out. Waiting for processes to exit. worker1 # [ 333.755282] systemd-logind[608]: Removed session 34. worker2 # [ 333.770928] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 333.781340] systemd[1]: Started SSH per-connection Daemon (vsock:2:24). worker2 # [ 333.851541] sshd-session[1807]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 333.856957] sshd-session[1807]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 333.862435] sshd-session[1807]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 333.875825] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 333.880382] systemd-logind[555]: New session '28' of user 'root' with class 'user' and type 'tty'. worker2 # [ 333.899941] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 333.903842] systemd[1]: Starting User Manager for UID 0... worker2 # [ 333.919381] (systemd)[1815]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 333.923334] systemd-logind[555]: New session '29' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 333.998628] systemd[1815]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 334.069079] systemd[1815]: Queued start job for default target Main User Target. worker2 # [ 334.071696] systemd[1815]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 334.073948] systemd[1815]: Created slice User Application Slice. worker2 # [ 334.074900] systemd[1815]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 334.075983] systemd[1815]: Reached target Paths. worker2 # [ 334.077117] systemd[1815]: Reached target Timers. worker2 # [ 334.079079] systemd[1815]: Starting D-Bus User Message Bus Socket... worker2 # [ 334.080987] systemd[1815]: Starting Create User Files and Directories... worker2 # [ 334.106456] systemd[1815]: Finished Create User Files and Directories. worker2 # [ 334.109221] systemd[1815]: Listening on D-Bus User Message Bus Socket. worker2 # [ 334.110596] systemd[1815]: Reached target Sockets. worker2 # [ 334.113094] systemd[1815]: Reached target Basic System. worker2 # [ 334.113834] systemd[1]: Started User Manager for UID 0. worker2 # [ 334.114668] systemd[1815]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 334.115966] systemd[1815]: Reached target Main User Target. worker2 # [ 334.116762] systemd[1815]: Startup finished in 178ms. worker2 # [ 334.118353] systemd[1]: Started Session 28 of User root. worker2 # [ 334.141752] sshd-session[1828]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 334.143545] sshd-session[1828]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 334.144853] sshd-session[1807]: pam_unix(sshd:session): session closed for user root worker2 # [ 334.147894] systemd[1]: sshd-vsock@24-25-6:22-2:24.service: Deactivated successfully. worker2 # [ 334.151577] systemd[1]: session-28.scope: Deactivated successfully. worker2 # [ 334.154865] systemd-logind[555]: Session 28 logged out. Waiting for processes to exit. worker2 # [ 334.156474] systemd-logind[555]: Removed session 28. lb # [ 334.177290] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 334.185141] systemd[1]: Started SSH per-connection Daemon (vsock:2:24). lb # [ 334.252578] sshd-session[1453]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 334.257849] sshd-session[1453]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 334.265070] sshd-session[1453]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 334.280395] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 334.295409] systemd-logind[553]: New session '29' of user 'root' with class 'user' and type 'tty'. lb # [ 334.309200] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 334.313516] systemd[1]: Starting User Manager for UID 0... lb # [ 334.329740] (systemd)[1462]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 334.334306] systemd-logind[553]: New session '30' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 334.410437] systemd[1462]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 334.481406] systemd[1462]: Queued start job for default target Main User Target. lb # [ 334.483734] systemd[1462]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 334.486126] systemd[1462]: Created slice User Application Slice. lb # [ 334.487346] systemd[1462]: Started Daily Cleanup of User's Temporary Directories. lb # [ 334.489102] systemd[1462]: Reached target Paths. lb # [ 334.489804] systemd[1462]: Reached target Timers. lb # [ 334.491675] systemd[1462]: Starting D-Bus User Message Bus Socket... lb # [ 334.492989] systemd[1462]: Starting Create User Files and Directories... lb # [ 334.517111] systemd[1462]: Finished Create User Files and Directories. lb # [ 334.521069] systemd[1462]: Listening on D-Bus User Message Bus Socket. lb # [ 334.522887] systemd[1462]: Reached target Sockets. lb # [ 334.523849] systemd[1462]: Reached target Basic System. lb # [ 334.526228] systemd[1462]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 334.527614] systemd[1462]: Reached target Main User Target. lb # [ 334.528826] systemd[1462]: Startup finished in 177ms. lb # [ 334.529623] systemd[1]: Started User Manager for UID 0. lb # [ 334.531175] systemd[1]: Started Session 29 of User root. lb # [ 334.557497] sshd-session[1475]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 334.559355] sshd-session[1475]: Disconnected from user root UNKNOWN port 65535 lb # [ 334.560574] sshd-session[1453]: pam_unix(sshd:session): session closed for user root lb # [ 334.563679] systemd[1]: sshd-vsock@24-25-4:22-2:24.service: Deactivated successfully. lb # [ 334.567646] systemd[1]: session-29.scope: Deactivated successfully. lb # [ 334.568953] systemd[1]: session-29.scope: Consumed 16ms CPU time over 38ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 334.572709] systemd-logind[553]: Session 29 logged out. Waiting for processes to exit. lb # [ 334.574329] systemd-logind[553]: Removed session 29. worker1 # [ 334.676933] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 334.687456] systemd[1]: Started SSH per-connection Daemon (vsock:2:30). worker1 # [ 334.755906] sshd-session[1728]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 334.761084] sshd-session[1728]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 334.766487] sshd-session[1728]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 334.773231] systemd-logind[608]: New session '36' of user 'root' with class 'user' and type 'tty'. worker1 # [ 334.776367] systemd[1]: Started Session 36 of User root. worker1 # [ 334.801322] sshd-session[1734]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 334.802955] sshd-session[1734]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 334.804331] sshd-session[1728]: pam_unix(sshd:session): session closed for user root worker1 # [ 334.808233] systemd[1]: sshd-vsock@30-31-5:22-2:30.service: Deactivated successfully. worker1 # [ 334.810973] systemd[1]: session-36.scope: Deactivated successfully. worker1 # [ 334.812497] systemd[1]: session-36.scope: Consumed 15ms CPU time over 35ms wall clock time, 3.1M memory peak, 17.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 334.816339] systemd-logind[608]: Session 36 logged out. Waiting for processes to exit. worker1 # [ 334.817680] systemd-logind[608]: Removed session 36. lb # [ 334.875329] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 334.884272] systemd[1]: Started SSH per-connection Daemon (vsock:2:25). lb # [ 334.954350] sshd-session[1480]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 334.959419] sshd-session[1480]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 334.964775] sshd-session[1480]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 334.971248] systemd-logind[553]: New session '31' of user 'root' with class 'user' and type 'tty'. lb # [ 334.974407] systemd[1]: Started Session 31 of User root. lb # [ 335.000895] sshd-session[1486]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 335.002170] sshd-session[1486]: Disconnected from user root UNKNOWN port 65535 lb # [ 335.003376] sshd-session[1480]: pam_unix(sshd:session): session closed for user root lb # [ 335.006533] systemd[1]: sshd-vsock@25-26-4:22-2:25.service: Deactivated successfully. lb # [ 335.010299] systemd[1]: session-31.scope: Deactivated successfully. lb # [ 335.011694] systemd[1]: session-31.scope: Consumed 16ms CPU time over 36ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 335.015315] systemd-logind[553]: Session 31 logged out. Waiting for processes to exit. lb # [ 335.016934] systemd-logind[553]: Removed session 31. worker1 # [ 335.076268] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 335.085824] systemd[1]: Started SSH per-connection Daemon (vsock:2:31). worker2 # [ 335.113872] nix-grpc-daemon[1514]: ts=2026-11-07T15:13:10Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 335.126799] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker1 # [ 335.152431] sshd-session[1739]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 335.157132] sshd-session[1739]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 335.163338] sshd-session[1739]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 335.169348] systemd-logind[608]: New session '37' of user 'root' with class 'user' and type 'tty'. worker1 # [ 335.172420] systemd[1]: Started Session 37 of User root. worker1 # [ 335.193991] sshd-session[1745]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 335.195691] sshd-session[1745]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 335.197089] sshd-session[1739]: pam_unix(sshd:session): session closed for user root worker1 # [ 335.200183] systemd[1]: sshd-vsock@31-32-5:22-2:31.service: Deactivated successfully. worker1 # [ 335.203621] systemd[1]: session-37.scope: Deactivated successfully. worker1 # [ 335.206929] systemd-logind[608]: Session 37 logged out. Waiting for processes to exit. worker1 # [ 335.209218] systemd-logind[608]: Removed session 37. worker2 # [ 335.233847] nix-daemon[986]: accepted connection from pid 1836, user nix-grpc-daemon (trusted) worker2 # [ 335.247335] nix-daemon[986]: reaped child process 1839, status = succeeded lb # [ 335.257810] niks3-server[963]: 2026/11/07 15:13:10 INFO Received push request method=POST path=/api/pushes worker2 # [ 335.266862] nix-grpc-daemon[1617]: time=2026-11-07T15:13:10.478Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 335.268646] nix-grpc-daemon[1617]: time=2026-11-07T15:13:10.479Z level=INFO msg="Uploading j5sh943zaa0qjagii0xkivjfb4c2c5p0-fail-boom.drv (400B)" worker2 # [ 335.271808] nix-grpc-daemon[1617]: time=2026-11-07T15:13:10.484Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3c77d7c2ead4f396198a576c33fa44b2d21784204c9a106a5e0c095310fafc56\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3c77d7c2ead4f396198a576c33fa44b2d21784204c9a106a5e0c095310fafc56" lb # [ 335.279531] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 335.287535] systemd[1]: Started SSH per-connection Daemon (vsock:2:26). worker2 # [ 335.279908] nix-grpc-daemon[1617]: time=2026-11-07T15:13:10.484Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6f4e36985c33f4343a8ddb6bf124af65f8e4fae8a676d352e00305783ef10dfa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6f4e36985c33f4343a8ddb6bf124af65f8e4fae8a676d352e00305783ef10dfa" lb # [ 335.354322] sshd-session[1491]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 335.359520] sshd-session[1491]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 335.364830] sshd-session[1491]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 335.370713] systemd-logind[553]: New session '32' of user 'root' with class 'user' and type 'tty'. lb # [ 335.375414] systemd[1]: Started Session 32 of User root. lb # [ 335.393994] niks3-server[963]: 2026/11/07 15:13:10 INFO Shutdown signal received, draining in-flight requests timeout=10s lb # [ 335.396355] systemd[1]: Stopping niks3 server... lb # [ 335.398264] niks3-server[963]: 2026/11/07 15:13:10 INFO lead: released remote=192.168.1.3:42732 worker1 # [ 335.398861] nix-grpc-daemon[529]: ts=2026-11-07T15:13:10Z level=info event=scheduler_lock_lost status=200 worker2 # [ 335.377699] nix-grpc-daemon[1617]: time=2026-11-07T15:13:10.590Z level=WARN msg="Request failed, retrying" attempt=2 backoff=181.561517ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6f4e36985c33f4343a8ddb6bf124af65f8e4fae8a676d352e00305783ef10dfa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6f4e36985c33f4343a8ddb6bf124af65f8e4fae8a676d352e00305783ef10dfa" worker2 # [ 335.401074] nix-grpc-daemon[1514]: ts=2026-11-07T15:13:10Z level=info event=scheduler_lock_lost status=200 lb # [ 335.412094] systemd[1]: niks3.service: Deactivated successfully. lb # [ 335.412926] systemd[1]: Stopped niks3 server. lb # [ 335.414981] systemd[1]: niks3.service: Consumed 751ms CPU time over 5min 16.672s wall clock time, 28.9M memory peak, 70.9K incoming IP traffic, 131.4K outgoing IP traffic. lb # [ 335.420171] systemd[1]: Starting niks3 server... worker2 # [ 335.404125] nix-grpc-daemon[1617]: time=2026-11-07T15:13:10.613Z level=WARN msg="Request failed, retrying" attempt=2 backoff=185.294905ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3c77d7c2ead4f396198a576c33fa44b2d21784204c9a106a5e0c095310fafc56\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3c77d7c2ead4f396198a576c33fa44b2d21784204c9a106a5e0c095310fafc56" lb # [ 335.485594] niks3-server[1503]: 2026/11/07 15:13:10 INFO Loaded signing key name=farm-test-1 path=/nix/store/i8pw345f2cpx4hsyfpcgqv4nnm329abs-key lb # [ 335.490461] garage[913]: 2026-11-07T15:13:10.758674Z INFO garage_api_common::generic_server: 127.0.0.1:51874 (key GK0123456789abcdef01234567) GET /farm/?location= lb # [ 335.493636] garage[913]: 2026-11-07T15:13:10.761836Z INFO garage_api_common::generic_server: 127.0.0.1:51874 (key GK0123456789abcdef01234567) PUT /farm/nix-cache-info lb # [ 335.498537] niks3-server[1503]: 2026/11/07 15:13:10 INFO Read proxy enabled — serving cache objects from S3 lb # [ 335.500723] niks3-server[1503]: 2026/11/07 15:13:10 INFO Using socket-activated listener address=0.0.0.0:5751 lb # [ 335.502139] niks3-server[1503]: 2026/11/07 15:13:10 INFO systemd watchdog enabled interval=15s lb # [ 335.503235] systemd[1]: Started niks3 server. lb # [ 335.506825] niks3-server[1503]: 2026/11/07 15:13:10 INFO Starting HTTP server address=0.0.0.0:5751 lb # [ 335.509716] sshd-session[1497]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 335.510970] sshd-session[1497]: Disconnected from user root UNKNOWN port 65535 lb # [ 335.512828] sshd-session[1491]: pam_unix(sshd:session): session closed for user root lb # [ 335.515732] systemd[1]: sshd-vsock@26-27-4:22-2:26.service: Deactivated successfully. lb # [ 335.519554] systemd[1]: session-32.scope: Deactivated successfully. lb # [ 335.523207] systemd-logind[553]: Session 32 logged out. Waiting for processes to exit. lb # [ 335.524644] systemd-logind[553]: Removed session 32. lb # [ 335.576312] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 335.579985] systemd[1]: Started SSH per-connection Daemon (vsock:2:27). worker2 # [ 335.587991] nix-grpc-daemon[1617]: time=2026-11-07T15:13:10.800Z level=WARN msg="Request failed, retrying" attempt=3 backoff=438.473386ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6f4e36985c33f4343a8ddb6bf124af65f8e4fae8a676d352e00305783ef10dfa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6f4e36985c33f4343a8ddb6bf124af65f8e4fae8a676d352e00305783ef10dfa" lb # [ 335.628747] sshd-session[1513]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 335.634053] sshd-session[1513]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 335.639415] sshd-session[1513]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 335.646079] systemd-logind[553]: New session '33' of user 'root' with class 'user' and type 'tty'. lb # [ 335.649333] systemd[1]: Started Session 33 of User root. lb # [ 335.666919] sshd-session[1519]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 335.668603] sshd-session[1519]: Disconnected from user root UNKNOWN port 65535 lb # [ 335.669879] sshd-session[1513]: pam_unix(sshd:session): session closed for user root lb # [ 335.672844] systemd[1]: sshd-vsock@27-28-4:22-2:27.service: Deactivated successfully. lb # [ 335.676479] systemd[1]: session-33.scope: Deactivated successfully. lb # [ 335.679721] systemd-logind[553]: Session 33 logged out. Waiting for processes to exit. lb # [ 335.681409] systemd-logind[553]: Removed session 33. lb # [ 335.778548] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 335.788466] systemd[1]: Started SSH per-connection Daemon (vsock:2:28). lb # [ 335.849323] sshd-session[1524]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 335.854389] sshd-session[1524]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 335.859872] sshd-session[1524]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 335.865452] systemd-logind[553]: New session '34' of user 'root' with class 'user' and type 'tty'. lb # [ 335.870325] systemd[1]: Started Session 34 of User root. lb # [ 335.896723] sshd-session[1530]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 335.898578] sshd-session[1530]: Disconnected from user root UNKNOWN port 65535 lb # [ 335.899903] sshd-session[1524]: pam_unix(sshd:session): session closed for user root lb # [ 335.902951] systemd[1]: sshd-vsock@28-29-4:22-2:28.service: Deactivated successfully. lb # [ 335.906666] systemd[1]: session-34.scope: Deactivated successfully. lb # [ 335.908206] systemd[1]: session-34.scope: Consumed 16ms CPU time over 37ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 335.911972] systemd-logind[553]: Session 34 logged out. Waiting for processes to exit. lb # [ 335.914231] systemd-logind[553]: Removed session 34. worker1 # [ 335.979875] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 335.988804] systemd[1]: Started SSH per-connection Daemon (vsock:2:32). worker2 # [ 336.031669] nix-grpc-daemon[1617]: time=2026-11-07T15:13:11.244Z level=WARN msg="Request failed, retrying" attempt=4 backoff=774.059629ms error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6f4e36985c33f4343a8ddb6bf124af65f8e4fae8a676d352e00305783ef10dfa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6f4e36985c33f4343a8ddb6bf124af65f8e4fae8a676d352e00305783ef10dfa" worker1 # [ 336.059640] sshd-session[1750]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 336.064773] sshd-session[1750]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 336.070242] sshd-session[1750]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 336.076852] systemd-logind[608]: New session '38' of user 'root' with class 'user' and type 'tty'. worker1 # [ 336.079354] systemd[1]: Started Session 38 of User root. worker1 # [ 336.104571] sshd-session[1756]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 336.105867] sshd-session[1756]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 336.107318] sshd-session[1750]: pam_unix(sshd:session): session closed for user root worker1 # [ 336.110225] systemd[1]: sshd-vsock@32-33-5:22-2:32.service: Deactivated successfully. worker1 # [ 336.113836] systemd[1]: session-38.scope: Deactivated successfully. worker1 # [ 336.115352] systemd[1]: session-38.scope: Consumed 15ms CPU time over 35ms wall clock time, 3.1M memory peak, 17.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 336.119056] systemd-logind[608]: Session 38 logged out. Waiting for processes to exit. worker1 # [ 336.121230] systemd-logind[608]: Removed session 38. lb # [ 336.180395] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 336.190628] systemd[1]: Started SSH per-connection Daemon (vsock:2:29). lb # [ 336.259217] sshd-session[1535]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 336.264090] sshd-session[1535]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 336.271175] sshd-session[1535]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 336.278359] systemd-logind[553]: New session '35' of user 'root' with class 'user' and type 'tty'. lb # [ 336.280556] systemd[1]: Started Session 35 of User root. lb # [ 336.306510] sshd-session[1541]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 336.307831] sshd-session[1541]: Disconnected from user root UNKNOWN port 65535 lb # [ 336.309088] sshd-session[1535]: pam_unix(sshd:session): session closed for user root lb # [ 336.312305] systemd[1]: sshd-vsock@29-30-4:22-2:29.service: Deactivated successfully. lb # [ 336.316348] systemd[1]: session-35.scope: Deactivated successfully. lb # [ 336.317852] systemd[1]: session-35.scope: Consumed 16ms CPU time over 37ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 336.321381] systemd-logind[553]: Session 35 logged out. Waiting for processes to exit. lb # [ 336.322995] systemd-logind[553]: Removed session 35. worker1 # [ 336.384507] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 336.392191] systemd[1]: Started SSH per-connection Daemon (vsock:2:33). lb # [ 336.401955] niks3-server[1503]: 2026/11/07 15:13:11 INFO lead: acquired remote=192.168.1.3:36208 worker1 # [ 336.464760] sshd-session[1761]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 336.469900] sshd-session[1761]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 336.475364] sshd-session[1761]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 336.480825] systemd-logind[608]: New session '39' of user 'root' with class 'user' and type 'tty'. worker1 # [ 336.485400] systemd[1]: Started Session 39 of User root. worker1 # [ 336.506272] sshd-session[1769]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 336.507902] sshd-session[1769]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 336.509249] sshd-session[1761]: pam_unix(sshd:session): session closed for user root worker1 # [ 336.512319] systemd[1]: sshd-vsock@33-34-5:22-2:33.service: Deactivated successfully. worker1 # [ 336.515670] systemd[1]: session-39.scope: Deactivated successfully. worker1 # [ 336.518770] systemd-logind[608]: Session 39 logged out. Waiting for processes to exit. worker1 # [ 336.520560] systemd-logind[608]: Removed session 39. client # [ 336.578759] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 336.587749] systemd[1]: Started SSH per-connection Daemon (vsock:2:196). client # [ 336.655416] sshd-session[3298]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 336.660758] sshd-session[3298]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 336.666165] sshd-session[3298]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 336.671689] systemd-logind[465]: New session '198' of user 'root' with class 'user' and type 'tty'. client # [ 336.676403] systemd[1]: Started Session 198 of User root. worker1 # [ 336.803944] nix-grpc-daemon[529]: ts=2026-11-07T15:13:12Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60242 worker2 # [ 336.804887] nix-grpc-daemon[1514]: ts=2026-11-07T15:13:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44924 lb # [ 336.821919] garage[913]: 2026-11-07T15:13:12.088827Z INFO garage_api_common::generic_server: 127.0.0.1:51874 (key GK0123456789abcdef01234567) HEAD /farm/lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo lb # [ 336.828574] garage[913]: 2026-11-07T15:13:12.089489Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 336.837345] garage[913]: 2026-11-07T15:13:12.104645Z INFO garage_api_common::generic_server: 127.0.0.1:51874 (key GK0123456789abcdef01234567) HEAD /farm/vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo lb # [ 336.843246] garage[913]: 2026-11-07T15:13:12.105105Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 336.852259] garage[913]: 2026-11-07T15:13:12.119654Z INFO garage_api_common::generic_server: 127.0.0.1:51874 (key GK0123456789abcdef01234567) HEAD /farm/vllq1krpcvis69h349hy98vfz55ld1wv.narinfo lb # [ 336.859259] garage[913]: 2026-11-07T15:13:12.120122Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 336.866166] nix-grpc-daemon[1514]: ts=2026-11-07T15:13:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44924 lb # [ 336.874186] garage[913]: 2026-11-07T15:13:12.141817Z INFO garage_api_common::generic_server: 127.0.0.1:51886 (key GK0123456789abcdef01234567) HEAD /farm/lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo lb # [ 336.878931] garage[913]: 2026-11-07T15:13:12.142215Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 336.883671] garage[913]: 2026-11-07T15:13:12.151931Z INFO garage_api_common::generic_server: 127.0.0.1:51886 (key GK0123456789abcdef01234567) HEAD /farm/lyi0sw9pvmhznkzgfl39callq9c0n87r.narinfo lb # [ 336.888893] garage[913]: 2026-11-07T15:13:12.156937Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 336.895484] nix-grpc-daemon[1514]: ts=2026-11-07T15:13:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44924 lb # [ 336.903358] garage[913]: 2026-11-07T15:13:12.171015Z INFO garage_api_common::generic_server: 127.0.0.1:51886 (key GK0123456789abcdef01234567) HEAD /farm/vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo lb # [ 336.907978] garage[913]: 2026-11-07T15:13:12.171388Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 336.913558] garage[913]: 2026-11-07T15:13:12.181143Z INFO garage_api_common::generic_server: 127.0.0.1:51886 (key GK0123456789abcdef01234567) HEAD /farm/vkqg7lcax8h1mxs0g750ficqiii1falw.narinfo lb # [ 336.916740] garage[913]: 2026-11-07T15:13:12.181472Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 336.919568] nix-grpc-daemon[1514]: ts=2026-11-07T15:13:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44924 lb # [ 336.926247] garage[913]: 2026-11-07T15:13:12.194698Z INFO garage_api_common::generic_server: 127.0.0.1:51886 (key GK0123456789abcdef01234567) HEAD /farm/vllq1krpcvis69h349hy98vfz55ld1wv.narinfo lb # [ 336.928895] garage[913]: 2026-11-07T15:13:12.197365Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 336.933415] garage[913]: 2026-11-07T15:13:12.201493Z INFO garage_api_common::generic_server: 127.0.0.1:51886 (key GK0123456789abcdef01234567) HEAD /farm/vllq1krpcvis69h349hy98vfz55ld1wv.narinfo lb # [ 336.935901] garage[913]: 2026-11-07T15:13:12.201703Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 336.943366] nix-grpc-daemon[529]: ts=2026-11-07T15:13:12Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 336.950704] garage[913]: 2026-11-07T15:13:12.218712Z INFO garage_api_common::generic_server: 127.0.0.1:51886 (key GK0123456789abcdef01234567) HEAD /farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.narinfo lb # [ 336.953185] garage[913]: 2026-11-07T15:13:12.218944Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 336.956710] garage[913]: 2026-11-07T15:13:12.224787Z INFO garage_api_common::generic_server: 127.0.0.1:51886 (key GK0123456789abcdef01234567) HEAD /farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.narinfo lb # [ 336.959178] garage[913]: 2026-11-07T15:13:12.224987Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 336.961870] garage[913]: 2026-11-07T15:13:12.230037Z INFO garage_api_common::generic_server: 127.0.0.1:51886 (key GK0123456789abcdef01234567) HEAD /farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.narinfo lb # [ 336.964413] garage[913]: 2026-11-07T15:13:12.230224Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 336.971128] nix-grpc-daemon[529]: ts=2026-11-07T15:13:12Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 336.985231] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 337.005221] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 337.125056] nix-daemon[1026]: accepted connection from pid 1780, user nix-grpc-daemon (trusted) worker1 # [ 337.141671] nix-daemon[1026]: reaped child process 1783, status = succeeded lb # [ 337.148192] niks3-server[1503]: 2026/11/07 15:13:12 INFO Received push request method=POST path=/api/pushes worker1 # [ 337.163286] nix-grpc-daemon[1057]: time=2026-11-07T15:13:12.471Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker1 # [ 337.164773] nix-grpc-daemon[1057]: time=2026-11-07T15:13:12.473Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" worker1 # [ 337.166503] nix-grpc-daemon[1057]: time=2026-11-07T15:13:12.475Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" worker1 # [ 337.168215] nix-grpc-daemon[1057]: time=2026-11-07T15:13:12.476Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" worker1 # [ 337.176534] nix-grpc-daemon[1057]: time=2026-11-07T15:13:12.485Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3ce90012b9136be9b88f2dcd081a108de5d4dfd9fa11565b85d4bb369402cc0b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3ce90012b9136be9b88f2dcd081a108de5d4dfd9fa11565b85d4bb369402cc0b" worker1 # [ 337.185605] nix-grpc-daemon[1057]: time=2026-11-07T15:13:12.493Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6723def49b27d258fd9fea00e0e1e2c40af14c9f87880a7c5f9922bc633b588a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6723def49b27d258fd9fea00e0e1e2c40af14c9f87880a7c5f9922bc633b588a" worker1 # [ 337.194673] nix-grpc-daemon[1057]: time=2026-11-07T15:13:12.493Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b" worker1 # [ 337.203453] nix-grpc-daemon[1057]: time=2026-11-07T15:13:12.493Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3d9526954edb9be7bd6bde314188d3623a6251b17a951699d9c7e4021bf15eef\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3d9526954edb9be7bd6bde314188d3623a6251b17a951699d9c7e4021bf15eef" worker1 # [ 337.212206] nix-grpc-daemon[1057]: time=2026-11-07T15:13:12.494Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64ab5c497915c2807b4e395df1edfeeab477adf03ff4fa15f3a6432898fdafe1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64ab5c497915c2807b4e395df1edfeeab477adf03ff4fa15f3a6432898fdafe1" worker1 # [ 337.220477] nix-grpc-daemon[1057]: time=2026-11-07T15:13:12.503Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1cfb56414e08d279c5d9d203d37d06065803b91b080ecf45497f89083fd2a580\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1cfb56414e08d279c5d9d203d37d06065803b91b080ecf45497f89083fd2a580" worker2 # [ 337.639336] nix-grpc-daemon[1617]: time=2026-11-07T15:13:12.851Z level=WARN msg="Request failed, retrying" attempt=3 backoff=377.38817ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3c77d7c2ead4f396198a576c33fa44b2d21784204c9a106a5e0c095310fafc56\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3c77d7c2ead4f396198a576c33fa44b2d21784204c9a106a5e0c095310fafc56" worker2 # [ 338.020226] nix-grpc-daemon[1617]: time=2026-11-07T15:13:13.232Z level=WARN msg="Request failed, retrying" attempt=4 backoff=820.623224ms error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3c77d7c2ead4f396198a576c33fa44b2d21784204c9a106a5e0c095310fafc56\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3c77d7c2ead4f396198a576c33fa44b2d21784204c9a106a5e0c095310fafc56" worker1 # [ 338.344509] nix-grpc-daemon[1057]: time=2026-11-07T15:13:13.652Z level=WARN msg="Request failed, retrying" attempt=2 backoff=193.71525ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3ce90012b9136be9b88f2dcd081a108de5d4dfd9fa11565b85d4bb369402cc0b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3ce90012b9136be9b88f2dcd081a108de5d4dfd9fa11565b85d4bb369402cc0b" worker1 # [ 339.560624] nix-grpc-daemon[1057]: time=2026-11-07T15:13:14.868Z level=WARN msg="Request failed, retrying" attempt=3 backoff=379.544518ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3ce90012b9136be9b88f2dcd081a108de5d4dfd9fa11565b85d4bb369402cc0b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3ce90012b9136be9b88f2dcd081a108de5d4dfd9fa11565b85d4bb369402cc0b" worker2 # [ 339.878919] nix-grpc-daemon[1617]: time=2026-11-07T15:13:15.090Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.503714907s error="Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6f4e36985c33f4343a8ddb6bf124af65f8e4fae8a676d352e00305783ef10dfa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6f4e36985c33f4343a8ddb6bf124af65f8e4fae8a676d352e00305783ef10dfa" worker1 # [ 340.648504] nix-grpc-daemon[1057]: time=2026-11-07T15:13:15.956Z level=WARN msg="Request failed, retrying" attempt=2 backoff=192.793503ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1cfb56414e08d279c5d9d203d37d06065803b91b080ecf45497f89083fd2a580\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1cfb56414e08d279c5d9d203d37d06065803b91b080ecf45497f89083fd2a580" worker2 # [ 340.903276] nix-grpc-daemon[1617]: time=2026-11-07T15:13:16.114Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.567040912s error="Put \"http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3c77d7c2ead4f396198a576c33fa44b2d21784204c9a106a5e0c095310fafc56\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/j5sh943zaa0qjagii0xkivjfb4c2c5p0.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3c77d7c2ead4f396198a576c33fa44b2d21784204c9a106a5e0c095310fafc56" worker1 # [ 341.672438] nix-grpc-daemon[1057]: time=2026-11-07T15:13:16.980Z level=WARN msg="Request failed, retrying" attempt=2 backoff=191.51984ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b" worker2 # [ 342.476654] nix-grpc-daemon[1617]: time=2026-11-07T15:13:17.686Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading NAR nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1awa0khyixxmb53bhxv3vk1qy0fd3xzskbp3b8g2fzdmcz3cvv97.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151310Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6f4e36985c33f4343a8ddb6bf124af65f8e4fae8a676d352e00305783ef10dfa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 342.503930] nix-daemon[986]: reaped child process 1834, status = succeeded client # [ 342.504777] systemd[1]: session-197.scope: Deactivated successfully. client # [ 342.508727] systemd[1]: session-197.scope: Consumed 253ms CPU time over 2min 9.079s wall clock time, 42.5M memory peak, 8K written to disk, 18.5K incoming IP traffic, 19.7K outgoing IP traffic. client # [ 342.517911] systemd-logind[465]: Removed session 197. worker1 # [ 342.696460] nix-grpc-daemon[1057]: time=2026-11-07T15:13:18.004Z level=WARN msg="Request failed, retrying" attempt=2 backoff=212.014691ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6723def49b27d258fd9fea00e0e1e2c40af14c9f87880a7c5f9922bc633b588a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6723def49b27d258fd9fea00e0e1e2c40af14c9f87880a7c5f9922bc633b588a" worker1 # [ 343.912323] nix-grpc-daemon[1057]: time=2026-11-07T15:13:19.220Z level=WARN msg="Request failed, retrying" attempt=3 backoff=394.316467ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1cfb56414e08d279c5d9d203d37d06065803b91b080ecf45497f89083fd2a580\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1cfb56414e08d279c5d9d203d37d06065803b91b080ecf45497f89083fd2a580" worker2 # [ 344.234587] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 344.241846] systemd[1815]: Activating special unit Exit the Session... worker2 # [ 344.246497] systemd[1815]: Stopped target Main User Target. worker2 # [ 344.249806] systemd[1815]: Stopped target Basic System. worker2 # [ 344.252575] systemd[1815]: Stopped target Paths. worker2 # [ 344.255743] systemd[1815]: Stopped target Sockets. worker2 # [ 344.258581] systemd[1815]: Stopped target Timers. worker2 # [ 344.261953] systemd[1815]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 344.266388] systemd[1815]: Closed D-Bus User Message Bus Socket. worker2 # [ 344.269474] systemd[1815]: Stopped Create User Files and Directories. worker2 # [ 344.273782] systemd[1815]: Removed slice User Application Slice. worker2 # [ 344.276472] systemd[1815]: Reached target Shutdown. worker2 # [ 344.279656] systemd[1815]: Finished Exit the Session. worker2 # [ 344.286206] systemd[1815]: Reached target Exit the Session. worker2 # [ 344.291648] systemd-logind[555]: Removed session 29. worker2 # [ 344.294655] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 344.297574] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 344.306417] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 344.324800] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 344.309750] nix-grpc-daemon[1057]: time=2026-11-07T15:13:19.618Z level=WARN msg="Request failed, retrying" attempt=4 backoff=770.648507ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1cfb56414e08d279c5d9d203d37d06065803b91b080ecf45497f89083fd2a580\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1cfb56414e08d279c5d9d203d37d06065803b91b080ecf45497f89083fd2a580" worker2 # [ 344.326604] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 344.328117] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 345.959797] nix-grpc-daemon[1057]: time=2026-11-07T15:13:21.267Z level=WARN msg="Request failed, retrying" attempt=3 backoff=419.812035ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b" lb # [ 346.333698] systemd[1]: Stopping User Manager for UID 0... lb # [ 346.342555] systemd[1462]: Activating special unit Exit the Session... lb # [ 346.347321] systemd[1462]: Stopped target Main User Target. lb # [ 346.351355] systemd[1462]: Stopped target Basic System. lb # [ 346.354633] systemd[1462]: Stopped target Paths. lb # [ 346.357498] systemd[1462]: Stopped target Sockets. lb # [ 346.361235] systemd[1462]: Stopped target Timers. lb # [ 346.363790] systemd[1462]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 346.367795] systemd[1462]: Closed D-Bus User Message Bus Socket. lb # [ 346.371073] systemd[1462]: Stopped Create User Files and Directories. lb # [ 346.375736] systemd[1462]: Removed slice User Application Slice. lb # [ 346.378297] systemd[1462]: Reached target Shutdown. lb # [ 346.382239] systemd[1462]: Finished Exit the Session. lb # [ 346.386370] systemd[1462]: Reached target Exit the Session. lb # [ 346.388991] systemd-logind[553]: Removed session 30. lb # [ 346.394574] systemd[1]: user@0.service: Deactivated successfully. lb # [ 346.398161] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 346.383190] nix-grpc-daemon[1057]: time=2026-11-07T15:13:21.691Z level=WARN msg="Request failed, retrying" attempt=4 backoff=812.772464ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b" lb # [ 346.421303] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 346.439209] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 346.441087] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 346.442489] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 346.631813] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 346.639647] systemd[1709]: Activating special unit Exit the Session... worker1 # [ 346.642721] systemd[1709]: Stopped target Main User Target. worker1 # [ 346.645377] systemd[1709]: Stopped target Basic System. worker1 # [ 346.648506] systemd[1709]: Stopped target Paths. worker1 # [ 346.651451] systemd[1709]: Stopped target Sockets. worker1 # [ 346.654306] systemd[1709]: Stopped target Timers. worker1 # [ 346.657967] systemd[1709]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 346.661535] systemd[1709]: Closed D-Bus User Message Bus Socket. worker1 # [ 346.663771] systemd[1709]: Stopped Create User Files and Directories. worker1 # [ 346.668409] systemd[1709]: Removed slice User Application Slice. worker1 # [ 346.670541] systemd[1709]: Reached target Shutdown. worker1 # [ 346.672858] systemd[1709]: Finished Exit the Session. worker1 # [ 346.676831] systemd[1709]: Reached target Exit the Session. worker1 # [ 346.681828] systemd-logind[608]: Removed session 35. worker1 # [ 346.687471] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 346.691200] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 346.699960] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 346.719059] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 346.720772] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 346.722340] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 347.200898] nix-grpc-daemon[1057]: time=2026-11-07T15:13:22.508Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.493451422s error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b" lb # [ 348.591225] envoy[912]: conn peer=[2001:db8:1::1]:56896 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=8188 tx=8038 ms=128950 worker1 # [ 350.120337] nix-grpc-daemon[1057]: time=2026-11-07T15:13:25.427Z level=WARN msg="Request failed, retrying" attempt=3 backoff=360.75844ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6723def49b27d258fd9fea00e0e1e2c40af14c9f87880a7c5f9922bc633b588a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6723def49b27d258fd9fea00e0e1e2c40af14c9f87880a7c5f9922bc633b588a" worker1 # [ 350.183421] nix-grpc-daemon[1057]: time=2026-11-07T15:13:25.491Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.546318116s error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1cfb56414e08d279c5d9d203d37d06065803b91b080ecf45497f89083fd2a580\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1cfb56414e08d279c5d9d203d37d06065803b91b080ecf45497f89083fd2a580" worker1 # [ 351.527996] nix-grpc-daemon[1057]: time=2026-11-07T15:13:26.835Z level=WARN msg="Request failed, retrying" attempt=4 backoff=852.457558ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6723def49b27d258fd9fea00e0e1e2c40af14c9f87880a7c5f9922bc633b588a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6723def49b27d258fd9fea00e0e1e2c40af14c9f87880a7c5f9922bc633b588a" worker1 # [ 352.383178] nix-grpc-daemon[1057]: time=2026-11-07T15:13:27.691Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.67639407s error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6723def49b27d258fd9fea00e0e1e2c40af14c9f87880a7c5f9922bc633b588a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6723def49b27d258fd9fea00e0e1e2c40af14c9f87880a7c5f9922bc633b588a" worker1 # [ 353.832583] nix-grpc-daemon[1057]: time=2026-11-07T15:13:29.140Z level=WARN msg="Request failed, retrying" attempt=2 backoff=180.451769ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64ab5c497915c2807b4e395df1edfeeab477adf03ff4fa15f3a6432898fdafe1\": uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64ab5c497915c2807b4e395df1edfeeab477adf03ff4fa15f3a6432898fdafe1" worker1 # [ 353.870639] nix-grpc-daemon[1057]: time=2026-11-07T15:13:29.140Z level=WARN msg="Request failed, retrying" attempt=2 backoff=191.797533ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3d9526954edb9be7bd6bde314188d3623a6251b17a951699d9c7e4021bf15eef\": uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3d9526954edb9be7bd6bde314188d3623a6251b17a951699d9c7e4021bf15eef" worker1 # [ 353.901386] nix-grpc-daemon[1057]: time=2026-11-07T15:13:29.140Z level=WARN msg="Request failed, retrying" attempt=4 backoff=863.513432ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3ce90012b9136be9b88f2dcd081a108de5d4dfd9fa11565b85d4bb369402cc0b\": uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3ce90012b9136be9b88f2dcd081a108de5d4dfd9fa11565b85d4bb369402cc0b" worker1 # [ 353.917263] nix-grpc-daemon[1057]: time=2026-11-07T15:13:29.140Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=3 worker1 # [ 353.928380] nix-daemon[1026]: reaped child process 1776, status = succeeded worker2 # [ 354.373699] nix-grpc-daemon[1514]: ts=2026-11-07T15:13:29Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 354.386388] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 354.406283] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) client # [ 354.471592] systemd[750]: Created slice User Background Tasks Slice. client # [ 354.477238] systemd[750]: Starting Cleanup of User's Temporary Files and Directories... worker2 # [ 354.512627] nix-daemon[986]: accepted connection from pid 1854, user nix-grpc-daemon (trusted) client # [ 354.511525] systemd[750]: Finished Cleanup of User's Temporary Files and Directories. worker2 # [ 354.527577] nix-daemon[986]: reaped child process 1857, status = succeeded lb # [ 354.536398] niks3-server[1503]: 2026/11/07 15:13:29 INFO Received push request method=POST path=/api/pushes worker2 # [ 354.548300] nix-grpc-daemon[1617]: time=2026-11-07T15:13:29.760Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker2 # [ 354.552979] nix-grpc-daemon[1617]: time=2026-11-07T15:13:29.760Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" worker2 # [ 354.556632] nix-grpc-daemon[1617]: time=2026-11-07T15:13:29.760Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" worker2 # [ 354.558525] nix-grpc-daemon[1617]: time=2026-11-07T15:13:29.760Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" worker2 # [ 354.560200] nix-grpc-daemon[1617]: time=2026-11-07T15:13:29.768Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb69178542fde37a7b2042fe4d407b2198a53a9b658b112b8caccebb4177a30b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb69178542fde37a7b2042fe4d407b2198a53a9b658b112b8caccebb4177a30b" worker2 # [ 354.568489] nix-grpc-daemon[1617]: time=2026-11-07T15:13:29.769Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=af0daf525e800ca95632cf2954ed1968f4095bd051486dba6ede9a0d9f85086b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=af0daf525e800ca95632cf2954ed1968f4095bd051486dba6ede9a0d9f85086b" worker2 # [ 354.576793] nix-grpc-daemon[1617]: time=2026-11-07T15:13:29.769Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=23f9adb921c0feabe74a25368f5f8788f34c9edff8de068b8bb0581fe462b223\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=23f9adb921c0feabe74a25368f5f8788f34c9edff8de068b8bb0581fe462b223" worker2 # [ 354.585497] nix-grpc-daemon[1617]: time=2026-11-07T15:13:29.769Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d0ce0b734a2c5a73c64c163eaa544b86115684587e5a07ca5868b97fcd5aba93\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d0ce0b734a2c5a73c64c163eaa544b86115684587e5a07ca5868b97fcd5aba93" worker2 # [ 354.594152] nix-grpc-daemon[1617]: time=2026-11-07T15:13:29.770Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266" worker2 # [ 354.602705] nix-grpc-daemon[1617]: time=2026-11-07T15:13:29.771Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=759b18021c287c01dc847b499cbabb15fdd69e4b22dbb679b43e815ec773d6c8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=759b18021c287c01dc847b499cbabb15fdd69e4b22dbb679b43e815ec773d6c8" worker2 # [ 355.687720] nix-grpc-daemon[1617]: time=2026-11-07T15:13:30.899Z level=WARN msg="Request failed, retrying" attempt=2 backoff=211.673317ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=759b18021c287c01dc847b499cbabb15fdd69e4b22dbb679b43e815ec773d6c8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=759b18021c287c01dc847b499cbabb15fdd69e4b22dbb679b43e815ec773d6c8" worker2 # [ 356.967173] nix-grpc-daemon[1617]: time=2026-11-07T15:13:32.178Z level=WARN msg="Request failed, retrying" attempt=3 backoff=414.770697ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=759b18021c287c01dc847b499cbabb15fdd69e4b22dbb679b43e815ec773d6c8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=759b18021c287c01dc847b499cbabb15fdd69e4b22dbb679b43e815ec773d6c8" worker2 # [ 358.055417] nix-grpc-daemon[1617]: time=2026-11-07T15:13:33.267Z level=WARN msg="Request failed, retrying" attempt=2 backoff=190.042497ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=af0daf525e800ca95632cf2954ed1968f4095bd051486dba6ede9a0d9f85086b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=af0daf525e800ca95632cf2954ed1968f4095bd051486dba6ede9a0d9f85086b" worker2 # [ 359.079390] nix-grpc-daemon[1617]: time=2026-11-07T15:13:34.290Z level=WARN msg="Request failed, retrying" attempt=2 backoff=212.97881ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=23f9adb921c0feabe74a25368f5f8788f34c9edff8de068b8bb0581fe462b223\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=23f9adb921c0feabe74a25368f5f8788f34c9edff8de068b8bb0581fe462b223" worker2 # [ 360.103487] nix-grpc-daemon[1617]: time=2026-11-07T15:13:35.315Z level=WARN msg="Request failed, retrying" attempt=2 backoff=207.428347ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266" worker2 # [ 361.318589] nix-grpc-daemon[1617]: time=2026-11-07T15:13:36.530Z level=WARN msg="Request failed, retrying" attempt=3 backoff=423.809568ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266" worker2 # [ 361.747733] nix-grpc-daemon[1617]: time=2026-11-07T15:13:36.960Z level=WARN msg="Request failed, retrying" attempt=4 backoff=731.523902ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266" [e2e] heartbeat t=300s worker2 # [ 363.366974] nix-grpc-daemon[1617]: time=2026-11-07T15:13:38.578Z level=WARN msg="Request failed, retrying" attempt=3 backoff=398.263726ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=af0daf525e800ca95632cf2954ed1968f4095bd051486dba6ede9a0d9f85086b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=af0daf525e800ca95632cf2954ed1968f4095bd051486dba6ede9a0d9f85086b" worker2 # [ 363.769431] nix-grpc-daemon[1617]: time=2026-11-07T15:13:38.981Z level=WARN msg="Request failed, retrying" attempt=4 backoff=777.746741ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=af0daf525e800ca95632cf2954ed1968f4095bd051486dba6ede9a0d9f85086b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=af0daf525e800ca95632cf2954ed1968f4095bd051486dba6ede9a0d9f85086b" worker2 # [ 364.573441] nix-grpc-daemon[1617]: time=2026-11-07T15:13:39.785Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.587479575s error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=af0daf525e800ca95632cf2954ed1968f4095bd051486dba6ede9a0d9f85086b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=af0daf525e800ca95632cf2954ed1968f4095bd051486dba6ede9a0d9f85086b" worker2 # [ 366.567811] nix-grpc-daemon[1617]: time=2026-11-07T15:13:41.778Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.521019683s error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266" worker2 # [ 368.092822] nix-grpc-daemon[1617]: time=2026-11-07T15:13:43.304Z level=WARN msg="Request failed, retrying" attempt=2 backoff=192.166394ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d0ce0b734a2c5a73c64c163eaa544b86115684587e5a07ca5868b97fcd5aba93\": uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d0ce0b734a2c5a73c64c163eaa544b86115684587e5a07ca5868b97fcd5aba93" worker2 # [ 368.132680] nix-grpc-daemon[1617]: time=2026-11-07T15:13:43.304Z level=WARN msg="Request failed, retrying" attempt=4 backoff=786.988246ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=759b18021c287c01dc847b499cbabb15fdd69e4b22dbb679b43e815ec773d6c8\": uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=759b18021c287c01dc847b499cbabb15fdd69e4b22dbb679b43e815ec773d6c8" worker2 # [ 368.161459] nix-grpc-daemon[1617]: time=2026-11-07T15:13:43.339Z level=WARN msg="Request failed, retrying" attempt=2 backoff=181.803909ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb69178542fde37a7b2042fe4d407b2198a53a9b658b112b8caccebb4177a30b\": uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=eb69178542fde37a7b2042fe4d407b2198a53a9b658b112b8caccebb4177a30b" worker2 # [ 368.175567] nix-grpc-daemon[1617]: time=2026-11-07T15:13:43.339Z level=WARN msg="Request failed, retrying" attempt=3 backoff=384.720396ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=23f9adb921c0feabe74a25368f5f8788f34c9edff8de068b8bb0581fe462b223\": uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=23f9adb921c0feabe74a25368f5f8788f34c9edff8de068b8bb0581fe462b223" worker2 # [ 368.189684] nix-grpc-daemon[1617]: time=2026-11-07T15:13:43.339Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=3 worker2 # [ 368.201122] nix-daemon[986]: reaped child process 1850, status = succeeded worker2 # [ 369.138728] nix-grpc-daemon[1514]: ts=2026-11-07T15:13:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 369.149184] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 369.260850] nix-daemon[986]: accepted connection from pid 1861, user nix-grpc-daemon (trusted) worker2 # [ 369.274125] nix-daemon[986]: reaped child process 1864, status = succeeded lb # [ 369.284558] niks3-server[1503]: 2026/11/07 15:13:44 INFO Received push request method=POST path=/api/pushes worker2 # [ 369.294936] nix-grpc-daemon[1617]: time=2026-11-07T15:13:44.507Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker2 # [ 369.298570] nix-grpc-daemon[1617]: time=2026-11-07T15:13:44.509Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" worker2 # [ 369.300220] nix-grpc-daemon[1617]: time=2026-11-07T15:13:44.509Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" worker2 # [ 369.301702] nix-grpc-daemon[1617]: time=2026-11-07T15:13:44.509Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" worker2 # [ 370.343288] nix-grpc-daemon[1617]: time=2026-11-07T15:13:45.554Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e54f9efdd1f9ae574ca04853474edf68e6b31f961642d83c5fe451e6b368b41\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e54f9efdd1f9ae574ca04853474edf68e6b31f961642d83c5fe451e6b368b41" worker2 # [ 371.367196] nix-grpc-daemon[1617]: time=2026-11-07T15:13:46.578Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9448c4b504be21daed0d7de60d9c9c021123a1a6bb778ad4a8cbb74fb915502c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9448c4b504be21daed0d7de60d9c9c021123a1a6bb778ad4a8cbb74fb915502c" worker2 # [ 372.391394] nix-grpc-daemon[1617]: time=2026-11-07T15:13:47.602Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=929c7f346684c01147bd2acaa0011b6cae77d5b6060c0e121ca4eea4fb98604e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=929c7f346684c01147bd2acaa0011b6cae77d5b6060c0e121ca4eea4fb98604e" worker2 # [ 373.415366] nix-grpc-daemon[1617]: time=2026-11-07T15:13:48.626Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=57f77c378664d2804ce671030fcdd37c7e7f98e59ebe7fa0955a4feb6616f135\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=57f77c378664d2804ce671030fcdd37c7e7f98e59ebe7fa0955a4feb6616f135" worker2 # [ 374.567401] nix-grpc-daemon[1617]: time=2026-11-07T15:13:49.778Z level=WARN msg="Request failed, retrying" attempt=2 backoff=215.524602ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=929c7f346684c01147bd2acaa0011b6cae77d5b6060c0e121ca4eea4fb98604e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=929c7f346684c01147bd2acaa0011b6cae77d5b6060c0e121ca4eea4fb98604e" worker2 # [ 375.591566] nix-grpc-daemon[1617]: time=2026-11-07T15:13:50.803Z level=WARN msg="Request failed, retrying" attempt=2 backoff=201.156843ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=57f77c378664d2804ce671030fcdd37c7e7f98e59ebe7fa0955a4feb6616f135\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=57f77c378664d2804ce671030fcdd37c7e7f98e59ebe7fa0955a4feb6616f135" worker2 # [ 376.615455] nix-grpc-daemon[1617]: time=2026-11-07T15:13:51.827Z level=WARN msg="Request failed, retrying" attempt=2 backoff=191.033461ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9448c4b504be21daed0d7de60d9c9c021123a1a6bb778ad4a8cbb74fb915502c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9448c4b504be21daed0d7de60d9c9c021123a1a6bb778ad4a8cbb74fb915502c" worker2 # [ 377.639716] nix-grpc-daemon[1617]: time=2026-11-07T15:13:52.851Z level=WARN msg="Request failed, retrying" attempt=2 backoff=212.913731ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e54f9efdd1f9ae574ca04853474edf68e6b31f961642d83c5fe451e6b368b41\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e54f9efdd1f9ae574ca04853474edf68e6b31f961642d83c5fe451e6b368b41" worker2 # [ 378.855443] nix-grpc-daemon[1617]: time=2026-11-07T15:13:54.067Z level=WARN msg="Request failed, retrying" attempt=3 backoff=390.230885ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=57f77c378664d2804ce671030fcdd37c7e7f98e59ebe7fa0955a4feb6616f135\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=57f77c378664d2804ce671030fcdd37c7e7f98e59ebe7fa0955a4feb6616f135" worker2 # [ 379.879585] nix-grpc-daemon[1617]: time=2026-11-07T15:13:55.091Z level=WARN msg="Request failed, retrying" attempt=3 backoff=398.416322ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9448c4b504be21daed0d7de60d9c9c021123a1a6bb778ad4a8cbb74fb915502c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9448c4b504be21daed0d7de60d9c9c021123a1a6bb778ad4a8cbb74fb915502c" worker2 # [ 380.967190] nix-grpc-daemon[1617]: time=2026-11-07T15:13:56.178Z level=WARN msg="Request failed, retrying" attempt=3 backoff=402.589648ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e54f9efdd1f9ae574ca04853474edf68e6b31f961642d83c5fe451e6b368b41\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e54f9efdd1f9ae574ca04853474edf68e6b31f961642d83c5fe451e6b368b41" worker2 # [ 381.991347] nix-grpc-daemon[1617]: time=2026-11-07T15:13:57.202Z level=WARN msg="Request failed, retrying" attempt=3 backoff=398.806601ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=929c7f346684c01147bd2acaa0011b6cae77d5b6060c0e121ca4eea4fb98604e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=929c7f346684c01147bd2acaa0011b6cae77d5b6060c0e121ca4eea4fb98604e" worker2 # [ 383.335344] nix-grpc-daemon[1617]: time=2026-11-07T15:13:58.546Z level=WARN msg="Request failed, retrying" attempt=4 backoff=877.828998ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9448c4b504be21daed0d7de60d9c9c021123a1a6bb778ad4a8cbb74fb915502c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9448c4b504be21daed0d7de60d9c9c021123a1a6bb778ad4a8cbb74fb915502c" worker2 # [ 384.217282] nix-grpc-daemon[1617]: time=2026-11-07T15:13:59.429Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.664529725s error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9448c4b504be21daed0d7de60d9c9c021123a1a6bb778ad4a8cbb74fb915502c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9448c4b504be21daed0d7de60d9c9c021123a1a6bb778ad4a8cbb74fb915502c" worker2 # [ 385.447273] nix-grpc-daemon[1617]: time=2026-11-07T15:14:00.659Z level=WARN msg="Request failed, retrying" attempt=4 backoff=727.326997ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=929c7f346684c01147bd2acaa0011b6cae77d5b6060c0e121ca4eea4fb98604e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=929c7f346684c01147bd2acaa0011b6cae77d5b6060c0e121ca4eea4fb98604e" worker2 # [ 387.239590] nix-grpc-daemon[1617]: time=2026-11-07T15:14:02.451Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.534846685s error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=929c7f346684c01147bd2acaa0011b6cae77d5b6060c0e121ca4eea4fb98604e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=929c7f346684c01147bd2acaa0011b6cae77d5b6060c0e121ca4eea4fb98604e" worker2 # [ 388.518982] nix-grpc-daemon[1617]: time=2026-11-07T15:14:03.730Z level=WARN msg="Request failed, retrying" attempt=4 backoff=778.510725ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e54f9efdd1f9ae574ca04853474edf68e6b31f961642d83c5fe451e6b368b41\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e54f9efdd1f9ae574ca04853474edf68e6b31f961642d83c5fe451e6b368b41" worker2 # [ 388.646579] nix-grpc-daemon[1617]: time=2026-11-07T15:14:03.858Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae6f0170dad8da09cbbc9546c70b38efd203514a581baf969977eff5b5c7b609\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae6f0170dad8da09cbbc9546c70b38efd203514a581baf969977eff5b5c7b609" worker2 # [ 390.823541] nix-grpc-daemon[1617]: time=2026-11-07T15:14:06.035Z level=WARN msg="Request failed, retrying" attempt=2 backoff=188.471983ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae6f0170dad8da09cbbc9546c70b38efd203514a581baf969977eff5b5c7b609\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae6f0170dad8da09cbbc9546c70b38efd203514a581baf969977eff5b5c7b609" worker2 # [ 392.039208] nix-grpc-daemon[1617]: time=2026-11-07T15:14:07.250Z level=WARN msg="Request failed, retrying" attempt=3 backoff=369.886454ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae6f0170dad8da09cbbc9546c70b38efd203514a581baf969977eff5b5c7b609\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae6f0170dad8da09cbbc9546c70b38efd203514a581baf969977eff5b5c7b609" [e2e] heartbeat t=330s worker2 # [ 393.384287] nix-grpc-daemon[1617]: time=2026-11-07T15:14:08.594Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.531198983s error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e54f9efdd1f9ae574ca04853474edf68e6b31f961642d83c5fe451e6b368b41\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e54f9efdd1f9ae574ca04853474edf68e6b31f961642d83c5fe451e6b368b41" worker2 # [ 394.471246] nix-grpc-daemon[1617]: time=2026-11-07T15:14:09.682Z level=WARN msg="Request failed, retrying" attempt=4 backoff=799.132723ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae6f0170dad8da09cbbc9546c70b38efd203514a581baf969977eff5b5c7b609\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae6f0170dad8da09cbbc9546c70b38efd203514a581baf969977eff5b5c7b609" worker2 # [ 396.327505] nix-grpc-daemon[1617]: time=2026-11-07T15:14:11.539Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.594597463s error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae6f0170dad8da09cbbc9546c70b38efd203514a581baf969977eff5b5c7b609\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae6f0170dad8da09cbbc9546c70b38efd203514a581baf969977eff5b5c7b609" worker2 # [ 397.932521] nix-grpc-daemon[1617]: time=2026-11-07T15:14:13.139Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a91bdfa6752bff91fe08876f51ddf06a254105b0d881f1ef1642f62a7bb98863\": uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e54f9efdd1f9ae574ca04853474edf68e6b31f961642d83c5fe451e6b368b41\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a91bdfa6752bff91fe08876f51ddf06a254105b0d881f1ef1642f62a7bb98863" worker2 # [ 397.968460] nix-grpc-daemon[1617]: time=2026-11-07T15:14:13.140Z level=WARN msg="Request failed, retrying" attempt=4 backoff=837.760576ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=57f77c378664d2804ce671030fcdd37c7e7f98e59ebe7fa0955a4feb6616f135\": uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e54f9efdd1f9ae574ca04853474edf68e6b31f961642d83c5fe451e6b368b41\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=57f77c378664d2804ce671030fcdd37c7e7f98e59ebe7fa0955a4feb6616f135" worker2 # [ 397.992617] nix-grpc-daemon[1617]: time=2026-11-07T15:14:13.140Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e54f9efdd1f9ae574ca04853474edf68e6b31f961642d83c5fe451e6b368b41\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=3 worker2 # [ 398.004029] nix-daemon[986]: reaped child process 1859, status = succeeded worker2 # [ 399.972527] nix-grpc-daemon[1514]: ts=2026-11-07T15:14:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 399.985486] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 400.099565] nix-daemon[986]: accepted connection from pid 1868, user nix-grpc-daemon (trusted) worker2 # [ 400.113085] nix-daemon[986]: reaped child process 1871, status = succeeded lb # [ 400.122668] niks3-server[1503]: 2026/11/07 15:14:15 INFO Received push request method=POST path=/api/pushes worker2 # [ 400.134616] nix-grpc-daemon[1617]: time=2026-11-07T15:14:15.347Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker2 # [ 400.136143] nix-grpc-daemon[1617]: time=2026-11-07T15:14:15.348Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" worker2 # [ 400.137870] nix-grpc-daemon[1617]: time=2026-11-07T15:14:15.350Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" worker2 # [ 400.139458] nix-grpc-daemon[1617]: time=2026-11-07T15:14:15.350Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" worker2 # [ 400.143835] nix-grpc-daemon[1617]: time=2026-11-07T15:14:15.356Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d6e3884c90533885ce76a41e149744c586d6e10c0d0dc512595e6f10e0a0dff0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d6e3884c90533885ce76a41e149744c586d6e10c0d0dc512595e6f10e0a0dff0" worker2 # [ 400.152753] nix-grpc-daemon[1617]: time=2026-11-07T15:14:15.356Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9695dde598e053cb3d1e80e900cf30aa8e3e65c7235c7d344f3df9d1724346a5\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9695dde598e053cb3d1e80e900cf30aa8e3e65c7235c7d344f3df9d1724346a5" worker2 # [ 401.191459] nix-grpc-daemon[1617]: time=2026-11-07T15:14:16.402Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=736f3ffe8f734fe5d9d5801c2794720af92c6327798d17ce8d793607193b3c4a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=736f3ffe8f734fe5d9d5801c2794720af92c6327798d17ce8d793607193b3c4a" worker2 # [ 401.574547] nix-grpc-daemon[1617]: time=2026-11-07T15:14:16.787Z level=WARN msg="Request failed, retrying" attempt=2 backoff=200.228145ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9695dde598e053cb3d1e80e900cf30aa8e3e65c7235c7d344f3df9d1724346a5\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9695dde598e053cb3d1e80e900cf30aa8e3e65c7235c7d344f3df9d1724346a5" worker2 # [ 402.791536] nix-grpc-daemon[1617]: time=2026-11-07T15:14:18.003Z level=WARN msg="Request failed, retrying" attempt=3 backoff=397.384614ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9695dde598e053cb3d1e80e900cf30aa8e3e65c7235c7d344f3df9d1724346a5\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9695dde598e053cb3d1e80e900cf30aa8e3e65c7235c7d344f3df9d1724346a5" worker2 # [ 404.199350] nix-grpc-daemon[1617]: time=2026-11-07T15:14:19.410Z level=WARN msg="Request failed, retrying" attempt=4 backoff=863.612337ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9695dde598e053cb3d1e80e900cf30aa8e3e65c7235c7d344f3df9d1724346a5\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9695dde598e053cb3d1e80e900cf30aa8e3e65c7235c7d344f3df9d1724346a5" worker2 # [ 405.066536] nix-grpc-daemon[1617]: time=2026-11-07T15:14:20.279Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.616376794s error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9695dde598e053cb3d1e80e900cf30aa8e3e65c7235c7d344f3df9d1724346a5\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9695dde598e053cb3d1e80e900cf30aa8e3e65c7235c7d344f3df9d1724346a5" worker2 # [ 406.439371] nix-grpc-daemon[1617]: time=2026-11-07T15:14:21.650Z level=WARN msg="Request failed, retrying" attempt=2 backoff=193.86042ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=736f3ffe8f734fe5d9d5801c2794720af92c6327798d17ce8d793607193b3c4a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=736f3ffe8f734fe5d9d5801c2794720af92c6327798d17ce8d793607193b3c4a" worker2 # [ 406.637716] nix-grpc-daemon[1617]: time=2026-11-07T15:14:21.850Z level=WARN msg="Request failed, retrying" attempt=3 backoff=392.997549ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=736f3ffe8f734fe5d9d5801c2794720af92c6327798d17ce8d793607193b3c4a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=736f3ffe8f734fe5d9d5801c2794720af92c6327798d17ce8d793607193b3c4a" worker2 # [ 409.063429] nix-grpc-daemon[1617]: time=2026-11-07T15:14:24.274Z level=WARN msg="Request failed, retrying" attempt=4 backoff=830.400856ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=736f3ffe8f734fe5d9d5801c2794720af92c6327798d17ce8d793607193b3c4a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=736f3ffe8f734fe5d9d5801c2794720af92c6327798d17ce8d793607193b3c4a" worker2 # [ 409.897830] nix-grpc-daemon[1617]: time=2026-11-07T15:14:25.110Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.654655631s error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=736f3ffe8f734fe5d9d5801c2794720af92c6327798d17ce8d793607193b3c4a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=736f3ffe8f734fe5d9d5801c2794720af92c6327798d17ce8d793607193b3c4a" worker2 # [ 411.367342] nix-grpc-daemon[1617]: time=2026-11-07T15:14:26.579Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=14c0470ad8e9e2eab3cb25591dec8ff77da5a43b62ba448e8d6a3a0538a0c4c3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=14c0470ad8e9e2eab3cb25591dec8ff77da5a43b62ba448e8d6a3a0538a0c4c3" worker2 # [ 413.543494] nix-grpc-daemon[1617]: time=2026-11-07T15:14:28.755Z level=WARN msg="Request failed, retrying" attempt=2 backoff=185.889091ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=14c0470ad8e9e2eab3cb25591dec8ff77da5a43b62ba448e8d6a3a0538a0c4c3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=14c0470ad8e9e2eab3cb25591dec8ff77da5a43b62ba448e8d6a3a0538a0c4c3" worker2 # [ 413.733350] nix-grpc-daemon[1617]: time=2026-11-07T15:14:28.945Z level=WARN msg="Request failed, retrying" attempt=3 backoff=378.418937ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=14c0470ad8e9e2eab3cb25591dec8ff77da5a43b62ba448e8d6a3a0538a0c4c3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=14c0470ad8e9e2eab3cb25591dec8ff77da5a43b62ba448e8d6a3a0538a0c4c3" worker2 # [ 415.143357] nix-grpc-daemon[1617]: time=2026-11-07T15:14:30.354Z level=WARN msg="Request failed, retrying" attempt=4 backoff=749.31318ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=14c0470ad8e9e2eab3cb25591dec8ff77da5a43b62ba448e8d6a3a0538a0c4c3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=14c0470ad8e9e2eab3cb25591dec8ff77da5a43b62ba448e8d6a3a0538a0c4c3" worker2 # [ 415.896217] nix-grpc-daemon[1617]: time=2026-11-07T15:14:31.108Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.452866735s error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=14c0470ad8e9e2eab3cb25591dec8ff77da5a43b62ba448e8d6a3a0538a0c4c3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=14c0470ad8e9e2eab3cb25591dec8ff77da5a43b62ba448e8d6a3a0538a0c4c3" lb # [ 417.469536] postgres[782]: [782] LOG: checkpoint complete: wrote 1056 buffers (6.4%), wrote 3 SLRU buffers; 1 WAL file(s) added, 0 removed, 0 recycled; write=105.953 s, sync=0.059 s, total=106.071 s; sync files=364, longest=0.005 s, average=0.001 s; distance=5175 kB, estimate=5175 kB; lsn=0/1CA0A90, redo lsn=0/1C73DF8 worker2 # [ 419.880550] nix-grpc-daemon[1617]: time=2026-11-07T15:14:35.091Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9eebc1aff7bd16b8bc3bb9b605c5ef55f3e9bb2dc020e770ad3026e47eca277f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9eebc1aff7bd16b8bc3bb9b605c5ef55f3e9bb2dc020e770ad3026e47eca277f" worker2 # [ 419.900478] nix-grpc-daemon[1617]: time=2026-11-07T15:14:35.092Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9517d24232693cc793cce2a88ead943f0b14ac96859a40ed37d451bf6672b19a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9517d24232693cc793cce2a88ead943f0b14ac96859a40ed37d451bf6672b19a" worker2 # [ 419.921124] nix-grpc-daemon[1617]: time=2026-11-07T15:14:35.092Z level=WARN msg="Request failed, retrying" attempt=2 backoff=215.859985ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d6e3884c90533885ce76a41e149744c586d6e10c0d0dc512595e6f10e0a0dff0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d6e3884c90533885ce76a41e149744c586d6e10c0d0dc512595e6f10e0a0dff0" worker2 # [ 421.031086] nix-grpc-daemon[1617]: time=2026-11-07T15:14:36.242Z level=WARN msg="Request failed, retrying" attempt=2 backoff=195.794987ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9517d24232693cc793cce2a88ead943f0b14ac96859a40ed37d451bf6672b19a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9517d24232693cc793cce2a88ead943f0b14ac96859a40ed37d451bf6672b19a" worker2 # [ 422.055406] nix-grpc-daemon[1617]: time=2026-11-07T15:14:37.266Z level=WARN msg="Request failed, retrying" attempt=2 backoff=195.577502ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9eebc1aff7bd16b8bc3bb9b605c5ef55f3e9bb2dc020e770ad3026e47eca277f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9eebc1aff7bd16b8bc3bb9b605c5ef55f3e9bb2dc020e770ad3026e47eca277f" [e2e] heartbeat t=360s worker2 # [ 423.207499] nix-grpc-daemon[1617]: time=2026-11-07T15:14:38.419Z level=WARN msg="Request failed, retrying" attempt=3 backoff=434.605418ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d6e3884c90533885ce76a41e149744c586d6e10c0d0dc512595e6f10e0a0dff0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d6e3884c90533885ce76a41e149744c586d6e10c0d0dc512595e6f10e0a0dff0" worker2 # [ 423.645501] nix-grpc-daemon[1617]: time=2026-11-07T15:14:38.857Z level=WARN msg="Request failed, retrying" attempt=4 backoff=800.974618ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d6e3884c90533885ce76a41e149744c586d6e10c0d0dc512595e6f10e0a0dff0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d6e3884c90533885ce76a41e149744c586d6e10c0d0dc512595e6f10e0a0dff0" worker2 # [ 425.319566] nix-grpc-daemon[1617]: time=2026-11-07T15:14:40.531Z level=WARN msg="Request failed, retrying" attempt=3 backoff=399.287968ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9eebc1aff7bd16b8bc3bb9b605c5ef55f3e9bb2dc020e770ad3026e47eca277f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9eebc1aff7bd16b8bc3bb9b605c5ef55f3e9bb2dc020e770ad3026e47eca277f" worker2 # [ 425.722596] nix-grpc-daemon[1617]: time=2026-11-07T15:14:40.934Z level=WARN msg="Request failed, retrying" attempt=4 backoff=815.499388ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9eebc1aff7bd16b8bc3bb9b605c5ef55f3e9bb2dc020e770ad3026e47eca277f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9eebc1aff7bd16b8bc3bb9b605c5ef55f3e9bb2dc020e770ad3026e47eca277f" worker2 # [ 427.559325] nix-grpc-daemon[1617]: time=2026-11-07T15:14:42.770Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.757770926s error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d6e3884c90533885ce76a41e149744c586d6e10c0d0dc512595e6f10e0a0dff0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d6e3884c90533885ce76a41e149744c586d6e10c0d0dc512595e6f10e0a0dff0" worker2 # [ 427.580989] nix-grpc-daemon[1617]: time=2026-11-07T15:14:42.771Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.476255565s error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9eebc1aff7bd16b8bc3bb9b605c5ef55f3e9bb2dc020e770ad3026e47eca277f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9eebc1aff7bd16b8bc3bb9b605c5ef55f3e9bb2dc020e770ad3026e47eca277f" worker2 # [ 429.037495] nix-grpc-daemon[1617]: time=2026-11-07T15:14:44.249Z level=WARN msg="Request failed, retrying" attempt=3 backoff=428.286417ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9517d24232693cc793cce2a88ead943f0b14ac96859a40ed37d451bf6672b19a\": uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9695dde598e053cb3d1e80e900cf30aa8e3e65c7235c7d344f3df9d1724346a5\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9517d24232693cc793cce2a88ead943f0b14ac96859a40ed37d451bf6672b19a" worker2 # [ 429.054239] nix-grpc-daemon[1617]: time=2026-11-07T15:14:44.249Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9695dde598e053cb3d1e80e900cf30aa8e3e65c7235c7d344f3df9d1724346a5\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=3 worker2 # [ 429.065929] nix-daemon[986]: reaped child process 1866, status = succeeded worker1 # [ 433.063683] nix-grpc-daemon[529]: ts=2026-11-07T15:14:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 433.076521] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 433.187354] nix-daemon[1026]: accepted connection from pid 1791, user nix-grpc-daemon (trusted) worker1 # [ 433.201443] nix-daemon[1026]: reaped child process 1794, status = succeeded lb # [ 433.207651] niks3-server[1503]: 2026/11/07 15:14:48 INFO Received push request method=POST path=/api/pushes worker1 # [ 433.220044] nix-grpc-daemon[1057]: time=2026-11-07T15:14:48.528Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker1 # [ 433.223859] nix-grpc-daemon[1057]: time=2026-11-07T15:14:48.530Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" worker1 # [ 433.225487] nix-grpc-daemon[1057]: time=2026-11-07T15:14:48.530Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" worker1 # [ 433.227725] nix-grpc-daemon[1057]: time=2026-11-07T15:14:48.530Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" worker1 # [ 433.230547] nix-grpc-daemon[1057]: time=2026-11-07T15:14:48.538Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f871b6a9b2586c65cd7a5a59d60ef22ea73213363311f77386789e8357503a2b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f871b6a9b2586c65cd7a5a59d60ef22ea73213363311f77386789e8357503a2b" worker1 # [ 433.239558] nix-grpc-daemon[1057]: time=2026-11-07T15:14:48.539Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=165ca9ad867218fd7927ff28b0d2ac7e99da686a8741e35698c47aea64fc37fa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=165ca9ad867218fd7927ff28b0d2ac7e99da686a8741e35698c47aea64fc37fa" worker1 # [ 433.247804] nix-grpc-daemon[1057]: time=2026-11-07T15:14:48.539Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=94b98cd39ab6ad2d61d9446ca273dbdf0d9293c0192398f67eb4e297eb2b8e63\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=94b98cd39ab6ad2d61d9446ca273dbdf0d9293c0192398f67eb4e297eb2b8e63" worker1 # [ 433.256097] nix-grpc-daemon[1057]: time=2026-11-07T15:14:48.547Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=26fc62e2b190be6e6b7c40bb909a24151380adb345876ccdf0875cb60a829186\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=26fc62e2b190be6e6b7c40bb909a24151380adb345876ccdf0875cb60a829186" worker1 # [ 433.264338] nix-grpc-daemon[1057]: time=2026-11-07T15:14:48.548Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=637b11ba37e6c1ece8c46f3d7ccebeca08007b6e77e37fde65a040cd571c03c4\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=637b11ba37e6c1ece8c46f3d7ccebeca08007b6e77e37fde65a040cd571c03c4" worker1 # [ 433.272933] nix-grpc-daemon[1057]: time=2026-11-07T15:14:48.548Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0" worker1 # [ 434.344795] nix-grpc-daemon[1057]: time=2026-11-07T15:14:49.652Z level=WARN msg="Request failed, retrying" attempt=2 backoff=195.992121ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=94b98cd39ab6ad2d61d9446ca273dbdf0d9293c0192398f67eb4e297eb2b8e63\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=94b98cd39ab6ad2d61d9446ca273dbdf0d9293c0192398f67eb4e297eb2b8e63" worker1 # [ 436.584311] nix-grpc-daemon[1057]: time=2026-11-07T15:14:51.892Z level=WARN msg="Request failed, retrying" attempt=3 backoff=362.899609ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=94b98cd39ab6ad2d61d9446ca273dbdf0d9293c0192398f67eb4e297eb2b8e63\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=94b98cd39ab6ad2d61d9446ca273dbdf0d9293c0192398f67eb4e297eb2b8e63" worker1 # [ 437.736423] nix-grpc-daemon[1057]: time=2026-11-07T15:14:53.044Z level=WARN msg="Request failed, retrying" attempt=2 backoff=186.545418ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=165ca9ad867218fd7927ff28b0d2ac7e99da686a8741e35698c47aea64fc37fa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=165ca9ad867218fd7927ff28b0d2ac7e99da686a8741e35698c47aea64fc37fa" worker1 # [ 438.759904] nix-grpc-daemon[1057]: time=2026-11-07T15:14:54.067Z level=WARN msg="Request failed, retrying" attempt=2 backoff=211.830109ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0" worker1 # [ 439.976324] nix-grpc-daemon[1057]: time=2026-11-07T15:14:55.284Z level=WARN msg="Request failed, retrying" attempt=3 backoff=398.128059ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=165ca9ad867218fd7927ff28b0d2ac7e99da686a8741e35698c47aea64fc37fa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=165ca9ad867218fd7927ff28b0d2ac7e99da686a8741e35698c47aea64fc37fa" worker1 # [ 440.377783] nix-grpc-daemon[1057]: time=2026-11-07T15:14:55.686Z level=WARN msg="Request failed, retrying" attempt=4 backoff=767.747832ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=165ca9ad867218fd7927ff28b0d2ac7e99da686a8741e35698c47aea64fc37fa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=165ca9ad867218fd7927ff28b0d2ac7e99da686a8741e35698c47aea64fc37fa" worker1 # [ 442.087780] nix-grpc-daemon[1057]: time=2026-11-07T15:14:57.395Z level=WARN msg="Request failed, retrying" attempt=4 backoff=763.134831ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=94b98cd39ab6ad2d61d9446ca273dbdf0d9293c0192398f67eb4e297eb2b8e63\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=94b98cd39ab6ad2d61d9446ca273dbdf0d9293c0192398f67eb4e297eb2b8e63" worker1 # [ 442.854360] nix-grpc-daemon[1057]: time=2026-11-07T15:14:58.162Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.502777821s error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=94b98cd39ab6ad2d61d9446ca273dbdf0d9293c0192398f67eb4e297eb2b8e63\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=94b98cd39ab6ad2d61d9446ca273dbdf0d9293c0192398f67eb4e297eb2b8e63" worker1 # [ 444.136380] nix-grpc-daemon[1057]: time=2026-11-07T15:14:59.444Z level=WARN msg="Request failed, retrying" attempt=3 backoff=373.953797ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0" worker1 # [ 445.544202] nix-grpc-daemon[1057]: time=2026-11-07T15:15:00.851Z level=WARN msg="Request failed, retrying" attempt=4 backoff=770.549677ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0" worker1 # [ 446.247460] nix-grpc-daemon[1057]: time=2026-11-07T15:15:01.556Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.554929469s error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=165ca9ad867218fd7927ff28b0d2ac7e99da686a8741e35698c47aea64fc37fa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=165ca9ad867218fd7927ff28b0d2ac7e99da686a8741e35698c47aea64fc37fa" worker1 # [ 447.336097] nix-grpc-daemon[1057]: time=2026-11-07T15:15:02.643Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.558000269s error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0" worker1 # [ 449.960742] nix-grpc-daemon[1057]: time=2026-11-07T15:15:05.268Z level=WARN msg="Request failed, retrying" attempt=2 backoff=186.643408ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=637b11ba37e6c1ece8c46f3d7ccebeca08007b6e77e37fde65a040cd571c03c4\": uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=637b11ba37e6c1ece8c46f3d7ccebeca08007b6e77e37fde65a040cd571c03c4" worker1 # [ 450.001105] nix-grpc-daemon[1057]: time=2026-11-07T15:15:05.268Z level=WARN msg="Request failed, retrying" attempt=2 backoff=180.171661ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f871b6a9b2586c65cd7a5a59d60ef22ea73213363311f77386789e8357503a2b\": uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f871b6a9b2586c65cd7a5a59d60ef22ea73213363311f77386789e8357503a2b" worker1 # [ 450.032262] nix-grpc-daemon[1057]: time=2026-11-07T15:15:05.268Z level=WARN msg="Request failed, retrying" attempt=2 backoff=188.700752ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=26fc62e2b190be6e6b7c40bb909a24151380adb345876ccdf0875cb60a829186\": uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=26fc62e2b190be6e6b7c40bb909a24151380adb345876ccdf0875cb60a829186" worker1 # [ 450.046348] nix-grpc-daemon[1057]: time=2026-11-07T15:15:05.268Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=3 worker1 # [ 450.057528] nix-daemon[1026]: reaped child process 1789, status = succeeded [e2e] heartbeat t=390s worker1 # [ 454.005695] nix-grpc-daemon[529]: ts=2026-11-07T15:15:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 454.019200] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 454.133655] nix-daemon[1026]: accepted connection from pid 1798, user nix-grpc-daemon (trusted) worker1 # [ 454.147779] nix-daemon[1026]: reaped child process 1801, status = succeeded lb # [ 454.155354] niks3-server[1503]: 2026/11/07 15:15:09 INFO Received push request method=POST path=/api/pushes worker1 # [ 454.167344] nix-grpc-daemon[1057]: time=2026-11-07T15:15:09.475Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker1 # [ 454.169886] nix-grpc-daemon[1057]: time=2026-11-07T15:15:09.475Z level=INFO msg="Uploading v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv (784B)" worker1 # [ 454.173362] nix-grpc-daemon[1057]: time=2026-11-07T15:15:09.475Z level=INFO msg="Uploading 5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv (656B)" worker1 # [ 454.174876] nix-grpc-daemon[1057]: time=2026-11-07T15:15:09.475Z level=INFO msg="Uploading 6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv (536B)" worker1 # [ 454.177086] nix-grpc-daemon[1057]: time=2026-11-07T15:15:09.481Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=21e8556ea4abdb4f3c1e43fe09e232f1540fd1d3a391832a6c7ae7af482010c3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=21e8556ea4abdb4f3c1e43fe09e232f1540fd1d3a391832a6c7ae7af482010c3" worker1 # [ 454.276307] nix-grpc-daemon[1057]: time=2026-11-07T15:15:09.584Z level=WARN msg="Request failed, retrying" attempt=2 backoff=199.2122ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=21e8556ea4abdb4f3c1e43fe09e232f1540fd1d3a391832a6c7ae7af482010c3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=21e8556ea4abdb4f3c1e43fe09e232f1540fd1d3a391832a6c7ae7af482010c3" worker1 # [ 455.527805] nix-grpc-daemon[1057]: time=2026-11-07T15:15:10.835Z level=WARN msg="Request failed, retrying" attempt=3 backoff=433.391259ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=21e8556ea4abdb4f3c1e43fe09e232f1540fd1d3a391832a6c7ae7af482010c3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=21e8556ea4abdb4f3c1e43fe09e232f1540fd1d3a391832a6c7ae7af482010c3" worker1 # [ 456.231254] nix-grpc-daemon[1057]: time=2026-11-07T15:15:11.539Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1f57bd794ebece3c8560fda1d8b8aa2f07a84872fb8e5671ba38c78d347a2ccf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1f57bd794ebece3c8560fda1d8b8aa2f07a84872fb8e5671ba38c78d347a2ccf" worker1 # [ 457.259339] nix-grpc-daemon[1057]: time=2026-11-07T15:15:12.563Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c346a8997ef489a2d34981e47c6b8902fb3a469f6968b2f989163d5b758d5d5\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c346a8997ef489a2d34981e47c6b8902fb3a469f6968b2f989163d5b758d5d5" worker1 # [ 458.280282] nix-grpc-daemon[1057]: time=2026-11-07T15:15:13.587Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=810873970f4c14a46ea24107bd593eb061fa3ede7783cea6cda597c73af9baad\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=810873970f4c14a46ea24107bd593eb061fa3ede7783cea6cda597c73af9baad" worker1 # [ 459.304489] nix-grpc-daemon[1057]: time=2026-11-07T15:15:14.612Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91f819348ba76a333b8ed31cc1cdf6e50b82f8dd44f421dd10106013f599139d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91f819348ba76a333b8ed31cc1cdf6e50b82f8dd44f421dd10106013f599139d" worker1 # [ 460.456347] nix-grpc-daemon[1057]: time=2026-11-07T15:15:15.764Z level=WARN msg="Request failed, retrying" attempt=2 backoff=218.853036ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=810873970f4c14a46ea24107bd593eb061fa3ede7783cea6cda597c73af9baad\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=810873970f4c14a46ea24107bd593eb061fa3ede7783cea6cda597c73af9baad" worker1 # [ 461.351368] nix-grpc-daemon[1057]: time=2026-11-07T15:15:16.659Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fed2b31887eb830c3bd6df678dedb2973911499f82e0a61ab24a197c251eabc9\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fed2b31887eb830c3bd6df678dedb2973911499f82e0a61ab24a197c251eabc9" worker1 # [ 462.504338] nix-grpc-daemon[1057]: time=2026-11-07T15:15:17.812Z level=WARN msg="Request failed, retrying" attempt=2 backoff=199.336312ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c346a8997ef489a2d34981e47c6b8902fb3a469f6968b2f989163d5b758d5d5\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c346a8997ef489a2d34981e47c6b8902fb3a469f6968b2f989163d5b758d5d5" worker1 # [ 463.527870] nix-grpc-daemon[1057]: time=2026-11-07T15:15:18.835Z level=WARN msg="Request failed, retrying" attempt=2 backoff=195.882856ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fed2b31887eb830c3bd6df678dedb2973911499f82e0a61ab24a197c251eabc9\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fed2b31887eb830c3bd6df678dedb2973911499f82e0a61ab24a197c251eabc9" worker1 # [ 464.553851] nix-grpc-daemon[1057]: time=2026-11-07T15:15:19.860Z level=WARN msg="Request failed, retrying" attempt=2 backoff=205.65462ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91f819348ba76a333b8ed31cc1cdf6e50b82f8dd44f421dd10106013f599139d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91f819348ba76a333b8ed31cc1cdf6e50b82f8dd44f421dd10106013f599139d" worker1 # [ 465.768596] nix-grpc-daemon[1057]: time=2026-11-07T15:15:21.076Z level=WARN msg="Request failed, retrying" attempt=3 backoff=392.155655ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91f819348ba76a333b8ed31cc1cdf6e50b82f8dd44f421dd10106013f599139d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91f819348ba76a333b8ed31cc1cdf6e50b82f8dd44f421dd10106013f599139d" worker1 # [ 466.791285] nix-grpc-daemon[1057]: time=2026-11-07T15:15:22.099Z level=WARN msg="Request failed, retrying" attempt=3 backoff=386.895498ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fed2b31887eb830c3bd6df678dedb2973911499f82e0a61ab24a197c251eabc9\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fed2b31887eb830c3bd6df678dedb2973911499f82e0a61ab24a197c251eabc9" worker1 # [ 467.559287] nix-grpc-daemon[1057]: time=2026-11-07T15:15:22.867Z level=WARN msg="Request failed, retrying" attempt=2 backoff=182.702162ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1f57bd794ebece3c8560fda1d8b8aa2f07a84872fb8e5671ba38c78d347a2ccf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1f57bd794ebece3c8560fda1d8b8aa2f07a84872fb8e5671ba38c78d347a2ccf" worker1 # [ 468.776170] nix-grpc-daemon[1057]: time=2026-11-07T15:15:24.084Z level=WARN msg="Request failed, retrying" attempt=3 backoff=392.131541ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1f57bd794ebece3c8560fda1d8b8aa2f07a84872fb8e5671ba38c78d347a2ccf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1f57bd794ebece3c8560fda1d8b8aa2f07a84872fb8e5671ba38c78d347a2ccf" worker1 # [ 469.864314] nix-grpc-daemon[1057]: time=2026-11-07T15:15:25.172Z level=WARN msg="Request failed, retrying" attempt=3 backoff=401.690719ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c346a8997ef489a2d34981e47c6b8902fb3a469f6968b2f989163d5b758d5d5\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c346a8997ef489a2d34981e47c6b8902fb3a469f6968b2f989163d5b758d5d5" worker1 # [ 470.247456] nix-grpc-daemon[1057]: time=2026-11-07T15:15:25.555Z level=WARN msg="Request failed, retrying" attempt=4 backoff=741.012637ms error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fed2b31887eb830c3bd6df678dedb2973911499f82e0a61ab24a197c251eabc9\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fed2b31887eb830c3bd6df678dedb2973911499f82e0a61ab24a197c251eabc9" worker1 # [ 471.272151] nix-grpc-daemon[1057]: time=2026-11-07T15:15:26.579Z level=WARN msg="Request failed, retrying" attempt=4 backoff=799.661142ms error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91f819348ba76a333b8ed31cc1cdf6e50b82f8dd44f421dd10106013f599139d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91f819348ba76a333b8ed31cc1cdf6e50b82f8dd44f421dd10106013f599139d" worker1 # [ 472.231147] nix-grpc-daemon[1057]: time=2026-11-07T15:15:27.539Z level=WARN msg="Request failed, retrying" attempt=4 backoff=767.773996ms error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1f57bd794ebece3c8560fda1d8b8aa2f07a84872fb8e5671ba38c78d347a2ccf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1f57bd794ebece3c8560fda1d8b8aa2f07a84872fb8e5671ba38c78d347a2ccf" worker1 # [ 473.384339] nix-grpc-daemon[1057]: time=2026-11-07T15:15:28.692Z level=WARN msg="Request failed, retrying" attempt=4 backoff=829.197274ms error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c346a8997ef489a2d34981e47c6b8902fb3a469f6968b2f989163d5b758d5d5\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c346a8997ef489a2d34981e47c6b8902fb3a469f6968b2f989163d5b758d5d5" worker1 # [ 475.048382] nix-grpc-daemon[1057]: time=2026-11-07T15:15:30.356Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.623453651s error="Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1f57bd794ebece3c8560fda1d8b8aa2f07a84872fb8e5671ba38c78d347a2ccf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1f57bd794ebece3c8560fda1d8b8aa2f07a84872fb8e5671ba38c78d347a2ccf" worker1 # [ 475.239425] nix-grpc-daemon[1057]: time=2026-11-07T15:15:30.547Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.567537425s error="Put \"http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c346a8997ef489a2d34981e47c6b8902fb3a469f6968b2f989163d5b758d5d5\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/5g2krgx4inyydhy0jrhhylv4xhhlm7j7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c346a8997ef489a2d34981e47c6b8902fb3a469f6968b2f989163d5b758d5d5" worker1 # [ 479.271967] nix-grpc-daemon[1057]: time=2026-11-07T15:15:34.579Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.564994277s error="Put \"http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91f819348ba76a333b8ed31cc1cdf6e50b82f8dd44f421dd10106013f599139d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/6finahhb2q4vla8rjb6gi4z4cvf71qmc.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=91f819348ba76a333b8ed31cc1cdf6e50b82f8dd44f421dd10106013f599139d" worker1 # [ 480.295933] nix-grpc-daemon[1057]: time=2026-11-07T15:15:35.603Z level=WARN msg="Request failed, retrying" attempt=3 backoff=385.077134ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=810873970f4c14a46ea24107bd593eb061fa3ede7783cea6cda597c73af9baad\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=810873970f4c14a46ea24107bd593eb061fa3ede7783cea6cda597c73af9baad" worker1 # [ 480.684524] nix-grpc-daemon[1057]: time=2026-11-07T15:15:35.993Z level=WARN msg="Request failed, retrying" attempt=4 backoff=798.149412ms error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=810873970f4c14a46ea24107bd593eb061fa3ede7783cea6cda597c73af9baad\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=810873970f4c14a46ea24107bd593eb061fa3ede7783cea6cda597c73af9baad" worker1 # [ 481.485453] nix-grpc-daemon[1057]: time=2026-11-07T15:15:36.793Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.645482658s error="Put \"http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=810873970f4c14a46ea24107bd593eb061fa3ede7783cea6cda597c73af9baad\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=810873970f4c14a46ea24107bd593eb061fa3ede7783cea6cda597c73af9baad" [e2e] heartbeat t=420s worker1 # [ 482.920715] nix-grpc-daemon[1057]: time=2026-11-07T15:15:38.228Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.66686403s error="Put \"http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fed2b31887eb830c3bd6df678dedb2973911499f82e0a61ab24a197c251eabc9\": uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1f57bd794ebece3c8560fda1d8b8aa2f07a84872fb8e5671ba38c78d347a2ccf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0ppnnsmr641nka691g6vrp1crps1bbn31zm7nc5za9pl2y2iwb0f.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fed2b31887eb830c3bd6df678dedb2973911499f82e0a61ab24a197c251eabc9" worker1 # [ 482.965861] nix-grpc-daemon[1057]: time=2026-11-07T15:15:38.228Z level=WARN msg="Request failed, retrying" attempt=4 backoff=742.705161ms error="Put \"http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=21e8556ea4abdb4f3c1e43fe09e232f1540fd1d3a391832a6c7ae7af482010c3\": uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1f57bd794ebece3c8560fda1d8b8aa2f07a84872fb8e5671ba38c78d347a2ccf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=21e8556ea4abdb4f3c1e43fe09e232f1540fd1d3a391832a6c7ae7af482010c3" client # [ 482.989718] sshd-session[3304]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 482.993442] sshd-session[3304]: Disconnected from user root UNKNOWN port 65535 client # [ 482.996792] sshd-session[3298]: pam_unix(sshd:session): session closed for user root worker1 # [ 482.996196] nix-grpc-daemon[1057]: time=2026-11-07T15:15:38.228Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1f57bd794ebece3c8560fda1d8b8aa2f07a84872fb8e5671ba38c78d347a2ccf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=3 worker1 # [ 483.008144] nix-daemon[1026]: reaped child process 1796, status = succeeded client # [ 483.004206] systemd[1]: sshd-vsock@196-197-3:22-2:196.service: Deactivated successfully. client # [ 483.013213] systemd[1]: session-198.scope: Deactivated successfully. client # [ 483.016422] systemd[1]: session-198.scope: Consumed 253ms CPU time over 2min 26.336s wall clock time, 44.3M memory peak, 8K written to disk, 15.1K incoming IP traffic, 16.9K outgoing IP traffic. client # [ 483.023647] systemd-logind[465]: Session 198 logged out. Waiting for processes to exit. client # [ 483.027310] systemd-logind[465]: Removed session 198. thread 'farm::serial::a_niks3_restart_does_not_cost_the_leader_its_role' (1455) panicked at harness.rs:216:5: assertion `left == right` failed: [client] failed (1): sh -c 'exec "$@" >&2' sh nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.pem&client-key=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.key' --eval-store auto -f /nix/store/k21whgkqjvpyl87rq4aj8qjpawh8ywii-job.nix --argstr tag after-niks3-restart don't know how to build these paths: /nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv copying 3 paths to 'lb:50051'... copying path '/nix/store/6finahhb2q4vla8rjb6gi4z4cvf71qmc-farm-a.drv' to 'lb:50051'... copying path '/nix/store/5g2krgx4inyydhy0jrhhylv4xhhlm7j7-farm-b.drv' to 'lb:50051'... copying path '/nix/store/v0ppd6w8hc0jlggdq33p3mhzyjib8r6c-farm-top.drv' to 'lb:50051'... lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151312Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c0b06ed89d7a562dc30e811ff1b6a46df828ceb3259ce8eb74e1fcb6db8e391b": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151329Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=54ad34a786e5468525325717a2d3b1fccdbf6e1c8859a5d5adbe6b4b0bf1f266": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151344Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7e54f9efdd1f9ae574ca04853474edf68e6b31f961642d83c5fe451e6b368b41": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151415Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9695dde598e053cb3d1e80e900cf30aa8e3e65c7235c7d344f3df9d1724346a5": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading NAR nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0sjnwmbwn7i8g7g7czwn9r2pzaaa1j1yx3dfa4gw29ynhmpz9v3j.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151448Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3583dcf204136616ad49fc2abc219cc701ae536c82fbab4ec3571e1678a8b5e0": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying error: gRPC AddMultipleToStore on 'lb:50051' failed: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading NAR nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0wjrljh500qj2dh74gryz4ik45bn1iv9w72490z0f2w0l2x4c87h.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151509Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1f57bd794ebece3c8560fda1d8b8aa2f07a84872fb8e5671ba38c78d347a2ccf": dial tcp [2001:db8:1::2]:9000: connect: connection refused hint: Set NIX_GRPC_DEBUG=1 for a handshake trace. left: 1 right: 0 FAILED test farm::serial::a_recovery_that_throws_fails_only_its_job ... worker1 # [ 483.078729] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 483.082834] systemd[1]: Started SSH per-connection Daemon (vsock:2:34). worker1 # [ 483.132879] sshd-session[1803]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 483.138316] sshd-session[1803]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 483.144781] sshd-session[1803]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 483.157712] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 483.163451] systemd-logind[608]: New session '40' of user 'root' with class 'user' and type 'tty'. worker1 # [ 483.181043] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 483.184856] systemd[1]: Starting User Manager for UID 0... worker1 # [ 483.201578] (systemd)[1811]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 483.205721] systemd-logind[608]: New session '41' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 483.287889] systemd[1811]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 483.366689] systemd[1811]: Queued start job for default target Main User Target. worker1 # [ 483.368642] systemd[1811]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 483.371128] systemd[1811]: Created slice User Application Slice. worker1 # [ 483.372336] systemd[1811]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 483.374168] systemd[1811]: Reached target Paths. worker1 # [ 483.375035] systemd[1811]: Reached target Timers. worker1 # [ 483.377159] systemd[1811]: Starting D-Bus User Message Bus Socket... worker1 # [ 483.379736] systemd[1811]: Starting Create User Files and Directories... worker1 # [ 483.406350] systemd[1811]: Finished Create User Files and Directories. worker1 # [ 483.409581] systemd[1811]: Listening on D-Bus User Message Bus Socket. worker1 # [ 483.410940] systemd[1811]: Reached target Sockets. worker1 # [ 483.412109] systemd[1811]: Reached target Basic System. worker1 # [ 483.413298] systemd[1811]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 483.415206] systemd[1811]: Reached target Main User Target. worker1 # [ 483.418108] systemd[1811]: Startup finished in 196ms. worker1 # [ 483.418975] systemd[1]: Started User Manager for UID 0. worker1 # [ 483.420615] systemd[1]: Started Session 40 of User root. worker1 # [ 483.447755] sshd-session[1825]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 483.449467] sshd-session[1825]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 483.450728] sshd-session[1803]: pam_unix(sshd:session): session closed for user root worker1 # [ 483.453716] systemd[1]: sshd-vsock@34-35-5:22-2:34.service: Deactivated successfully. worker1 # [ 483.457417] systemd[1]: session-40.scope: Deactivated successfully. worker1 # [ 483.460633] systemd-logind[608]: Session 40 logged out. Waiting for processes to exit. worker1 # [ 483.462752] systemd-logind[608]: Removed session 40. worker2 # [ 483.481589] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 483.491463] systemd[1]: Started SSH per-connection Daemon (vsock:2:25). worker2 # [ 483.559587] sshd-session[1873]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 483.565380] sshd-session[1873]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 483.570720] sshd-session[1873]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 483.583909] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 483.589418] systemd-logind[555]: New session '30' of user 'root' with class 'user' and type 'tty'. worker2 # [ 483.606626] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 483.610420] systemd[1]: Starting User Manager for UID 0... worker2 # [ 483.626609] (systemd)[1881]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 483.630986] systemd-logind[555]: New session '31' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 483.706573] systemd[1881]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 483.775552] systemd[1881]: Queued start job for default target Main User Target. worker2 # [ 483.777613] systemd[1881]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 483.779878] systemd[1881]: Created slice User Application Slice. worker2 # [ 483.781912] systemd[1881]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 483.782955] systemd[1881]: Reached target Paths. worker2 # [ 483.783654] systemd[1881]: Reached target Timers. worker2 # [ 483.785073] systemd[1881]: Starting D-Bus User Message Bus Socket... worker2 # [ 483.787073] systemd[1881]: Starting Create User Files and Directories... worker2 # [ 483.811134] systemd[1881]: Finished Create User Files and Directories. worker2 # [ 483.814078] systemd[1881]: Listening on D-Bus User Message Bus Socket. worker2 # [ 483.815148] systemd[1881]: Reached target Sockets. worker2 # [ 483.815787] systemd[1881]: Reached target Basic System. worker2 # [ 483.817171] systemd[1881]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 483.819140] systemd[1881]: Reached target Main User Target. worker2 # [ 483.819888] systemd[1881]: Startup finished in 175ms. worker2 # [ 483.821931] systemd[1]: Started User Manager for UID 0. worker2 # [ 483.823293] systemd[1]: Started Session 30 of User root. worker2 # [ 483.846379] sshd-session[1894]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 483.848126] sshd-session[1894]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 483.849449] sshd-session[1873]: pam_unix(sshd:session): session closed for user root worker2 # [ 483.852473] systemd[1]: sshd-vsock@25-26-6:22-2:25.service: Deactivated successfully. worker2 # [ 483.856584] systemd[1]: session-30.scope: Deactivated successfully. worker2 # [ 483.859336] systemd-logind[555]: Session 30 logged out. Waiting for processes to exit. worker2 # [ 483.861257] systemd-logind[555]: Removed session 30. lb # [ 483.883514] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 483.892376] systemd[1]: Started SSH per-connection Daemon (vsock:2:30). lb # [ 483.961154] sshd-session[1571]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 483.966391] sshd-session[1571]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 483.971878] sshd-session[1571]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 483.985037] systemd-logind[553]: New session '36' of user 'root' with class 'user' and type 'tty'. lb # [ 483.992064] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 484.014582] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 484.018879] systemd[1]: Starting User Manager for UID 0... lb # [ 484.034636] (systemd)[1580]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 484.038777] systemd-logind[553]: New session '37' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 484.115523] systemd[1580]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 484.185953] systemd[1580]: Queued start job for default target Main User Target. lb # [ 484.188708] systemd[1580]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 484.191029] systemd[1580]: Created slice User Application Slice. lb # [ 484.192049] systemd[1580]: Started Daily Cleanup of User's Temporary Directories. lb # [ 484.193176] systemd[1580]: Reached target Paths. lb # [ 484.194261] systemd[1580]: Reached target Timers. lb # [ 484.196682] systemd[1580]: Starting D-Bus User Message Bus Socket... lb # [ 484.197947] systemd[1580]: Starting Create User Files and Directories... lb # [ 484.224879] systemd[1580]: Finished Create User Files and Directories. lb # [ 484.228407] systemd[1580]: Listening on D-Bus User Message Bus Socket. lb # [ 484.229790] systemd[1580]: Reached target Sockets. lb # [ 484.230536] systemd[1580]: Reached target Basic System. lb # [ 484.231685] systemd[1580]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 484.233662] systemd[1580]: Reached target Main User Target. lb # [ 484.235559] systemd[1580]: Startup finished in 179ms. lb # [ 484.236340] systemd[1]: Started User Manager for UID 0. lb # [ 484.238244] systemd[1]: Started Session 36 of User root. lb # [ 484.264887] sshd-session[1594]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 484.266690] sshd-session[1594]: Disconnected from user root UNKNOWN port 65535 lb # [ 484.267947] sshd-session[1571]: pam_unix(sshd:session): session closed for user root lb # [ 484.271146] systemd[1]: sshd-vsock@30-31-4:22-2:30.service: Deactivated successfully. lb # [ 484.274648] systemd[1]: session-36.scope: Deactivated successfully. lb # [ 484.276147] systemd[1]: session-36.scope: Consumed 16ms CPU time over 37ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 484.279768] systemd-logind[553]: Session 36 logged out. Waiting for processes to exit. lb # [ 484.281360] systemd-logind[553]: Removed session 36. worker1 # [ 484.286774] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 484.295590] systemd[1]: Started SSH per-connection Daemon (vsock:2:35). worker1 # [ 484.363496] sshd-session[1831]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 484.368604] sshd-session[1831]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 484.374165] sshd-session[1831]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 484.380450] systemd-logind[608]: New session '42' of user 'root' with class 'user' and type 'tty'. worker1 # [ 484.384337] systemd[1]: Started Session 42 of User root. worker1 # [ 484.409095] sshd-session[1837]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 484.410370] sshd-session[1837]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 484.411564] sshd-session[1831]: pam_unix(sshd:session): session closed for user root worker1 # [ 484.415151] systemd[1]: sshd-vsock@35-36-5:22-2:35.service: Deactivated successfully. worker1 # [ 484.418392] systemd[1]: session-42.scope: Deactivated successfully. worker1 # [ 484.419730] systemd[1]: session-42.scope: Consumed 15ms CPU time over 35ms wall clock time, 3.1M memory peak, 17.6K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 484.422694] systemd-logind[608]: Session 42 logged out. Waiting for processes to exit. worker1 # [ 484.425165] systemd-logind[608]: Removed session 42. client # [ 484.481890] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 484.491142] systemd[1]: Started SSH per-connection Daemon (vsock:2:197). client # [ 484.555865] sshd-session[3329]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 484.561144] sshd-session[3329]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 484.566527] sshd-session[3329]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 484.572224] systemd-logind[465]: New session '199' of user 'root' with class 'user' and type 'tty'. client # [ 484.576504] systemd[1]: Started Session 199 of User root. client # [ 484.688327] sshd-session[3335]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 484.690246] sshd-session[3335]: Disconnected from user root UNKNOWN port 65535 client # [ 484.691573] sshd-session[3329]: pam_unix(sshd:session): session closed for user root client # [ 484.694704] systemd[1]: sshd-vsock@197-198-3:22-2:197.service: Deactivated successfully. client # [ 484.698523] systemd[1]: session-199.scope: Deactivated successfully. client # [ 484.701753] systemd-logind[465]: Session 199 logged out. Waiting for processes to exit. client # [ 484.704088] systemd-logind[465]: Removed session 199. client # [ 484.781226] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 484.790524] systemd[1]: Started SSH per-connection Daemon (vsock:2:198). client # [ 484.848329] sshd-session[3342]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 484.853350] sshd-session[3342]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 484.858680] sshd-session[3342]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 484.865072] systemd-logind[465]: New session '200' of user 'root' with class 'user' and type 'tty'. client # [ 484.868408] systemd[1]: Started Session 200 of User root. worker1 # [ 484.976878] nix-grpc-daemon[529]: ts=2026-11-07T15:15:40Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:47690 lb # [ 484.989937] garage[913]: 2026-11-07T15:15:40.257385Z INFO garage_api_common::generic_server: 127.0.0.1:52278 (key GK0123456789abcdef01234567) HEAD /farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.narinfo lb # [ 484.998890] garage[913]: 2026-11-07T15:15:40.265445Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 485.002369] nix-grpc-daemon[529]: ts=2026-11-07T15:15:40Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:47690 worker1 # [ 485.015577] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 485.123342] nix-daemon[1026]: accepted connection from pid 1846, user nix-grpc-daemon (trusted) worker1 # [ 485.137674] nix-daemon[1026]: reaped child process 1849, status = succeeded lb # [ 485.142910] niks3-server[1503]: 2026/11/07 15:15:40 INFO Received push request method=POST path=/api/pushes worker1 # [ 485.154113] nix-grpc-daemon[1057]: time=2026-11-07T15:15:40.462Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 485.156208] nix-grpc-daemon[1057]: time=2026-11-07T15:15:40.464Z level=INFO msg="Uploading 41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca (120B)" worker1 # [ 485.159607] nix-grpc-daemon[1057]: time=2026-11-07T15:15:40.468Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7968177745e45271796abc3a18844860ab156669b1e442d8172d5309485a82a8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7968177745e45271796abc3a18844860ab156669b1e442d8172d5309485a82a8" worker1 # [ 485.168113] nix-grpc-daemon[1057]: time=2026-11-07T15:15:40.468Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45fb787cf421e59cddca1f0f271a5347068d47ede591df5836574b13907ee624\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45fb787cf421e59cddca1f0f271a5347068d47ede591df5836574b13907ee624" worker1 # [ 485.264490] nix-grpc-daemon[1057]: time=2026-11-07T15:15:40.572Z level=WARN msg="Request failed, retrying" attempt=2 backoff=192.050445ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45fb787cf421e59cddca1f0f271a5347068d47ede591df5836574b13907ee624\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45fb787cf421e59cddca1f0f271a5347068d47ede591df5836574b13907ee624" worker1 # [ 486.312358] nix-grpc-daemon[1057]: time=2026-11-07T15:15:41.620Z level=WARN msg="Request failed, retrying" attempt=2 backoff=196.3268ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7968177745e45271796abc3a18844860ab156669b1e442d8172d5309485a82a8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7968177745e45271796abc3a18844860ab156669b1e442d8172d5309485a82a8" worker1 # [ 487.528339] nix-grpc-daemon[1057]: time=2026-11-07T15:15:42.836Z level=WARN msg="Request failed, retrying" attempt=3 backoff=370.81464ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7968177745e45271796abc3a18844860ab156669b1e442d8172d5309485a82a8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7968177745e45271796abc3a18844860ab156669b1e442d8172d5309485a82a8" worker1 # [ 488.552474] nix-grpc-daemon[1057]: time=2026-11-07T15:15:43.860Z level=WARN msg="Request failed, retrying" attempt=3 backoff=392.126862ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45fb787cf421e59cddca1f0f271a5347068d47ede591df5836574b13907ee624\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45fb787cf421e59cddca1f0f271a5347068d47ede591df5836574b13907ee624" lb # [ 488.599486] envoy[912]: conn peer=[2001:db8:1::1]:57058 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=8149 tx=4470 ms=146173 worker1 # [ 489.960504] nix-grpc-daemon[1057]: time=2026-11-07T15:15:45.268Z level=WARN msg="Request failed, retrying" attempt=4 backoff=811.361153ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45fb787cf421e59cddca1f0f271a5347068d47ede591df5836574b13907ee624\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45fb787cf421e59cddca1f0f271a5347068d47ede591df5836574b13907ee624" worker1 # [ 491.816424] nix-grpc-daemon[1057]: time=2026-11-07T15:15:47.124Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.449154676s error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45fb787cf421e59cddca1f0f271a5347068d47ede591df5836574b13907ee624\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45fb787cf421e59cddca1f0f271a5347068d47ede591df5836574b13907ee624" worker1 # [ 493.032520] nix-grpc-daemon[1057]: time=2026-11-07T15:15:48.340Z level=WARN msg="Request failed, retrying" attempt=4 backoff=745.432485ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7968177745e45271796abc3a18844860ab156669b1e442d8172d5309485a82a8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7968177745e45271796abc3a18844860ab156669b1e442d8172d5309485a82a8" worker2 # [ 493.987169] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 493.995431] systemd[1881]: Activating special unit Exit the Session... worker2 # [ 493.997598] systemd[1881]: Stopped target Main User Target. worker2 # [ 494.003112] systemd[1881]: Stopped target Basic System. worker2 # [ 494.005578] systemd[1881]: Stopped target Paths. worker2 # [ 494.009356] systemd[1881]: Stopped target Sockets. worker2 # [ 494.011832] systemd[1881]: Stopped target Timers. worker2 # [ 494.014924] systemd[1881]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 494.017977] systemd[1881]: Closed D-Bus User Message Bus Socket. worker2 # [ 494.020877] systemd[1881]: Stopped Create User Files and Directories. worker2 # [ 494.025306] systemd[1881]: Removed slice User Application Slice. worker2 # [ 494.027301] systemd[1881]: Reached target Shutdown. worker2 # [ 494.029692] systemd[1881]: Finished Exit the Session. worker2 # [ 494.034274] systemd[1881]: Reached target Exit the Session. worker2 # [ 494.039230] systemd-logind[555]: Removed session 31. worker2 # [ 494.043744] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 494.047149] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 494.054527] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 494.073718] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 494.075544] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 494.077037] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 494.336562] systemd[1]: Stopping User Manager for UID 0... lb # [ 494.344949] systemd[1580]: Activating special unit Exit the Session... lb # [ 494.349160] systemd[1580]: Stopped target Main User Target. lb # [ 494.352395] systemd[1580]: Stopped target Basic System. lb # [ 494.355669] systemd[1580]: Stopped target Paths. lb # [ 494.357957] systemd[1580]: Stopped target Sockets. lb # [ 494.361454] systemd[1580]: Stopped target Timers. lb # [ 494.365659] systemd[1580]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 494.368598] systemd[1580]: Closed D-Bus User Message Bus Socket. lb # [ 494.371556] systemd[1580]: Stopped Create User Files and Directories. lb # [ 494.375555] systemd[1580]: Removed slice User Application Slice. lb # [ 494.378883] systemd[1580]: Reached target Shutdown. lb # [ 494.381341] systemd[1580]: Finished Exit the Session. lb # [ 494.384758] systemd[1580]: Reached target Exit the Session. lb # [ 494.390829] systemd-logind[553]: Removed session 37. lb # [ 494.394755] systemd[1]: user@0.service: Deactivated successfully. lb # [ 494.398417] systemd[1]: Stopped User Manager for UID 0. lb # [ 494.417786] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 494.438259] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 494.440653] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 494.441797] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 494.629630] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 494.635983] systemd[1811]: Activating special unit Exit the Session... worker1 # [ 494.641761] systemd[1811]: Stopped target Main User Target. worker1 # [ 494.648478] systemd[1811]: Stopped target Basic System. worker1 # [ 494.651334] systemd[1811]: Stopped target Paths. worker1 # [ 494.654716] systemd[1811]: Stopped target Sockets. worker1 # [ 494.657608] systemd[1811]: Stopped target Timers. worker1 # [ 494.661943] systemd[1811]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 494.666385] systemd[1811]: Closed D-Bus User Message Bus Socket. worker1 # [ 494.669998] systemd[1811]: Stopped Create User Files and Directories. worker1 # [ 494.675284] systemd[1811]: Removed slice User Application Slice. worker1 # [ 494.677546] systemd[1811]: Reached target Shutdown. worker1 # [ 494.679924] systemd[1811]: Finished Exit the Session. worker1 # [ 494.683404] systemd[1811]: Reached target Exit the Session. worker1 # [ 494.685750] systemd-logind[608]: Removed session 41. worker1 # [ 494.688251] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 494.691486] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 494.703245] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 494.724893] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 494.726683] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 494.728118] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 494.824430] nix-grpc-daemon[1057]: time=2026-11-07T15:15:50.132Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.64993888s error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7968177745e45271796abc3a18844860ab156669b1e442d8172d5309485a82a8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7968177745e45271796abc3a18844860ab156669b1e442d8172d5309485a82a8" worker1 # [ 496.482240] nix-grpc-daemon[1057]: time=2026-11-07T15:15:51.787Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45fb787cf421e59cddca1f0f271a5347068d47ede591df5836574b13907ee624\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 496.508833] nix-daemon[1026]: reaped child process 1844, status = succeeded worker1 # [ 496.985747] nix-grpc-daemon[529]: ts=2026-11-07T15:15:52Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:47690 worker1 # [ 496.996178] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 497.108087] nix-daemon[1026]: accepted connection from pid 1862, user nix-grpc-daemon (trusted) worker1 # [ 497.122041] nix-daemon[1026]: reaped child process 1865, status = succeeded lb # [ 497.129262] niks3-server[1503]: 2026/11/07 15:15:52 INFO Received push request method=POST path=/api/pushes worker1 # [ 497.138427] nix-grpc-daemon[1057]: time=2026-11-07T15:15:52.447Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 497.140209] nix-grpc-daemon[1057]: time=2026-11-07T15:15:52.448Z level=INFO msg="Uploading 41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca (120B)" worker1 # [ 497.143680] nix-grpc-daemon[1057]: time=2026-11-07T15:15:52.452Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d9bccf7202911e63a6abdfce4dbb7cf75ab89b624ee9e83eadf598883f5f29e8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d9bccf7202911e63a6abdfce4dbb7cf75ab89b624ee9e83eadf598883f5f29e8" worker1 # [ 497.248725] nix-grpc-daemon[1057]: time=2026-11-07T15:15:52.557Z level=WARN msg="Request failed, retrying" attempt=2 backoff=187.467864ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d9bccf7202911e63a6abdfce4dbb7cf75ab89b624ee9e83eadf598883f5f29e8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d9bccf7202911e63a6abdfce4dbb7cf75ab89b624ee9e83eadf598883f5f29e8" worker1 # [ 498.472408] nix-grpc-daemon[1057]: time=2026-11-07T15:15:53.780Z level=WARN msg="Request failed, retrying" attempt=3 backoff=399.398109ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d9bccf7202911e63a6abdfce4dbb7cf75ab89b624ee9e83eadf598883f5f29e8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d9bccf7202911e63a6abdfce4dbb7cf75ab89b624ee9e83eadf598883f5f29e8" worker1 # [ 499.880538] nix-grpc-daemon[1057]: time=2026-11-07T15:15:55.188Z level=WARN msg="Request failed, retrying" attempt=4 backoff=868.836141ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d9bccf7202911e63a6abdfce4dbb7cf75ab89b624ee9e83eadf598883f5f29e8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d9bccf7202911e63a6abdfce4dbb7cf75ab89b624ee9e83eadf598883f5f29e8" worker1 # [ 500.753485] nix-grpc-daemon[1057]: time=2026-11-07T15:15:56.062Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.462562492s error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d9bccf7202911e63a6abdfce4dbb7cf75ab89b624ee9e83eadf598883f5f29e8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d9bccf7202911e63a6abdfce4dbb7cf75ab89b624ee9e83eadf598883f5f29e8" worker1 # [ 502.247751] nix-grpc-daemon[1057]: time=2026-11-07T15:15:57.555Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2395f3fc895a64a6fd675d5553413fa1e743dc5026bd0a4186f5ad5b3e3e1f39\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2395f3fc895a64a6fd675d5553413fa1e743dc5026bd0a4186f5ad5b3e3e1f39" worker1 # [ 503.399712] nix-grpc-daemon[1057]: time=2026-11-07T15:15:58.707Z level=WARN msg="Request failed, retrying" attempt=2 backoff=185.152116ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2395f3fc895a64a6fd675d5553413fa1e743dc5026bd0a4186f5ad5b3e3e1f39\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2395f3fc895a64a6fd675d5553413fa1e743dc5026bd0a4186f5ad5b3e3e1f39" worker1 # [ 504.616174] nix-grpc-daemon[1057]: time=2026-11-07T15:15:59.923Z level=WARN msg="Request failed, retrying" attempt=3 backoff=429.432467ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2395f3fc895a64a6fd675d5553413fa1e743dc5026bd0a4186f5ad5b3e3e1f39\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2395f3fc895a64a6fd675d5553413fa1e743dc5026bd0a4186f5ad5b3e3e1f39" worker1 # [ 506.088432] nix-grpc-daemon[1057]: time=2026-11-07T15:16:01.396Z level=WARN msg="Request failed, retrying" attempt=4 backoff=828.499346ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2395f3fc895a64a6fd675d5553413fa1e743dc5026bd0a4186f5ad5b3e3e1f39\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2395f3fc895a64a6fd675d5553413fa1e743dc5026bd0a4186f5ad5b3e3e1f39" worker1 # [ 506.920171] nix-grpc-daemon[1057]: time=2026-11-07T15:16:02.228Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.744611592s error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2395f3fc895a64a6fd675d5553413fa1e743dc5026bd0a4186f5ad5b3e3e1f39\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=2395f3fc895a64a6fd675d5553413fa1e743dc5026bd0a4186f5ad5b3e3e1f39" worker1 # [ 508.672549] nix-grpc-daemon[1057]: time=2026-11-07T15:16:03.977Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d9bccf7202911e63a6abdfce4dbb7cf75ab89b624ee9e83eadf598883f5f29e8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 508.700253] nix-daemon[1026]: reaped child process 1860, status = succeeded worker1 # [ 509.676694] nix-grpc-daemon[529]: ts=2026-11-07T15:16:04Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:47690 worker1 # [ 509.687324] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 509.796722] nix-daemon[1026]: accepted connection from pid 1869, user nix-grpc-daemon (trusted) worker1 # [ 509.810369] nix-daemon[1026]: reaped child process 1872, status = succeeded lb # [ 509.816711] niks3-server[1503]: 2026/11/07 15:16:05 INFO Received push request method=POST path=/api/pushes worker1 # [ 509.832064] nix-grpc-daemon[1057]: time=2026-11-07T15:16:05.140Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 509.833628] nix-grpc-daemon[1057]: time=2026-11-07T15:16:05.142Z level=INFO msg="Uploading 41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca (120B)" worker1 # [ 509.837544] nix-grpc-daemon[1057]: time=2026-11-07T15:16:05.146Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64f91dfdf100a4b794f2f7fa7bd3d8ac1fc67f4838eb07b9dbf3350994d6eb20\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64f91dfdf100a4b794f2f7fa7bd3d8ac1fc67f4838eb07b9dbf3350994d6eb20" worker1 # [ 509.845992] nix-grpc-daemon[1057]: time=2026-11-07T15:16:05.146Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=762e861c3b73f751f9601605478cba67f96946732acab9fb962805fba6e997cb\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=762e861c3b73f751f9601605478cba67f96946732acab9fb962805fba6e997cb" worker1 # [ 510.952331] nix-grpc-daemon[1057]: time=2026-11-07T15:16:06.260Z level=WARN msg="Request failed, retrying" attempt=2 backoff=186.771045ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64f91dfdf100a4b794f2f7fa7bd3d8ac1fc67f4838eb07b9dbf3350994d6eb20\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64f91dfdf100a4b794f2f7fa7bd3d8ac1fc67f4838eb07b9dbf3350994d6eb20" worker1 # [ 511.976617] nix-grpc-daemon[1057]: time=2026-11-07T15:16:07.284Z level=WARN msg="Request failed, retrying" attempt=2 backoff=187.339748ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=762e861c3b73f751f9601605478cba67f96946732acab9fb962805fba6e997cb\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=762e861c3b73f751f9601605478cba67f96946732acab9fb962805fba6e997cb" [e2e] heartbeat t=450s worker1 # [ 513.192209] nix-grpc-daemon[1057]: time=2026-11-07T15:16:08.499Z level=WARN msg="Request failed, retrying" attempt=3 backoff=438.284876ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=762e861c3b73f751f9601605478cba67f96946732acab9fb962805fba6e997cb\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=762e861c3b73f751f9601605478cba67f96946732acab9fb962805fba6e997cb" worker1 # [ 513.633673] nix-grpc-daemon[1057]: time=2026-11-07T15:16:08.942Z level=WARN msg="Request failed, retrying" attempt=4 backoff=778.470345ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=762e861c3b73f751f9601605478cba67f96946732acab9fb962805fba6e997cb\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=762e861c3b73f751f9601605478cba67f96946732acab9fb962805fba6e997cb" worker1 # [ 514.416773] nix-grpc-daemon[1057]: time=2026-11-07T15:16:09.724Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.507232491s error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=762e861c3b73f751f9601605478cba67f96946732acab9fb962805fba6e997cb\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=762e861c3b73f751f9601605478cba67f96946732acab9fb962805fba6e997cb" worker1 # [ 515.239422] nix-grpc-daemon[1057]: time=2026-11-07T15:16:10.547Z level=WARN msg="Request failed, retrying" attempt=3 backoff=386.913486ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64f91dfdf100a4b794f2f7fa7bd3d8ac1fc67f4838eb07b9dbf3350994d6eb20\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64f91dfdf100a4b794f2f7fa7bd3d8ac1fc67f4838eb07b9dbf3350994d6eb20" worker1 # [ 516.647928] nix-grpc-daemon[1057]: time=2026-11-07T15:16:11.955Z level=WARN msg="Request failed, retrying" attempt=4 backoff=756.475482ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64f91dfdf100a4b794f2f7fa7bd3d8ac1fc67f4838eb07b9dbf3350994d6eb20\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64f91dfdf100a4b794f2f7fa7bd3d8ac1fc67f4838eb07b9dbf3350994d6eb20" worker1 # [ 517.407896] nix-grpc-daemon[1057]: time=2026-11-07T15:16:12.716Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.599842614s error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64f91dfdf100a4b794f2f7fa7bd3d8ac1fc67f4838eb07b9dbf3350994d6eb20\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=64f91dfdf100a4b794f2f7fa7bd3d8ac1fc67f4838eb07b9dbf3350994d6eb20" worker1 # [ 520.039939] nix-grpc-daemon[1057]: time=2026-11-07T15:16:15.347Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=762e861c3b73f751f9601605478cba67f96946732acab9fb962805fba6e997cb\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 520.069476] nix-daemon[1026]: reaped child process 1867, status = succeeded worker1 # [ 522.062418] nix-grpc-daemon[529]: ts=2026-11-07T15:16:17Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:47690 worker1 # [ 522.068281] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 522.152467] nix-daemon[1026]: accepted connection from pid 1876, user nix-grpc-daemon (trusted) worker1 # [ 522.167150] nix-daemon[1026]: reaped child process 1879, status = succeeded lb # [ 522.169959] niks3-server[1503]: 2026/11/07 15:16:17 INFO Received push request method=POST path=/api/pushes worker1 # [ 522.183414] nix-grpc-daemon[1057]: time=2026-11-07T15:16:17.491Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 522.185263] nix-grpc-daemon[1057]: time=2026-11-07T15:16:17.493Z level=INFO msg="Uploading 41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca (120B)" worker1 # [ 522.188568] nix-grpc-daemon[1057]: time=2026-11-07T15:16:17.497Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b3121775c85335833b04cf21b598cc4619fe6d354fb7bd81e0533409b1c3fcea\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b3121775c85335833b04cf21b598cc4619fe6d354fb7bd81e0533409b1c3fcea" worker1 # [ 522.197294] nix-grpc-daemon[1057]: time=2026-11-07T15:16:17.505Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bae97abee3b8cce76c7877422fae3606ef603217822e2b708e3640820750d4c6\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bae97abee3b8cce76c7877422fae3606ef603217822e2b708e3640820750d4c6" worker1 # [ 522.291683] nix-grpc-daemon[1057]: time=2026-11-07T15:16:17.600Z level=WARN msg="Request failed, retrying" attempt=2 backoff=213.945728ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b3121775c85335833b04cf21b598cc4619fe6d354fb7bd81e0533409b1c3fcea\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b3121775c85335833b04cf21b598cc4619fe6d354fb7bd81e0533409b1c3fcea" worker1 # [ 523.303457] nix-grpc-daemon[1057]: time=2026-11-07T15:16:18.611Z level=WARN msg="Request failed, retrying" attempt=2 backoff=183.303866ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bae97abee3b8cce76c7877422fae3606ef603217822e2b708e3640820750d4c6\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bae97abee3b8cce76c7877422fae3606ef603217822e2b708e3640820750d4c6" worker1 # [ 524.520089] nix-grpc-daemon[1057]: time=2026-11-07T15:16:19.827Z level=WARN msg="Request failed, retrying" attempt=3 backoff=419.042668ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bae97abee3b8cce76c7877422fae3606ef603217822e2b708e3640820750d4c6\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bae97abee3b8cce76c7877422fae3606ef603217822e2b708e3640820750d4c6" worker1 # [ 525.608520] nix-grpc-daemon[1057]: time=2026-11-07T15:16:20.916Z level=WARN msg="Request failed, retrying" attempt=3 backoff=364.587659ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b3121775c85335833b04cf21b598cc4619fe6d354fb7bd81e0533409b1c3fcea\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b3121775c85335833b04cf21b598cc4619fe6d354fb7bd81e0533409b1c3fcea" worker1 # [ 527.016372] nix-grpc-daemon[1057]: time=2026-11-07T15:16:22.324Z level=WARN msg="Request failed, retrying" attempt=4 backoff=794.991231ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bae97abee3b8cce76c7877422fae3606ef603217822e2b708e3640820750d4c6\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bae97abee3b8cce76c7877422fae3606ef603217822e2b708e3640820750d4c6" worker1 # [ 527.814184] nix-grpc-daemon[1057]: time=2026-11-07T15:16:23.122Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.65653421s error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bae97abee3b8cce76c7877422fae3606ef603217822e2b708e3640820750d4c6\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bae97abee3b8cce76c7877422fae3606ef603217822e2b708e3640820750d4c6" worker1 # [ 529.064409] nix-grpc-daemon[1057]: time=2026-11-07T15:16:24.372Z level=WARN msg="Request failed, retrying" attempt=4 backoff=801.314588ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b3121775c85335833b04cf21b598cc4619fe6d354fb7bd81e0533409b1c3fcea\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b3121775c85335833b04cf21b598cc4619fe6d354fb7bd81e0533409b1c3fcea" worker1 # [ 530.920426] nix-grpc-daemon[1057]: time=2026-11-07T15:16:26.228Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.743013817s error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b3121775c85335833b04cf21b598cc4619fe6d354fb7bd81e0533409b1c3fcea\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b3121775c85335833b04cf21b598cc4619fe6d354fb7bd81e0533409b1c3fcea" worker1 # [ 532.669542] nix-grpc-daemon[1057]: time=2026-11-07T15:16:27.975Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b3121775c85335833b04cf21b598cc4619fe6d354fb7bd81e0533409b1c3fcea\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 532.696842] nix-daemon[1026]: reaped child process 1874, status = succeeded worker1 # [ 536.672996] nix-grpc-daemon[529]: ts=2026-11-07T15:16:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:47690 worker1 # [ 536.686127] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 536.795095] nix-daemon[1026]: accepted connection from pid 1883, user nix-grpc-daemon (trusted) worker1 # [ 536.808305] nix-daemon[1026]: reaped child process 1886, status = succeeded lb # [ 536.812268] niks3-server[1503]: 2026/11/07 15:16:32 INFO Received push request method=POST path=/api/pushes worker1 # [ 536.822839] nix-grpc-daemon[1057]: time=2026-11-07T15:16:32.131Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 536.824345] nix-grpc-daemon[1057]: time=2026-11-07T15:16:32.133Z level=INFO msg="Uploading 41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca (120B)" worker1 # [ 536.828418] nix-grpc-daemon[1057]: time=2026-11-07T15:16:32.137Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6d38624482b340f7e972450df944ccbdc5e7598894c2d547ed9d9fccd3d7381e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6d38624482b340f7e972450df944ccbdc5e7598894c2d547ed9d9fccd3d7381e" worker1 # [ 536.837270] nix-grpc-daemon[1057]: time=2026-11-07T15:16:32.145Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4fd9c88087b2a231ef20e0fb0b0198bacf3d4a9904d7cbf6cee2f6cf799feda0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4fd9c88087b2a231ef20e0fb0b0198bacf3d4a9904d7cbf6cee2f6cf799feda0" worker1 # [ 536.942605] nix-grpc-daemon[1057]: time=2026-11-07T15:16:32.250Z level=WARN msg="Request failed, retrying" attempt=2 backoff=181.867146ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6d38624482b340f7e972450df944ccbdc5e7598894c2d547ed9d9fccd3d7381e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6d38624482b340f7e972450df944ccbdc5e7598894c2d547ed9d9fccd3d7381e" worker1 # [ 536.963083] nix-grpc-daemon[1057]: time=2026-11-07T15:16:32.251Z level=WARN msg="Request failed, retrying" attempt=2 backoff=185.634681ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4fd9c88087b2a231ef20e0fb0b0198bacf3d4a9904d7cbf6cee2f6cf799feda0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4fd9c88087b2a231ef20e0fb0b0198bacf3d4a9904d7cbf6cee2f6cf799feda0" worker1 # [ 537.130606] nix-grpc-daemon[1057]: time=2026-11-07T15:16:32.438Z level=WARN msg="Request failed, retrying" attempt=3 backoff=433.127711ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6d38624482b340f7e972450df944ccbdc5e7598894c2d547ed9d9fccd3d7381e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6d38624482b340f7e972450df944ccbdc5e7598894c2d547ed9d9fccd3d7381e" worker1 # [ 537.568290] nix-grpc-daemon[1057]: time=2026-11-07T15:16:32.876Z level=WARN msg="Request failed, retrying" attempt=4 backoff=870.892099ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6d38624482b340f7e972450df944ccbdc5e7598894c2d547ed9d9fccd3d7381e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6d38624482b340f7e972450df944ccbdc5e7598894c2d547ed9d9fccd3d7381e" worker1 # [ 538.443901] nix-grpc-daemon[1057]: time=2026-11-07T15:16:33.751Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.517995195s error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6d38624482b340f7e972450df944ccbdc5e7598894c2d547ed9d9fccd3d7381e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6d38624482b340f7e972450df944ccbdc5e7598894c2d547ed9d9fccd3d7381e" worker1 # [ 539.239443] nix-grpc-daemon[1057]: time=2026-11-07T15:16:34.548Z level=WARN msg="Request failed, retrying" attempt=3 backoff=398.674295ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4fd9c88087b2a231ef20e0fb0b0198bacf3d4a9904d7cbf6cee2f6cf799feda0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4fd9c88087b2a231ef20e0fb0b0198bacf3d4a9904d7cbf6cee2f6cf799feda0" worker1 # [ 540.648552] nix-grpc-daemon[1057]: time=2026-11-07T15:16:35.956Z level=WARN msg="Request failed, retrying" attempt=4 backoff=793.983737ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4fd9c88087b2a231ef20e0fb0b0198bacf3d4a9904d7cbf6cee2f6cf799feda0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4fd9c88087b2a231ef20e0fb0b0198bacf3d4a9904d7cbf6cee2f6cf799feda0" worker1 # [ 541.445214] nix-grpc-daemon[1057]: time=2026-11-07T15:16:36.753Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.681457598s error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4fd9c88087b2a231ef20e0fb0b0198bacf3d4a9904d7cbf6cee2f6cf799feda0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4fd9c88087b2a231ef20e0fb0b0198bacf3d4a9904d7cbf6cee2f6cf799feda0" [e2e] heartbeat t=480s worker1 # [ 544.172193] nix-grpc-daemon[1057]: time=2026-11-07T15:16:39.476Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4fd9c88087b2a231ef20e0fb0b0198bacf3d4a9904d7cbf6cee2f6cf799feda0\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 544.201453] nix-daemon[1026]: reaped child process 1881, status = succeeded worker1 # [ 548.174860] nix-grpc-daemon[529]: ts=2026-11-07T15:16:43Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:47690 worker1 # [ 548.187616] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 548.298423] nix-daemon[1026]: accepted connection from pid 1890, user nix-grpc-daemon (trusted) worker1 # [ 548.312106] nix-daemon[1026]: reaped child process 1893, status = succeeded lb # [ 548.319773] niks3-server[1503]: 2026/11/07 15:16:43 INFO Received push request method=POST path=/api/pushes worker1 # [ 548.328554] nix-grpc-daemon[1057]: time=2026-11-07T15:16:43.637Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 548.330440] nix-grpc-daemon[1057]: time=2026-11-07T15:16:43.638Z level=INFO msg="Uploading 41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca (120B)" worker1 # [ 548.333986] nix-grpc-daemon[1057]: time=2026-11-07T15:16:43.642Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fb645f7b12cf5ad2f3e532ad4d049807cebec69c5680e9f59d1cf7fa1f662403\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fb645f7b12cf5ad2f3e532ad4d049807cebec69c5680e9f59d1cf7fa1f662403" worker1 # [ 548.342192] nix-grpc-daemon[1057]: time=2026-11-07T15:16:43.642Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b3887c9a6678bad45529ad27149b40f0ab41469702e5de9c2423e64b81ae499\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b3887c9a6678bad45529ad27149b40f0ab41469702e5de9c2423e64b81ae499" worker1 # [ 548.438830] nix-grpc-daemon[1057]: time=2026-11-07T15:16:43.747Z level=WARN msg="Request failed, retrying" attempt=2 backoff=187.892885ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fb645f7b12cf5ad2f3e532ad4d049807cebec69c5680e9f59d1cf7fa1f662403\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fb645f7b12cf5ad2f3e532ad4d049807cebec69c5680e9f59d1cf7fa1f662403" worker1 # [ 548.459562] nix-grpc-daemon[1057]: time=2026-11-07T15:16:43.747Z level=WARN msg="Request failed, retrying" attempt=2 backoff=194.482697ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b3887c9a6678bad45529ad27149b40f0ab41469702e5de9c2423e64b81ae499\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b3887c9a6678bad45529ad27149b40f0ab41469702e5de9c2423e64b81ae499" worker1 # [ 548.631524] nix-grpc-daemon[1057]: time=2026-11-07T15:16:43.940Z level=WARN msg="Request failed, retrying" attempt=3 backoff=437.994504ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fb645f7b12cf5ad2f3e532ad4d049807cebec69c5680e9f59d1cf7fa1f662403\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fb645f7b12cf5ad2f3e532ad4d049807cebec69c5680e9f59d1cf7fa1f662403" worker1 # [ 549.672629] nix-grpc-daemon[1057]: time=2026-11-07T15:16:44.980Z level=WARN msg="Request failed, retrying" attempt=3 backoff=361.520952ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b3887c9a6678bad45529ad27149b40f0ab41469702e5de9c2423e64b81ae499\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b3887c9a6678bad45529ad27149b40f0ab41469702e5de9c2423e64b81ae499" worker1 # [ 551.138698] nix-grpc-daemon[1057]: time=2026-11-07T15:16:46.447Z level=WARN msg="Request failed, retrying" attempt=4 backoff=857.261645ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b3887c9a6678bad45529ad27149b40f0ab41469702e5de9c2423e64b81ae499\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b3887c9a6678bad45529ad27149b40f0ab41469702e5de9c2423e64b81ae499" worker1 # [ 551.998155] nix-grpc-daemon[1057]: time=2026-11-07T15:16:47.306Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.694445681s error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b3887c9a6678bad45529ad27149b40f0ab41469702e5de9c2423e64b81ae499\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b3887c9a6678bad45529ad27149b40f0ab41469702e5de9c2423e64b81ae499" worker1 # [ 553.191352] nix-grpc-daemon[1057]: time=2026-11-07T15:16:48.499Z level=WARN msg="Request failed, retrying" attempt=4 backoff=817.964151ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fb645f7b12cf5ad2f3e532ad4d049807cebec69c5680e9f59d1cf7fa1f662403\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fb645f7b12cf5ad2f3e532ad4d049807cebec69c5680e9f59d1cf7fa1f662403" worker1 # [ 555.047835] nix-grpc-daemon[1057]: time=2026-11-07T15:16:50.355Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.689923377s error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fb645f7b12cf5ad2f3e532ad4d049807cebec69c5680e9f59d1cf7fa1f662403\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fb645f7b12cf5ad2f3e532ad4d049807cebec69c5680e9f59d1cf7fa1f662403" worker1 # [ 556.745170] nix-grpc-daemon[1057]: time=2026-11-07T15:16:52.050Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b3887c9a6678bad45529ad27149b40f0ab41469702e5de9c2423e64b81ae499\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 556.772469] nix-daemon[1026]: reaped child process 1888, status = succeeded worker1 # [ 560.749293] nix-grpc-daemon[529]: ts=2026-11-07T15:16:56Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:47690 worker1 # [ 560.759858] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 560.866142] nix-daemon[1026]: accepted connection from pid 1897, user nix-grpc-daemon (trusted) worker1 # [ 560.881284] nix-daemon[1026]: reaped child process 1900, status = succeeded lb # [ 560.885727] niks3-server[1503]: 2026/11/07 15:16:56 INFO Received push request method=POST path=/api/pushes worker1 # [ 560.895910] nix-grpc-daemon[1057]: time=2026-11-07T15:16:56.204Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 560.897876] nix-grpc-daemon[1057]: time=2026-11-07T15:16:56.206Z level=INFO msg="Uploading 41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca (120B)" worker1 # [ 560.901548] nix-grpc-daemon[1057]: time=2026-11-07T15:16:56.210Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cace7794a6307a7fb3b4c6a43cf7bf1ee13fe9b4f33e0a7330f30b06088852c8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cace7794a6307a7fb3b4c6a43cf7bf1ee13fe9b4f33e0a7330f30b06088852c8" worker1 # [ 560.910694] nix-grpc-daemon[1057]: time=2026-11-07T15:16:56.210Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7aaf8be37f0bfec80f608fb0c5692fe7391034da989541d6cd9beb7fb781cb53\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7aaf8be37f0bfec80f608fb0c5692fe7391034da989541d6cd9beb7fb781cb53" worker1 # [ 561.005651] nix-grpc-daemon[1057]: time=2026-11-07T15:16:56.314Z level=WARN msg="Request failed, retrying" attempt=2 backoff=192.617397ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7aaf8be37f0bfec80f608fb0c5692fe7391034da989541d6cd9beb7fb781cb53\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7aaf8be37f0bfec80f608fb0c5692fe7391034da989541d6cd9beb7fb781cb53" worker1 # [ 562.023623] nix-grpc-daemon[1057]: time=2026-11-07T15:16:57.331Z level=WARN msg="Request failed, retrying" attempt=2 backoff=182.148159ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cace7794a6307a7fb3b4c6a43cf7bf1ee13fe9b4f33e0a7330f30b06088852c8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cace7794a6307a7fb3b4c6a43cf7bf1ee13fe9b4f33e0a7330f30b06088852c8" worker1 # [ 563.240561] nix-grpc-daemon[1057]: time=2026-11-07T15:16:58.548Z level=WARN msg="Request failed, retrying" attempt=3 backoff=365.506523ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cace7794a6307a7fb3b4c6a43cf7bf1ee13fe9b4f33e0a7330f30b06088852c8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cace7794a6307a7fb3b4c6a43cf7bf1ee13fe9b4f33e0a7330f30b06088852c8" worker1 # [ 563.262220] nix-grpc-daemon[1057]: time=2026-11-07T15:16:58.548Z level=WARN msg="Request failed, retrying" attempt=3 backoff=419.141582ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7aaf8be37f0bfec80f608fb0c5692fe7391034da989541d6cd9beb7fb781cb53\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7aaf8be37f0bfec80f608fb0c5692fe7391034da989541d6cd9beb7fb781cb53" worker1 # [ 564.648322] nix-grpc-daemon[1057]: time=2026-11-07T15:16:59.956Z level=WARN msg="Request failed, retrying" attempt=4 backoff=768.517224ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cace7794a6307a7fb3b4c6a43cf7bf1ee13fe9b4f33e0a7330f30b06088852c8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cace7794a6307a7fb3b4c6a43cf7bf1ee13fe9b4f33e0a7330f30b06088852c8" worker1 # [ 565.419463] nix-grpc-daemon[1057]: time=2026-11-07T15:17:00.728Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.663029465s error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cace7794a6307a7fb3b4c6a43cf7bf1ee13fe9b4f33e0a7330f30b06088852c8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cace7794a6307a7fb3b4c6a43cf7bf1ee13fe9b4f33e0a7330f30b06088852c8" worker1 # [ 566.760289] nix-grpc-daemon[1057]: time=2026-11-07T15:17:02.068Z level=WARN msg="Request failed, retrying" attempt=4 backoff=760.413761ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7aaf8be37f0bfec80f608fb0c5692fe7391034da989541d6cd9beb7fb781cb53\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7aaf8be37f0bfec80f608fb0c5692fe7391034da989541d6cd9beb7fb781cb53" worker1 # [ 567.523608] nix-grpc-daemon[1057]: time=2026-11-07T15:17:02.832Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.492268097s error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7aaf8be37f0bfec80f608fb0c5692fe7391034da989541d6cd9beb7fb781cb53\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7aaf8be37f0bfec80f608fb0c5692fe7391034da989541d6cd9beb7fb781cb53" worker1 # [ 570.154666] nix-grpc-daemon[1057]: time=2026-11-07T15:17:05.460Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cace7794a6307a7fb3b4c6a43cf7bf1ee13fe9b4f33e0a7330f30b06088852c8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 570.182748] nix-daemon[1026]: reaped child process 1895, status = succeeded [e2e] heartbeat t=510s worker1 # [ 574.158694] nix-grpc-daemon[529]: ts=2026-11-07T15:17:09Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:47690 worker1 # [ 574.171179] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 574.283611] nix-daemon[1026]: accepted connection from pid 1904, user nix-grpc-daemon (trusted) worker1 # [ 574.298685] nix-daemon[1026]: reaped child process 1907, status = succeeded lb # [ 574.303595] niks3-server[1503]: 2026/11/07 15:17:09 INFO Received push request method=POST path=/api/pushes worker1 # [ 574.314512] nix-grpc-daemon[1057]: time=2026-11-07T15:17:09.623Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 574.316152] nix-grpc-daemon[1057]: time=2026-11-07T15:17:09.624Z level=INFO msg="Uploading 41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca (120B)" worker1 # [ 574.319994] nix-grpc-daemon[1057]: time=2026-11-07T15:17:09.628Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=47304e300a90035e4a345a6d687ead36739659def1fb672bbe532fd4b163dbbf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=47304e300a90035e4a345a6d687ead36739659def1fb672bbe532fd4b163dbbf" worker1 # [ 574.328239] nix-grpc-daemon[1057]: time=2026-11-07T15:17:09.628Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dba3e459218a53e2758f26e4268577bd2d9c96d74efa1b039249ee6f0f8a4daf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dba3e459218a53e2758f26e4268577bd2d9c96d74efa1b039249ee6f0f8a4daf" worker1 # [ 574.424633] nix-grpc-daemon[1057]: time=2026-11-07T15:17:09.732Z level=WARN msg="Request failed, retrying" attempt=2 backoff=204.407649ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dba3e459218a53e2758f26e4268577bd2d9c96d74efa1b039249ee6f0f8a4daf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dba3e459218a53e2758f26e4268577bd2d9c96d74efa1b039249ee6f0f8a4daf" worker1 # [ 574.447547] nix-grpc-daemon[1057]: time=2026-11-07T15:17:09.733Z level=WARN msg="Request failed, retrying" attempt=2 backoff=200.448977ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=47304e300a90035e4a345a6d687ead36739659def1fb672bbe532fd4b163dbbf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=47304e300a90035e4a345a6d687ead36739659def1fb672bbe532fd4b163dbbf" worker1 # [ 574.632133] nix-grpc-daemon[1057]: time=2026-11-07T15:17:09.940Z level=WARN msg="Request failed, retrying" attempt=3 backoff=421.566895ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=47304e300a90035e4a345a6d687ead36739659def1fb672bbe532fd4b163dbbf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=47304e300a90035e4a345a6d687ead36739659def1fb672bbe532fd4b163dbbf" worker1 # [ 575.656373] nix-grpc-daemon[1057]: time=2026-11-07T15:17:10.964Z level=WARN msg="Request failed, retrying" attempt=3 backoff=395.940771ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dba3e459218a53e2758f26e4268577bd2d9c96d74efa1b039249ee6f0f8a4daf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dba3e459218a53e2758f26e4268577bd2d9c96d74efa1b039249ee6f0f8a4daf" worker1 # [ 577.064657] nix-grpc-daemon[1057]: time=2026-11-07T15:17:12.372Z level=WARN msg="Request failed, retrying" attempt=4 backoff=766.141519ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dba3e459218a53e2758f26e4268577bd2d9c96d74efa1b039249ee6f0f8a4daf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dba3e459218a53e2758f26e4268577bd2d9c96d74efa1b039249ee6f0f8a4daf" worker1 # [ 577.837796] nix-grpc-daemon[1057]: time=2026-11-07T15:17:13.146Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.680727432s error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dba3e459218a53e2758f26e4268577bd2d9c96d74efa1b039249ee6f0f8a4daf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dba3e459218a53e2758f26e4268577bd2d9c96d74efa1b039249ee6f0f8a4daf" worker1 # [ 579.175478] nix-grpc-daemon[1057]: time=2026-11-07T15:17:14.483Z level=WARN msg="Request failed, retrying" attempt=4 backoff=865.348044ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=47304e300a90035e4a345a6d687ead36739659def1fb672bbe532fd4b163dbbf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=47304e300a90035e4a345a6d687ead36739659def1fb672bbe532fd4b163dbbf" worker1 # [ 581.096366] nix-grpc-daemon[1057]: time=2026-11-07T15:17:16.404Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.64886195s error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=47304e300a90035e4a345a6d687ead36739659def1fb672bbe532fd4b163dbbf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=47304e300a90035e4a345a6d687ead36739659def1fb672bbe532fd4b163dbbf" worker1 # [ 582.751550] nix-grpc-daemon[1057]: time=2026-11-07T15:17:18.058Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dba3e459218a53e2758f26e4268577bd2d9c96d74efa1b039249ee6f0f8a4daf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 582.779981] nix-daemon[1026]: reaped child process 1902, status = succeeded worker1 # [ 586.775598] nix-grpc-daemon[529]: ts=2026-11-07T15:17:22Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:47690 worker1 # [ 586.786988] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 586.896449] nix-daemon[1026]: accepted connection from pid 1911, user nix-grpc-daemon (trusted) worker1 # [ 586.911050] nix-daemon[1026]: reaped child process 1914, status = succeeded lb # [ 586.915399] niks3-server[1503]: 2026/11/07 15:17:22 INFO Received push request method=POST path=/api/pushes worker1 # [ 586.926791] nix-grpc-daemon[1057]: time=2026-11-07T15:17:22.235Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 586.928269] nix-grpc-daemon[1057]: time=2026-11-07T15:17:22.237Z level=INFO msg="Uploading 41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca (120B)" worker1 # [ 586.932147] nix-grpc-daemon[1057]: time=2026-11-07T15:17:22.240Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=049bbe32c530e1caf1424d072e609b757fe7a1d7f6e40de5e251e3370c61177e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=049bbe32c530e1caf1424d072e609b757fe7a1d7f6e40de5e251e3370c61177e" worker1 # [ 586.940890] nix-grpc-daemon[1057]: time=2026-11-07T15:17:22.249Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d26242681cbc96139058272e471718046816d351b0ca3eed1128f61ba01eb0b3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d26242681cbc96139058272e471718046816d351b0ca3eed1128f61ba01eb0b3" worker1 # [ 587.037327] nix-grpc-daemon[1057]: time=2026-11-07T15:17:22.345Z level=WARN msg="Request failed, retrying" attempt=2 backoff=196.40295ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=049bbe32c530e1caf1424d072e609b757fe7a1d7f6e40de5e251e3370c61177e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=049bbe32c530e1caf1424d072e609b757fe7a1d7f6e40de5e251e3370c61177e" worker1 # [ 587.062144] nix-grpc-daemon[1057]: time=2026-11-07T15:17:22.370Z level=WARN msg="Request failed, retrying" attempt=2 backoff=196.479117ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d26242681cbc96139058272e471718046816d351b0ca3eed1128f61ba01eb0b3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d26242681cbc96139058272e471718046816d351b0ca3eed1128f61ba01eb0b3" worker1 # [ 587.238536] nix-grpc-daemon[1057]: time=2026-11-07T15:17:22.547Z level=WARN msg="Request failed, retrying" attempt=3 backoff=421.63998ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=049bbe32c530e1caf1424d072e609b757fe7a1d7f6e40de5e251e3370c61177e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=049bbe32c530e1caf1424d072e609b757fe7a1d7f6e40de5e251e3370c61177e" worker1 # [ 587.264177] nix-grpc-daemon[1057]: time=2026-11-07T15:17:22.572Z level=WARN msg="Request failed, retrying" attempt=3 backoff=423.72317ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d26242681cbc96139058272e471718046816d351b0ca3eed1128f61ba01eb0b3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d26242681cbc96139058272e471718046816d351b0ca3eed1128f61ba01eb0b3" worker1 # [ 588.712767] nix-grpc-daemon[1057]: time=2026-11-07T15:17:24.020Z level=WARN msg="Request failed, retrying" attempt=4 backoff=876.977251ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d26242681cbc96139058272e471718046816d351b0ca3eed1128f61ba01eb0b3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d26242681cbc96139058272e471718046816d351b0ca3eed1128f61ba01eb0b3" worker1 # [ 589.592922] nix-grpc-daemon[1057]: time=2026-11-07T15:17:24.901Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.724981843s error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d26242681cbc96139058272e471718046816d351b0ca3eed1128f61ba01eb0b3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d26242681cbc96139058272e471718046816d351b0ca3eed1128f61ba01eb0b3" worker1 # [ 590.760264] nix-grpc-daemon[1057]: time=2026-11-07T15:17:26.068Z level=WARN msg="Request failed, retrying" attempt=4 backoff=835.992932ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=049bbe32c530e1caf1424d072e609b757fe7a1d7f6e40de5e251e3370c61177e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=049bbe32c530e1caf1424d072e609b757fe7a1d7f6e40de5e251e3370c61177e" worker1 # [ 592.616465] nix-grpc-daemon[1057]: time=2026-11-07T15:17:27.924Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.499600776s error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=049bbe32c530e1caf1424d072e609b757fe7a1d7f6e40de5e251e3370c61177e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=049bbe32c530e1caf1424d072e609b757fe7a1d7f6e40de5e251e3370c61177e" worker1 # [ 594.122650] nix-grpc-daemon[1057]: time=2026-11-07T15:17:29.428Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=049bbe32c530e1caf1424d072e609b757fe7a1d7f6e40de5e251e3370c61177e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 594.149760] nix-daemon[1026]: reaped child process 1909, status = succeeded worker1 # [ 598.126650] nix-grpc-daemon[529]: ts=2026-11-07T15:17:33Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:47690 worker1 # [ 598.138693] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 598.247532] nix-daemon[1026]: accepted connection from pid 1918, user nix-grpc-daemon (trusted) worker1 # [ 598.261410] nix-daemon[1026]: reaped child process 1921, status = succeeded lb # [ 598.267328] niks3-server[1503]: 2026/11/07 15:17:33 INFO Received push request method=POST path=/api/pushes worker1 # [ 598.277867] nix-grpc-daemon[1057]: time=2026-11-07T15:17:33.586Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 598.280111] nix-grpc-daemon[1057]: time=2026-11-07T15:17:33.588Z level=INFO msg="Uploading 41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca (120B)" worker1 # [ 598.283148] nix-grpc-daemon[1057]: time=2026-11-07T15:17:33.591Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=78df6210374af5a43032ccce3d13d799791c711589deeb00f2c8f1162ee0f8c1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=78df6210374af5a43032ccce3d13d799791c711589deeb00f2c8f1162ee0f8c1" worker1 # [ 598.291603] nix-grpc-daemon[1057]: time=2026-11-07T15:17:33.600Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b1fb400771f29374ad2d4687408bf0cc84cc6eaea003470910361ee4dc1c30cf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b1fb400771f29374ad2d4687408bf0cc84cc6eaea003470910361ee4dc1c30cf" worker1 # [ 598.396591] nix-grpc-daemon[1057]: time=2026-11-07T15:17:33.704Z level=WARN msg="Request failed, retrying" attempt=2 backoff=195.638367ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b1fb400771f29374ad2d4687408bf0cc84cc6eaea003470910361ee4dc1c30cf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b1fb400771f29374ad2d4687408bf0cc84cc6eaea003470910361ee4dc1c30cf" worker1 # [ 598.418270] nix-grpc-daemon[1057]: time=2026-11-07T15:17:33.705Z level=WARN msg="Request failed, retrying" attempt=2 backoff=184.39265ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=78df6210374af5a43032ccce3d13d799791c711589deeb00f2c8f1162ee0f8c1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=78df6210374af5a43032ccce3d13d799791c711589deeb00f2c8f1162ee0f8c1" worker1 # [ 598.585207] nix-grpc-daemon[1057]: time=2026-11-07T15:17:33.893Z level=WARN msg="Request failed, retrying" attempt=3 backoff=409.463528ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=78df6210374af5a43032ccce3d13d799791c711589deeb00f2c8f1162ee0f8c1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=78df6210374af5a43032ccce3d13d799791c711589deeb00f2c8f1162ee0f8c1" worker1 # [ 599.656382] nix-grpc-daemon[1057]: time=2026-11-07T15:17:34.964Z level=WARN msg="Request failed, retrying" attempt=3 backoff=401.867567ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b1fb400771f29374ad2d4687408bf0cc84cc6eaea003470910361ee4dc1c30cf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b1fb400771f29374ad2d4687408bf0cc84cc6eaea003470910361ee4dc1c30cf" worker1 # [ 601.063669] nix-grpc-daemon[1057]: time=2026-11-07T15:17:36.371Z level=WARN msg="Request failed, retrying" attempt=4 backoff=817.0619ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b1fb400771f29374ad2d4687408bf0cc84cc6eaea003470910361ee4dc1c30cf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b1fb400771f29374ad2d4687408bf0cc84cc6eaea003470910361ee4dc1c30cf" worker1 # [ 601.884569] nix-grpc-daemon[1057]: time=2026-11-07T15:17:37.193Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.546275411s error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b1fb400771f29374ad2d4687408bf0cc84cc6eaea003470910361ee4dc1c30cf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b1fb400771f29374ad2d4687408bf0cc84cc6eaea003470910361ee4dc1c30cf" [e2e] heartbeat t=540s worker1 # [ 603.112302] nix-grpc-daemon[1057]: time=2026-11-07T15:17:38.420Z level=WARN msg="Request failed, retrying" attempt=4 backoff=819.129907ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=78df6210374af5a43032ccce3d13d799791c711589deeb00f2c8f1162ee0f8c1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=78df6210374af5a43032ccce3d13d799791c711589deeb00f2c8f1162ee0f8c1" worker1 # [ 604.968347] nix-grpc-daemon[1057]: time=2026-11-07T15:17:40.276Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.694011452s error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=78df6210374af5a43032ccce3d13d799791c711589deeb00f2c8f1162ee0f8c1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=78df6210374af5a43032ccce3d13d799791c711589deeb00f2c8f1162ee0f8c1" worker1 # [ 606.668586] nix-grpc-daemon[1057]: time=2026-11-07T15:17:41.974Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b1fb400771f29374ad2d4687408bf0cc84cc6eaea003470910361ee4dc1c30cf\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 606.696820] nix-daemon[1026]: reaped child process 1916, status = succeeded worker1 # [ 610.671799] nix-grpc-daemon[529]: ts=2026-11-07T15:17:45Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:47690 worker1 # [ 610.685124] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 610.792647] nix-daemon[1026]: accepted connection from pid 1925, user nix-grpc-daemon (trusted) worker1 # [ 610.805834] nix-daemon[1026]: reaped child process 1928, status = succeeded lb # [ 610.815188] niks3-server[1503]: 2026/11/07 15:17:46 INFO Received push request method=POST path=/api/pushes worker1 # [ 610.824729] nix-grpc-daemon[1057]: time=2026-11-07T15:17:46.132Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 610.826498] nix-grpc-daemon[1057]: time=2026-11-07T15:17:46.133Z level=INFO msg="Uploading 41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca (120B)" worker1 # [ 610.829419] nix-grpc-daemon[1057]: time=2026-11-07T15:17:46.138Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a66a4aaa4b94b37a30a7fcfdd33f8937afb12611409d505bb13e9f36ce9cace3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a66a4aaa4b94b37a30a7fcfdd33f8937afb12611409d505bb13e9f36ce9cace3" worker1 # [ 610.838316] nix-grpc-daemon[1057]: time=2026-11-07T15:17:46.138Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9ab3565def8bb60c48edee980aa9dcb3e9640e7484dfb6841897ecd4fec125\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9ab3565def8bb60c48edee980aa9dcb3e9640e7484dfb6841897ecd4fec125" worker1 # [ 610.934793] nix-grpc-daemon[1057]: time=2026-11-07T15:17:46.242Z level=WARN msg="Request failed, retrying" attempt=2 backoff=183.625537ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9ab3565def8bb60c48edee980aa9dcb3e9640e7484dfb6841897ecd4fec125\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9ab3565def8bb60c48edee980aa9dcb3e9640e7484dfb6841897ecd4fec125" worker1 # [ 610.955485] nix-grpc-daemon[1057]: time=2026-11-07T15:17:46.243Z level=WARN msg="Request failed, retrying" attempt=2 backoff=197.001866ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a66a4aaa4b94b37a30a7fcfdd33f8937afb12611409d505bb13e9f36ce9cace3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a66a4aaa4b94b37a30a7fcfdd33f8937afb12611409d505bb13e9f36ce9cace3" worker1 # [ 611.121485] nix-grpc-daemon[1057]: time=2026-11-07T15:17:46.430Z level=WARN msg="Request failed, retrying" attempt=3 backoff=413.526901ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9ab3565def8bb60c48edee980aa9dcb3e9640e7484dfb6841897ecd4fec125\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9ab3565def8bb60c48edee980aa9dcb3e9640e7484dfb6841897ecd4fec125" lb # [ 611.551478] postgres[782]: [782] LOG: checkpoint starting: time worker1 # [ 611.538638] nix-grpc-daemon[1057]: time=2026-11-07T15:17:46.847Z level=WARN msg="Request failed, retrying" attempt=4 backoff=755.54558ms error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9ab3565def8bb60c48edee980aa9dcb3e9640e7484dfb6841897ecd4fec125\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9ab3565def8bb60c48edee980aa9dcb3e9640e7484dfb6841897ecd4fec125" worker1 # [ 612.299094] nix-grpc-daemon[1057]: time=2026-11-07T15:17:47.607Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.73615559s error="Put \"http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9ab3565def8bb60c48edee980aa9dcb3e9640e7484dfb6841897ecd4fec125\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9ab3565def8bb60c48edee980aa9dcb3e9640e7484dfb6841897ecd4fec125" worker1 # [ 614.247905] nix-grpc-daemon[1057]: time=2026-11-07T15:17:49.555Z level=WARN msg="Request failed, retrying" attempt=3 backoff=428.988921ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a66a4aaa4b94b37a30a7fcfdd33f8937afb12611409d505bb13e9f36ce9cace3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a66a4aaa4b94b37a30a7fcfdd33f8937afb12611409d505bb13e9f36ce9cace3" lb # [ 614.486933] postgres[782]: [782] LOG: checkpoint complete: wrote 29 buffers (0.2%), wrote 1 SLRU buffers; 0 WAL file(s) added, 0 removed, 0 recycled; write=2.916 s, sync=0.005 s, total=2.937 s; sync files=16, longest=0.003 s, average=0.001 s; distance=225 kB, estimate=4680 kB; lsn=0/1CAC538, redo lsn=0/1CAC4E0 worker1 # [ 615.720306] nix-grpc-daemon[1057]: time=2026-11-07T15:17:51.028Z level=WARN msg="Request failed, retrying" attempt=4 backoff=820.237292ms error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a66a4aaa4b94b37a30a7fcfdd33f8937afb12611409d505bb13e9f36ce9cace3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a66a4aaa4b94b37a30a7fcfdd33f8937afb12611409d505bb13e9f36ce9cace3" worker1 # [ 616.543287] nix-grpc-daemon[1057]: time=2026-11-07T15:17:51.851Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.661082489s error="Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a66a4aaa4b94b37a30a7fcfdd33f8937afb12611409d505bb13e9f36ce9cace3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a66a4aaa4b94b37a30a7fcfdd33f8937afb12611409d505bb13e9f36ce9cace3" worker1 # [ 618.208950] nix-grpc-daemon[1057]: time=2026-11-07T15:17:53.516Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a66a4aaa4b94b37a30a7fcfdd33f8937afb12611409d505bb13e9f36ce9cace3\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 618.239230] nix-daemon[1026]: reaped child process 1923, status = succeeded client # [ 618.254244] sshd-session[3348]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 618.257705] sshd-session[3348]: Disconnected from user root UNKNOWN port 65535 client # [ 618.261624] sshd-session[3342]: pam_unix(sshd:session): session closed for user root client # [ 618.268571] systemd[1]: sshd-vsock@198-199-3:22-2:198.service: Deactivated successfully. client # [ 618.277526] systemd[1]: session-200.scope: Deactivated successfully. client # [ 618.280746] systemd[1]: session-200.scope: Consumed 222ms CPU time over 2min 13.411s wall clock time, 34M memory peak, 8K written to disk, 19.2K incoming IP traffic, 16.4K outgoing IP traffic. client # [ 618.288996] systemd-logind[465]: Session 200 logged out. Waiting for processes to exit. client # [ 618.291919] systemd-logind[465]: Removed session 200. thread 'farm::serial::a_recovery_that_throws_fails_only_its_job' (1539) panicked at harness.rs:216:5: assertion `left == right` failed: [client] failed (1): nix copy --no-check-sigs --to 'grpc://worker1:50051?client-cert=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.pem&client-key=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.key&ca-cert=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ca.pem' /nix/store/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca copying 1 paths... copying path '/nix/store/41jfnyhgbq6g15z3xmxdilc1q9ihyhi7-fod-on-ca' to 'grpc://worker1:50051'... worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151540Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=45fb787cf421e59cddca1f0f271a5347068d47ede591df5836574b13907ee624": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151552Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d9bccf7202911e63a6abdfce4dbb7cf75ab89b624ee9e83eadf598883f5f29e8": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151605Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=762e861c3b73f751f9601605478cba67f96946732acab9fb962805fba6e997cb": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151617Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b3121775c85335833b04cf21b598cc4619fe6d354fb7bd81e0533409b1c3fcea": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151632Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4fd9c88087b2a231ef20e0fb0b0198bacf3d4a9904d7cbf6cee2f6cf799feda0": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151643Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b3887c9a6678bad45529ad27149b40f0ab41469702e5de9c2423e64b81ae499": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151656Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cace7794a6307a7fb3b4c6a43cf7bf1ee13fe9b4f33e0a7330f30b06088852c8": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151709Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dba3e459218a53e2758f26e4268577bd2d9c96d74efa1b039249ee6f0f8a4daf": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151722Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=049bbe32c530e1caf1424d072e609b757fe7a1d7f6e40de5e251e3370c61177e": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151733Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=b1fb400771f29374ad2d4687408bf0cc84cc6eaea003470910361ee4dc1c30cf": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying error: gRPC AddMultipleToStore on 'worker1:50051' failed: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading NAR nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/07y32ljqjzpgw56dgrwfs7f0illrfg8bgkfq0d89p01m677grk1p.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151746Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a66a4aaa4b94b37a30a7fcfdd33f8937afb12611409d505bb13e9f36ce9cace3": dial tcp [2001:db8:1::2]:9000: connect: connection refused hint: Set NIX_GRPC_DEBUG=1 for a handshake trace. left: 1 right: 0 FAILED test farm::serial::an_input_whose_nar_the_cache_lost_is_built_again ... worker1 # [ 618.345731] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 618.353279] systemd[1]: Started SSH per-connection Daemon (vsock:2:36). worker1 # [ 618.420332] sshd-session[1930]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 618.425339] sshd-session[1930]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 618.430617] sshd-session[1930]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 618.443697] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 618.449381] systemd-logind[608]: New session '43' of user 'root' with class 'user' and type 'tty'. worker1 # [ 618.467578] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 618.471748] systemd[1]: Starting User Manager for UID 0... lb # [ 618.479959] garage[913]: 2026-11-07T15:17:53.746149Z INFO garage_table::sync: bucket_v2: Adding full sync for ack layout version 1 worker1 # [ 618.487612] (systemd)[1938]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 618.484492] garage[913]: 2026-11-07T15:17:53.746233Z INFO garage_table::sync: bucket_alias: Adding full sync for ack layout version 1 worker1 # [ 618.491533] systemd-logind[608]: New session '44' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 618.488664] garage[913]: 2026-11-07T15:17:53.746265Z INFO garage_table::sync: key: Adding full sync for ack layout version 1 lb # [ 618.493191] garage[913]: 2026-11-07T15:17:53.746368Z INFO garage_table::sync: object: Adding full sync for ack layout version 1 lb # [ 618.497325] garage[913]: 2026-11-07T15:17:53.746446Z INFO garage_table::sync: bucket_object_counter: Adding full sync for ack layout version 1 lb # [ 618.501670] garage[913]: 2026-11-07T15:17:53.746569Z INFO garage_table::sync: multipart_upload: Adding full sync for ack layout version 1 lb # [ 618.507270] garage[913]: 2026-11-07T15:17:53.746642Z INFO garage_table::sync: bucket_mpu_counter: Adding full sync for ack layout version 1 lb # [ 618.511606] garage[913]: 2026-11-07T15:17:53.746711Z INFO garage_table::sync: version: Adding full sync for ack layout version 1 lb # [ 618.515647] garage[913]: 2026-11-07T15:17:53.746779Z INFO garage_table::sync: block_ref: Adding full sync for ack layout version 1 lb # [ 618.521199] garage[913]: 2026-11-07T15:17:53.746910Z INFO garage_table::sync: k2v_item: Adding full sync for ack layout version 1 lb # [ 618.525328] garage[913]: 2026-11-07T15:17:53.747014Z INFO garage_table::sync: k2v_index_counter_v2: Adding full sync for ack layout version 1 lb # [ 618.529673] garage[913]: 2026-11-07T15:17:53.747070Z INFO garage_table::sync: bucket_v2: Completed full sync for ack layout version 1 lb # [ 618.535333] garage[913]: 2026-11-07T15:17:53.747115Z INFO garage_table::sync: bucket_alias: Completed full sync for ack layout version 1 lb # [ 618.538759] garage[913]: 2026-11-07T15:17:53.747137Z INFO garage_table::sync: key: Completed full sync for ack layout version 1 lb # [ 618.542766] garage[913]: 2026-11-07T15:17:53.810956Z INFO garage_table::sync: object: Completed full sync for ack layout version 1 lb # [ 618.546089] garage[913]: 2026-11-07T15:17:53.811025Z INFO garage_table::sync: bucket_object_counter: Completed full sync for ack layout version 1 lb # [ 618.549632] garage[913]: 2026-11-07T15:17:53.811042Z INFO garage_table::sync: multipart_upload: Completed full sync for ack layout version 1 lb # [ 618.552344] garage[913]: 2026-11-07T15:17:53.811058Z INFO garage_table::sync: bucket_mpu_counter: Completed full sync for ack layout version 1 lb # [ 618.554281] garage[913]: 2026-11-07T15:17:53.811072Z INFO garage_table::sync: version: Completed full sync for ack layout version 1 lb # [ 618.556146] garage[913]: 2026-11-07T15:17:53.811088Z INFO garage_table::sync: block_ref: Completed full sync for ack layout version 1 lb # [ 618.557957] garage[913]: 2026-11-07T15:17:53.811112Z INFO garage_table::sync: k2v_item: Completed full sync for ack layout version 1 lb # [ 618.559788] garage[913]: 2026-11-07T15:17:53.811127Z INFO garage_table::sync: k2v_index_counter_v2: Completed full sync for ack layout version 1 worker1 # [ 618.568603] systemd[1938]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 618.637847] systemd[1938]: Queued start job for default target Main User Target. worker1 # [ 618.640636] systemd[1938]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 618.642908] systemd[1938]: Created slice User Application Slice. worker1 # [ 618.644131] systemd[1938]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 618.645183] systemd[1938]: Reached target Paths. worker1 # [ 618.645852] systemd[1938]: Reached target Timers. worker1 # [ 618.648065] systemd[1938]: Starting D-Bus User Message Bus Socket... worker1 # [ 618.650064] systemd[1938]: Starting Create User Files and Directories... worker1 # [ 618.674537] systemd[1938]: Finished Create User Files and Directories. worker1 # [ 618.677441] systemd[1938]: Listening on D-Bus User Message Bus Socket. worker1 # [ 618.679096] systemd[1938]: Reached target Sockets. worker1 # [ 618.679816] systemd[1938]: Reached target Basic System. worker1 # [ 618.680678] systemd[1938]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 618.683233] systemd[1938]: Reached target Main User Target. worker1 # [ 618.684687] systemd[1938]: Startup finished in 176ms. worker1 # [ 618.685844] systemd[1]: Started User Manager for UID 0. worker1 # [ 618.687393] systemd[1]: Started Session 43 of User root. worker1 # [ 618.710540] sshd-session[1951]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 618.712326] sshd-session[1951]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 618.713579] sshd-session[1930]: pam_unix(sshd:session): session closed for user root worker1 # [ 618.716537] systemd[1]: sshd-vsock@36-37-5:22-2:36.service: Deactivated successfully. worker1 # [ 618.720357] systemd[1]: session-43.scope: Deactivated successfully. worker1 # [ 618.723428] systemd-logind[608]: Session 43 logged out. Waiting for processes to exit. worker1 # [ 618.724791] systemd-logind[608]: Removed session 43. worker2 # [ 618.743604] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 618.754193] systemd[1]: Started SSH per-connection Daemon (vsock:2:26). worker2 # [ 618.821790] sshd-session[1910]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 618.826946] sshd-session[1910]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 618.832941] sshd-session[1910]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 618.846419] systemd-logind[555]: New session '32' of user 'root' with class 'user' and type 'tty'. worker2 # [ 618.850537] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 618.868744] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 618.872557] systemd[1]: Starting User Manager for UID 0... worker2 # [ 618.888403] (systemd)[1918]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 618.892918] systemd-logind[555]: New session '33' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 618.968619] systemd[1918]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 619.038358] systemd[1918]: Queued start job for default target Main User Target. worker2 # [ 619.040614] systemd[1918]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 619.042931] systemd[1918]: Created slice User Application Slice. worker2 # [ 619.044039] systemd[1918]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 619.045230] systemd[1918]: Reached target Paths. worker2 # [ 619.046675] systemd[1918]: Reached target Timers. worker2 # [ 619.048036] systemd[1918]: Starting D-Bus User Message Bus Socket... worker2 # [ 619.050290] systemd[1918]: Starting Create User Files and Directories... worker2 # [ 619.074621] systemd[1918]: Finished Create User Files and Directories. worker2 # [ 619.078771] systemd[1918]: Listening on D-Bus User Message Bus Socket. worker2 # [ 619.079961] systemd[1918]: Reached target Sockets. worker2 # [ 619.081077] systemd[1918]: Reached target Basic System. worker2 # [ 619.081783] systemd[1918]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 619.084252] systemd[1918]: Reached target Main User Target. worker2 # [ 619.084960] systemd[1918]: Startup finished in 177ms. worker2 # [ 619.086910] systemd[1]: Started User Manager for UID 0. worker2 # [ 619.088439] systemd[1]: Started Session 32 of User root. worker2 # [ 619.111424] sshd-session[1932]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 619.113182] sshd-session[1932]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 619.114537] sshd-session[1910]: pam_unix(sshd:session): session closed for user root worker2 # [ 619.117540] systemd[1]: sshd-vsock@26-27-6:22-2:26.service: Deactivated successfully. worker2 # [ 619.121424] systemd[1]: session-32.scope: Deactivated successfully. worker2 # [ 619.124588] systemd-logind[555]: Session 32 logged out. Waiting for processes to exit. worker2 # [ 619.126273] systemd-logind[555]: Removed session 32. lb # [ 619.144464] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 619.152875] systemd[1]: Started SSH per-connection Daemon (vsock:2:31). lb # [ 619.221932] sshd-session[1632]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 619.227058] sshd-session[1632]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 619.232390] sshd-session[1632]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 619.246214] systemd-logind[553]: New session '38' of user 'root' with class 'user' and type 'tty'. lb # [ 619.251534] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 619.275276] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 619.279242] systemd[1]: Starting User Manager for UID 0... lb # [ 619.295267] (systemd)[1641]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 619.299667] systemd-logind[553]: New session '39' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 619.375365] systemd[1641]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 619.442558] systemd[1641]: Queued start job for default target Main User Target. lb # [ 619.444712] systemd[1641]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 619.447066] systemd[1641]: Created slice User Application Slice. lb # [ 619.448082] systemd[1641]: Started Daily Cleanup of User's Temporary Directories. lb # [ 619.449150] systemd[1641]: Reached target Paths. lb # [ 619.450213] systemd[1641]: Reached target Timers. lb # [ 619.452693] systemd[1641]: Starting D-Bus User Message Bus Socket... lb # [ 619.453961] systemd[1641]: Starting Create User Files and Directories... lb # [ 619.478816] systemd[1641]: Finished Create User Files and Directories. lb # [ 619.481650] systemd[1641]: Listening on D-Bus User Message Bus Socket. lb # [ 619.482898] systemd[1641]: Reached target Sockets. lb # [ 619.483843] systemd[1641]: Reached target Basic System. lb # [ 619.485069] systemd[1641]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 619.486560] systemd[1641]: Reached target Main User Target. lb # [ 619.487540] systemd[1641]: Startup finished in 175ms. lb # [ 619.489149] systemd[1]: Started User Manager for UID 0. lb # [ 619.493230] systemd[1]: Started Session 38 of User root. lb # [ 619.518890] sshd-session[1654]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 619.520670] sshd-session[1654]: Disconnected from user root UNKNOWN port 65535 lb # [ 619.521952] sshd-session[1632]: pam_unix(sshd:session): session closed for user root lb # [ 619.524995] systemd[1]: sshd-vsock@31-32-4:22-2:31.service: Deactivated successfully. lb # [ 619.528759] systemd[1]: session-38.scope: Deactivated successfully. lb # [ 619.530343] systemd[1]: session-38.scope: Consumed 16ms CPU time over 36ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 619.533966] systemd-logind[553]: Session 38 logged out. Waiting for processes to exit. lb # [ 619.535776] systemd-logind[553]: Removed session 38. worker1 # [ 619.550814] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 619.558299] systemd[1]: Started SSH per-connection Daemon (vsock:2:37). worker1 # [ 619.625907] sshd-session[1957]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 619.630992] sshd-session[1957]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 619.636458] sshd-session[1957]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 619.642239] systemd-logind[608]: New session '45' of user 'root' with class 'user' and type 'tty'. worker1 # [ 619.646412] systemd[1]: Started Session 45 of User root. worker1 # [ 619.671500] sshd-session[1963]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 619.672732] sshd-session[1963]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 619.674116] sshd-session[1957]: pam_unix(sshd:session): session closed for user root worker1 # [ 619.677252] systemd[1]: sshd-vsock@37-38-5:22-2:37.service: Deactivated successfully. worker1 # [ 619.680749] systemd[1]: session-45.scope: Deactivated successfully. worker1 # [ 619.682258] systemd[1]: session-45.scope: Consumed 15ms CPU time over 35ms wall clock time, 3.1M memory peak, 17.7K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 619.685930] systemd-logind[608]: Session 45 logged out. Waiting for processes to exit. worker1 # [ 619.688129] systemd-logind[608]: Removed session 45. client # [ 619.744851] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 619.754473] systemd[1]: Started SSH per-connection Daemon (vsock:2:199). client # [ 619.820635] sshd-session[3362]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 619.825394] sshd-session[3362]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 619.830227] sshd-session[3362]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 619.836842] systemd-logind[465]: New session '201' of user 'root' with class 'user' and type 'tty'. client # [ 619.839346] systemd[1]: Started Session 201 of User root. client # [ 620.058242] sshd-session[3368]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 620.060073] sshd-session[3368]: Disconnected from user root UNKNOWN port 65535 client # [ 620.061431] sshd-session[3362]: pam_unix(sshd:session): session closed for user root client # [ 620.065062] systemd[1]: sshd-vsock@199-200-3:22-2:199.service: Deactivated successfully. client # [ 620.068528] systemd[1]: session-201.scope: Deactivated successfully. client # [ 620.071744] systemd-logind[465]: Session 201 logged out. Waiting for processes to exit. client # [ 620.073339] systemd-logind[465]: Removed session 201. client # [ 620.144277] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 620.152169] systemd[1]: Started SSH per-connection Daemon (vsock:2:200). client # [ 620.203563] sshd-session[3383]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 620.208636] sshd-session[3383]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 620.213958] sshd-session[3383]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 620.220076] systemd-logind[465]: New session '202' of user 'root' with class 'user' and type 'tty'. client # [ 620.223409] systemd[1]: Started Session 202 of User root. worker1 # [ 620.332752] nix-grpc-daemon[529]: ts=2026-11-07T15:17:55Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:52080 lb # [ 620.345936] garage[913]: 2026-11-07T15:17:55.612871Z INFO garage_api_common::generic_server: 127.0.0.1:60802 (key GK0123456789abcdef01234567) HEAD /farm/hc1y87gwih533ialmn27srpss205zkns.narinfo lb # [ 620.352470] garage[913]: 2026-11-07T15:17:55.613479Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 620.355702] nix-grpc-daemon[529]: ts=2026-11-07T15:17:55Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:52080 worker1 # [ 620.368293] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 620.475431] nix-daemon[1026]: accepted connection from pid 1972, user nix-grpc-daemon (trusted) worker1 # [ 620.489449] nix-daemon[1026]: reaped child process 1975, status = succeeded lb # [ 620.495566] niks3-server[1503]: 2026/11/07 15:17:55 INFO Received push request method=POST path=/api/pushes worker1 # [ 620.506096] nix-grpc-daemon[1057]: time=2026-11-07T15:17:55.814Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 620.508350] nix-grpc-daemon[1057]: time=2026-11-07T15:17:55.816Z level=INFO msg="Uploading hc1y87gwih533ialmn27srpss205zkns-local-input-lostnar (120B)" worker1 # [ 620.511395] nix-grpc-daemon[1057]: time=2026-11-07T15:17:55.820Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d513455684defca30be4a41286a2e3e6fc8a1dd09ab1b96a1ea4cae9a424641d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d513455684defca30be4a41286a2e3e6fc8a1dd09ab1b96a1ea4cae9a424641d" worker1 # [ 620.520064] nix-grpc-daemon[1057]: time=2026-11-07T15:17:55.820Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4cfc02a978e57df2971781c8df9f4bf8dc7fd3ef387f407bd4666b4b1a8422e8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4cfc02a978e57df2971781c8df9f4bf8dc7fd3ef387f407bd4666b4b1a8422e8" worker1 # [ 620.616403] nix-grpc-daemon[1057]: time=2026-11-07T15:17:55.924Z level=WARN msg="Request failed, retrying" attempt=2 backoff=195.932229ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4cfc02a978e57df2971781c8df9f4bf8dc7fd3ef387f407bd4666b4b1a8422e8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4cfc02a978e57df2971781c8df9f4bf8dc7fd3ef387f407bd4666b4b1a8422e8" worker1 # [ 621.672499] nix-grpc-daemon[1057]: time=2026-11-07T15:17:56.980Z level=WARN msg="Request failed, retrying" attempt=2 backoff=211.68564ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d513455684defca30be4a41286a2e3e6fc8a1dd09ab1b96a1ea4cae9a424641d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d513455684defca30be4a41286a2e3e6fc8a1dd09ab1b96a1ea4cae9a424641d" worker1 # [ 622.888395] nix-grpc-daemon[1057]: time=2026-11-07T15:17:58.195Z level=WARN msg="Request failed, retrying" attempt=3 backoff=386.223965ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4cfc02a978e57df2971781c8df9f4bf8dc7fd3ef387f407bd4666b4b1a8422e8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4cfc02a978e57df2971781c8df9f4bf8dc7fd3ef387f407bd4666b4b1a8422e8" worker1 # [ 623.278322] nix-grpc-daemon[1057]: time=2026-11-07T15:17:58.586Z level=WARN msg="Request failed, retrying" attempt=4 backoff=834.833675ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4cfc02a978e57df2971781c8df9f4bf8dc7fd3ef387f407bd4666b4b1a8422e8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4cfc02a978e57df2971781c8df9f4bf8dc7fd3ef387f407bd4666b4b1a8422e8" worker1 # [ 625.000349] nix-grpc-daemon[1057]: time=2026-11-07T15:18:00.308Z level=WARN msg="Request failed, retrying" attempt=3 backoff=417.278203ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d513455684defca30be4a41286a2e3e6fc8a1dd09ab1b96a1ea4cae9a424641d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d513455684defca30be4a41286a2e3e6fc8a1dd09ab1b96a1ea4cae9a424641d" worker1 # [ 625.420778] nix-grpc-daemon[1057]: time=2026-11-07T15:18:00.729Z level=WARN msg="Request failed, retrying" attempt=4 backoff=738.377698ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d513455684defca30be4a41286a2e3e6fc8a1dd09ab1b96a1ea4cae9a424641d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d513455684defca30be4a41286a2e3e6fc8a1dd09ab1b96a1ea4cae9a424641d" worker1 # [ 627.175468] nix-grpc-daemon[1057]: time=2026-11-07T15:18:02.483Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.728547746s error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d513455684defca30be4a41286a2e3e6fc8a1dd09ab1b96a1ea4cae9a424641d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d513455684defca30be4a41286a2e3e6fc8a1dd09ab1b96a1ea4cae9a424641d" worker1 # [ 628.199520] nix-grpc-daemon[1057]: time=2026-11-07T15:18:03.507Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.707445842s error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4cfc02a978e57df2971781c8df9f4bf8dc7fd3ef387f407bd4666b4b1a8422e8\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4cfc02a978e57df2971781c8df9f4bf8dc7fd3ef387f407bd4666b4b1a8422e8" worker2 # [ 629.233696] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 629.245933] systemd[1918]: Activating special unit Exit the Session... worker2 # [ 629.248678] systemd[1918]: Stopped target Main User Target. worker2 # [ 629.252840] systemd[1918]: Stopped target Basic System. worker2 # [ 629.256432] systemd[1918]: Stopped target Paths. worker2 # [ 629.261380] systemd[1918]: Stopped target Sockets. worker2 # [ 629.263998] systemd[1918]: Stopped target Timers. worker2 # [ 629.267932] systemd[1918]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 629.274818] systemd[1918]: Closed D-Bus User Message Bus Socket. worker2 # [ 629.277937] systemd[1918]: Stopped Create User Files and Directories. worker2 # [ 629.282451] systemd[1918]: Removed slice User Application Slice. worker2 # [ 629.284604] systemd[1918]: Reached target Shutdown. worker2 # [ 629.287264] systemd[1918]: Finished Exit the Session. worker2 # [ 629.288744] systemd[1918]: Reached target Exit the Session. worker2 # [ 629.291534] systemd-logind[555]: Removed session 33. worker2 # [ 629.294653] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 629.297218] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 629.308769] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 629.330048] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 629.331851] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 629.333432] systemd[1]: Stopped User Runtime Directory /run/user/0. lb # [ 629.583507] systemd[1]: Stopping User Manager for UID 0... lb # [ 629.586410] systemd[1641]: Activating special unit Exit the Session... lb # [ 629.588132] systemd[1641]: Stopped target Main User Target. lb # [ 629.588909] systemd[1641]: Stopped target Basic System. lb # [ 629.590122] systemd[1641]: Stopped target Paths. lb # [ 629.590800] systemd[1641]: Stopped target Sockets. lb # [ 629.592376] systemd[1641]: Stopped target Timers. lb # [ 629.593852] systemd[1641]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 629.595641] systemd[1641]: Closed D-Bus User Message Bus Socket. lb # [ 629.596696] systemd[1641]: Stopped Create User Files and Directories. lb # [ 629.597960] systemd[1641]: Removed slice User Application Slice. lb # [ 629.599137] systemd[1641]: Reached target Shutdown. lb # [ 629.599838] systemd[1641]: Finished Exit the Session. lb # [ 629.600559] systemd[1641]: Reached target Exit the Session. lb # [ 629.608951] systemd-logind[553]: Removed session 39. lb # [ 629.612628] systemd[1]: user@0.service: Deactivated successfully. lb # [ 629.614386] systemd[1]: Stopped User Manager for UID 0. lb # [ 629.632486] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 629.650084] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 629.651931] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 629.653579] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 629.878835] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 629.888340] systemd[1938]: Activating special unit Exit the Session... worker1 # [ 629.890535] systemd[1938]: Stopped target Main User Target. worker1 # [ 629.893983] systemd[1938]: Stopped target Basic System. worker1 # [ 629.897674] systemd[1938]: Stopped target Paths. worker1 # [ 629.901592] systemd[1938]: Stopped target Sockets. worker1 # [ 629.905479] systemd[1938]: Stopped target Timers. worker1 # [ 629.915268] systemd[1938]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 629.927199] nix-grpc-daemon[1057]: time=2026-11-07T15:18:05.220Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d513455684defca30be4a41286a2e3e6fc8a1dd09ab1b96a1ea4cae9a424641d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 629.942934] systemd[1938]: Closed D-Bus User Message Bus Socket. worker1 # [ 629.946901] systemd[1938]: Stopped Create User Files and Directories. worker1 # [ 629.949241] systemd[1938]: Removed slice User Application Slice. worker1 # [ 629.950505] systemd[1938]: Reached target Shutdown. worker1 # [ 629.951201] systemd[1938]: Finished Exit the Session. worker1 # [ 629.954123] systemd[1938]: Reached target Exit the Session. worker1 # [ 629.957262] systemd-logind[608]: Removed session 44. worker1 # [ 629.958552] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 629.961291] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 629.965806] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 629.973149] nix-daemon[1026]: reaped child process 1970, status = succeeded worker1 # [ 629.981061] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 629.982894] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 629.984371] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 630.423764] nix-grpc-daemon[529]: ts=2026-11-07T15:18:05Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:52080 worker1 # [ 630.434164] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 630.542198] nix-daemon[1026]: accepted connection from pid 1983, user nix-grpc-daemon (trusted) worker1 # [ 630.555584] nix-daemon[1026]: reaped child process 1986, status = succeeded lb # [ 630.561433] niks3-server[1503]: 2026/11/07 15:18:05 INFO Received push request method=POST path=/api/pushes worker1 # [ 630.568758] nix-grpc-daemon[1057]: time=2026-11-07T15:18:05.877Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 630.570277] nix-grpc-daemon[1057]: time=2026-11-07T15:18:05.879Z level=INFO msg="Uploading hc1y87gwih533ialmn27srpss205zkns-local-input-lostnar (120B)" worker1 # [ 630.573867] nix-grpc-daemon[1057]: time=2026-11-07T15:18:05.882Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4ad05c069ed6c87c907b8aba979085b973f26fdd8c65bdb6374f5cd2830e5b08\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4ad05c069ed6c87c907b8aba979085b973f26fdd8c65bdb6374f5cd2830e5b08" worker1 # [ 631.591947] nix-grpc-daemon[1057]: time=2026-11-07T15:18:06.899Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aaef11ba296eb6c0a1f067b457d35cf63779f50b759c9df6ee00307dbee5a16e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aaef11ba296eb6c0a1f067b457d35cf63779f50b759c9df6ee00307dbee5a16e" [e2e] heartbeat t=570s worker1 # [ 632.744337] nix-grpc-daemon[1057]: time=2026-11-07T15:18:08.051Z level=WARN msg="Request failed, retrying" attempt=2 backoff=187.495918ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4ad05c069ed6c87c907b8aba979085b973f26fdd8c65bdb6374f5cd2830e5b08\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4ad05c069ed6c87c907b8aba979085b973f26fdd8c65bdb6374f5cd2830e5b08" worker1 # [ 633.768404] nix-grpc-daemon[1057]: time=2026-11-07T15:18:09.076Z level=WARN msg="Request failed, retrying" attempt=2 backoff=191.477709ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aaef11ba296eb6c0a1f067b457d35cf63779f50b759c9df6ee00307dbee5a16e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aaef11ba296eb6c0a1f067b457d35cf63779f50b759c9df6ee00307dbee5a16e" worker1 # [ 634.983984] nix-grpc-daemon[1057]: time=2026-11-07T15:18:10.291Z level=WARN msg="Request failed, retrying" attempt=3 backoff=426.274138ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aaef11ba296eb6c0a1f067b457d35cf63779f50b759c9df6ee00307dbee5a16e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aaef11ba296eb6c0a1f067b457d35cf63779f50b759c9df6ee00307dbee5a16e" worker1 # [ 635.414411] nix-grpc-daemon[1057]: time=2026-11-07T15:18:10.722Z level=WARN msg="Request failed, retrying" attempt=4 backoff=838.103311ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aaef11ba296eb6c0a1f067b457d35cf63779f50b759c9df6ee00307dbee5a16e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aaef11ba296eb6c0a1f067b457d35cf63779f50b759c9df6ee00307dbee5a16e" worker1 # [ 636.256949] nix-grpc-daemon[1057]: time=2026-11-07T15:18:11.564Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.512242707s error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aaef11ba296eb6c0a1f067b457d35cf63779f50b759c9df6ee00307dbee5a16e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=aaef11ba296eb6c0a1f067b457d35cf63779f50b759c9df6ee00307dbee5a16e" worker1 # [ 640.103412] nix-grpc-daemon[1057]: time=2026-11-07T15:18:15.411Z level=WARN msg="Request failed, retrying" attempt=3 backoff=372.629939ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4ad05c069ed6c87c907b8aba979085b973f26fdd8c65bdb6374f5cd2830e5b08\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4ad05c069ed6c87c907b8aba979085b973f26fdd8c65bdb6374f5cd2830e5b08" worker1 # [ 640.478956] nix-grpc-daemon[1057]: time=2026-11-07T15:18:15.787Z level=WARN msg="Request failed, retrying" attempt=4 backoff=737.557358ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4ad05c069ed6c87c907b8aba979085b973f26fdd8c65bdb6374f5cd2830e5b08\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4ad05c069ed6c87c907b8aba979085b973f26fdd8c65bdb6374f5cd2830e5b08" worker1 # [ 641.219434] nix-grpc-daemon[1057]: time=2026-11-07T15:18:16.527Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.451367547s error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4ad05c069ed6c87c907b8aba979085b973f26fdd8c65bdb6374f5cd2830e5b08\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4ad05c069ed6c87c907b8aba979085b973f26fdd8c65bdb6374f5cd2830e5b08" worker1 # [ 642.674972] nix-grpc-daemon[1057]: time=2026-11-07T15:18:17.982Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4ad05c069ed6c87c907b8aba979085b973f26fdd8c65bdb6374f5cd2830e5b08\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 642.704122] nix-daemon[1026]: reaped child process 1981, status = succeeded worker1 # [ 643.681743] nix-grpc-daemon[529]: ts=2026-11-07T15:18:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:52080 worker1 # [ 643.693181] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 643.804044] nix-daemon[1026]: accepted connection from pid 1991, user nix-grpc-daemon (trusted) worker1 # [ 643.816936] nix-daemon[1026]: reaped child process 1994, status = succeeded lb # [ 643.823961] niks3-server[1503]: 2026/11/07 15:18:19 INFO Received push request method=POST path=/api/pushes worker1 # [ 643.834340] nix-grpc-daemon[1057]: time=2026-11-07T15:18:19.142Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 643.836603] nix-grpc-daemon[1057]: time=2026-11-07T15:18:19.144Z level=INFO msg="Uploading hc1y87gwih533ialmn27srpss205zkns-local-input-lostnar (120B)" worker1 # [ 643.839369] nix-grpc-daemon[1057]: time=2026-11-07T15:18:19.148Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=754b1964ef2ccd30fb07404cc367f8a3e4b06842b5187d1f06a74297d829f681\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=754b1964ef2ccd30fb07404cc367f8a3e4b06842b5187d1f06a74297d829f681" worker1 # [ 643.848581] nix-grpc-daemon[1057]: time=2026-11-07T15:18:19.157Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fe05e1fc259a9d0855ff2a035573391672f666e51dd8a0a264db4c45f9a4d947\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fe05e1fc259a9d0855ff2a035573391672f666e51dd8a0a264db4c45f9a4d947" worker1 # [ 644.969412] nix-grpc-daemon[1057]: time=2026-11-07T15:18:20.276Z level=WARN msg="Request failed, retrying" attempt=2 backoff=206.284241ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fe05e1fc259a9d0855ff2a035573391672f666e51dd8a0a264db4c45f9a4d947\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fe05e1fc259a9d0855ff2a035573391672f666e51dd8a0a264db4c45f9a4d947" worker1 # [ 645.991939] nix-grpc-daemon[1057]: time=2026-11-07T15:18:21.299Z level=WARN msg="Request failed, retrying" attempt=2 backoff=187.538073ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=754b1964ef2ccd30fb07404cc367f8a3e4b06842b5187d1f06a74297d829f681\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=754b1964ef2ccd30fb07404cc367f8a3e4b06842b5187d1f06a74297d829f681" worker1 # [ 647.208171] nix-grpc-daemon[1057]: time=2026-11-07T15:18:22.515Z level=WARN msg="Request failed, retrying" attempt=3 backoff=418.740682ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=754b1964ef2ccd30fb07404cc367f8a3e4b06842b5187d1f06a74297d829f681\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=754b1964ef2ccd30fb07404cc367f8a3e4b06842b5187d1f06a74297d829f681" worker1 # [ 647.630287] nix-grpc-daemon[1057]: time=2026-11-07T15:18:22.938Z level=WARN msg="Request failed, retrying" attempt=4 backoff=851.148361ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=754b1964ef2ccd30fb07404cc367f8a3e4b06842b5187d1f06a74297d829f681\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=754b1964ef2ccd30fb07404cc367f8a3e4b06842b5187d1f06a74297d829f681" worker1 # [ 648.232355] nix-grpc-daemon[1057]: time=2026-11-07T15:18:23.539Z level=WARN msg="Request failed, retrying" attempt=3 backoff=367.362405ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fe05e1fc259a9d0855ff2a035573391672f666e51dd8a0a264db4c45f9a4d947\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fe05e1fc259a9d0855ff2a035573391672f666e51dd8a0a264db4c45f9a4d947" worker1 # [ 649.512341] nix-grpc-daemon[1057]: time=2026-11-07T15:18:24.820Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.527208292s error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=754b1964ef2ccd30fb07404cc367f8a3e4b06842b5187d1f06a74297d829f681\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=754b1964ef2ccd30fb07404cc367f8a3e4b06842b5187d1f06a74297d829f681" worker1 # [ 650.664323] nix-grpc-daemon[1057]: time=2026-11-07T15:18:25.972Z level=WARN msg="Request failed, retrying" attempt=4 backoff=722.541019ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fe05e1fc259a9d0855ff2a035573391672f666e51dd8a0a264db4c45f9a4d947\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fe05e1fc259a9d0855ff2a035573391672f666e51dd8a0a264db4c45f9a4d947" worker1 # [ 651.390233] nix-grpc-daemon[1057]: time=2026-11-07T15:18:26.698Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.705673971s error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fe05e1fc259a9d0855ff2a035573391672f666e51dd8a0a264db4c45f9a4d947\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=fe05e1fc259a9d0855ff2a035573391672f666e51dd8a0a264db4c45f9a4d947" worker1 # [ 654.119898] nix-grpc-daemon[1057]: time=2026-11-07T15:18:29.427Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=754b1964ef2ccd30fb07404cc367f8a3e4b06842b5187d1f06a74297d829f681\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 654.150548] nix-daemon[1026]: reaped child process 1989, status = succeeded worker1 # [ 656.146622] nix-grpc-daemon[529]: ts=2026-11-07T15:18:31Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:52080 worker1 # [ 656.157481] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 656.266536] nix-daemon[1026]: accepted connection from pid 1998, user nix-grpc-daemon (trusted) worker1 # [ 656.280683] nix-daemon[1026]: reaped child process 2001, status = succeeded lb # [ 656.287647] niks3-server[1503]: 2026/11/07 15:18:31 INFO Received push request method=POST path=/api/pushes worker1 # [ 656.297708] nix-grpc-daemon[1057]: time=2026-11-07T15:18:31.606Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 656.300042] nix-grpc-daemon[1057]: time=2026-11-07T15:18:31.608Z level=INFO msg="Uploading hc1y87gwih533ialmn27srpss205zkns-local-input-lostnar (120B)" worker1 # [ 656.302818] nix-grpc-daemon[1057]: time=2026-11-07T15:18:31.611Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=11218f24727159a664d11b4059191a9f3f0b98da792f53de85a362ed8da69d49\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=11218f24727159a664d11b4059191a9f3f0b98da792f53de85a362ed8da69d49" worker1 # [ 656.311777] nix-grpc-daemon[1057]: time=2026-11-07T15:18:31.611Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b11b774a933a0d6d941d0b4225c9d84500d4df8bbd161568bd87a39226943ca\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b11b774a933a0d6d941d0b4225c9d84500d4df8bbd161568bd87a39226943ca" worker1 # [ 656.405470] nix-grpc-daemon[1057]: time=2026-11-07T15:18:31.714Z level=WARN msg="Request failed, retrying" attempt=2 backoff=183.727269ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b11b774a933a0d6d941d0b4225c9d84500d4df8bbd161568bd87a39226943ca\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b11b774a933a0d6d941d0b4225c9d84500d4df8bbd161568bd87a39226943ca" worker1 # [ 657.448295] nix-grpc-daemon[1057]: time=2026-11-07T15:18:32.756Z level=WARN msg="Request failed, retrying" attempt=2 backoff=180.40708ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=11218f24727159a664d11b4059191a9f3f0b98da792f53de85a362ed8da69d49\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=11218f24727159a664d11b4059191a9f3f0b98da792f53de85a362ed8da69d49" worker1 # [ 658.664319] nix-grpc-daemon[1057]: time=2026-11-07T15:18:33.971Z level=WARN msg="Request failed, retrying" attempt=3 backoff=380.834025ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b11b774a933a0d6d941d0b4225c9d84500d4df8bbd161568bd87a39226943ca\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b11b774a933a0d6d941d0b4225c9d84500d4df8bbd161568bd87a39226943ca" worker1 # [ 659.688311] nix-grpc-daemon[1057]: time=2026-11-07T15:18:34.996Z level=WARN msg="Request failed, retrying" attempt=3 backoff=438.026323ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=11218f24727159a664d11b4059191a9f3f0b98da792f53de85a362ed8da69d49\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=11218f24727159a664d11b4059191a9f3f0b98da792f53de85a362ed8da69d49" worker1 # [ 661.095407] nix-grpc-daemon[1057]: time=2026-11-07T15:18:36.403Z level=WARN msg="Request failed, retrying" attempt=4 backoff=727.327457ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b11b774a933a0d6d941d0b4225c9d84500d4df8bbd161568bd87a39226943ca\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b11b774a933a0d6d941d0b4225c9d84500d4df8bbd161568bd87a39226943ca" worker1 # [ 661.826039] nix-grpc-daemon[1057]: time=2026-11-07T15:18:37.134Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.518224942s error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b11b774a933a0d6d941d0b4225c9d84500d4df8bbd161568bd87a39226943ca\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b11b774a933a0d6d941d0b4225c9d84500d4df8bbd161568bd87a39226943ca" [e2e] heartbeat t=600s worker1 # [ 663.208426] nix-grpc-daemon[1057]: time=2026-11-07T15:18:38.516Z level=WARN msg="Request failed, retrying" attempt=4 backoff=848.194858ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=11218f24727159a664d11b4059191a9f3f0b98da792f53de85a362ed8da69d49\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=11218f24727159a664d11b4059191a9f3f0b98da792f53de85a362ed8da69d49" worker1 # [ 665.064198] nix-grpc-daemon[1057]: time=2026-11-07T15:18:40.371Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.638694048s error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=11218f24727159a664d11b4059191a9f3f0b98da792f53de85a362ed8da69d49\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=11218f24727159a664d11b4059191a9f3f0b98da792f53de85a362ed8da69d49" worker1 # [ 666.709854] nix-grpc-daemon[1057]: time=2026-11-07T15:18:42.015Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=11218f24727159a664d11b4059191a9f3f0b98da792f53de85a362ed8da69d49\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 666.737676] nix-daemon[1026]: reaped child process 1996, status = succeeded worker1 # [ 670.713737] nix-grpc-daemon[529]: ts=2026-11-07T15:18:46Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:52080 worker1 # [ 670.727168] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 670.839592] nix-daemon[1026]: accepted connection from pid 2005, user nix-grpc-daemon (trusted) worker1 # [ 670.853053] nix-daemon[1026]: reaped child process 2008, status = succeeded lb # [ 670.860507] niks3-server[1503]: 2026/11/07 15:18:46 INFO Received push request method=POST path=/api/pushes worker1 # [ 670.871598] nix-grpc-daemon[1057]: time=2026-11-07T15:18:46.179Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 670.873525] nix-grpc-daemon[1057]: time=2026-11-07T15:18:46.179Z level=INFO msg="Uploading hc1y87gwih533ialmn27srpss205zkns-local-input-lostnar (120B)" worker1 # [ 670.876487] nix-grpc-daemon[1057]: time=2026-11-07T15:18:46.185Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83d7a04c373cf4aceb1f3b3b2cd568fdb7cb6b8d8a29e353e8377166cb588e50\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83d7a04c373cf4aceb1f3b3b2cd568fdb7cb6b8d8a29e353e8377166cb588e50" worker1 # [ 670.885242] nix-grpc-daemon[1057]: time=2026-11-07T15:18:46.185Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0ec264ac1ef50283ae73a54e90d482cf824d7fd5c5fc264cf55f76425fa45112\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0ec264ac1ef50283ae73a54e90d482cf824d7fd5c5fc264cf55f76425fa45112" worker1 # [ 670.981917] nix-grpc-daemon[1057]: time=2026-11-07T15:18:46.290Z level=WARN msg="Request failed, retrying" attempt=2 backoff=202.164225ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0ec264ac1ef50283ae73a54e90d482cf824d7fd5c5fc264cf55f76425fa45112\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0ec264ac1ef50283ae73a54e90d482cf824d7fd5c5fc264cf55f76425fa45112" worker1 # [ 671.003649] nix-grpc-daemon[1057]: time=2026-11-07T15:18:46.311Z level=WARN msg="Request failed, retrying" attempt=2 backoff=208.414285ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83d7a04c373cf4aceb1f3b3b2cd568fdb7cb6b8d8a29e353e8377166cb588e50\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83d7a04c373cf4aceb1f3b3b2cd568fdb7cb6b8d8a29e353e8377166cb588e50" worker1 # [ 671.209734] nix-grpc-daemon[1057]: time=2026-11-07T15:18:46.518Z level=WARN msg="Request failed, retrying" attempt=3 backoff=434.150559ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0ec264ac1ef50283ae73a54e90d482cf824d7fd5c5fc264cf55f76425fa45112\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0ec264ac1ef50283ae73a54e90d482cf824d7fd5c5fc264cf55f76425fa45112" worker1 # [ 671.234782] nix-grpc-daemon[1057]: time=2026-11-07T15:18:46.543Z level=WARN msg="Request failed, retrying" attempt=3 backoff=366.093446ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83d7a04c373cf4aceb1f3b3b2cd568fdb7cb6b8d8a29e353e8377166cb588e50\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83d7a04c373cf4aceb1f3b3b2cd568fdb7cb6b8d8a29e353e8377166cb588e50" worker1 # [ 672.616447] nix-grpc-daemon[1057]: time=2026-11-07T15:18:47.924Z level=WARN msg="Request failed, retrying" attempt=4 backoff=784.127653ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83d7a04c373cf4aceb1f3b3b2cd568fdb7cb6b8d8a29e353e8377166cb588e50\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83d7a04c373cf4aceb1f3b3b2cd568fdb7cb6b8d8a29e353e8377166cb588e50" worker1 # [ 673.404474] nix-grpc-daemon[1057]: time=2026-11-07T15:18:48.712Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.570014452s error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83d7a04c373cf4aceb1f3b3b2cd568fdb7cb6b8d8a29e353e8377166cb588e50\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83d7a04c373cf4aceb1f3b3b2cd568fdb7cb6b8d8a29e353e8377166cb588e50" worker1 # [ 674.727429] nix-grpc-daemon[1057]: time=2026-11-07T15:18:50.035Z level=WARN msg="Request failed, retrying" attempt=4 backoff=873.406846ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0ec264ac1ef50283ae73a54e90d482cf824d7fd5c5fc264cf55f76425fa45112\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0ec264ac1ef50283ae73a54e90d482cf824d7fd5c5fc264cf55f76425fa45112" worker1 # [ 675.605531] nix-grpc-daemon[1057]: time=2026-11-07T15:18:50.914Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.508211313s error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0ec264ac1ef50283ae73a54e90d482cf824d7fd5c5fc264cf55f76425fa45112\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0ec264ac1ef50283ae73a54e90d482cf824d7fd5c5fc264cf55f76425fa45112" worker1 # [ 678.119796] nix-grpc-daemon[1057]: time=2026-11-07T15:18:53.427Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83d7a04c373cf4aceb1f3b3b2cd568fdb7cb6b8d8a29e353e8377166cb588e50\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 678.150312] nix-daemon[1026]: reaped child process 2003, status = succeeded worker1 # [ 682.144690] nix-grpc-daemon[529]: ts=2026-11-07T15:18:57Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:52080 worker1 # [ 682.157126] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 682.265688] nix-daemon[1026]: accepted connection from pid 2012, user nix-grpc-daemon (trusted) worker1 # [ 682.278911] nix-daemon[1026]: reaped child process 2015, status = succeeded lb # [ 682.285462] niks3-server[1503]: 2026/11/07 15:18:57 INFO Received push request method=POST path=/api/pushes worker1 # [ 682.294994] nix-grpc-daemon[1057]: time=2026-11-07T15:18:57.603Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 682.296920] nix-grpc-daemon[1057]: time=2026-11-07T15:18:57.603Z level=INFO msg="Uploading hc1y87gwih533ialmn27srpss205zkns-local-input-lostnar (120B)" worker1 # [ 682.300105] nix-grpc-daemon[1057]: time=2026-11-07T15:18:57.608Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f9fed435496a3f44b45c24d704b924104a63980191afe2b85955360ce9f45361\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f9fed435496a3f44b45c24d704b924104a63980191afe2b85955360ce9f45361" worker1 # [ 682.308517] nix-grpc-daemon[1057]: time=2026-11-07T15:18:57.608Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9cad9d6c1f2bd408b3014db759f97471b5cad2b4b2b973d5502ad856ba11a18d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9cad9d6c1f2bd408b3014db759f97471b5cad2b4b2b973d5502ad856ba11a18d" worker1 # [ 683.431515] nix-grpc-daemon[1057]: time=2026-11-07T15:18:58.739Z level=WARN msg="Request failed, retrying" attempt=2 backoff=185.957811ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9cad9d6c1f2bd408b3014db759f97471b5cad2b4b2b973d5502ad856ba11a18d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9cad9d6c1f2bd408b3014db759f97471b5cad2b4b2b973d5502ad856ba11a18d" worker1 # [ 684.456513] nix-grpc-daemon[1057]: time=2026-11-07T15:18:59.764Z level=WARN msg="Request failed, retrying" attempt=2 backoff=188.875329ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f9fed435496a3f44b45c24d704b924104a63980191afe2b85955360ce9f45361\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f9fed435496a3f44b45c24d704b924104a63980191afe2b85955360ce9f45361" worker1 # [ 685.671914] nix-grpc-daemon[1057]: time=2026-11-07T15:19:00.979Z level=WARN msg="Request failed, retrying" attempt=3 backoff=411.461926ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f9fed435496a3f44b45c24d704b924104a63980191afe2b85955360ce9f45361\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f9fed435496a3f44b45c24d704b924104a63980191afe2b85955360ce9f45361" worker1 # [ 686.695878] nix-grpc-daemon[1057]: time=2026-11-07T15:19:02.003Z level=WARN msg="Request failed, retrying" attempt=3 backoff=374.822982ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9cad9d6c1f2bd408b3014db759f97471b5cad2b4b2b973d5502ad856ba11a18d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9cad9d6c1f2bd408b3014db759f97471b5cad2b4b2b973d5502ad856ba11a18d" worker1 # [ 688.103778] nix-grpc-daemon[1057]: time=2026-11-07T15:19:03.411Z level=WARN msg="Request failed, retrying" attempt=4 backoff=851.208714ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9cad9d6c1f2bd408b3014db759f97471b5cad2b4b2b973d5502ad856ba11a18d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9cad9d6c1f2bd408b3014db759f97471b5cad2b4b2b973d5502ad856ba11a18d" worker1 # [ 688.959330] nix-grpc-daemon[1057]: time=2026-11-07T15:19:04.267Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.562578145s error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9cad9d6c1f2bd408b3014db759f97471b5cad2b4b2b973d5502ad856ba11a18d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9cad9d6c1f2bd408b3014db759f97471b5cad2b4b2b973d5502ad856ba11a18d" worker1 # [ 690.216347] nix-grpc-daemon[1057]: time=2026-11-07T15:19:05.523Z level=WARN msg="Request failed, retrying" attempt=4 backoff=873.17413ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f9fed435496a3f44b45c24d704b924104a63980191afe2b85955360ce9f45361\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f9fed435496a3f44b45c24d704b924104a63980191afe2b85955360ce9f45361" worker1 # [ 692.136215] nix-grpc-daemon[1057]: time=2026-11-07T15:19:07.444Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.735048436s error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f9fed435496a3f44b45c24d704b924104a63980191afe2b85955360ce9f45361\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f9fed435496a3f44b45c24d704b924104a63980191afe2b85955360ce9f45361" [e2e] heartbeat t=630s worker1 # [ 693.879183] nix-grpc-daemon[1057]: time=2026-11-07T15:19:09.183Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9cad9d6c1f2bd408b3014db759f97471b5cad2b4b2b973d5502ad856ba11a18d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 693.906312] nix-daemon[1026]: reaped child process 2010, status = succeeded worker1 # [ 697.881571] nix-grpc-daemon[529]: ts=2026-11-07T15:19:13Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:52080 worker1 # [ 697.886544] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 697.974044] nix-daemon[1026]: accepted connection from pid 2019, user nix-grpc-daemon (trusted) worker1 # [ 697.987778] nix-daemon[1026]: reaped child process 2022, status = succeeded lb # [ 697.994703] niks3-server[1503]: 2026/11/07 15:19:13 INFO Received push request method=POST path=/api/pushes worker1 # [ 698.004531] nix-grpc-daemon[1057]: time=2026-11-07T15:19:13.313Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 698.006369] nix-grpc-daemon[1057]: time=2026-11-07T15:19:13.314Z level=INFO msg="Uploading hc1y87gwih533ialmn27srpss205zkns-local-input-lostnar (120B)" worker1 # [ 698.009785] nix-grpc-daemon[1057]: time=2026-11-07T15:19:13.318Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=48129d7668a247cf6fd3baaf14560839c1678516efa54dc096bef15b40e87f3f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=48129d7668a247cf6fd3baaf14560839c1678516efa54dc096bef15b40e87f3f" worker1 # [ 698.018768] nix-grpc-daemon[1057]: time=2026-11-07T15:19:13.318Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=964d3fe16607ed169bfe43c9bafef727d57a9b4685caec4773a5756d793a2e34\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=964d3fe16607ed169bfe43c9bafef727d57a9b4685caec4773a5756d793a2e34" worker1 # [ 698.112458] nix-grpc-daemon[1057]: time=2026-11-07T15:19:13.421Z level=WARN msg="Request failed, retrying" attempt=2 backoff=196.761063ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=964d3fe16607ed169bfe43c9bafef727d57a9b4685caec4773a5756d793a2e34\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=964d3fe16607ed169bfe43c9bafef727d57a9b4685caec4773a5756d793a2e34" worker1 # [ 698.121183] nix-grpc-daemon[1057]: time=2026-11-07T15:19:13.421Z level=WARN msg="Request failed, retrying" attempt=2 backoff=198.842967ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=48129d7668a247cf6fd3baaf14560839c1678516efa54dc096bef15b40e87f3f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=48129d7668a247cf6fd3baaf14560839c1678516efa54dc096bef15b40e87f3f" worker1 # [ 698.315854] nix-grpc-daemon[1057]: time=2026-11-07T15:19:13.623Z level=WARN msg="Request failed, retrying" attempt=3 backoff=395.340807ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=964d3fe16607ed169bfe43c9bafef727d57a9b4685caec4773a5756d793a2e34\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=964d3fe16607ed169bfe43c9bafef727d57a9b4685caec4773a5756d793a2e34" worker1 # [ 698.336690] nix-grpc-daemon[1057]: time=2026-11-07T15:19:13.624Z level=WARN msg="Request failed, retrying" attempt=3 backoff=383.167561ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=48129d7668a247cf6fd3baaf14560839c1678516efa54dc096bef15b40e87f3f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=48129d7668a247cf6fd3baaf14560839c1678516efa54dc096bef15b40e87f3f" worker1 # [ 699.751324] nix-grpc-daemon[1057]: time=2026-11-07T15:19:15.059Z level=WARN msg="Request failed, retrying" attempt=4 backoff=743.305551ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=964d3fe16607ed169bfe43c9bafef727d57a9b4685caec4773a5756d793a2e34\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=964d3fe16607ed169bfe43c9bafef727d57a9b4685caec4773a5756d793a2e34" worker1 # [ 700.496696] nix-grpc-daemon[1057]: time=2026-11-07T15:19:15.805Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.614531883s error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=964d3fe16607ed169bfe43c9bafef727d57a9b4685caec4773a5756d793a2e34\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=964d3fe16607ed169bfe43c9bafef727d57a9b4685caec4773a5756d793a2e34" worker1 # [ 701.800372] nix-grpc-daemon[1057]: time=2026-11-07T15:19:17.108Z level=WARN msg="Request failed, retrying" attempt=4 backoff=766.811737ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=48129d7668a247cf6fd3baaf14560839c1678516efa54dc096bef15b40e87f3f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=48129d7668a247cf6fd3baaf14560839c1678516efa54dc096bef15b40e87f3f" worker1 # [ 702.569514] nix-grpc-daemon[1057]: time=2026-11-07T15:19:17.878Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.584459855s error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=48129d7668a247cf6fd3baaf14560839c1678516efa54dc096bef15b40e87f3f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=48129d7668a247cf6fd3baaf14560839c1678516efa54dc096bef15b40e87f3f" worker1 # [ 705.195372] nix-grpc-daemon[1057]: time=2026-11-07T15:19:20.500Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=48129d7668a247cf6fd3baaf14560839c1678516efa54dc096bef15b40e87f3f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 705.221814] nix-daemon[1026]: reaped child process 2017, status = succeeded worker1 # [ 709.198710] nix-grpc-daemon[529]: ts=2026-11-07T15:19:24Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:52080 worker1 # [ 709.210897] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 709.319078] nix-daemon[1026]: accepted connection from pid 2026, user nix-grpc-daemon (trusted) worker1 # [ 709.332311] nix-daemon[1026]: reaped child process 2029, status = succeeded lb # [ 709.339281] niks3-server[1503]: 2026/11/07 15:19:24 INFO Received push request method=POST path=/api/pushes worker1 # [ 709.349168] nix-grpc-daemon[1057]: time=2026-11-07T15:19:24.657Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 709.351138] nix-grpc-daemon[1057]: time=2026-11-07T15:19:24.657Z level=INFO msg="Uploading hc1y87gwih533ialmn27srpss205zkns-local-input-lostnar (120B)" worker1 # [ 709.353759] nix-grpc-daemon[1057]: time=2026-11-07T15:19:24.662Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bbf99d3de370fc0e735462c5ad09d78c2fdac88de53738684bfd5c5448ff04b7\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bbf99d3de370fc0e735462c5ad09d78c2fdac88de53738684bfd5c5448ff04b7" worker1 # [ 709.362186] nix-grpc-daemon[1057]: time=2026-11-07T15:19:24.662Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae9b5b50bb18f05ab90abc6a587b5d2b236700cef91daaf23ebdf7e86ed4ed91\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae9b5b50bb18f05ab90abc6a587b5d2b236700cef91daaf23ebdf7e86ed4ed91" worker1 # [ 709.456651] nix-grpc-daemon[1057]: time=2026-11-07T15:19:24.765Z level=WARN msg="Request failed, retrying" attempt=2 backoff=216.637795ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae9b5b50bb18f05ab90abc6a587b5d2b236700cef91daaf23ebdf7e86ed4ed91\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae9b5b50bb18f05ab90abc6a587b5d2b236700cef91daaf23ebdf7e86ed4ed91" worker1 # [ 709.475285] nix-grpc-daemon[1057]: time=2026-11-07T15:19:24.765Z level=WARN msg="Request failed, retrying" attempt=2 backoff=194.055462ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bbf99d3de370fc0e735462c5ad09d78c2fdac88de53738684bfd5c5448ff04b7\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bbf99d3de370fc0e735462c5ad09d78c2fdac88de53738684bfd5c5448ff04b7" worker1 # [ 709.654930] nix-grpc-daemon[1057]: time=2026-11-07T15:19:24.963Z level=WARN msg="Request failed, retrying" attempt=3 backoff=423.910536ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bbf99d3de370fc0e735462c5ad09d78c2fdac88de53738684bfd5c5448ff04b7\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bbf99d3de370fc0e735462c5ad09d78c2fdac88de53738684bfd5c5448ff04b7" worker1 # [ 710.696435] nix-grpc-daemon[1057]: time=2026-11-07T15:19:26.004Z level=WARN msg="Request failed, retrying" attempt=3 backoff=389.612087ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae9b5b50bb18f05ab90abc6a587b5d2b236700cef91daaf23ebdf7e86ed4ed91\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae9b5b50bb18f05ab90abc6a587b5d2b236700cef91daaf23ebdf7e86ed4ed91" worker1 # [ 712.105416] nix-grpc-daemon[1057]: time=2026-11-07T15:19:27.411Z level=WARN msg="Request failed, retrying" attempt=4 backoff=766.159731ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae9b5b50bb18f05ab90abc6a587b5d2b236700cef91daaf23ebdf7e86ed4ed91\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae9b5b50bb18f05ab90abc6a587b5d2b236700cef91daaf23ebdf7e86ed4ed91" worker1 # [ 712.873769] nix-grpc-daemon[1057]: time=2026-11-07T15:19:28.182Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.719730326s error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae9b5b50bb18f05ab90abc6a587b5d2b236700cef91daaf23ebdf7e86ed4ed91\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae9b5b50bb18f05ab90abc6a587b5d2b236700cef91daaf23ebdf7e86ed4ed91" worker1 # [ 714.216289] nix-grpc-daemon[1057]: time=2026-11-07T15:19:29.523Z level=WARN msg="Request failed, retrying" attempt=4 backoff=752.759689ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bbf99d3de370fc0e735462c5ad09d78c2fdac88de53738684bfd5c5448ff04b7\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bbf99d3de370fc0e735462c5ad09d78c2fdac88de53738684bfd5c5448ff04b7" worker1 # [ 716.008307] nix-grpc-daemon[1057]: time=2026-11-07T15:19:31.315Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.584713199s error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bbf99d3de370fc0e735462c5ad09d78c2fdac88de53738684bfd5c5448ff04b7\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=bbf99d3de370fc0e735462c5ad09d78c2fdac88de53738684bfd5c5448ff04b7" worker1 # [ 717.596887] nix-grpc-daemon[1057]: time=2026-11-07T15:19:32.904Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae9b5b50bb18f05ab90abc6a587b5d2b236700cef91daaf23ebdf7e86ed4ed91\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 717.627597] nix-daemon[1026]: reaped child process 2024, status = succeeded worker1 # [ 721.622670] nix-grpc-daemon[529]: ts=2026-11-07T15:19:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:52080 worker1 # [ 721.634727] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 721.745891] nix-daemon[1026]: accepted connection from pid 2033, user nix-grpc-daemon (trusted) worker1 # [ 721.759376] nix-daemon[1026]: reaped child process 2036, status = succeeded lb # [ 721.766663] niks3-server[1503]: 2026/11/07 15:19:37 INFO Received push request method=POST path=/api/pushes worker1 # [ 721.776391] nix-grpc-daemon[1057]: time=2026-11-07T15:19:37.084Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 721.778396] nix-grpc-daemon[1057]: time=2026-11-07T15:19:37.084Z level=INFO msg="Uploading hc1y87gwih533ialmn27srpss205zkns-local-input-lostnar (120B)" worker1 # [ 721.781055] nix-grpc-daemon[1057]: time=2026-11-07T15:19:37.089Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a804bde7a4963447f4acef79a2847e218e52e01ed644951b39e65b69d37e692b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a804bde7a4963447f4acef79a2847e218e52e01ed644951b39e65b69d37e692b" worker1 # [ 721.789779] nix-grpc-daemon[1057]: time=2026-11-07T15:19:37.089Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5a90ca40d91e54cc432406403e1a24a680d1cc2ff474df0d91962bf1053ea324\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5a90ca40d91e54cc432406403e1a24a680d1cc2ff474df0d91962bf1053ea324" worker1 # [ 721.885427] nix-grpc-daemon[1057]: time=2026-11-07T15:19:37.193Z level=WARN msg="Request failed, retrying" attempt=2 backoff=209.60792ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a804bde7a4963447f4acef79a2847e218e52e01ed644951b39e65b69d37e692b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a804bde7a4963447f4acef79a2847e218e52e01ed644951b39e65b69d37e692b" worker1 # [ 721.905965] nix-grpc-daemon[1057]: time=2026-11-07T15:19:37.194Z level=WARN msg="Request failed, retrying" attempt=2 backoff=212.579682ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5a90ca40d91e54cc432406403e1a24a680d1cc2ff474df0d91962bf1053ea324\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5a90ca40d91e54cc432406403e1a24a680d1cc2ff474df0d91962bf1053ea324" worker1 # [ 722.100308] nix-grpc-daemon[1057]: time=2026-11-07T15:19:37.408Z level=WARN msg="Request failed, retrying" attempt=3 backoff=420.195581ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a804bde7a4963447f4acef79a2847e218e52e01ed644951b39e65b69d37e692b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a804bde7a4963447f4acef79a2847e218e52e01ed644951b39e65b69d37e692b" [e2e] heartbeat t=660s worker1 # [ 722.524268] nix-grpc-daemon[1057]: time=2026-11-07T15:19:37.832Z level=WARN msg="Request failed, retrying" attempt=4 backoff=802.523623ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a804bde7a4963447f4acef79a2847e218e52e01ed644951b39e65b69d37e692b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a804bde7a4963447f4acef79a2847e218e52e01ed644951b39e65b69d37e692b" worker1 # [ 723.331621] nix-grpc-daemon[1057]: time=2026-11-07T15:19:38.639Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.560554408s error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a804bde7a4963447f4acef79a2847e218e52e01ed644951b39e65b69d37e692b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a804bde7a4963447f4acef79a2847e218e52e01ed644951b39e65b69d37e692b" worker1 # [ 726.248409] nix-grpc-daemon[1057]: time=2026-11-07T15:19:41.556Z level=WARN msg="Request failed, retrying" attempt=3 backoff=392.244578ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5a90ca40d91e54cc432406403e1a24a680d1cc2ff474df0d91962bf1053ea324\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5a90ca40d91e54cc432406403e1a24a680d1cc2ff474df0d91962bf1053ea324" worker1 # [ 726.644242] nix-grpc-daemon[1057]: time=2026-11-07T15:19:41.952Z level=WARN msg="Request failed, retrying" attempt=4 backoff=807.502939ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5a90ca40d91e54cc432406403e1a24a680d1cc2ff474df0d91962bf1053ea324\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5a90ca40d91e54cc432406403e1a24a680d1cc2ff474df0d91962bf1053ea324" worker1 # [ 727.454494] nix-grpc-daemon[1057]: time=2026-11-07T15:19:42.762Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.492594642s error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5a90ca40d91e54cc432406403e1a24a680d1cc2ff474df0d91962bf1053ea324\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5a90ca40d91e54cc432406403e1a24a680d1cc2ff474df0d91962bf1053ea324" worker1 # [ 728.953771] nix-grpc-daemon[1057]: time=2026-11-07T15:19:44.259Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5a90ca40d91e54cc432406403e1a24a680d1cc2ff474df0d91962bf1053ea324\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 728.981515] nix-daemon[1026]: reaped child process 2031, status = succeeded worker1 # [ 732.956800] nix-grpc-daemon[529]: ts=2026-11-07T15:19:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:52080 worker1 # [ 732.968502] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 733.076750] nix-daemon[1026]: accepted connection from pid 2040, user nix-grpc-daemon (trusted) worker1 # [ 733.089899] nix-daemon[1026]: reaped child process 2043, status = succeeded lb # [ 733.097073] niks3-server[1503]: 2026/11/07 15:19:48 INFO Received push request method=POST path=/api/pushes worker1 # [ 733.107911] nix-grpc-daemon[1057]: time=2026-11-07T15:19:48.416Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 733.109917] nix-grpc-daemon[1057]: time=2026-11-07T15:19:48.418Z level=INFO msg="Uploading hc1y87gwih533ialmn27srpss205zkns-local-input-lostnar (120B)" worker1 # [ 733.113310] nix-grpc-daemon[1057]: time=2026-11-07T15:19:48.421Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4809c604f273caf0cf0098382dfa0c8e26583fe4575a5bbffaadb35bee12129e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4809c604f273caf0cf0098382dfa0c8e26583fe4575a5bbffaadb35bee12129e" worker1 # [ 733.121813] nix-grpc-daemon[1057]: time=2026-11-07T15:19:48.422Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31935b24257ce4265194ae4241733945807e461bdc777fd994f0c7220763cee6\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31935b24257ce4265194ae4241733945807e461bdc777fd994f0c7220763cee6" worker1 # [ 733.217772] nix-grpc-daemon[1057]: time=2026-11-07T15:19:48.526Z level=WARN msg="Request failed, retrying" attempt=2 backoff=180.198783ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4809c604f273caf0cf0098382dfa0c8e26583fe4575a5bbffaadb35bee12129e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4809c604f273caf0cf0098382dfa0c8e26583fe4575a5bbffaadb35bee12129e" worker1 # [ 733.240068] nix-grpc-daemon[1057]: time=2026-11-07T15:19:48.526Z level=WARN msg="Request failed, retrying" attempt=2 backoff=190.892659ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31935b24257ce4265194ae4241733945807e461bdc777fd994f0c7220763cee6\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31935b24257ce4265194ae4241733945807e461bdc777fd994f0c7220763cee6" worker1 # [ 733.402383] nix-grpc-daemon[1057]: time=2026-11-07T15:19:48.710Z level=WARN msg="Request failed, retrying" attempt=3 backoff=365.164871ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4809c604f273caf0cf0098382dfa0c8e26583fe4575a5bbffaadb35bee12129e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4809c604f273caf0cf0098382dfa0c8e26583fe4575a5bbffaadb35bee12129e" worker1 # [ 734.440201] nix-grpc-daemon[1057]: time=2026-11-07T15:19:49.747Z level=WARN msg="Request failed, retrying" attempt=3 backoff=427.676587ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31935b24257ce4265194ae4241733945807e461bdc777fd994f0c7220763cee6\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31935b24257ce4265194ae4241733945807e461bdc777fd994f0c7220763cee6" worker1 # [ 735.848387] nix-grpc-daemon[1057]: time=2026-11-07T15:19:51.156Z level=WARN msg="Request failed, retrying" attempt=4 backoff=810.228184ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4809c604f273caf0cf0098382dfa0c8e26583fe4575a5bbffaadb35bee12129e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4809c604f273caf0cf0098382dfa0c8e26583fe4575a5bbffaadb35bee12129e" worker1 # [ 736.661771] nix-grpc-daemon[1057]: time=2026-11-07T15:19:51.970Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.481255596s error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4809c604f273caf0cf0098382dfa0c8e26583fe4575a5bbffaadb35bee12129e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4809c604f273caf0cf0098382dfa0c8e26583fe4575a5bbffaadb35bee12129e" worker1 # [ 737.960425] nix-grpc-daemon[1057]: time=2026-11-07T15:19:53.268Z level=WARN msg="Request failed, retrying" attempt=4 backoff=824.533872ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31935b24257ce4265194ae4241733945807e461bdc777fd994f0c7220763cee6\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31935b24257ce4265194ae4241733945807e461bdc777fd994f0c7220763cee6" worker1 # [ 738.787605] nix-grpc-daemon[1057]: time=2026-11-07T15:19:54.096Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.485509857s error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31935b24257ce4265194ae4241733945807e461bdc777fd994f0c7220763cee6\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=31935b24257ce4265194ae4241733945807e461bdc777fd994f0c7220763cee6" worker1 # [ 740.280525] nix-grpc-daemon[1057]: time=2026-11-07T15:19:55.586Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4809c604f273caf0cf0098382dfa0c8e26583fe4575a5bbffaadb35bee12129e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 740.308185] nix-daemon[1026]: reaped child process 2038, status = succeeded worker1 # [ 744.283739] nix-grpc-daemon[529]: ts=2026-11-07T15:19:59Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv6:%5B2001:db8:1::1%5D:52080 worker1 # [ 744.297394] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 744.405768] nix-daemon[1026]: accepted connection from pid 2047, user nix-grpc-daemon (trusted) worker1 # [ 744.419138] nix-daemon[1026]: reaped child process 2050, status = succeeded lb # [ 744.425901] niks3-server[1503]: 2026/11/07 15:19:59 INFO Received push request method=POST path=/api/pushes worker1 # [ 744.437796] nix-grpc-daemon[1057]: time=2026-11-07T15:19:59.746Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker1 # [ 744.439653] nix-grpc-daemon[1057]: time=2026-11-07T15:19:59.748Z level=INFO msg="Uploading hc1y87gwih533ialmn27srpss205zkns-local-input-lostnar (120B)" worker1 # [ 744.443052] nix-grpc-daemon[1057]: time=2026-11-07T15:19:59.751Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1790896d723300465e6d0efbc93727dda13c4343073fc672b1608b706b48a832\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1790896d723300465e6d0efbc93727dda13c4343073fc672b1608b706b48a832" worker1 # [ 744.451923] nix-grpc-daemon[1057]: time=2026-11-07T15:19:59.760Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6b310c9d6ded1e7cc0c5db216a68ab50d3b220311d0eba163347485dfdb565fa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6b310c9d6ded1e7cc0c5db216a68ab50d3b220311d0eba163347485dfdb565fa" worker1 # [ 744.556324] nix-grpc-daemon[1057]: time=2026-11-07T15:19:59.864Z level=WARN msg="Request failed, retrying" attempt=2 backoff=216.190536ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6b310c9d6ded1e7cc0c5db216a68ab50d3b220311d0eba163347485dfdb565fa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6b310c9d6ded1e7cc0c5db216a68ab50d3b220311d0eba163347485dfdb565fa" worker1 # [ 744.580372] nix-grpc-daemon[1057]: time=2026-11-07T15:19:59.864Z level=WARN msg="Request failed, retrying" attempt=2 backoff=199.62498ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1790896d723300465e6d0efbc93727dda13c4343073fc672b1608b706b48a832\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1790896d723300465e6d0efbc93727dda13c4343073fc672b1608b706b48a832" worker1 # [ 745.831981] nix-grpc-daemon[1057]: time=2026-11-07T15:20:01.139Z level=WARN msg="Request failed, retrying" attempt=3 backoff=399.613839ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1790896d723300465e6d0efbc93727dda13c4343073fc672b1608b706b48a832\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1790896d723300465e6d0efbc93727dda13c4343073fc672b1608b706b48a832" worker1 # [ 746.234707] nix-grpc-daemon[1057]: time=2026-11-07T15:20:01.543Z level=WARN msg="Request failed, retrying" attempt=4 backoff=832.632657ms error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1790896d723300465e6d0efbc93727dda13c4343073fc672b1608b706b48a832\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1790896d723300465e6d0efbc93727dda13c4343073fc672b1608b706b48a832" worker1 # [ 747.880383] nix-grpc-daemon[1057]: time=2026-11-07T15:20:03.188Z level=WARN msg="Request failed, retrying" attempt=3 backoff=401.4713ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6b310c9d6ded1e7cc0c5db216a68ab50d3b220311d0eba163347485dfdb565fa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6b310c9d6ded1e7cc0c5db216a68ab50d3b220311d0eba163347485dfdb565fa" worker1 # [ 748.285561] nix-grpc-daemon[1057]: time=2026-11-07T15:20:03.593Z level=WARN msg="Request failed, retrying" attempt=4 backoff=792.168747ms error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6b310c9d6ded1e7cc0c5db216a68ab50d3b220311d0eba163347485dfdb565fa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6b310c9d6ded1e7cc0c5db216a68ab50d3b220311d0eba163347485dfdb565fa" worker1 # [ 750.120387] nix-grpc-daemon[1057]: time=2026-11-07T15:20:05.428Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.752921964s error="Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6b310c9d6ded1e7cc0c5db216a68ab50d3b220311d0eba163347485dfdb565fa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6b310c9d6ded1e7cc0c5db216a68ab50d3b220311d0eba163347485dfdb565fa" worker1 # [ 751.208302] nix-grpc-daemon[1057]: time=2026-11-07T15:20:06.515Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.729295802s error="Put \"http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1790896d723300465e6d0efbc93727dda13c4343073fc672b1608b706b48a832\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/hc1y87gwih533ialmn27srpss205zkns.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=1790896d723300465e6d0efbc93727dda13c4343073fc672b1608b706b48a832" [e2e] heartbeat t=690s worker1 # [ 752.945165] nix-grpc-daemon[1057]: time=2026-11-07T15:20:08.249Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6b310c9d6ded1e7cc0c5db216a68ab50d3b220311d0eba163347485dfdb565fa\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 client # [ 752.964429] sshd-session[3389]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 752.971892] nix-daemon[1026]: reaped child process 2045, status = succeeded client # [ 752.972962] sshd-session[3389]: Disconnected from user root UNKNOWN port 65535 client # [ 752.977567] sshd-session[3383]: pam_unix(sshd:session): session closed for user root client # [ 752.981977] systemd[1]: sshd-vsock@200-201-3:22-2:200.service: Deactivated successfully. client # [ 752.988646] systemd[1]: session-202.scope: Deactivated successfully. client # [ 752.991750] systemd[1]: session-202.scope: Consumed 228ms CPU time over 2min 12.767s wall clock time, 32M memory peak, 8K written to disk, 19.3K incoming IP traffic, 16.3K outgoing IP traffic. client # [ 752.999460] systemd-logind[465]: Session 202 logged out. Waiting for processes to exit. client # [ 753.003543] systemd-logind[465]: Removed session 202. thread 'farm::serial::an_input_whose_nar_the_cache_lost_is_built_again' (1612) panicked at harness.rs:216:5: assertion `left == right` failed: [client] failed (1): nix copy --no-check-sigs --to 'grpc://worker1:50051?client-cert=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.pem&client-key=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.key&ca-cert=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ca.pem' /nix/store/hc1y87gwih533ialmn27srpss205zkns-local-input-lostnar copying 1 paths... copying path '/nix/store/hc1y87gwih533ialmn27srpss205zkns-local-input-lostnar' to 'grpc://worker1:50051'... worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151755Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d513455684defca30be4a41286a2e3e6fc8a1dd09ab1b96a1ea4cae9a424641d": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151805Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4ad05c069ed6c87c907b8aba979085b973f26fdd8c65bdb6374f5cd2830e5b08": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151819Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=754b1964ef2ccd30fb07404cc367f8a3e4b06842b5187d1f06a74297d829f681": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151831Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=11218f24727159a664d11b4059191a9f3f0b98da792f53de85a362ed8da69d49": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151846Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83d7a04c373cf4aceb1f3b3b2cd568fdb7cb6b8d8a29e353e8377166cb588e50": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151857Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9cad9d6c1f2bd408b3014db759f97471b5cad2b4b2b973d5502ad856ba11a18d": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151913Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=48129d7668a247cf6fd3baaf14560839c1678516efa54dc096bef15b40e87f3f": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151924Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ae9b5b50bb18f05ab90abc6a587b5d2b236700cef91daaf23ebdf7e86ed4ed91": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151937Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5a90ca40d91e54cc432406403e1a24a680d1cc2ff474df0d91962bf1053ea324": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151948Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=4809c604f273caf0cf0098382dfa0c8e26583fe4575a5bbffaadb35bee12129e": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying error: gRPC AddMultipleToStore on 'worker1:50051' failed: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading NAR nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/0j7s38h04cyv43q9ch7jdv6qx5ji5mgf0a1az12gl0mw8pw7367r.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T151959Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=6b310c9d6ded1e7cc0c5db216a68ab50d3b220311d0eba163347485dfdb565fa": dial tcp [2001:db8:1::2]:9000: connect: connection refused hint: Set NIX_GRPC_DEBUG=1 for a handshake trace. left: 1 right: 0 FAILED test farm::serial::balancer_auth_client_cert_token_nothing_unknown_cn ... worker1 # [ 753.044674] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 753.052266] systemd[1]: Started SSH per-connection Daemon (vsock:2:38). worker1 # [ 753.115381] sshd-session[2052]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 753.120123] sshd-session[2052]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 753.125757] sshd-session[2052]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 753.138540] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 753.144387] systemd-logind[608]: New session '46' of user 'root' with class 'user' and type 'tty'. worker1 # [ 753.161203] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 753.165388] systemd[1]: Starting User Manager for UID 0... worker1 # [ 753.180757] (systemd)[2060]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 753.184646] systemd-logind[608]: New session '47' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 753.260098] systemd[2060]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 753.326426] systemd[2060]: Queued start job for default target Main User Target. worker1 # [ 753.328695] systemd[2060]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 753.330871] systemd[2060]: Created slice User Application Slice. worker1 # [ 753.331824] systemd[2060]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 753.332936] systemd[2060]: Reached target Paths. worker1 # [ 753.334135] systemd[2060]: Reached target Timers. worker1 # [ 753.336068] systemd[2060]: Starting D-Bus User Message Bus Socket... worker1 # [ 753.339519] systemd[2060]: Starting Create User Files and Directories... worker1 # [ 753.361792] systemd[2060]: Finished Create User Files and Directories. worker1 # [ 753.365100] systemd[2060]: Listening on D-Bus User Message Bus Socket. worker1 # [ 753.365953] systemd[2060]: Reached target Sockets. worker1 # [ 753.367200] systemd[2060]: Reached target Basic System. worker1 # [ 753.367987] systemd[2060]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 753.369278] systemd[2060]: Reached target Main User Target. worker1 # [ 753.371852] systemd[2060]: Startup finished in 169ms. worker1 # [ 753.372660] systemd[1]: Started User Manager for UID 0. worker1 # [ 753.374659] systemd[1]: Started Session 46 of User root. worker1 # [ 753.394621] sshd-session[2073]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 753.396419] sshd-session[2073]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 753.397630] sshd-session[2052]: pam_unix(sshd:session): session closed for user root worker1 # [ 753.400436] systemd[1]: sshd-vsock@38-39-5:22-2:38.service: Deactivated successfully. worker1 # [ 753.404104] systemd[1]: session-46.scope: Deactivated successfully. worker1 # [ 753.407302] systemd-logind[608]: Session 46 logged out. Waiting for processes to exit. worker1 # [ 753.408973] systemd-logind[608]: Removed session 46. worker2 # [ 753.441572] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 753.452475] systemd[1]: Started SSH per-connection Daemon (vsock:2:27). worker2 # [ 753.518865] sshd-session[1942]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 753.524142] sshd-session[1942]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 753.529686] sshd-session[1942]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 753.539965] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 753.550186] systemd-logind[555]: New session '34' of user 'root' with class 'user' and type 'tty'. worker2 # [ 753.564159] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 753.568825] systemd[1]: Starting User Manager for UID 0... worker2 # [ 753.584498] (systemd)[1951]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 753.588466] systemd-logind[555]: New session '35' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 753.665330] systemd[1951]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 753.735426] systemd[1951]: Queued start job for default target Main User Target. worker2 # [ 753.737717] systemd[1951]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 753.739954] systemd[1951]: Created slice User Application Slice. worker2 # [ 753.741138] systemd[1951]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 753.742154] systemd[1951]: Reached target Paths. worker2 # [ 753.742805] systemd[1951]: Reached target Timers. worker2 # [ 753.745080] systemd[1951]: Starting D-Bus User Message Bus Socket... worker2 # [ 753.746842] systemd[1951]: Starting Create User Files and Directories... worker2 # [ 753.772291] systemd[1951]: Finished Create User Files and Directories. worker2 # [ 753.775207] systemd[1951]: Listening on D-Bus User Message Bus Socket. worker2 # [ 753.776546] systemd[1951]: Reached target Sockets. worker2 # [ 753.777336] systemd[1951]: Reached target Basic System. worker2 # [ 753.778476] systemd[1951]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 753.780127] systemd[1951]: Reached target Main User Target. worker2 # [ 753.780915] systemd[1951]: Startup finished in 177ms. worker2 # [ 753.783347] systemd[1]: Started User Manager for UID 0. worker2 # [ 753.784481] systemd[1]: Started Session 34 of User root. worker2 # [ 753.809757] sshd-session[1964]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 753.811589] sshd-session[1964]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 753.812803] sshd-session[1942]: pam_unix(sshd:session): session closed for user root worker2 # [ 753.816244] systemd[1]: sshd-vsock@27-28-6:22-2:27.service: Deactivated successfully. worker2 # [ 753.819821] systemd[1]: session-34.scope: Deactivated successfully. worker2 # [ 753.823120] systemd-logind[555]: Session 34 logged out. Waiting for processes to exit. worker2 # [ 753.824725] systemd-logind[555]: Removed session 34. lb # [ 753.846857] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 753.855144] systemd[1]: Started SSH per-connection Daemon (vsock:2:32). lb # [ 753.924147] sshd-session[1681]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 753.929328] sshd-session[1681]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 753.935064] sshd-session[1681]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 753.947529] systemd-logind[553]: New session '40' of user 'root' with class 'user' and type 'tty'. lb # [ 753.954649] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 753.979747] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 753.984230] systemd[1]: Starting User Manager for UID 0... lb # [ 754.001166] (systemd)[1690]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 754.005788] systemd-logind[553]: New session '41' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 754.084797] systemd[1690]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 754.157517] systemd[1690]: Queued start job for default target Main User Target. lb # [ 754.159731] systemd[1690]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 754.161965] systemd[1690]: Created slice User Application Slice. lb # [ 754.162913] systemd[1690]: Started Daily Cleanup of User's Temporary Directories. lb # [ 754.163987] systemd[1690]: Reached target Paths. lb # [ 754.165460] systemd[1690]: Reached target Timers. lb # [ 754.167066] systemd[1690]: Starting D-Bus User Message Bus Socket... lb # [ 754.169066] systemd[1690]: Starting Create User Files and Directories... lb # [ 754.195494] systemd[1690]: Finished Create User Files and Directories. lb # [ 754.198329] systemd[1690]: Listening on D-Bus User Message Bus Socket. lb # [ 754.200066] systemd[1690]: Reached target Sockets. lb # [ 754.200775] systemd[1690]: Reached target Basic System. lb # [ 754.201512] systemd[1690]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 754.202893] systemd[1690]: Reached target Main User Target. lb # [ 754.204125] systemd[1690]: Startup finished in 182ms. lb # [ 754.204850] systemd[1]: Started User Manager for UID 0. lb # [ 754.208491] systemd[1]: Started Session 40 of User root. lb # [ 754.235720] sshd-session[1703]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 754.237515] sshd-session[1703]: Disconnected from user root UNKNOWN port 65535 lb # [ 754.238797] sshd-session[1681]: pam_unix(sshd:session): session closed for user root lb # [ 754.242221] systemd[1]: sshd-vsock@32-33-4:22-2:32.service: Deactivated successfully. lb # [ 754.245887] systemd[1]: session-40.scope: Deactivated successfully. lb # [ 754.247498] systemd[1]: session-40.scope: Consumed 17ms CPU time over 38ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 754.251309] systemd-logind[553]: Session 40 logged out. Waiting for processes to exit. lb # [ 754.252811] systemd-logind[553]: Removed session 40. worker1 # [ 754.347774] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 754.356677] systemd[1]: Started SSH per-connection Daemon (vsock:2:39). worker1 # [ 754.424724] sshd-session[2079]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 754.429702] sshd-session[2079]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 754.434780] sshd-session[2079]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 754.441230] systemd-logind[608]: New session '48' of user 'root' with class 'user' and type 'tty'. worker1 # [ 754.444415] systemd[1]: Started Session 48 of User root. worker1 # [ 754.467842] sshd-session[2085]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 754.469621] sshd-session[2085]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 754.470875] sshd-session[2079]: pam_unix(sshd:session): session closed for user root worker1 # [ 754.473846] systemd[1]: sshd-vsock@39-40-5:22-2:39.service: Deactivated successfully. worker1 # [ 754.477583] systemd[1]: session-48.scope: Deactivated successfully. worker1 # [ 754.479067] systemd[1]: session-48.scope: Consumed 15ms CPU time over 34ms wall clock time, 3.1M memory peak, 17.7K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 754.482717] systemd-logind[608]: Session 48 logged out. Waiting for processes to exit. worker1 # [ 754.484386] systemd-logind[608]: Removed session 48. client # [ 754.544694] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 754.553819] systemd[1]: Started SSH per-connection Daemon (vsock:2:201). client # [ 754.617749] sshd-session[3409]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 754.622126] sshd-session[3409]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 754.627378] sshd-session[3409]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 754.634133] systemd-logind[465]: New session '203' of user 'root' with class 'user' and type 'tty'. client # [ 754.636357] systemd[1]: Started Session 203 of User root. client # [ 754.651369] sshd-session[3415]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 754.653190] sshd-session[3415]: Disconnected from user root UNKNOWN port 65535 client # [ 754.654547] sshd-session[3409]: pam_unix(sshd:session): session closed for user root client # [ 754.657881] systemd[1]: sshd-vsock@201-202-3:22-2:201.service: Deactivated successfully. client # [ 754.662293] systemd[1]: session-203.scope: Deactivated successfully. client # [ 754.666351] systemd-logind[465]: Session 203 logged out. Waiting for processes to exit. client # [ 754.668116] systemd-logind[465]: Removed session 203. client # [ 754.743374] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 754.750840] systemd[1]: Started SSH per-connection Daemon (vsock:2:202). client # [ 754.804379] sshd-session[3420]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 754.809340] sshd-session[3420]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 754.814194] sshd-session[3420]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 754.820763] systemd-logind[465]: New session '204' of user 'root' with class 'user' and type 'tty'. client # [ 754.823244] systemd[1]: Started Session 204 of User root. worker1 # [ 754.939617] nix-grpc-daemon[529]: ts=2026-11-07T15:20:10Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 754.953257] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 754.980309] nix-daemon[1026]: reaped child process 1201, status = succeeded worker1 # [ 754.982310] nix-daemon[1026]: reaped child process 1028, status = succeeded worker1 # [ 754.988339] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 23 ms (attempt 1/5) worker1 # [ 755.017457] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 15 ms (attempt 2/5) worker1 # [ 755.033945] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 31 ms (attempt 3/5) worker1 # [ 755.066768] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 160 ms (attempt 4/5) worker1 # [ 755.229359] nix-grpc-daemon[529]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker1 # [ 755.232796] nix-grpc-daemon[529]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 755.246909] garage[913]: 2026-11-07T15:20:10.514102Z INFO garage_api_common::generic_server: 127.0.0.1:43364 (key GK0123456789abcdef01234567) HEAD /farm/3xd6dbxz1qssv249bz933ccxrijwf6j8.narinfo lb # [ 755.254275] garage[913]: 2026-11-07T15:20:10.521292Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 755.264608] nix-grpc-daemon[1514]: ts=2026-11-07T15:20:10Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 755.279353] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 755.294289] nix-daemon[986]: reaped child process 1592, status = succeeded worker2 # [ 755.304485] nix-grpc-daemon[1514]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 37 ms (attempt 1/5) worker2 # [ 755.348942] nix-grpc-daemon[1514]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 170 ms (attempt 2/5) worker2 # [ 755.521193] nix-grpc-daemon[1514]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 358 ms (attempt 3/5) worker2 # [ 755.881379] nix-grpc-daemon[1514]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org; retrying in 339 ms (attempt 4/5) worker2 # [ 756.222699] nix-grpc-daemon[1514]: disabling binary cache 'https://cache.nixos.org' for 60 seconds worker2 # [ 756.226101] nix-grpc-daemon[1514]: warning: unable to download 'https://cache.nixos.org/nix-cache-info': Could not resolve hostname (6) Could not resolve host: cache.nixos.org lb # [ 756.238357] garage[913]: 2026-11-07T15:20:11.505680Z INFO garage_api_common::generic_server: 127.0.0.1:43364 (key GK0123456789abcdef01234567) HEAD /farm/3xd6dbxz1qssv249bz933ccxrijwf6j8.narinfo lb # [ 756.244639] garage[913]: 2026-11-07T15:20:11.506337Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 756.245750] nix-grpc-daemon[1514]: ts=2026-11-07T15:20:11Z level=debug event=path_info_miss path=3xd6dbxz1qssv249bz933ccxrijwf6j8-nixos-system-client-test error="error: path '/nix/store/3xd6dbxz1qssv249bz933ccxrijwf6j8-nixos-system-client-test' is required, but there is no substituter that can build it" worker1 # [ 756.256612] nix-grpc-daemon[529]: ts=2026-11-07T15:20:11Z level=debug event=rpc_start method=QueryPathInfos cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 756.262880] garage[913]: 2026-11-07T15:20:11.530639Z INFO garage_api_common::generic_server: 127.0.0.1:43364 (key GK0123456789abcdef01234567) HEAD /farm/3xd6dbxz1qssv249bz933ccxrijwf6j8.narinfo lb # [ 756.270120] garage[913]: 2026-11-07T15:20:11.537369Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 756.273534] nix-grpc-daemon[529]: ts=2026-11-07T15:20:11Z level=debug event=path_info_miss path=3xd6dbxz1qssv249bz933ccxrijwf6j8-nixos-system-client-test error="error: path '/nix/store/3xd6dbxz1qssv249bz933ccxrijwf6j8-nixos-system-client-test' is required, but there is no substituter that can build it" client # [ 756.301249] sshd-session[3426]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 756.304537] sshd-session[3426]: Disconnected from user root UNKNOWN port 65535 client # [ 756.308889] sshd-session[3420]: pam_unix(sshd:session): session closed for user root client # [ 756.315531] systemd[1]: sshd-vsock@202-203-3:22-2:202.service: Deactivated successfully. client # [ 756.324442] systemd[1]: session-204.scope: Deactivated successfully. client # [ 756.327341] systemd[1]: session-204.scope: Consumed 106ms CPU time over 1.503s wall clock time, 29.8M memory peak, 6.1K incoming IP traffic, 4.5K outgoing IP traffic. client # [ 756.334850] systemd-logind[465]: Session 204 logged out. Waiting for processes to exit. client # [ 756.339167] systemd-logind[465]: Removed session 204. client # [ 756.345498] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 756.349611] systemd[1]: Started SSH per-connection Daemon (vsock:2:203). client # [ 756.395337] sshd-session[3442]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 756.400366] sshd-session[3442]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 756.405620] sshd-session[3442]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 756.412068] systemd-logind[465]: New session '205' of user 'root' with class 'user' and type 'tty'. client # [ 756.415430] systemd[1]: Started Session 205 of User root. client # [ 756.459538] sshd-session[3448]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 756.461351] sshd-session[3448]: Disconnected from user root UNKNOWN port 65535 client # [ 756.462606] sshd-session[3442]: pam_unix(sshd:session): session closed for user root client # [ 756.465692] systemd[1]: sshd-vsock@203-204-3:22-2:203.service: Deactivated successfully. client # [ 756.469446] systemd[1]: session-205.scope: Deactivated successfully. client # [ 756.470934] systemd[1]: session-205.scope: Consumed 20ms CPU time over 55ms wall clock time, 4.8M memory peak, 1001B incoming IP traffic, 560B outgoing IP traffic. client # [ 756.474743] systemd-logind[465]: Session 205 logged out. Waiting for processes to exit. client # [ 756.476413] systemd-logind[465]: Removed session 205. client # [ 756.545091] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 756.548749] systemd[1]: Started SSH per-connection Daemon (vsock:2:204). client # [ 756.594790] sshd-session[3456]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 756.599913] sshd-session[3456]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 756.605301] sshd-session[3456]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 756.611238] systemd-logind[465]: New session '206' of user 'root' with class 'user' and type 'tty'. client # [ 756.615305] systemd[1]: Started Session 206 of User root. client # [ 756.632953] sshd-session[3462]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 756.634646] sshd-session[3462]: Disconnected from user root UNKNOWN port 65535 client # [ 756.636299] sshd-session[3456]: pam_unix(sshd:session): session closed for user root client # [ 756.639067] systemd[1]: sshd-vsock@204-205-3:22-2:204.service: Deactivated successfully. client # [ 756.642652] systemd[1]: session-206.scope: Deactivated successfully. client # [ 756.645954] systemd-logind[465]: Session 206 logged out. Waiting for processes to exit. client # [ 756.647611] systemd-logind[465]: Removed session 206. client # [ 756.747850] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 756.757224] systemd[1]: Started SSH per-connection Daemon (vsock:2:205). client # [ 756.824686] sshd-session[3467]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 756.829124] sshd-session[3467]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 756.834513] sshd-session[3467]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 756.839880] systemd-logind[465]: New session '207' of user 'root' with class 'user' and type 'tty'. client # [ 756.844445] systemd[1]: Started Session 207 of User root. client # [ 756.859923] sshd-session[3473]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 756.861643] sshd-session[3473]: Disconnected from user root UNKNOWN port 65535 client # [ 756.862930] sshd-session[3467]: pam_unix(sshd:session): session closed for user root client # [ 756.865836] systemd[1]: sshd-vsock@205-206-3:22-2:205.service: Deactivated successfully. client # [ 756.869482] systemd[1]: session-207.scope: Deactivated successfully. client # [ 756.872732] systemd-logind[465]: Session 207 logged out. Waiting for processes to exit. client # [ 756.874969] systemd-logind[465]: Removed session 207. client # [ 756.946515] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 756.950830] systemd[1]: Started SSH per-connection Daemon (vsock:2:206). client # [ 756.996474] sshd-session[3478]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 757.002263] sshd-session[3478]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 757.007604] sshd-session[3478]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 757.014198] systemd-logind[465]: New session '208' of user 'root' with class 'user' and type 'tty'. client # [ 757.016403] systemd[1]: Started Session 208 of User root. client # [ 757.032318] sshd-session[3484]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 757.033975] sshd-session[3484]: Disconnected from user root UNKNOWN port 65535 client # [ 757.035304] sshd-session[3478]: pam_unix(sshd:session): session closed for user root client # [ 757.038162] systemd[1]: sshd-vsock@206-207-3:22-2:206.service: Deactivated successfully. client # [ 757.041602] systemd[1]: session-208.scope: Deactivated successfully. client # [ 757.044801] systemd-logind[465]: Session 208 logged out. Waiting for processes to exit. client # [ 757.048429] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 757.051629] systemd[1]: Started SSH per-connection Daemon (vsock:2:207). client # [ 757.054191] systemd-logind[465]: Removed session 208. client # [ 757.099882] sshd-session[3489]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 757.104917] sshd-session[3489]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 757.110259] sshd-session[3489]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 757.115590] systemd-logind[465]: New session '209' of user 'root' with class 'user' and type 'tty'. client # [ 757.120403] systemd[1]: Started Session 209 of User root. worker1 # [ 757.239809] nix-grpc-daemon[529]: ts=2026-11-07T15:20:12Z level=debug event=rpc_start method=QueryMissing cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:60242 lb # [ 757.246088] garage[913]: 2026-11-07T15:20:12.513669Z INFO garage_api_common::generic_server: 127.0.0.1:43364 (key GK0123456789abcdef01234567) HEAD /farm/3xd6dbxz1qssv249bz933ccxrijwf6j8.narinfo lb # [ 757.252098] garage[913]: 2026-11-07T15:20:12.514316Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 757.267805] nix-grpc-daemon[1514]: ts=2026-11-07T15:20:12Z level=info event=oidc_jwks provider=mock keys=1 worker2 # [ 757.272549] nix-grpc-daemon[1514]: ts=2026-11-07T15:20:12Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:44924 lb # [ 757.277157] garage[913]: 2026-11-07T15:20:12.543672Z INFO garage_api_common::generic_server: 127.0.0.1:43364 (key GK0123456789abcdef01234567) HEAD /farm/3xd6dbxz1qssv249bz933ccxrijwf6j8.narinfo worker2 # [ 757.278242] nix-grpc-daemon[1514]: ts=2026-11-07T15:20:12Z level=debug event=path_info_miss path=3xd6dbxz1qssv249bz933ccxrijwf6j8-nixos-system-client-test error="error: path '/nix/store/3xd6dbxz1qssv249bz933ccxrijwf6j8-nixos-system-client-test' is required, but there is no substituter that can build it" lb # [ 757.283741] garage[913]: 2026-11-07T15:20:12.544196Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 757.292650] nix-grpc-daemon[529]: ts=2026-11-07T15:20:12Z level=debug event=rpc_start method=QueryPathInfos cn=oidc:mock:dev:alice peer=ipv4:192.168.1.2:60242 lb # [ 757.298164] garage[913]: 2026-11-07T15:20:12.566575Z INFO garage_api_common::generic_server: 127.0.0.1:43364 (key GK0123456789abcdef01234567) HEAD /farm/3xd6dbxz1qssv249bz933ccxrijwf6j8.narinfo lb # [ 757.304569] garage[913]: 2026-11-07T15:20:12.572966Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 757.312453] nix-grpc-daemon[529]: ts=2026-11-07T15:20:12Z level=debug event=path_info_miss path=3xd6dbxz1qssv249bz933ccxrijwf6j8-nixos-system-client-test error="error: path '/nix/store/3xd6dbxz1qssv249bz933ccxrijwf6j8-nixos-system-client-test' is required, but there is no substituter that can build it" client # [ 758.350791] sshd-session[3495]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 758.354902] sshd-session[3495]: Disconnected from user root UNKNOWN port 65535 client # [ 758.359514] sshd-session[3489]: pam_unix(sshd:session): session closed for user root client # [ 758.367330] systemd[1]: sshd-vsock@207-208-3:22-2:207.service: Deactivated successfully. client # [ 758.374958] systemd[1]: session-209.scope: Deactivated successfully. client # [ 758.378673] systemd[1]: session-209.scope: Consumed 113ms CPU time over 1.257s wall clock time, 30.1M memory peak, 4.2K incoming IP traffic, 5.2K outgoing IP traffic. client # [ 758.386806] systemd-logind[465]: Session 209 logged out. Waiting for processes to exit. client # [ 758.389912] systemd-logind[465]: Removed session 209. client # [ 758.451936] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 758.462168] systemd[1]: Started SSH per-connection Daemon (vsock:2:208). client # [ 758.524871] sshd-session[3517]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 758.530087] sshd-session[3517]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 758.535432] sshd-session[3517]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 758.541066] systemd-logind[465]: New session '210' of user 'root' with class 'user' and type 'tty'. client # [ 758.545394] systemd[1]: Started Session 210 of User root. client # [ 758.561574] sshd-session[3523]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 758.563302] sshd-session[3523]: Disconnected from user root UNKNOWN port 65535 client # [ 758.564556] sshd-session[3517]: pam_unix(sshd:session): session closed for user root client # [ 758.567492] systemd[1]: sshd-vsock@208-209-3:22-2:208.service: Deactivated successfully. client # [ 758.570983] systemd[1]: session-210.scope: Deactivated successfully. client # [ 758.574273] systemd-logind[465]: Session 210 logged out. Waiting for processes to exit. client # [ 758.575809] systemd-logind[465]: Removed session 210. lb # [ 758.618416] envoy[912]: conn peer=[2001:db8:1::1]:45254 tls=TLSv1.3 subject="CN=ci-1" sni=- flags=- tls_fail="-" rx=732 tx=407 ms=1349 lb # [ 758.622327] envoy[912]: conn peer=[2001:db8:1::1]:45256 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=2596 tx=357 ms=83 client # [ 758.650958] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 758.654589] systemd[1]: Started SSH per-connection Daemon (vsock:2:209). client # [ 758.700520] sshd-session[3528]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 758.705645] sshd-session[3528]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 758.711068] sshd-session[3528]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 758.717064] systemd-logind[465]: New session '211' of user 'root' with class 'user' and type 'tty'. client # [ 758.720410] systemd[1]: Started Session 211 of User root. client # [ 758.736877] sshd-session[3534]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 758.738150] sshd-session[3534]: Disconnected from user root UNKNOWN port 65535 client # [ 758.739421] sshd-session[3528]: pam_unix(sshd:session): session closed for user root client # [ 758.742583] systemd[1]: sshd-vsock@209-210-3:22-2:209.service: Deactivated successfully. client # [ 758.746274] systemd[1]: session-211.scope: Deactivated successfully. client # [ 758.749556] systemd-logind[465]: Session 211 logged out. Waiting for processes to exit. client # [ 758.752970] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 758.756281] systemd[1]: Started SSH per-connection Daemon (vsock:2:210). client # [ 758.759208] systemd-logind[465]: Removed session 211. client # [ 758.804477] sshd-session[3539]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 758.809628] sshd-session[3539]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 758.815038] sshd-session[3539]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 758.821743] systemd-logind[465]: New session '212' of user 'root' with class 'user' and type 'tty'. client # [ 758.824621] systemd[1]: Started Session 212 of User root. worker2 # [ 758.939851] nix-grpc-daemon[1514]: ts=2026-11-07T15:20:14Z level=info event=denied method=QueryMissing cn=- role=none client # [ 758.956152] sshd-session[3545]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 758.957509] sshd-session[3545]: Disconnected from user root UNKNOWN port 65535 client # [ 758.958806] sshd-session[3539]: pam_unix(sshd:session): session closed for user root client # [ 758.961924] systemd[1]: sshd-vsock@210-211-3:22-2:210.service: Deactivated successfully. client # [ 758.965684] systemd[1]: session-212.scope: Deactivated successfully. client # [ 758.967295] systemd[1]: session-212.scope: Consumed 88ms CPU time over 142ms wall clock time, 25.8M memory peak, 3.8K incoming IP traffic, 2.7K outgoing IP traffic. client # [ 758.970955] systemd-logind[465]: Session 212 logged out. Waiting for processes to exit. client # [ 758.972569] systemd-logind[465]: Removed session 212. client # [ 759.053445] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 759.057267] systemd[1]: Started SSH per-connection Daemon (vsock:2:211). client # [ 759.103529] sshd-session[3558]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 759.108589] sshd-session[3558]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 759.114101] sshd-session[3558]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 759.120208] systemd-logind[465]: New session '213' of user 'root' with class 'user' and type 'tty'. client # [ 759.123352] systemd[1]: Started Session 213 of User root. client # [ 759.139371] sshd-session[3564]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 759.141153] sshd-session[3564]: Disconnected from user root UNKNOWN port 65535 client # [ 759.142461] sshd-session[3558]: pam_unix(sshd:session): session closed for user root client # [ 759.146239] systemd[1]: sshd-vsock@211-212-3:22-2:211.service: Deactivated successfully. client # [ 759.148882] systemd[1]: session-213.scope: Deactivated successfully. client # [ 759.152375] systemd-logind[465]: Session 213 logged out. Waiting for processes to exit. client # [ 759.155642] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 759.158899] systemd[1]: Started SSH per-connection Daemon (vsock:2:212). client # [ 759.161206] systemd-logind[465]: Removed session 213. client # [ 759.206410] sshd-session[3569]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 759.211119] sshd-session[3569]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 759.216767] sshd-session[3569]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 759.223065] systemd-logind[465]: New session '214' of user 'root' with class 'user' and type 'tty'. client # [ 759.226400] systemd[1]: Started Session 214 of User root. worker1 # [ 759.345460] nix-grpc-daemon[529]: ts=2026-11-07T15:20:14Z level=info event=denied method=QueryMissing cn=stranger role=none client # [ 759.357853] sshd-session[3575]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 759.359203] sshd-session[3575]: Disconnected from user root UNKNOWN port 65535 client # [ 759.360642] sshd-session[3569]: pam_unix(sshd:session): session closed for user root client # [ 759.363766] systemd[1]: sshd-vsock@212-213-3:22-2:212.service: Deactivated successfully. client # [ 759.367759] systemd[1]: session-214.scope: Deactivated successfully. client # [ 759.369310] systemd[1]: session-214.scope: Consumed 89ms CPU time over 142ms wall clock time, 27.8M memory peak, 5.4K incoming IP traffic, 3.8K outgoing IP traffic. client # [ 759.372914] systemd-logind[465]: Session 214 logged out. Waiting for processes to exit. client # [ 759.374527] systemd-logind[465]: Removed session 214. ok test farm::serial::clean_scheduler_restart_peers_are_told_and_running_builds_survive ... worker1 # [ 759.464829] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 759.473441] systemd[1]: Started SSH per-connection Daemon (vsock:2:40). worker1 # [ 759.543704] sshd-session[2096]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 759.548105] sshd-session[2096]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 759.553849] sshd-session[2096]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 759.560201] systemd-logind[608]: New session '49' of user 'root' with class 'user' and type 'tty'. worker1 # [ 759.563346] systemd[1]: Started Session 49 of User root. worker1 # [ 759.585514] sshd-session[2102]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 759.586868] sshd-session[2102]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 759.588316] sshd-session[2096]: pam_unix(sshd:session): session closed for user root worker1 # [ 759.591282] systemd[1]: sshd-vsock@40-41-5:22-2:40.service: Deactivated successfully. worker1 # [ 759.594599] systemd[1]: session-49.scope: Deactivated successfully. worker1 # [ 759.597437] systemd-logind[608]: Session 49 logged out. Waiting for processes to exit. worker1 # [ 759.600137] systemd-logind[608]: Removed session 49. worker2 # [ 759.664749] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 759.671165] systemd[1]: Started SSH per-connection Daemon (vsock:2:28). worker2 # [ 759.738820] sshd-session[1976]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 759.743857] sshd-session[1976]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 759.749270] sshd-session[1976]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 759.755240] systemd-logind[555]: New session '36' of user 'root' with class 'user' and type 'tty'. worker2 # [ 759.759347] systemd[1]: Started Session 36 of User root. worker2 # [ 759.782587] sshd-session[1982]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 759.783856] sshd-session[1982]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 759.785244] sshd-session[1976]: pam_unix(sshd:session): session closed for user root worker2 # [ 759.788265] systemd[1]: sshd-vsock@28-29-6:22-2:28.service: Deactivated successfully. worker2 # [ 759.792171] systemd[1]: session-36.scope: Deactivated successfully. worker2 # [ 759.794868] systemd-logind[555]: Session 36 logged out. Waiting for processes to exit. worker2 # [ 759.796496] systemd-logind[555]: Removed session 36. lb # [ 759.864971] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 759.875160] systemd[1]: Started SSH per-connection Daemon (vsock:2:33). lb # [ 759.948847] sshd-session[1708]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 759.954245] sshd-session[1708]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 759.959737] sshd-session[1708]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 759.966936] systemd-logind[553]: New session '42' of user 'root' with class 'user' and type 'tty'. lb # [ 759.970433] systemd[1]: Started Session 42 of User root. lb # [ 759.997330] sshd-session[1714]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 759.999153] sshd-session[1714]: Disconnected from user root UNKNOWN port 65535 lb # [ 760.000503] sshd-session[1708]: pam_unix(sshd:session): session closed for user root lb # [ 760.003823] systemd[1]: sshd-vsock@33-34-4:22-2:33.service: Deactivated successfully. lb # [ 760.007733] systemd[1]: session-42.scope: Deactivated successfully. lb # [ 760.009331] systemd[1]: session-42.scope: Consumed 17ms CPU time over 38ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 760.013305] systemd-logind[553]: Session 42 logged out. Waiting for processes to exit. lb # [ 760.014930] systemd-logind[553]: Removed session 42. worker1 # [ 760.069183] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 760.076875] systemd[1]: Started SSH per-connection Daemon (vsock:2:41). worker1 # [ 760.142781] sshd-session[2108]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 760.147666] sshd-session[2108]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 760.152795] sshd-session[2108]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 760.159631] systemd-logind[608]: New session '50' of user 'root' with class 'user' and type 'tty'. worker1 # [ 760.162406] systemd[1]: Started Session 50 of User root. worker1 # [ 760.185783] sshd-session[2114]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 760.187620] sshd-session[2114]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 760.188761] sshd-session[2108]: pam_unix(sshd:session): session closed for user root worker1 # [ 760.191659] systemd[1]: sshd-vsock@41-42-5:22-2:41.service: Deactivated successfully. worker1 # [ 760.195419] systemd[1]: session-50.scope: Deactivated successfully. worker1 # [ 760.196787] systemd[1]: session-50.scope: Consumed 15ms CPU time over 33ms wall clock time, 3.1M memory peak, 17.8K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 760.201091] systemd-logind[608]: Session 50 logged out. Waiting for processes to exit. worker1 # [ 760.203255] systemd-logind[608]: Removed session 50. client # [ 760.262329] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 760.272149] systemd[1]: Started SSH per-connection Daemon (vsock:2:213). client # [ 760.339654] sshd-session[3589]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 760.344705] sshd-session[3589]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 760.349942] sshd-session[3589]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 760.355504] systemd-logind[465]: New session '215' of user 'root' with class 'user' and type 'tty'. client # [ 760.359398] systemd[1]: Started Session 215 of User root. client # [ 760.377354] systemd[1]: Started [systemd-run] /run/current-system/sw/bin/nix build --store "grpc://lb:50051?client-cert=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.pem&client-key=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.key" --eval-store auto -f /nix/store/1d7a42y6p1ncxd03bdnj6lvs5y0kwr7g-slow.nix --argstr tag rs. client # [ 760.385397] sshd-session[3595]: Received disconnect from UNKNOWN port 65535:11: disconnected by user client # [ 760.386558] sshd-session[3595]: Disconnected from user root UNKNOWN port 65535 client # [ 760.387895] sshd-session[3589]: pam_unix(sshd:session): session closed for user root client # [ 760.391811] systemd[1]: sshd-vsock@213-214-3:22-2:213.service: Deactivated successfully. client # [ 760.396571] systemd[1]: session-215.scope: Deactivated successfully. client # [ 760.400633] systemd-logind[465]: Session 215 logged out. Waiting for processes to exit. client # [ 760.403192] systemd-logind[465]: Removed session 215. worker1 # [ 760.471817] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 760.481286] systemd[1]: Started SSH per-connection Daemon (vsock:2:42). worker2 # [ 760.513398] nix-grpc-daemon[1514]: ts=2026-11-07T15:20:15Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:44924 client # [ 760.517985] nix[3598]: don't know how to build these paths: client # [ 760.518944] nix[3598]: /nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv worker2 # [ 760.520757] nix-grpc-daemon[1514]: ts=2026-11-07T15:20:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44924 lb # [ 760.529837] garage[913]: 2026-11-07T15:20:15.796873Z INFO garage_api_common::generic_server: 127.0.0.1:43364 (key GK0123456789abcdef01234567) HEAD /farm/6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo lb # [ 760.536704] garage[913]: 2026-11-07T15:20:15.804061Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 760.545819] sshd-session[2119]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 760.542856] nix-grpc-daemon[1514]: ts=2026-11-07T15:20:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44924 worker1 # [ 760.550694] sshd-session[2119]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 760.555783] sshd-session[2119]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 760.551943] garage[913]: 2026-11-07T15:20:15.819191Z INFO garage_api_common::generic_server: 127.0.0.1:43364 (key GK0123456789abcdef01234567) HEAD /farm/6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo worker1 # [ 760.560988] systemd-logind[608]: New session '51' of user 'root' with class 'user' and type 'tty'. lb # [ 760.557884] garage[913]: 2026-11-07T15:20:15.819727Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 760.565364] systemd[1]: Started Session 51 of User root. lb # [ 760.563873] garage[913]: 2026-11-07T15:20:15.831745Z INFO garage_api_common::generic_server: 127.0.0.1:43364 (key GK0123456789abcdef01234567) HEAD /farm/6qby8qgv9vwglq2yryw4zqyixrizh5d2.narinfo lb # [ 760.569554] garage[913]: 2026-11-07T15:20:15.832227Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 760.577616] nix-grpc-daemon[1514]: ts=2026-11-07T15:20:15Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44924 worker1 # [ 760.586968] sshd-session[2125]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 760.588836] sshd-session[2125]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 760.590146] sshd-session[2119]: pam_unix(sshd:session): session closed for user root lb # [ 760.586235] garage[913]: 2026-11-07T15:20:15.853470Z INFO garage_api_common::generic_server: 127.0.0.1:43364 (key GK0123456789abcdef01234567) HEAD /farm/2765168rrfa4dbs7pfx66j88710jx2fm.narinfo worker1 # [ 760.592803] systemd[1]: sshd-vsock@42-43-5:22-2:42.service: Deactivated successfully. worker1 # [ 760.596589] systemd[1]: session-51.scope: Deactivated successfully. lb # [ 760.592067] garage[913]: 2026-11-07T15:20:15.854007Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 760.599721] systemd-logind[608]: Session 51 logged out. Waiting for processes to exit. client # [ 760.595201] nix[3598]: copying 1 paths to 'lb:50051'... worker1 # [ 760.601486] systemd-logind[608]: Removed session 51. worker2 # [ 760.598514] nix-grpc-daemon[1514]: ts=2026-11-07T15:20:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 client # [ 760.597969] nix[3598]: copying path '/nix/store/2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv' to 'lb:50051'... worker2 # [ 760.611413] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 760.627887] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 760.663560] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 760.667885] systemd[1]: Started SSH per-connection Daemon (vsock:2:29). worker2 # [ 760.752616] nix-daemon[986]: accepted connection from pid 1992, user nix-grpc-daemon (trusted) worker2 # [ 760.777346] nix-daemon[986]: reaped child process 1997, status = succeeded lb # [ 760.778536] niks3-server[1503]: 2026/11/07 15:20:16 INFO Received push request method=POST path=/api/pushes worker2 # [ 760.786593] nix-grpc-daemon[1617]: time=2026-11-07T15:20:15.997Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 760.788978] nix-grpc-daemon[1617]: time=2026-11-07T15:20:15.998Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" worker2 # [ 760.792301] nix-grpc-daemon[1617]: time=2026-11-07T15:20:16.004Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e03ba7365c4bdcc72f2f1fa13fa04e5f24741d814d61b328ba312f40f145a0cb\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e03ba7365c4bdcc72f2f1fa13fa04e5f24741d814d61b328ba312f40f145a0cb" worker2 # [ 760.800971] nix-grpc-daemon[1617]: time=2026-11-07T15:20:16.013Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0a700f1d42893726b80416692dc081983efd4b119bf6356e98fdb244786934b1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0a700f1d42893726b80416692dc081983efd4b119bf6356e98fdb244786934b1" worker2 # [ 760.816043] sshd-session[1993]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 760.821103] sshd-session[1993]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 760.826369] sshd-session[1993]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 760.833228] systemd-logind[555]: New session '37' of user 'root' with class 'user' and type 'tty'. worker2 # [ 760.836382] systemd[1]: Started Session 37 of User root. worker2 # [ 760.859285] sshd-session[2003]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 760.860581] sshd-session[2003]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 760.861911] sshd-session[1993]: pam_unix(sshd:session): session closed for user root worker2 # [ 760.864932] systemd[1]: sshd-vsock@29-30-6:22-2:29.service: Deactivated successfully. worker2 # [ 760.868736] systemd[1]: session-37.scope: Deactivated successfully. worker2 # [ 760.871493] systemd-logind[555]: Session 37 logged out. Waiting for processes to exit. worker2 # [ 760.873629] systemd-logind[555]: Removed session 37. worker2 # [ 760.903646] nix-grpc-daemon[1617]: time=2026-11-07T15:20:16.116Z level=WARN msg="Request failed, retrying" attempt=2 backoff=195.787292ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0a700f1d42893726b80416692dc081983efd4b119bf6356e98fdb244786934b1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0a700f1d42893726b80416692dc081983efd4b119bf6356e98fdb244786934b1" worker2 # [ 760.912633] nix-grpc-daemon[1617]: time=2026-11-07T15:20:16.125Z level=WARN msg="Request failed, retrying" attempt=2 backoff=212.110626ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e03ba7365c4bdcc72f2f1fa13fa04e5f24741d814d61b328ba312f40f145a0cb\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e03ba7365c4bdcc72f2f1fa13fa04e5f24741d814d61b328ba312f40f145a0cb" worker2 # [ 761.113450] nix-grpc-daemon[1617]: time=2026-11-07T15:20:16.325Z level=WARN msg="Request failed, retrying" attempt=3 backoff=401.841681ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0a700f1d42893726b80416692dc081983efd4b119bf6356e98fdb244786934b1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0a700f1d42893726b80416692dc081983efd4b119bf6356e98fdb244786934b1" worker2 # [ 761.139362] nix-grpc-daemon[1617]: time=2026-11-07T15:20:16.351Z level=WARN msg="Request failed, retrying" attempt=3 backoff=372.464322ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e03ba7365c4bdcc72f2f1fa13fa04e5f24741d814d61b328ba312f40f145a0cb\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e03ba7365c4bdcc72f2f1fa13fa04e5f24741d814d61b328ba312f40f145a0cb" worker1 # [ 761.473231] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 761.481224] systemd[1]: Started SSH per-connection Daemon (vsock:2:43). worker1 # [ 761.550783] sshd-session[2130]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 761.555723] sshd-session[2130]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 761.560897] sshd-session[2130]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 761.567410] systemd-logind[608]: New session '52' of user 'root' with class 'user' and type 'tty'. worker1 # [ 761.571339] systemd[1]: Started Session 52 of User root. worker1 # [ 761.593382] sshd-session[2136]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 761.595112] sshd-session[2136]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 761.596386] sshd-session[2130]: pam_unix(sshd:session): session closed for user root worker1 # [ 761.599338] systemd[1]: sshd-vsock@43-44-5:22-2:43.service: Deactivated successfully. worker1 # [ 761.602828] systemd[1]: session-52.scope: Deactivated successfully. worker1 # [ 761.606154] systemd-logind[608]: Session 52 logged out. Waiting for processes to exit. worker1 # [ 761.608205] systemd-logind[608]: Removed session 52. worker2 # [ 761.673007] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 761.681410] systemd[1]: Started SSH per-connection Daemon (vsock:2:30). worker2 # [ 761.747932] sshd-session[2008]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 761.753137] sshd-session[2008]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 761.758541] sshd-session[2008]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 761.765079] systemd-logind[555]: New session '38' of user 'root' with class 'user' and type 'tty'. worker2 # [ 761.768410] systemd[1]: Started Session 38 of User root. worker2 # [ 761.790986] sshd-session[2014]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 761.792754] sshd-session[2014]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 761.794155] sshd-session[2008]: pam_unix(sshd:session): session closed for user root worker2 # [ 761.797278] systemd[1]: sshd-vsock@30-31-6:22-2:30.service: Deactivated successfully. worker2 # [ 761.800860] systemd[1]: session-38.scope: Deactivated successfully. worker2 # [ 761.803155] systemd-logind[555]: Session 38 logged out. Waiting for processes to exit. worker2 # [ 761.806193] systemd-logind[555]: Removed session 38. worker1 # [ 762.372516] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 762.382442] systemd[1]: Started SSH per-connection Daemon (vsock:2:44). worker1 # [ 762.449868] sshd-session[2141]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 762.454979] sshd-session[2141]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 762.460172] sshd-session[2141]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 762.465521] systemd-logind[608]: New session '53' of user 'root' with class 'user' and type 'tty'. worker1 # [ 762.469397] systemd[1]: Started Session 53 of User root. worker1 # [ 762.491238] sshd-session[2147]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 762.492941] sshd-session[2147]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 762.494281] sshd-session[2141]: pam_unix(sshd:session): session closed for user root worker1 # [ 762.498221] systemd[1]: sshd-vsock@44-45-5:22-2:44.service: Deactivated successfully. worker1 # [ 762.500824] systemd[1]: session-53.scope: Deactivated successfully. worker1 # [ 762.503981] systemd-logind[608]: Session 53 logged out. Waiting for processes to exit. worker1 # [ 762.506193] systemd-logind[608]: Removed session 53. worker2 # [ 762.535330] nix-grpc-daemon[1617]: time=2026-11-07T15:20:17.746Z level=WARN msg="Request failed, retrying" attempt=4 backoff=720.405921ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0a700f1d42893726b80416692dc081983efd4b119bf6356e98fdb244786934b1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0a700f1d42893726b80416692dc081983efd4b119bf6356e98fdb244786934b1" worker2 # [ 762.570385] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 762.579194] systemd[1]: Started SSH per-connection Daemon (vsock:2:31). worker2 # [ 762.641300] sshd-session[2019]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 762.646354] sshd-session[2019]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 762.651737] sshd-session[2019]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 762.658232] systemd-logind[555]: New session '39' of user 'root' with class 'user' and type 'tty'. worker2 # [ 762.661432] systemd[1]: Started Session 39 of User root. worker2 # [ 762.684325] sshd-session[2025]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 762.687268] sshd-session[2025]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 762.688557] sshd-session[2019]: pam_unix(sshd:session): session closed for user root worker2 # [ 762.692252] systemd[1]: sshd-vsock@31-32-6:22-2:31.service: Deactivated successfully. worker2 # [ 762.694974] systemd[1]: session-39.scope: Deactivated successfully. worker2 # [ 762.697156] systemd-logind[555]: Session 39 logged out. Waiting for processes to exit. worker2 # [ 762.700224] systemd-logind[555]: Removed session 39. worker1 # [ 763.274411] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 763.258944] nix-grpc-daemon[1617]: time=2026-11-07T15:20:18.471Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.716477721s error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0a700f1d42893726b80416692dc081983efd4b119bf6356e98fdb244786934b1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0a700f1d42893726b80416692dc081983efd4b119bf6356e98fdb244786934b1" worker1 # [ 763.284222] systemd[1]: Started SSH per-connection Daemon (vsock:2:45). worker1 # [ 763.350791] sshd-session[2152]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 763.355722] sshd-session[2152]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 763.360870] sshd-session[2152]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 763.367414] systemd-logind[608]: New session '54' of user 'root' with class 'user' and type 'tty'. worker1 # [ 763.370343] systemd[1]: Started Session 54 of User root. worker1 # [ 763.392128] sshd-session[2158]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 763.393573] sshd-session[2158]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 763.395221] sshd-session[2152]: pam_unix(sshd:session): session closed for user root worker1 # [ 763.399136] systemd[1]: sshd-vsock@45-46-5:22-2:45.service: Deactivated successfully. worker1 # [ 763.401899] systemd[1]: session-54.scope: Deactivated successfully. worker1 # [ 763.404576] systemd-logind[608]: Session 54 logged out. Waiting for processes to exit. worker1 # [ 763.406794] systemd-logind[608]: Removed session 54. worker2 # [ 763.473468] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 763.483415] systemd[1]: Started SSH per-connection Daemon (vsock:2:32). worker2 # [ 763.551308] sshd-session[2030]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 763.556371] sshd-session[2030]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 763.561783] sshd-session[2030]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 763.568078] systemd-logind[555]: New session '40' of user 'root' with class 'user' and type 'tty'. worker2 # [ 763.571425] systemd[1]: Started Session 40 of User root. worker2 # [ 763.593993] sshd-session[2036]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 763.595330] sshd-session[2036]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 763.596702] sshd-session[2030]: pam_unix(sshd:session): session closed for user root worker2 # [ 763.600112] systemd[1]: sshd-vsock@32-33-6:22-2:32.service: Deactivated successfully. worker2 # [ 763.603493] systemd[1]: session-40.scope: Deactivated successfully. worker2 # [ 763.606664] systemd-logind[555]: Session 40 logged out. Waiting for processes to exit. worker2 # [ 763.608297] systemd-logind[555]: Removed session 40. worker1 # [ 764.180554] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 764.187458] systemd[1]: Started SSH per-connection Daemon (vsock:2:46). worker1 # [ 764.255532] sshd-session[2163]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 764.260130] sshd-session[2163]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 764.265826] sshd-session[2163]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 764.270933] systemd-logind[608]: New session '55' of user 'root' with class 'user' and type 'tty'. worker1 # [ 764.275404] systemd[1]: Started Session 55 of User root. worker1 # [ 764.297603] sshd-session[2169]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 764.298921] sshd-session[2169]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 764.300298] sshd-session[2163]: pam_unix(sshd:session): session closed for user root worker1 # [ 764.303296] systemd[1]: sshd-vsock@46-47-5:22-2:46.service: Deactivated successfully. worker1 # [ 764.306694] systemd[1]: session-55.scope: Deactivated successfully. worker1 # [ 764.309166] systemd-logind[608]: Session 55 logged out. Waiting for processes to exit. worker1 # [ 764.312099] systemd-logind[608]: Removed session 55. worker2 # [ 764.375941] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 764.383711] systemd[1]: Started SSH per-connection Daemon (vsock:2:33). worker2 # [ 764.453619] sshd-session[2041]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 764.458874] sshd-session[2041]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 764.464370] sshd-session[2041]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 764.470246] systemd-logind[555]: New session '41' of user 'root' with class 'user' and type 'tty'. worker2 # [ 764.474522] systemd[1]: Started Session 41 of User root. worker2 # [ 764.496892] sshd-session[2047]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 764.498631] sshd-session[2047]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 764.499986] sshd-session[2041]: pam_unix(sshd:session): session closed for user root worker2 # [ 764.503036] systemd[1]: sshd-vsock@33-34-6:22-2:33.service: Deactivated successfully. worker2 # [ 764.506682] systemd[1]: session-41.scope: Deactivated successfully. worker2 # [ 764.509272] systemd-logind[555]: Session 41 logged out. Waiting for processes to exit. worker2 # [ 764.511928] systemd-logind[555]: Removed session 41. worker2 # [ 764.647607] nix-grpc-daemon[1617]: time=2026-11-07T15:20:19.859Z level=WARN msg="Request failed, retrying" attempt=4 backoff=756.054561ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e03ba7365c4bdcc72f2f1fa13fa04e5f24741d814d61b328ba312f40f145a0cb\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e03ba7365c4bdcc72f2f1fa13fa04e5f24741d814d61b328ba312f40f145a0cb" worker1 # [ 765.077635] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 765.086842] systemd[1]: Started SSH per-connection Daemon (vsock:2:47). worker1 # [ 765.155585] sshd-session[2174]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 765.160122] sshd-session[2174]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 765.165884] sshd-session[2174]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 765.171331] systemd-logind[608]: New session '56' of user 'root' with class 'user' and type 'tty'. worker1 # [ 765.175319] systemd[1]: Started Session 56 of User root. worker1 # [ 765.197209] sshd-session[2180]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 765.198747] sshd-session[2180]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 765.200125] sshd-session[2174]: pam_unix(sshd:session): session closed for user root worker1 # [ 765.203288] systemd[1]: sshd-vsock@47-48-5:22-2:47.service: Deactivated successfully. worker1 # [ 765.207360] systemd[1]: session-56.scope: Deactivated successfully. worker1 # [ 765.210319] systemd-logind[608]: Session 56 logged out. Waiting for processes to exit. worker1 # [ 765.212202] systemd-logind[608]: Removed session 56. worker2 # [ 765.278180] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 765.285771] systemd[1]: Started SSH per-connection Daemon (vsock:2:34). worker2 # [ 765.354373] sshd-session[2052]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 765.359131] sshd-session[2052]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 765.364974] sshd-session[2052]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 765.371675] systemd-logind[555]: New session '42' of user 'root' with class 'user' and type 'tty'. worker2 # [ 765.375376] systemd[1]: Started Session 42 of User root. worker2 # [ 765.397893] sshd-session[2058]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 765.399637] sshd-session[2058]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 765.400916] sshd-session[2052]: pam_unix(sshd:session): session closed for user root worker2 # [ 765.404796] systemd[1]: sshd-vsock@34-35-6:22-2:34.service: Deactivated successfully. worker2 # [ 765.408732] systemd[1]: session-42.scope: Deactivated successfully. worker2 # [ 765.412171] systemd-logind[555]: Session 42 logged out. Waiting for processes to exit. worker2 # [ 765.413691] systemd-logind[555]: Removed session 42. worker1 # [ 765.982529] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 765.990473] systemd[1]: Started SSH per-connection Daemon (vsock:2:48). worker1 # [ 766.061191] sshd-session[2185]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 766.066039] sshd-session[2185]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 766.071163] sshd-session[2185]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 766.077673] systemd-logind[608]: New session '57' of user 'root' with class 'user' and type 'tty'. worker1 # [ 766.080318] systemd[1]: Started Session 57 of User root. worker1 # [ 766.101836] sshd-session[2191]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 766.103669] sshd-session[2191]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 766.104940] sshd-session[2185]: pam_unix(sshd:session): session closed for user root worker1 # [ 766.107939] systemd[1]: sshd-vsock@48-49-5:22-2:48.service: Deactivated successfully. worker1 # [ 766.111480] systemd[1]: session-57.scope: Deactivated successfully. worker1 # [ 766.114681] systemd-logind[608]: Session 57 logged out. Waiting for processes to exit. worker1 # [ 766.116791] systemd-logind[608]: Removed session 57. worker2 # [ 766.180400] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 766.190185] systemd[1]: Started SSH per-connection Daemon (vsock:2:35). worker2 # [ 766.257578] sshd-session[2063]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 766.262127] sshd-session[2063]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 766.267637] sshd-session[2063]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 766.274239] systemd-logind[555]: New session '43' of user 'root' with class 'user' and type 'tty'. worker2 # [ 766.277354] systemd[1]: Started Session 43 of User root. worker2 # [ 766.298819] sshd-session[2069]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 766.300469] sshd-session[2069]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 766.301788] sshd-session[2063]: pam_unix(sshd:session): session closed for user root worker2 # [ 766.304597] systemd[1]: sshd-vsock@35-36-6:22-2:35.service: Deactivated successfully. worker2 # [ 766.308383] systemd[1]: session-43.scope: Deactivated successfully. worker2 # [ 766.311587] systemd-logind[555]: Session 43 logged out. Waiting for processes to exit. worker2 # [ 766.313303] systemd-logind[555]: Removed session 43. worker2 # [ 766.439334] nix-grpc-daemon[1617]: time=2026-11-07T15:20:21.650Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.588200926s error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e03ba7365c4bdcc72f2f1fa13fa04e5f24741d814d61b328ba312f40f145a0cb\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e03ba7365c4bdcc72f2f1fa13fa04e5f24741d814d61b328ba312f40f145a0cb" worker1 # [ 766.883829] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 766.892727] systemd[1]: Started SSH per-connection Daemon (vsock:2:49). worker1 # [ 766.961414] sshd-session[2196]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 766.966465] sshd-session[2196]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 766.971565] sshd-session[2196]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 766.977237] systemd-logind[608]: New session '58' of user 'root' with class 'user' and type 'tty'. worker1 # [ 766.981400] systemd[1]: Started Session 58 of User root. worker1 # [ 767.003621] sshd-session[2202]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 767.004911] sshd-session[2202]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 767.006231] sshd-session[2196]: pam_unix(sshd:session): session closed for user root worker1 # [ 767.009179] systemd[1]: sshd-vsock@49-50-5:22-2:49.service: Deactivated successfully. worker1 # [ 767.012707] systemd[1]: session-58.scope: Deactivated successfully. worker1 # [ 767.016130] systemd-logind[608]: Session 58 logged out. Waiting for processes to exit. worker1 # [ 767.018195] systemd-logind[608]: Removed session 58. worker2 # [ 767.083756] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 767.092295] systemd[1]: Started SSH per-connection Daemon (vsock:2:36). worker2 # [ 767.166506] sshd-session[2074]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 767.171137] sshd-session[2074]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 767.176769] sshd-session[2074]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 767.183128] systemd-logind[555]: New session '44' of user 'root' with class 'user' and type 'tty'. worker2 # [ 767.186370] systemd[1]: Started Session 44 of User root. worker2 # [ 767.208130] sshd-session[2080]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 767.209628] sshd-session[2080]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 767.211243] sshd-session[2074]: pam_unix(sshd:session): session closed for user root worker2 # [ 767.214247] systemd[1]: sshd-vsock@36-37-6:22-2:36.service: Deactivated successfully. worker2 # [ 767.217791] systemd[1]: session-44.scope: Deactivated successfully. worker2 # [ 767.220935] systemd-logind[555]: Session 44 logged out. Waiting for processes to exit. worker2 # [ 767.222807] systemd-logind[555]: Removed session 44. worker1 # [ 767.786440] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 767.796449] systemd[1]: Started SSH per-connection Daemon (vsock:2:50). worker1 # [ 767.862886] sshd-session[2207]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 767.867171] sshd-session[2207]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 767.872422] sshd-session[2207]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 767.878271] systemd-logind[608]: New session '59' of user 'root' with class 'user' and type 'tty'. worker1 # [ 767.881402] systemd[1]: Started Session 59 of User root. worker1 # [ 767.902437] sshd-session[2213]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 767.903725] sshd-session[2213]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 767.904957] sshd-session[2207]: pam_unix(sshd:session): session closed for user root worker1 # [ 767.907980] systemd[1]: sshd-vsock@50-51-5:22-2:50.service: Deactivated successfully. worker1 # [ 767.911493] systemd[1]: session-59.scope: Deactivated successfully. worker1 # [ 767.914117] systemd-logind[608]: Session 59 logged out. Waiting for processes to exit. worker1 # [ 767.916734] systemd-logind[608]: Removed session 59. worker2 # [ 767.988244] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 767.996280] systemd[1]: Started SSH per-connection Daemon (vsock:2:37). worker2 # [ 768.031885] nix-grpc-daemon[1617]: time=2026-11-07T15:20:23.244Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0a700f1d42893726b80416692dc081983efd4b119bf6356e98fdb244786934b1\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 768.058866] nix-daemon[986]: reaped child process 1988, status = succeeded client # [ 768.048653] nix[3598]: lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152016Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0a700f1d42893726b80416692dc081983efd4b119bf6356e98fdb244786934b1": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker2 # [ 768.084846] sshd-session[2085]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 768.089794] sshd-session[2085]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 768.095168] sshd-session[2085]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 768.101695] systemd-logind[555]: New session '45' of user 'root' with class 'user' and type 'tty'. worker2 # [ 768.104522] systemd[1]: Started Session 45 of User root. worker2 # [ 768.126577] sshd-session[2091]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 768.127876] sshd-session[2091]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 768.129213] sshd-session[2085]: pam_unix(sshd:session): session closed for user root worker2 # [ 768.132188] systemd[1]: sshd-vsock@37-38-6:22-2:37.service: Deactivated successfully. worker2 # [ 768.135702] systemd[1]: session-45.scope: Deactivated successfully. worker2 # [ 768.139311] systemd-logind[555]: Session 45 logged out. Waiting for processes to exit. worker2 # [ 768.140634] systemd-logind[555]: Removed session 45. worker2 # [ 768.553737] nix-grpc-daemon[1514]: ts=2026-11-07T15:20:23Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 768.565142] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) lb # [ 768.618892] envoy[912]: conn peer=[2001:db8:1::1]:45258 tls=TLSv1.3 subject="-" sni=- flags=- tls_fail="-" rx=423 tx=198 ms=8 lb # [ 768.622845] envoy[912]: conn peer=[2001:db8:1::1]:45262 tls=TLSv1.3 subject="CN=stranger" sni=- flags=- tls_fail="-" rx=423 tx=181 ms=9 worker2 # [ 768.673781] nix-daemon[986]: accepted connection from pid 2098, user nix-grpc-daemon (trusted) worker1 # [ 768.687429] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 768.686798] nix-daemon[986]: reaped child process 2101, status = succeeded worker1 # [ 768.696861] systemd[1]: Started SSH per-connection Daemon (vsock:2:51). lb # [ 768.696064] niks3-server[1503]: 2026/11/07 15:20:23 INFO Received push request method=POST path=/api/pushes worker2 # [ 768.703174] nix-grpc-daemon[1617]: time=2026-11-07T15:20:23.915Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 768.705615] nix-grpc-daemon[1617]: time=2026-11-07T15:20:23.915Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" worker2 # [ 768.708737] nix-grpc-daemon[1617]: time=2026-11-07T15:20:23.921Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c22ce8ecbac399476199949e7a20385a5de5ffe4c083338b2ed58e72e40fb22b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c22ce8ecbac399476199949e7a20385a5de5ffe4c083338b2ed58e72e40fb22b" worker1 # [ 768.762240] sshd-session[2218]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 768.766706] sshd-session[2218]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 768.771409] sshd-session[2218]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 768.776769] systemd-logind[608]: New session '60' of user 'root' with class 'user' and type 'tty'. worker1 # [ 768.781401] systemd[1]: Started Session 60 of User root. worker1 # [ 768.801715] sshd-session[2224]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 768.803436] sshd-session[2224]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 768.804667] sshd-session[2218]: pam_unix(sshd:session): session closed for user root worker1 # [ 768.807515] systemd[1]: sshd-vsock@51-52-5:22-2:51.service: Deactivated successfully. worker1 # [ 768.811258] systemd[1]: session-60.scope: Deactivated successfully. worker1 # [ 768.814297] systemd-logind[608]: Session 60 logged out. Waiting for processes to exit. worker1 # [ 768.815899] systemd-logind[608]: Removed session 60. worker2 # [ 768.813393] nix-grpc-daemon[1617]: time=2026-11-07T15:20:24.025Z level=WARN msg="Request failed, retrying" attempt=2 backoff=209.145233ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c22ce8ecbac399476199949e7a20385a5de5ffe4c083338b2ed58e72e40fb22b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c22ce8ecbac399476199949e7a20385a5de5ffe4c083338b2ed58e72e40fb22b" worker2 # [ 768.888444] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 768.895845] systemd[1]: Started SSH per-connection Daemon (vsock:2:38). worker2 # [ 768.958226] sshd-session[2103]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 768.963109] sshd-session[2103]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 768.968260] sshd-session[2103]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 768.975077] systemd-logind[555]: New session '46' of user 'root' with class 'user' and type 'tty'. worker2 # [ 768.977409] systemd[1]: Started Session 46 of User root. worker2 # [ 768.998834] sshd-session[2109]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 769.000540] sshd-session[2109]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 769.001793] sshd-session[2103]: pam_unix(sshd:session): session closed for user root worker2 # [ 769.004705] systemd[1]: sshd-vsock@38-39-6:22-2:38.service: Deactivated successfully. worker2 # [ 769.008795] systemd[1]: session-46.scope: Deactivated successfully. worker2 # [ 769.011474] systemd-logind[555]: Session 46 logged out. Waiting for processes to exit. worker2 # [ 769.013460] systemd-logind[555]: Removed session 46. worker1 # [ 769.588898] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 769.597758] systemd[1]: Started SSH per-connection Daemon (vsock:2:52). worker1 # [ 769.663967] sshd-session[2229]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 769.668744] sshd-session[2229]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 769.673464] sshd-session[2229]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 769.679063] systemd-logind[608]: New session '61' of user 'root' with class 'user' and type 'tty'. worker1 # [ 769.682395] systemd[1]: Started Session 61 of User root. worker1 # [ 769.702731] sshd-session[2235]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 769.704473] sshd-session[2235]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 769.705714] sshd-session[2229]: pam_unix(sshd:session): session closed for user root worker1 # [ 769.708415] systemd[1]: sshd-vsock@52-53-5:22-2:52.service: Deactivated successfully. worker1 # [ 769.712186] systemd[1]: session-61.scope: Deactivated successfully. worker1 # [ 769.715278] systemd-logind[608]: Session 61 logged out. Waiting for processes to exit. worker1 # [ 769.717201] systemd-logind[608]: Removed session 61. worker2 # [ 769.791802] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 769.800198] systemd[1]: Started SSH per-connection Daemon (vsock:2:39). worker2 # [ 769.866221] sshd-session[2114]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 769.871093] sshd-session[2114]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 769.876341] sshd-session[2114]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 769.882233] systemd-logind[555]: New session '47' of user 'root' with class 'user' and type 'tty'. worker2 # [ 769.886416] systemd[1]: Started Session 47 of User root. worker2 # [ 769.907934] sshd-session[2120]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 769.909729] sshd-session[2120]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 769.911351] sshd-session[2114]: pam_unix(sshd:session): session closed for user root worker2 # [ 769.914328] systemd[1]: sshd-vsock@39-40-6:22-2:39.service: Deactivated successfully. worker2 # [ 769.917616] systemd[1]: session-47.scope: Deactivated successfully. worker2 # [ 769.920813] systemd-logind[555]: Session 47 logged out. Waiting for processes to exit. worker2 # [ 769.922455] systemd-logind[555]: Removed session 47. lb # [ 770.083638] systemd[1]: Stopping User Manager for UID 0... lb # [ 770.092419] systemd[1690]: Activating special unit Exit the Session... lb # [ 770.096501] systemd[1690]: Stopped target Main User Target. lb # [ 770.100385] systemd[1690]: Stopped target Basic System. lb # [ 770.103683] systemd[1690]: Stopped target Paths. lb # [ 770.106940] systemd[1690]: Stopped target Sockets. worker2 # [ 770.087547] nix-grpc-daemon[1617]: time=2026-11-07T15:20:25.299Z level=WARN msg="Request failed, retrying" attempt=3 backoff=437.744795ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c22ce8ecbac399476199949e7a20385a5de5ffe4c083338b2ed58e72e40fb22b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c22ce8ecbac399476199949e7a20385a5de5ffe4c083338b2ed58e72e40fb22b" lb # [ 770.110317] systemd[1690]: Stopped target Timers. lb # [ 770.113685] systemd[1690]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 770.117467] systemd[1690]: Closed D-Bus User Message Bus Socket. lb # [ 770.120371] systemd[1690]: Stopped Create User Files and Directories. lb # [ 770.124547] systemd[1690]: Removed slice User Application Slice. lb # [ 770.126597] systemd[1690]: Reached target Shutdown. lb # [ 770.129623] systemd[1690]: Finished Exit the Session. lb # [ 770.135496] systemd[1690]: Reached target Exit the Session. lb # [ 770.139212] systemd-logind[553]: Removed session 41. lb # [ 770.143865] systemd[1]: user@0.service: Deactivated successfully. lb # [ 770.147465] systemd[1]: Stopped User Manager for UID 0. lb # [ 770.169619] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 770.187319] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 770.189315] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 770.190869] systemd[1]: Stopped User Runtime Directory /run/user/0. client # [ 770.472598] systemd[1]: Stopping User Manager for UID 0... client # [ 770.481139] systemd[750]: Activating special unit Exit the Session... client # [ 770.485832] systemd[750]: Removed slice User Background Tasks Slice. worker1 # [ 770.492354] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 770.489492] systemd[750]: Stopped target Main User Target. client # [ 770.493298] systemd[750]: Stopped target Basic System. client # [ 770.496747] systemd[750]: Stopped target Paths. worker1 # [ 770.501835] systemd[1]: Started SSH per-connection Daemon (vsock:2:53). client # [ 770.498830] systemd[750]: Stopped target Sockets. client # [ 770.502425] systemd[750]: Stopped target Timers. client # [ 770.504744] systemd[750]: Stopped Daily Cleanup of User's Temporary Directories. client # [ 770.508776] systemd[750]: Closed D-Bus User Message Bus Socket. client # [ 770.511503] systemd[750]: Stopped Create User Files and Directories. client # [ 770.514344] systemd[750]: Removed slice User Application Slice. client # [ 770.516966] systemd[750]: Reached target Shutdown. client # [ 770.520934] systemd[750]: Finished Exit the Session. client # [ 770.523757] systemd[750]: Reached target Exit the Session. client # [ 770.531581] systemd-logind[465]: Removed session 2. client # [ 770.535252] systemd[1]: user@0.service: Deactivated successfully. client # [ 770.539245] systemd[1]: Stopped User Manager for UID 0. client # [ 770.562312] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 770.570295] sshd-session[2240]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 770.575215] sshd-session[2240]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 770.580365] sshd-session[2240]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 770.578845] systemd[1]: run-user-0.mount: Deactivated successfully. client # [ 770.580880] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 770.586240] systemd-logind[608]: New session '62' of user 'root' with class 'user' and type 'tty'. client # [ 770.582641] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 770.590516] systemd[1]: Started Session 62 of User root. worker1 # [ 770.612887] sshd-session[2246]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 770.614296] sshd-session[2246]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 770.615422] sshd-session[2240]: pam_unix(sshd:session): session closed for user root worker1 # [ 770.618163] systemd[1]: sshd-vsock@53-54-5:22-2:53.service: Deactivated successfully. worker1 # [ 770.621719] systemd[1]: session-62.scope: Deactivated successfully. worker1 # [ 770.624414] systemd-logind[608]: Session 62 logged out. Waiting for processes to exit. worker1 # [ 770.626647] systemd-logind[608]: Removed session 62. worker2 # [ 770.689489] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 770.699166] systemd[1]: Started SSH per-connection Daemon (vsock:2:40). worker2 # [ 770.765766] sshd-session[2125]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 770.770825] sshd-session[2125]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 770.775893] sshd-session[2125]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 770.782558] systemd-logind[555]: New session '48' of user 'root' with class 'user' and type 'tty'. worker2 # [ 770.785325] systemd[1]: Started Session 48 of User root. worker2 # [ 770.807231] sshd-session[2131]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 770.808883] sshd-session[2131]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 770.810234] sshd-session[2125]: pam_unix(sshd:session): session closed for user root worker2 # [ 770.813264] systemd[1]: sshd-vsock@40-41-6:22-2:40.service: Deactivated successfully. worker2 # [ 770.816816] systemd[1]: session-48.scope: Deactivated successfully. worker2 # [ 770.819626] systemd-logind[555]: Session 48 logged out. Waiting for processes to exit. worker2 # [ 770.822203] systemd-logind[555]: Removed session 48. worker1 # [ 771.395351] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 771.405604] systemd[1]: Started SSH per-connection Daemon (vsock:2:54). worker1 # [ 771.471641] sshd-session[2251]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 771.476124] sshd-session[2251]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 771.481830] sshd-session[2251]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 771.486935] systemd-logind[608]: New session '63' of user 'root' with class 'user' and type 'tty'. worker1 # [ 771.491403] systemd[1]: Started Session 63 of User root. worker1 # [ 771.513718] sshd-session[2257]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 771.514978] sshd-session[2257]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 771.516249] sshd-session[2251]: pam_unix(sshd:session): session closed for user root worker1 # [ 771.519261] systemd[1]: sshd-vsock@54-55-5:22-2:54.service: Deactivated successfully. worker1 # [ 771.523243] systemd[1]: session-63.scope: Deactivated successfully. worker1 # [ 771.525891] systemd-logind[608]: Session 63 logged out. Waiting for processes to exit. worker1 # [ 771.527543] systemd-logind[608]: Removed session 63. worker2 # [ 771.559313] nix-grpc-daemon[1617]: time=2026-11-07T15:20:26.770Z level=WARN msg="Request failed, retrying" attempt=4 backoff=733.255785ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c22ce8ecbac399476199949e7a20385a5de5ffe4c083338b2ed58e72e40fb22b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c22ce8ecbac399476199949e7a20385a5de5ffe4c083338b2ed58e72e40fb22b" worker2 # [ 771.594174] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 771.602193] systemd[1]: Started SSH per-connection Daemon (vsock:2:41). worker2 # [ 771.663481] sshd-session[2136]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 771.668140] sshd-session[2136]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 771.673666] sshd-session[2136]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 771.680240] systemd-logind[555]: New session '49' of user 'root' with class 'user' and type 'tty'. worker2 # [ 771.683378] systemd[1]: Started Session 49 of User root. worker2 # [ 771.705547] sshd-session[2142]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 771.706857] sshd-session[2142]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 771.708129] sshd-session[2136]: pam_unix(sshd:session): session closed for user root worker2 # [ 771.711605] systemd[1]: sshd-vsock@41-42-6:22-2:41.service: Deactivated successfully. worker2 # [ 771.715527] systemd[1]: session-49.scope: Deactivated successfully. worker2 # [ 771.718663] systemd-logind[555]: Session 49 logged out. Waiting for processes to exit. worker2 # [ 771.720356] systemd-logind[555]: Removed session 49. worker2 # [ 771.814488] nix-grpc-daemon[1617]: time=2026-11-07T15:20:27.026Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c4cf394362135708feecace5c8cc7c165672e1a1ecc8e00e558d394586a12cac\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c4cf394362135708feecace5c8cc7c165672e1a1ecc8e00e558d394586a12cac" worker1 # [ 772.297701] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 772.306354] systemd[1]: Started SSH per-connection Daemon (vsock:2:55). worker1 # [ 772.371676] sshd-session[2262]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 772.376716] sshd-session[2262]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 772.381788] sshd-session[2262]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 772.388227] systemd-logind[608]: New session '64' of user 'root' with class 'user' and type 'tty'. worker1 # [ 772.391397] systemd[1]: Started Session 64 of User root. worker1 # [ 772.413372] sshd-session[2268]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 772.414780] sshd-session[2268]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 772.416389] sshd-session[2262]: pam_unix(sshd:session): session closed for user root worker1 # [ 772.419294] systemd[1]: sshd-vsock@55-56-5:22-2:55.service: Deactivated successfully. worker1 # [ 772.422876] systemd[1]: session-64.scope: Deactivated successfully. worker1 # [ 772.425428] systemd-logind[608]: Session 64 logged out. Waiting for processes to exit. worker1 # [ 772.428121] systemd-logind[608]: Removed session 64. worker2 # [ 772.498167] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 772.505149] systemd[1]: Started SSH per-connection Daemon (vsock:2:42). worker2 # [ 772.572305] sshd-session[2147]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 772.577082] sshd-session[2147]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 772.582396] sshd-session[2147]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 772.588076] systemd-logind[555]: New session '50' of user 'root' with class 'user' and type 'tty'. worker2 # [ 772.591407] systemd[1]: Started Session 50 of User root. worker2 # [ 772.613287] sshd-session[2153]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 772.614910] sshd-session[2153]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 772.616171] sshd-session[2147]: pam_unix(sshd:session): session closed for user root worker2 # [ 772.618972] systemd[1]: sshd-vsock@42-43-6:22-2:42.service: Deactivated successfully. worker2 # [ 772.622649] systemd[1]: session-50.scope: Deactivated successfully. worker2 # [ 772.625844] systemd-logind[555]: Session 50 logged out. Waiting for processes to exit. worker2 # [ 772.627934] systemd-logind[555]: Removed session 50. worker2 # [ 772.967550] nix-grpc-daemon[1617]: time=2026-11-07T15:20:28.179Z level=WARN msg="Request failed, retrying" attempt=2 backoff=182.510079ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c4cf394362135708feecace5c8cc7c165672e1a1ecc8e00e558d394586a12cac\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c4cf394362135708feecace5c8cc7c165672e1a1ecc8e00e558d394586a12cac" worker1 # [ 773.199619] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 773.207870] systemd[1]: Started SSH per-connection Daemon (vsock:2:56). worker1 # [ 773.277958] sshd-session[2273]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 773.283280] sshd-session[2273]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 773.288447] sshd-session[2273]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 773.294856] systemd-logind[608]: New session '65' of user 'root' with class 'user' and type 'tty'. worker1 # [ 773.297548] systemd[1]: Started Session 65 of User root. worker1 # [ 773.319634] sshd-session[2279]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 773.320920] sshd-session[2279]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 773.322321] sshd-session[2273]: pam_unix(sshd:session): session closed for user root worker1 # [ 773.325288] systemd[1]: sshd-vsock@56-57-5:22-2:56.service: Deactivated successfully. worker1 # [ 773.328774] systemd[1]: session-65.scope: Deactivated successfully. worker1 # [ 773.331967] systemd-logind[608]: Session 65 logged out. Waiting for processes to exit. worker1 # [ 773.334114] systemd-logind[608]: Removed session 65. worker2 # [ 773.398341] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 773.406167] systemd[1]: Started SSH per-connection Daemon (vsock:2:43). worker2 # [ 773.472568] sshd-session[2158]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 773.477129] sshd-session[2158]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 773.482566] sshd-session[2158]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 773.489411] systemd-logind[555]: New session '51' of user 'root' with class 'user' and type 'tty'. worker2 # [ 773.493474] systemd[1]: Started Session 51 of User root. worker2 # [ 773.515676] sshd-session[2164]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 773.516957] sshd-session[2164]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 773.518295] sshd-session[2158]: pam_unix(sshd:session): session closed for user root worker2 # [ 773.521215] systemd[1]: sshd-vsock@43-44-6:22-2:43.service: Deactivated successfully. worker2 # [ 773.524836] systemd[1]: session-51.scope: Deactivated successfully. worker2 # [ 773.528126] systemd-logind[555]: Session 51 logged out. Waiting for processes to exit. worker2 # [ 773.529780] systemd-logind[555]: Removed session 51. worker1 # [ 774.100100] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 774.102982] systemd[1]: Started SSH per-connection Daemon (vsock:2:57). worker1 # [ 774.151407] sshd-session[2284]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 774.156632] sshd-session[2284]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 774.163588] sshd-session[2284]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 774.169822] systemd-logind[608]: New session '66' of user 'root' with class 'user' and type 'tty'. worker1 # [ 774.174444] systemd[1]: Started Session 66 of User root. worker2 # [ 774.182325] nix-grpc-daemon[1617]: time=2026-11-07T15:20:29.394Z level=WARN msg="Request failed, retrying" attempt=3 backoff=360.185147ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c4cf394362135708feecace5c8cc7c165672e1a1ecc8e00e558d394586a12cac\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c4cf394362135708feecace5c8cc7c165672e1a1ecc8e00e558d394586a12cac" worker1 # [ 774.199838] sshd-session[2290]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 774.202340] sshd-session[2290]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 774.203783] sshd-session[2284]: pam_unix(sshd:session): session closed for user root worker1 # [ 774.207166] systemd[1]: sshd-vsock@57-58-5:22-2:57.service: Deactivated successfully. worker1 # [ 774.210837] systemd[1]: session-66.scope: Deactivated successfully. worker1 # [ 774.214288] systemd-logind[608]: Session 66 logged out. Waiting for processes to exit. worker1 # [ 774.217428] systemd-logind[608]: Removed session 66. worker2 # [ 774.305184] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 774.310252] systemd[1]: Started SSH per-connection Daemon (vsock:2:44). worker2 # [ 774.370810] sshd-session[2169]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 774.377154] sshd-session[2169]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 774.385320] sshd-session[2169]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 774.393306] systemd-logind[555]: New session '52' of user 'root' with class 'user' and type 'tty'. worker2 # [ 774.398559] systemd[1]: Started Session 52 of User root. worker2 # [ 774.429266] sshd-session[2175]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 774.432525] sshd-session[2175]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 774.435538] sshd-session[2169]: pam_unix(sshd:session): session closed for user root worker2 # [ 774.440580] systemd[1]: sshd-vsock@44-45-6:22-2:44.service: Deactivated successfully. worker2 # [ 774.446542] systemd[1]: session-52.scope: Deactivated successfully. worker2 # [ 774.451902] systemd-logind[555]: Session 52 logged out. Waiting for processes to exit. worker2 # [ 774.454827] systemd-logind[555]: Removed session 52. worker1 # [ 775.006823] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 775.015678] systemd[1]: Started SSH per-connection Daemon (vsock:2:58). worker1 # [ 775.086602] sshd-session[2295]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 775.091707] sshd-session[2295]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 775.097290] sshd-session[2295]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 775.103541] systemd-logind[608]: New session '67' of user 'root' with class 'user' and type 'tty'. worker1 # [ 775.106414] systemd[1]: Started Session 67 of User root. worker1 # [ 775.129525] sshd-session[2301]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 775.130779] sshd-session[2301]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 775.132144] sshd-session[2295]: pam_unix(sshd:session): session closed for user root worker1 # [ 775.135044] systemd[1]: sshd-vsock@58-59-5:22-2:58.service: Deactivated successfully. worker1 # [ 775.138647] systemd[1]: session-67.scope: Deactivated successfully. worker1 # [ 775.141231] systemd-logind[608]: Session 67 logged out. Waiting for processes to exit. worker1 # [ 775.143222] systemd-logind[608]: Removed session 67. worker2 # [ 775.202367] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 775.206080] systemd[1]: Started SSH per-connection Daemon (vsock:2:45). worker2 # [ 775.251337] sshd-session[2180]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 775.256268] sshd-session[2180]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 775.261557] sshd-session[2180]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 775.268419] systemd-logind[555]: New session '53' of user 'root' with class 'user' and type 'tty'. worker2 # [ 775.271352] systemd[1]: Started Session 53 of User root. worker2 # [ 775.293589] sshd-session[2186]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 775.295219] sshd-session[2186]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 775.296419] sshd-session[2180]: pam_unix(sshd:session): session closed for user root worker2 # [ 775.299446] systemd[1]: sshd-vsock@45-46-6:22-2:45.service: Deactivated successfully. worker2 # [ 775.303667] systemd[1]: session-53.scope: Deactivated successfully. worker2 # [ 775.306744] systemd-logind[555]: Session 53 logged out. Waiting for processes to exit. worker2 # [ 775.308107] systemd-logind[555]: Removed session 53. worker2 # [ 775.398316] nix-grpc-daemon[1617]: time=2026-11-07T15:20:30.610Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.619254354s error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c22ce8ecbac399476199949e7a20385a5de5ffe4c083338b2ed58e72e40fb22b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c22ce8ecbac399476199949e7a20385a5de5ffe4c083338b2ed58e72e40fb22b" worker1 # [ 775.909256] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 775.917661] systemd[1]: Started SSH per-connection Daemon (vsock:2:59). worker1 # [ 775.987407] sshd-session[2306]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 775.992130] sshd-session[2306]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 775.998427] sshd-session[2306]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 776.005318] systemd-logind[608]: New session '68' of user 'root' with class 'user' and type 'tty'. worker1 # [ 776.008579] systemd[1]: Started Session 68 of User root. worker1 # [ 776.031496] sshd-session[2312]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 776.033325] sshd-session[2312]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 776.034566] sshd-session[2306]: pam_unix(sshd:session): session closed for user root worker1 # [ 776.037558] systemd[1]: sshd-vsock@59-60-5:22-2:59.service: Deactivated successfully. worker1 # [ 776.041460] systemd[1]: session-68.scope: Deactivated successfully. worker1 # [ 776.044783] systemd-logind[608]: Session 68 logged out. Waiting for processes to exit. worker1 # [ 776.046254] systemd-logind[608]: Removed session 68. worker2 # [ 776.104444] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 776.108569] systemd[1]: Started SSH per-connection Daemon (vsock:2:46). worker2 # [ 776.154687] sshd-session[2191]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 776.159711] sshd-session[2191]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 776.164784] sshd-session[2191]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 776.172074] systemd-logind[555]: New session '54' of user 'root' with class 'user' and type 'tty'. worker2 # [ 776.175366] systemd[1]: Started Session 54 of User root. worker2 # [ 776.196887] sshd-session[2197]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 776.198552] sshd-session[2197]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 776.199813] sshd-session[2191]: pam_unix(sshd:session): session closed for user root worker2 # [ 776.203216] systemd[1]: sshd-vsock@46-47-6:22-2:46.service: Deactivated successfully. worker2 # [ 776.206714] systemd[1]: session-54.scope: Deactivated successfully. worker2 # [ 776.209560] systemd-logind[555]: Session 54 logged out. Waiting for processes to exit. worker2 # [ 776.212137] systemd-logind[555]: Removed session 54. worker2 # [ 776.615349] nix-grpc-daemon[1617]: time=2026-11-07T15:20:31.826Z level=WARN msg="Request failed, retrying" attempt=4 backoff=730.67492ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c4cf394362135708feecace5c8cc7c165672e1a1ecc8e00e558d394586a12cac\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c4cf394362135708feecace5c8cc7c165672e1a1ecc8e00e558d394586a12cac" worker1 # [ 776.810625] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 776.818915] systemd[1]: Started SSH per-connection Daemon (vsock:2:60). worker1 # [ 776.893550] sshd-session[2317]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 776.898108] sshd-session[2317]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 776.904213] sshd-session[2317]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 776.909409] systemd-logind[608]: New session '69' of user 'root' with class 'user' and type 'tty'. worker1 # [ 776.914394] systemd[1]: Started Session 69 of User root. worker1 # [ 776.937034] sshd-session[2323]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 776.938338] sshd-session[2323]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 776.939556] sshd-session[2317]: pam_unix(sshd:session): session closed for user root worker1 # [ 776.943203] systemd[1]: sshd-vsock@60-61-5:22-2:60.service: Deactivated successfully. worker1 # [ 776.946501] systemd[1]: session-69.scope: Deactivated successfully. worker1 # [ 776.948948] systemd-logind[608]: Session 69 logged out. Waiting for processes to exit. worker1 # [ 776.951106] systemd-logind[608]: Removed session 69. worker2 # [ 777.007440] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 777.019641] systemd[1]: Started SSH per-connection Daemon (vsock:2:47). worker2 # [ 777.087277] sshd-session[2202]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 777.092127] sshd-session[2202]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 777.097425] sshd-session[2202]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 777.104247] systemd-logind[555]: New session '55' of user 'root' with class 'user' and type 'tty'. worker2 # [ 777.107294] systemd[1]: Started Session 55 of User root. worker2 # [ 777.129957] sshd-session[2208]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 777.131652] sshd-session[2208]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 777.132914] sshd-session[2202]: pam_unix(sshd:session): session closed for user root worker2 # [ 777.136084] systemd[1]: sshd-vsock@47-48-6:22-2:47.service: Deactivated successfully. worker2 # [ 777.139747] systemd[1]: session-55.scope: Deactivated successfully. worker2 # [ 777.143173] systemd-logind[555]: Session 55 logged out. Waiting for processes to exit. worker2 # [ 777.144826] systemd-logind[555]: Removed session 55. worker1 # [ 777.715705] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 777.722307] systemd[1]: Started SSH per-connection Daemon (vsock:2:61). worker1 # [ 777.791246] sshd-session[2328]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 777.796281] sshd-session[2328]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 777.801696] sshd-session[2328]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 777.807236] systemd-logind[608]: New session '70' of user 'root' with class 'user' and type 'tty'. worker1 # [ 777.811400] systemd[1]: Started Session 70 of User root. worker1 # [ 777.834352] sshd-session[2334]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 777.836047] sshd-session[2334]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 777.837325] sshd-session[2328]: pam_unix(sshd:session): session closed for user root worker1 # [ 777.840274] systemd[1]: sshd-vsock@61-62-5:22-2:61.service: Deactivated successfully. worker1 # [ 777.843706] systemd[1]: session-70.scope: Deactivated successfully. worker1 # [ 777.847192] systemd-logind[608]: Session 70 logged out. Waiting for processes to exit. worker1 # [ 777.848630] systemd-logind[608]: Removed session 70. worker2 # [ 777.909308] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 777.915083] systemd[1]: Started SSH per-connection Daemon (vsock:2:48). worker2 # [ 777.958690] sshd-session[2213]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 777.963135] sshd-session[2213]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 777.968964] sshd-session[2213]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 777.976106] systemd-logind[555]: New session '56' of user 'root' with class 'user' and type 'tty'. worker2 # [ 777.979375] systemd[1]: Started Session 56 of User root. worker2 # [ 778.002108] sshd-session[2219]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 778.003474] sshd-session[2219]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 778.004784] sshd-session[2213]: pam_unix(sshd:session): session closed for user root worker2 # [ 778.007698] systemd[1]: sshd-vsock@48-49-6:22-2:48.service: Deactivated successfully. worker2 # [ 778.011669] systemd[1]: session-56.scope: Deactivated successfully. worker2 # [ 778.014898] systemd-logind[555]: Session 56 logged out. Waiting for processes to exit. worker2 # [ 778.016530] systemd-logind[555]: Removed session 56. worker2 # [ 778.406351] nix-grpc-daemon[1617]: time=2026-11-07T15:20:33.618Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.474126625s error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c4cf394362135708feecace5c8cc7c165672e1a1ecc8e00e558d394586a12cac\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c4cf394362135708feecace5c8cc7c165672e1a1ecc8e00e558d394586a12cac" worker1 # [ 778.616193] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 778.624378] systemd[1]: Started SSH per-connection Daemon (vsock:2:62). worker1 # [ 778.693315] sshd-session[2339]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 778.698387] sshd-session[2339]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 778.703772] sshd-session[2339]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 778.708926] systemd-logind[608]: New session '71' of user 'root' with class 'user' and type 'tty'. worker1 # [ 778.713399] systemd[1]: Started Session 71 of User root. worker1 # [ 778.736304] sshd-session[2345]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 778.737627] sshd-session[2345]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 778.738921] sshd-session[2339]: pam_unix(sshd:session): session closed for user root worker1 # [ 778.742161] systemd[1]: sshd-vsock@62-63-5:22-2:62.service: Deactivated successfully. worker1 # [ 778.745750] systemd[1]: session-71.scope: Deactivated successfully. worker1 # [ 778.748225] systemd-logind[608]: Session 71 logged out. Waiting for processes to exit. worker1 # [ 778.750328] systemd-logind[608]: Removed session 71. worker2 # [ 778.813489] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 778.822386] systemd[1]: Started SSH per-connection Daemon (vsock:2:49). worker2 # [ 778.889487] sshd-session[2224]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 778.894405] sshd-session[2224]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 778.899457] sshd-session[2224]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 778.906235] systemd-logind[555]: New session '57' of user 'root' with class 'user' and type 'tty'. worker2 # [ 778.909564] systemd[1]: Started Session 57 of User root. worker2 # [ 778.930896] sshd-session[2230]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 778.932599] sshd-session[2230]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 778.933780] sshd-session[2224]: pam_unix(sshd:session): session closed for user root worker2 # [ 778.936685] systemd[1]: sshd-vsock@49-50-6:22-2:49.service: Deactivated successfully. worker2 # [ 778.940413] systemd[1]: session-57.scope: Deactivated successfully. worker2 # [ 778.943718] systemd-logind[555]: Session 57 logged out. Waiting for processes to exit. worker2 # [ 778.945139] systemd-logind[555]: Removed session 57. worker1 # [ 779.519316] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 779.527496] systemd[1]: Started SSH per-connection Daemon (vsock:2:63). worker1 # [ 779.595272] sshd-session[2350]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 779.600389] sshd-session[2350]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 779.605813] sshd-session[2350]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 779.612235] systemd-logind[608]: New session '72' of user 'root' with class 'user' and type 'tty'. worker1 # [ 779.615359] systemd[1]: Started Session 72 of User root. worker1 # [ 779.637788] sshd-session[2356]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 779.639568] sshd-session[2356]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 779.640889] sshd-session[2350]: pam_unix(sshd:session): session closed for user root worker1 # [ 779.644062] systemd[1]: sshd-vsock@63-64-5:22-2:63.service: Deactivated successfully. worker1 # [ 779.647580] systemd[1]: session-72.scope: Deactivated successfully. worker1 # [ 779.650397] systemd-logind[608]: Session 72 logged out. Waiting for processes to exit. worker1 # [ 779.652903] systemd-logind[608]: Removed session 72. worker2 # [ 779.716375] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 779.726981] systemd[1]: Started SSH per-connection Daemon (vsock:2:50). worker2 # [ 779.792704] sshd-session[2235]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 779.797695] sshd-session[2235]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 779.802815] sshd-session[2235]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 779.808076] systemd-logind[555]: New session '58' of user 'root' with class 'user' and type 'tty'. worker2 # [ 779.812345] systemd[1]: Started Session 58 of User root. worker2 # [ 779.834302] sshd-session[2241]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 779.835978] sshd-session[2241]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 779.837281] sshd-session[2235]: pam_unix(sshd:session): session closed for user root worker2 # [ 779.840300] systemd[1]: sshd-vsock@50-51-6:22-2:50.service: Deactivated successfully. worker2 # [ 779.843764] systemd[1]: session-58.scope: Deactivated successfully. worker2 # [ 779.846213] systemd-logind[555]: Session 58 logged out. Waiting for processes to exit. worker2 # [ 779.848669] systemd-logind[555]: Removed session 58. worker2 # [ 779.882651] nix-grpc-daemon[1617]: time=2026-11-07T15:20:35.095Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c22ce8ecbac399476199949e7a20385a5de5ffe4c083338b2ed58e72e40fb22b\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 779.895635] nix-daemon[986]: reaped child process 2096, status = succeeded client # [ 779.892187] nix[3598]: lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152023Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=c22ce8ecbac399476199949e7a20385a5de5ffe4c083338b2ed58e72e40fb22b": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1 # [ 780.421939] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 780.430854] systemd[1]: Started SSH per-connection Daemon (vsock:2:64). worker1 # [ 780.501166] sshd-session[2361]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 780.506158] sshd-session[2361]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 780.511564] sshd-session[2361]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 780.516838] systemd-logind[608]: New session '73' of user 'root' with class 'user' and type 'tty'. worker1 # [ 780.521394] systemd[1]: Started Session 73 of User root. worker1 # [ 780.544678] sshd-session[2367]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 780.545908] sshd-session[2367]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 780.547312] sshd-session[2361]: pam_unix(sshd:session): session closed for user root worker1 # [ 780.550265] systemd[1]: sshd-vsock@64-65-5:22-2:64.service: Deactivated successfully. worker1 # [ 780.553650] systemd[1]: session-73.scope: Deactivated successfully. worker1 # [ 780.556155] systemd-logind[608]: Session 73 logged out. Waiting for processes to exit. worker1 # [ 780.558880] systemd-logind[608]: Removed session 73. worker2 # [ 780.617301] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 780.620993] systemd[1]: Started SSH per-connection Daemon (vsock:2:51). worker2 # [ 780.666531] sshd-session[2246]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 780.671124] sshd-session[2246]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 780.676757] sshd-session[2246]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 780.683230] systemd-logind[555]: New session '59' of user 'root' with class 'user' and type 'tty'. worker2 # [ 780.687418] systemd[1]: Started Session 59 of User root. worker2 # [ 780.709459] sshd-session[2252]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 780.710756] sshd-session[2252]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 780.712102] sshd-session[2246]: pam_unix(sshd:session): session closed for user root worker2 # [ 780.715268] systemd[1]: sshd-vsock@51-52-6:22-2:51.service: Deactivated successfully. worker2 # [ 780.718625] systemd[1]: session-59.scope: Deactivated successfully. worker2 # [ 780.721882] systemd-logind[555]: Session 59 logged out. Waiting for processes to exit. worker2 # [ 780.723610] systemd-logind[555]: Removed session 59. worker2 # [ 780.897616] nix-grpc-daemon[1514]: ts=2026-11-07T15:20:36Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 780.902450] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 780.986313] nix-daemon[986]: accepted connection from pid 2259, user nix-grpc-daemon (trusted) worker2 # [ 781.000112] nix-daemon[986]: reaped child process 2262, status = succeeded lb # [ 781.009897] niks3-server[1503]: 2026/11/07 15:20:36 INFO Received push request method=POST path=/api/pushes worker2 # [ 781.016281] nix-grpc-daemon[1617]: time=2026-11-07T15:20:36.228Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 781.018523] nix-grpc-daemon[1617]: time=2026-11-07T15:20:36.230Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" worker2 # [ 781.021400] nix-grpc-daemon[1617]: time=2026-11-07T15:20:36.234Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83563c4d3e19ad5b42fd048847a9dbf75f988e87f903c96857794f30e2994016\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83563c4d3e19ad5b42fd048847a9dbf75f988e87f903c96857794f30e2994016" worker2 # [ 781.030827] nix-grpc-daemon[1617]: time=2026-11-07T15:20:36.243Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d8df9bc978f5beaa5bc042af4e4e19b54d00451d20f3a6b73599eb684cac80ca\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d8df9bc978f5beaa5bc042af4e4e19b54d00451d20f3a6b73599eb684cac80ca" worker1 # [ 781.322569] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 781.332174] systemd[1]: Started SSH per-connection Daemon (vsock:2:65). worker1 # [ 781.399044] sshd-session[2372]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 781.404237] sshd-session[2372]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 781.409951] sshd-session[2372]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 781.416234] systemd-logind[608]: New session '74' of user 'root' with class 'user' and type 'tty'. worker1 # [ 781.419349] systemd[1]: Started Session 74 of User root. worker1 # [ 781.441836] sshd-session[2378]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 781.443579] sshd-session[2378]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 781.444893] sshd-session[2372]: pam_unix(sshd:session): session closed for user root worker1 # [ 781.448496] systemd[1]: sshd-vsock@65-66-5:22-2:65.service: Deactivated successfully. worker1 # [ 781.451614] systemd[1]: session-74.scope: Deactivated successfully. worker1 # [ 781.454796] systemd-logind[608]: Session 74 logged out. Waiting for processes to exit. worker1 # [ 781.456528] systemd-logind[608]: Removed session 74. worker2 # [ 781.517661] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 781.521503] systemd[1]: Started SSH per-connection Daemon (vsock:2:52). worker2 # [ 781.568365] sshd-session[2264]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 781.573200] sshd-session[2264]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 781.578343] sshd-session[2264]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 781.584989] systemd-logind[555]: New session '60' of user 'root' with class 'user' and type 'tty'. worker2 # [ 781.587410] systemd[1]: Started Session 60 of User root. worker2 # [ 781.608800] sshd-session[2270]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 781.610539] sshd-session[2270]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 781.611848] sshd-session[2264]: pam_unix(sshd:session): session closed for user root worker2 # [ 781.614619] systemd[1]: sshd-vsock@52-53-6:22-2:52.service: Deactivated successfully. worker2 # [ 781.618910] systemd[1]: session-60.scope: Deactivated successfully. worker2 # [ 781.621795] systemd-logind[555]: Session 60 logged out. Waiting for processes to exit. worker2 # [ 781.623442] systemd-logind[555]: Removed session 60. worker2 # [ 782.182247] nix-grpc-daemon[1617]: time=2026-11-07T15:20:37.394Z level=WARN msg="Request failed, retrying" attempt=2 backoff=187.170506ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83563c4d3e19ad5b42fd048847a9dbf75f988e87f903c96857794f30e2994016\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83563c4d3e19ad5b42fd048847a9dbf75f988e87f903c96857794f30e2994016" worker1 # [ 782.224472] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 782.233995] systemd[1]: Started SSH per-connection Daemon (vsock:2:66). worker1 # [ 782.299610] sshd-session[2383]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 782.304136] sshd-session[2383]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 782.309673] sshd-session[2383]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 782.314755] systemd-logind[608]: New session '75' of user 'root' with class 'user' and type 'tty'. worker1 # [ 782.319447] systemd[1]: Started Session 75 of User root. worker1 # [ 782.341210] sshd-session[2389]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 782.342862] sshd-session[2389]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 782.344152] sshd-session[2383]: pam_unix(sshd:session): session closed for user root worker1 # [ 782.346881] systemd[1]: sshd-vsock@66-67-5:22-2:66.service: Deactivated successfully. worker1 # [ 782.350528] systemd[1]: session-75.scope: Deactivated successfully. worker1 # [ 782.353591] systemd-logind[608]: Session 75 logged out. Waiting for processes to exit. worker1 # [ 782.355241] systemd-logind[608]: Removed session 75. [e2e] heartbeat t=720s worker2 # [ 782.423467] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 782.433436] systemd[1]: Started SSH per-connection Daemon (vsock:2:53). worker2 # [ 782.503297] sshd-session[2275]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 782.508206] sshd-session[2275]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 782.513296] sshd-session[2275]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 782.520234] systemd-logind[555]: New session '61' of user 'root' with class 'user' and type 'tty'. worker2 # [ 782.523408] systemd[1]: Started Session 61 of User root. worker2 # [ 782.545473] sshd-session[2281]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 782.546679] sshd-session[2281]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 782.547936] sshd-session[2275]: pam_unix(sshd:session): session closed for user root worker2 # [ 782.550789] systemd[1]: sshd-vsock@53-54-6:22-2:53.service: Deactivated successfully. worker2 # [ 782.554428] systemd[1]: session-61.scope: Deactivated successfully. worker2 # [ 782.557138] systemd-logind[555]: Session 61 logged out. Waiting for processes to exit. worker2 # [ 782.559403] systemd-logind[555]: Removed session 61. worker1 # [ 783.125443] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 783.129230] systemd[1]: Started SSH per-connection Daemon (vsock:2:67). worker1 # [ 783.175323] sshd-session[2394]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 783.180211] sshd-session[2394]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 783.185335] sshd-session[2394]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 783.191725] systemd-logind[608]: New session '76' of user 'root' with class 'user' and type 'tty'. worker1 # [ 783.194391] systemd[1]: Started Session 76 of User root. worker1 # [ 783.216311] sshd-session[2400]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 783.206327] nix-grpc-daemon[1617]: time=2026-11-07T15:20:38.418Z level=WARN msg="Request failed, retrying" attempt=2 backoff=209.797422ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d8df9bc978f5beaa5bc042af4e4e19b54d00451d20f3a6b73599eb684cac80ca\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d8df9bc978f5beaa5bc042af4e4e19b54d00451d20f3a6b73599eb684cac80ca" worker1 # [ 783.217495] sshd-session[2400]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 783.218743] sshd-session[2394]: pam_unix(sshd:session): session closed for user root worker1 # [ 783.221724] systemd[1]: sshd-vsock@67-68-5:22-2:67.service: Deactivated successfully. worker1 # [ 783.225565] systemd[1]: session-76.scope: Deactivated successfully. worker1 # [ 783.228628] systemd-logind[608]: Session 76 logged out. Waiting for processes to exit. worker1 # [ 783.230264] systemd-logind[608]: Removed session 76. worker2 # [ 783.322912] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 783.327318] systemd[1]: Started SSH per-connection Daemon (vsock:2:54). worker2 # [ 783.373317] sshd-session[2286]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 783.378125] sshd-session[2286]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 783.384309] sshd-session[2286]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 783.389639] systemd-logind[555]: New session '62' of user 'root' with class 'user' and type 'tty'. worker2 # [ 783.393411] systemd[1]: Started Session 62 of User root. worker2 # [ 783.417348] sshd-session[2292]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 783.418766] sshd-session[2292]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 783.420354] sshd-session[2286]: pam_unix(sshd:session): session closed for user root worker2 # [ 783.424074] systemd[1]: sshd-vsock@54-55-6:22-2:54.service: Deactivated successfully. worker2 # [ 783.427906] systemd[1]: session-62.scope: Deactivated successfully. worker2 # [ 783.430839] systemd-logind[555]: Session 62 logged out. Waiting for processes to exit. worker2 # [ 783.432642] systemd-logind[555]: Removed session 62. worker1 # [ 784.030512] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 784.039240] systemd[1]: Started SSH per-connection Daemon (vsock:2:68). worker1 # [ 784.108260] sshd-session[2405]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 784.113303] sshd-session[2405]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 784.118359] sshd-session[2405]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 784.123572] systemd-logind[608]: New session '77' of user 'root' with class 'user' and type 'tty'. worker1 # [ 784.128547] systemd[1]: Started Session 77 of User root. worker1 # [ 784.150224] sshd-session[2411]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 784.151863] sshd-session[2411]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 784.153135] sshd-session[2405]: pam_unix(sshd:session): session closed for user root worker1 # [ 784.156056] systemd[1]: sshd-vsock@68-69-5:22-2:68.service: Deactivated successfully. worker1 # [ 784.159621] systemd[1]: session-77.scope: Deactivated successfully. worker1 # [ 784.163157] systemd-logind[608]: Session 77 logged out. Waiting for processes to exit. worker1 # [ 784.164465] systemd-logind[608]: Removed session 77. worker2 # [ 784.225682] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 784.230070] systemd[1]: Started SSH per-connection Daemon (vsock:2:55). worker2 # [ 784.275354] sshd-session[2297]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 784.280130] sshd-session[2297]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 784.285514] sshd-session[2297]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 784.291229] systemd-logind[555]: New session '63' of user 'root' with class 'user' and type 'tty'. worker2 # [ 784.295341] systemd[1]: Started Session 63 of User root. worker2 # [ 784.317339] sshd-session[2303]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 784.318579] sshd-session[2303]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 784.319793] sshd-session[2297]: pam_unix(sshd:session): session closed for user root worker2 # [ 784.322635] systemd[1]: sshd-vsock@55-56-6:22-2:55.service: Deactivated successfully. worker2 # [ 784.326599] systemd[1]: session-63.scope: Deactivated successfully. worker2 # [ 784.329702] systemd-logind[555]: Session 63 logged out. Waiting for processes to exit. worker2 # [ 784.331310] systemd-logind[555]: Removed session 63. worker2 # [ 784.422390] nix-grpc-daemon[1617]: time=2026-11-07T15:20:39.634Z level=WARN msg="Request failed, retrying" attempt=3 backoff=418.538529ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83563c4d3e19ad5b42fd048847a9dbf75f988e87f903c96857794f30e2994016\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83563c4d3e19ad5b42fd048847a9dbf75f988e87f903c96857794f30e2994016" worker2 # [ 784.843984] nix-grpc-daemon[1617]: time=2026-11-07T15:20:40.056Z level=WARN msg="Request failed, retrying" attempt=4 backoff=857.276805ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83563c4d3e19ad5b42fd048847a9dbf75f988e87f903c96857794f30e2994016\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83563c4d3e19ad5b42fd048847a9dbf75f988e87f903c96857794f30e2994016" worker1 # [ 784.931331] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 784.941179] systemd[1]: Started SSH per-connection Daemon (vsock:2:69). worker1 # [ 785.013398] sshd-session[2416]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 785.018193] sshd-session[2416]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 785.023257] sshd-session[2416]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 785.028675] systemd-logind[608]: New session '78' of user 'root' with class 'user' and type 'tty'. worker1 # [ 785.033398] systemd[1]: Started Session 78 of User root. worker1 # [ 785.054957] sshd-session[2422]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 785.056635] sshd-session[2422]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 785.057870] sshd-session[2416]: pam_unix(sshd:session): session closed for user root worker1 # [ 785.060780] systemd[1]: sshd-vsock@69-70-5:22-2:69.service: Deactivated successfully. worker1 # [ 785.064486] systemd[1]: session-78.scope: Deactivated successfully. worker1 # [ 785.067362] systemd-logind[608]: Session 78 logged out. Waiting for processes to exit. worker1 # [ 785.069632] systemd-logind[608]: Removed session 78. worker2 # [ 785.129328] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 785.133066] systemd[1]: Started SSH per-connection Daemon (vsock:2:56). worker2 # [ 785.178306] sshd-session[2308]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 785.183836] sshd-session[2308]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 785.188944] sshd-session[2308]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 785.194387] systemd-logind[555]: New session '64' of user 'root' with class 'user' and type 'tty'. worker2 # [ 785.199370] systemd[1]: Started Session 64 of User root. worker2 # [ 785.221223] sshd-session[2314]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 785.222501] sshd-session[2314]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 785.223817] sshd-session[2308]: pam_unix(sshd:session): session closed for user root worker2 # [ 785.227078] systemd[1]: sshd-vsock@56-57-6:22-2:56.service: Deactivated successfully. worker2 # [ 785.230355] systemd[1]: session-64.scope: Deactivated successfully. worker2 # [ 785.233236] systemd-logind[555]: Session 64 logged out. Waiting for processes to exit. worker2 # [ 785.235717] systemd-logind[555]: Removed session 64. worker1 # [ 785.837956] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 785.844841] systemd[1]: Started SSH per-connection Daemon (vsock:2:70). worker1 # [ 785.910392] sshd-session[2427]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 785.915179] sshd-session[2427]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 785.920256] sshd-session[2427]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 785.926812] systemd-logind[608]: New session '79' of user 'root' with class 'user' and type 'tty'. worker1 # [ 785.929406] systemd[1]: Started Session 79 of User root. worker1 # [ 785.951925] sshd-session[2433]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 785.953209] sshd-session[2433]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 785.954552] sshd-session[2427]: pam_unix(sshd:session): session closed for user root worker1 # [ 785.957510] systemd[1]: sshd-vsock@70-71-5:22-2:70.service: Deactivated successfully. worker1 # [ 785.961491] systemd[1]: session-79.scope: Deactivated successfully. worker1 # [ 785.964785] systemd-logind[608]: Session 79 logged out. Waiting for processes to exit. worker1 # [ 785.967165] systemd-logind[608]: Removed session 79. worker2 # [ 786.036754] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 786.045211] systemd[1]: Started SSH per-connection Daemon (vsock:2:57). worker2 # [ 786.110547] sshd-session[2319]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 786.115116] sshd-session[2319]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 786.120771] sshd-session[2319]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 786.127480] systemd-logind[555]: New session '65' of user 'root' with class 'user' and type 'tty'. worker2 # [ 786.130747] systemd[1]: Started Session 65 of User root. worker2 # [ 786.151363] sshd-session[2325]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 786.152649] sshd-session[2325]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 786.153856] sshd-session[2319]: pam_unix(sshd:session): session closed for user root worker2 # [ 786.157138] systemd[1]: sshd-vsock@57-58-6:22-2:57.service: Deactivated successfully. worker2 # [ 786.160349] systemd[1]: session-65.scope: Deactivated successfully. worker2 # [ 786.163083] systemd-logind[555]: Session 65 logged out. Waiting for processes to exit. worker2 # [ 786.165568] systemd-logind[555]: Removed session 65. worker2 # [ 786.535086] nix-grpc-daemon[1617]: time=2026-11-07T15:20:41.746Z level=WARN msg="Request failed, retrying" attempt=3 backoff=428.381947ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d8df9bc978f5beaa5bc042af4e4e19b54d00451d20f3a6b73599eb684cac80ca\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d8df9bc978f5beaa5bc042af4e4e19b54d00451d20f3a6b73599eb684cac80ca" worker1 # [ 786.738456] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 786.749404] systemd[1]: Started SSH per-connection Daemon (vsock:2:71). worker1 # [ 786.813883] sshd-session[2438]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 786.818847] sshd-session[2438]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 786.823867] sshd-session[2438]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 786.830376] systemd-logind[608]: New session '80' of user 'root' with class 'user' and type 'tty'. worker1 # [ 786.834560] systemd[1]: Started Session 80 of User root. worker1 # [ 786.856396] sshd-session[2444]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 786.857638] sshd-session[2444]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 786.858861] sshd-session[2438]: pam_unix(sshd:session): session closed for user root worker1 # [ 786.861993] systemd[1]: sshd-vsock@71-72-5:22-2:71.service: Deactivated successfully. worker1 # [ 786.865509] systemd[1]: session-80.scope: Deactivated successfully. worker1 # [ 786.869576] systemd-logind[608]: Session 80 logged out. Waiting for processes to exit. worker1 # [ 786.870857] systemd-logind[608]: Removed session 80. worker2 # [ 786.936560] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 786.946501] systemd[1]: Started SSH per-connection Daemon (vsock:2:58). worker2 # [ 786.965328] nix-grpc-daemon[1617]: time=2026-11-07T15:20:42.177Z level=WARN msg="Request failed, retrying" attempt=4 backoff=804.115098ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d8df9bc978f5beaa5bc042af4e4e19b54d00451d20f3a6b73599eb684cac80ca\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d8df9bc978f5beaa5bc042af4e4e19b54d00451d20f3a6b73599eb684cac80ca" worker2 # [ 787.006234] sshd-session[2330]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 787.010931] sshd-session[2330]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 787.015790] sshd-session[2330]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 787.021377] systemd-logind[555]: New session '66' of user 'root' with class 'user' and type 'tty'. worker2 # [ 787.026430] systemd[1]: Started Session 66 of User root. worker2 # [ 787.047810] sshd-session[2336]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 787.049701] sshd-session[2336]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 787.051360] sshd-session[2330]: pam_unix(sshd:session): session closed for user root worker2 # [ 787.055114] systemd[1]: sshd-vsock@58-59-6:22-2:58.service: Deactivated successfully. worker2 # [ 787.057637] systemd[1]: session-66.scope: Deactivated successfully. worker2 # [ 787.060894] systemd-logind[555]: Session 66 logged out. Waiting for processes to exit. worker2 # [ 787.062526] systemd-logind[555]: Removed session 66. worker1 # [ 787.641190] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 787.648644] systemd[1]: Started SSH per-connection Daemon (vsock:2:72). worker1 # [ 787.716425] sshd-session[2449]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 787.721185] sshd-session[2449]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 787.726227] sshd-session[2449]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 787.732777] systemd-logind[608]: New session '81' of user 'root' with class 'user' and type 'tty'. worker1 # [ 787.735640] systemd[1]: Started Session 81 of User root. worker1 # [ 787.756789] sshd-session[2455]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 787.758490] sshd-session[2455]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 787.759718] sshd-session[2449]: pam_unix(sshd:session): session closed for user root worker1 # [ 787.762430] systemd[1]: sshd-vsock@72-73-5:22-2:72.service: Deactivated successfully. worker1 # [ 787.766230] systemd[1]: session-81.scope: Deactivated successfully. worker1 # [ 787.769293] systemd-logind[608]: Session 81 logged out. Waiting for processes to exit. worker1 # [ 787.771085] systemd-logind[608]: Removed session 81. worker2 # [ 787.837096] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 787.839805] systemd[1]: Started SSH per-connection Daemon (vsock:2:59). worker2 # [ 787.887633] sshd-session[2341]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 787.892753] sshd-session[2341]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 787.898203] sshd-session[2341]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 787.904704] systemd-logind[555]: New session '67' of user 'root' with class 'user' and type 'tty'. worker2 # [ 787.907353] systemd[1]: Started Session 67 of User root. worker2 # [ 787.929768] sshd-session[2347]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 787.931610] sshd-session[2347]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 787.933320] sshd-session[2341]: pam_unix(sshd:session): session closed for user root worker2 # [ 787.935956] systemd[1]: sshd-vsock@59-60-6:22-2:59.service: Deactivated successfully. worker2 # [ 787.939690] systemd[1]: session-67.scope: Deactivated successfully. worker2 # [ 787.942872] systemd-logind[555]: Session 67 logged out. Waiting for processes to exit. worker2 # [ 787.944549] systemd-logind[555]: Removed session 67. worker1 # [ 788.542942] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 788.550258] systemd[1]: Started SSH per-connection Daemon (vsock:2:73). worker1 # [ 788.616643] sshd-session[2460]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 788.621603] sshd-session[2460]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 788.626782] sshd-session[2460]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 788.633343] systemd-logind[608]: New session '82' of user 'root' with class 'user' and type 'tty'. worker1 # [ 788.636360] systemd[1]: Started Session 82 of User root. worker1 # [ 788.658200] sshd-session[2466]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 788.659793] sshd-session[2466]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 788.661119] sshd-session[2460]: pam_unix(sshd:session): session closed for user root worker1 # [ 788.663987] systemd[1]: sshd-vsock@73-74-5:22-2:73.service: Deactivated successfully. worker1 # [ 788.667604] systemd[1]: session-82.scope: Deactivated successfully. worker1 # [ 788.670819] systemd-logind[608]: Session 82 logged out. Waiting for processes to exit. worker1 # [ 788.672506] systemd-logind[608]: Removed session 82. worker2 # [ 788.741403] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 788.744516] systemd[1]: Started SSH per-connection Daemon (vsock:2:60). worker2 # [ 788.774223] nix-grpc-daemon[1617]: time=2026-11-07T15:20:43.986Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.71737616s error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d8df9bc978f5beaa5bc042af4e4e19b54d00451d20f3a6b73599eb684cac80ca\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d8df9bc978f5beaa5bc042af4e4e19b54d00451d20f3a6b73599eb684cac80ca" worker2 # [ 788.801364] sshd-session[2352]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 788.806432] sshd-session[2352]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 788.811824] sshd-session[2352]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 788.818556] systemd-logind[555]: New session '68' of user 'root' with class 'user' and type 'tty'. worker2 # [ 788.821432] systemd[1]: Started Session 68 of User root. worker2 # [ 788.843392] sshd-session[2358]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 788.845261] sshd-session[2358]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 788.846535] sshd-session[2352]: pam_unix(sshd:session): session closed for user root worker2 # [ 788.849404] systemd[1]: sshd-vsock@60-61-6:22-2:60.service: Deactivated successfully. worker2 # [ 788.853215] systemd[1]: session-68.scope: Deactivated successfully. worker2 # [ 788.855756] systemd-logind[555]: Session 68 logged out. Waiting for processes to exit. worker2 # [ 788.858093] systemd-logind[555]: Removed session 68. worker1 # [ 789.443735] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 789.453900] systemd[1]: Started SSH per-connection Daemon (vsock:2:74). worker1 # [ 789.523551] sshd-session[2471]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 789.528405] sshd-session[2471]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 789.533556] sshd-session[2471]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 789.539066] systemd-logind[608]: New session '83' of user 'root' with class 'user' and type 'tty'. worker1 # [ 789.543585] systemd[1]: Started Session 83 of User root. worker1 # [ 789.565327] sshd-session[2477]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 789.566948] sshd-session[2477]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 789.568306] sshd-session[2471]: pam_unix(sshd:session): session closed for user root worker1 # [ 789.571225] systemd[1]: sshd-vsock@74-75-5:22-2:74.service: Deactivated successfully. worker1 # [ 789.574660] systemd[1]: session-83.scope: Deactivated successfully. worker1 # [ 789.577780] systemd-logind[608]: Session 83 logged out. Waiting for processes to exit. worker1 # [ 789.579470] systemd-logind[608]: Removed session 83. worker2 # [ 789.642370] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 789.650607] systemd[1]: Started SSH per-connection Daemon (vsock:2:61). worker2 # [ 789.720202] sshd-session[2363]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 789.725136] sshd-session[2363]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 789.730298] sshd-session[2363]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 789.737236] systemd-logind[555]: New session '69' of user 'root' with class 'user' and type 'tty'. worker2 # [ 789.741034] systemd[1]: Started Session 69 of User root. worker2 # [ 789.763486] sshd-session[2369]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 789.765160] sshd-session[2369]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 789.766395] sshd-session[2363]: pam_unix(sshd:session): session closed for user root worker2 # [ 789.769442] systemd[1]: sshd-vsock@61-62-6:22-2:61.service: Deactivated successfully. worker2 # [ 789.773141] systemd[1]: session-69.scope: Deactivated successfully. worker2 # [ 789.775966] systemd-logind[555]: Session 69 logged out. Waiting for processes to exit. worker2 # [ 789.777886] systemd-logind[555]: Removed session 69. worker2 # [ 789.798159] nix-grpc-daemon[1617]: time=2026-11-07T15:20:45.010Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.502044959s error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83563c4d3e19ad5b42fd048847a9dbf75f988e87f903c96857794f30e2994016\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83563c4d3e19ad5b42fd048847a9dbf75f988e87f903c96857794f30e2994016" worker1 # [ 790.345614] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 790.355165] systemd[1]: Started SSH per-connection Daemon (vsock:2:75). worker1 # [ 790.421768] sshd-session[2482]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 790.426111] sshd-session[2482]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 790.431750] sshd-session[2482]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 790.437096] systemd-logind[608]: New session '84' of user 'root' with class 'user' and type 'tty'. worker1 # [ 790.441360] systemd[1]: Started Session 84 of User root. worker1 # [ 790.463441] sshd-session[2488]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 790.464700] sshd-session[2488]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 790.465933] sshd-session[2482]: pam_unix(sshd:session): session closed for user root worker1 # [ 790.469199] systemd[1]: sshd-vsock@75-76-5:22-2:75.service: Deactivated successfully. worker1 # [ 790.472572] systemd[1]: session-84.scope: Deactivated successfully. worker1 # [ 790.475622] systemd-logind[608]: Session 84 logged out. Waiting for processes to exit. worker1 # [ 790.477346] systemd-logind[608]: Removed session 84. worker2 # [ 790.546408] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 790.554606] systemd[1]: Started SSH per-connection Daemon (vsock:2:62). worker2 # [ 790.622332] sshd-session[2374]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 790.627478] sshd-session[2374]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 790.632780] sshd-session[2374]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 790.639077] systemd-logind[555]: New session '70' of user 'root' with class 'user' and type 'tty'. worker2 # [ 790.642381] systemd[1]: Started Session 70 of User root. worker2 # [ 790.665092] sshd-session[2380]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 790.666308] sshd-session[2380]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 790.667502] sshd-session[2374]: pam_unix(sshd:session): session closed for user root worker2 # [ 790.670639] systemd[1]: sshd-vsock@62-63-6:22-2:62.service: Deactivated successfully. worker2 # [ 790.674420] systemd[1]: session-70.scope: Deactivated successfully. worker2 # [ 790.677668] systemd-logind[555]: Session 70 logged out. Waiting for processes to exit. worker2 # [ 790.679426] systemd-logind[555]: Removed session 70. worker1 # [ 791.251857] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 791.260815] systemd[1]: Started SSH per-connection Daemon (vsock:2:76). worker1 # [ 791.331759] sshd-session[2493]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 791.336609] sshd-session[2493]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 791.313892] nix-grpc-daemon[1617]: time=2026-11-07T15:20:46.525Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83563c4d3e19ad5b42fd048847a9dbf75f988e87f903c96857794f30e2994016\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker1 # [ 791.341759] sshd-session[2493]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 791.346879] systemd-logind[608]: New session '85' of user 'root' with class 'user' and type 'tty'. worker2 # [ 791.343668] nix-daemon[986]: reaped child process 2257, status = succeeded worker1 # [ 791.351386] systemd[1]: Started Session 85 of User root. client # [ 791.334768] nix[3598]: lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152036Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=83563c4d3e19ad5b42fd048847a9dbf75f988e87f903c96857794f30e2994016": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1 # [ 791.373571] sshd-session[2499]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 791.374838] sshd-session[2499]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 791.376154] sshd-session[2493]: pam_unix(sshd:session): session closed for user root worker1 # [ 791.379066] systemd[1]: sshd-vsock@76-77-5:22-2:76.service: Deactivated successfully. worker1 # [ 791.382599] systemd[1]: session-85.scope: Deactivated successfully. worker1 # [ 791.385817] systemd-logind[608]: Session 85 logged out. Waiting for processes to exit. worker1 # [ 791.388037] systemd-logind[608]: Removed session 85. worker2 # [ 791.446829] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 791.456844] systemd[1]: Started SSH per-connection Daemon (vsock:2:63). worker2 # [ 791.523285] sshd-session[2385]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 791.528188] sshd-session[2385]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 791.533546] sshd-session[2385]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 791.540235] systemd-logind[555]: New session '71' of user 'root' with class 'user' and type 'tty'. worker2 # [ 791.544356] systemd[1]: Started Session 71 of User root. worker2 # [ 791.567315] sshd-session[2391]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 791.568524] sshd-session[2391]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 791.569837] sshd-session[2385]: pam_unix(sshd:session): session closed for user root worker2 # [ 791.572797] systemd[1]: sshd-vsock@63-64-6:22-2:63.service: Deactivated successfully. worker2 # [ 791.576625] systemd[1]: session-71.scope: Deactivated successfully. worker2 # [ 791.579871] systemd-logind[555]: Session 71 logged out. Waiting for processes to exit. worker2 # [ 791.581511] systemd-logind[555]: Removed session 71. worker1 # [ 792.151484] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 792.158562] systemd[1]: Started SSH per-connection Daemon (vsock:2:77). worker1 # [ 792.225828] sshd-session[2504]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 792.230722] sshd-session[2504]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 792.235860] sshd-session[2504]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 792.242276] systemd-logind[608]: New session '86' of user 'root' with class 'user' and type 'tty'. worker1 # [ 792.245420] systemd[1]: Started Session 86 of User root. worker1 # [ 792.266838] sshd-session[2510]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 792.269734] sshd-session[2510]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 792.270968] sshd-session[2504]: pam_unix(sshd:session): session closed for user root worker1 # [ 792.274289] systemd[1]: sshd-vsock@77-78-5:22-2:77.service: Deactivated successfully. worker1 # [ 792.276868] systemd[1]: session-86.scope: Deactivated successfully. worker1 # [ 792.279432] systemd-logind[608]: Session 86 logged out. Waiting for processes to exit. worker1 # [ 792.282096] systemd-logind[608]: Removed session 86. worker2 # [ 792.351360] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 792.357912] systemd[1]: Started SSH per-connection Daemon (vsock:2:64). worker2 # [ 792.428264] sshd-session[2396]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 792.433167] sshd-session[2396]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 792.438426] sshd-session[2396]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 792.445134] systemd-logind[555]: New session '72' of user 'root' with class 'user' and type 'tty'. worker2 # [ 792.448511] systemd[1]: Started Session 72 of User root. worker2 # [ 792.471092] sshd-session[2402]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 792.472691] sshd-session[2402]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 792.473884] sshd-session[2396]: pam_unix(sshd:session): session closed for user root worker2 # [ 792.476987] systemd[1]: sshd-vsock@64-65-6:22-2:64.service: Deactivated successfully. worker2 # [ 792.480663] systemd[1]: session-72.scope: Deactivated successfully. worker2 # [ 792.483879] systemd-logind[555]: Session 72 logged out. Waiting for processes to exit. worker2 # [ 792.485475] systemd-logind[555]: Removed session 72. worker1 # [ 793.054409] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 793.064514] systemd[1]: Started SSH per-connection Daemon (vsock:2:78). worker1 # [ 793.132885] sshd-session[2515]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 793.137882] sshd-session[2515]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 793.143126] sshd-session[2515]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 793.149248] systemd-logind[608]: New session '87' of user 'root' with class 'user' and type 'tty'. worker1 # [ 793.153402] systemd[1]: Started Session 87 of User root. worker1 # [ 793.175215] sshd-session[2521]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 793.176896] sshd-session[2521]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 793.178190] sshd-session[2515]: pam_unix(sshd:session): session closed for user root worker1 # [ 793.181181] systemd[1]: sshd-vsock@78-79-5:22-2:78.service: Deactivated successfully. worker1 # [ 793.184689] systemd[1]: session-87.scope: Deactivated successfully. worker1 # [ 793.187826] systemd-logind[608]: Session 87 logged out. Waiting for processes to exit. worker1 # [ 793.189967] systemd-logind[608]: Removed session 87. worker2 # [ 793.252794] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 793.260795] systemd[1]: Started SSH per-connection Daemon (vsock:2:65). worker2 # [ 793.329881] sshd-session[2407]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 793.335076] sshd-session[2407]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 793.339414] nix-grpc-daemon[1514]: ts=2026-11-07T15:20:48Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 793.345483] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 793.348050] sshd-session[2407]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 793.357343] systemd-logind[555]: New session '73' of user 'root' with class 'user' and type 'tty'. worker2 # [ 793.363061] systemd[1]: Started Session 73 of User root. worker2 # [ 793.392482] sshd-session[2416]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 793.393739] sshd-session[2416]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 793.395588] sshd-session[2407]: pam_unix(sshd:session): session closed for user root worker2 # [ 793.402138] systemd[1]: sshd-vsock@65-66-6:22-2:65.service: Deactivated successfully. worker2 # [ 793.407696] systemd[1]: session-73.scope: Deactivated successfully. worker2 # [ 793.411134] systemd-logind[555]: Session 73 logged out. Waiting for processes to exit. worker2 # [ 793.416250] systemd-logind[555]: Removed session 73. worker2 # [ 793.474096] nix-daemon[986]: accepted connection from pid 2415, user nix-grpc-daemon (trusted) worker2 # [ 793.485934] nix-daemon[986]: reaped child process 2423, status = succeeded lb # [ 793.496363] niks3-server[1503]: 2026/11/07 15:20:48 INFO Received push request method=POST path=/api/pushes worker2 # [ 793.503467] nix-grpc-daemon[1617]: time=2026-11-07T15:20:48.715Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 793.504927] nix-grpc-daemon[1617]: time=2026-11-07T15:20:48.717Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" worker2 # [ 793.508768] nix-grpc-daemon[1617]: time=2026-11-07T15:20:48.721Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3cad0434e89391e1735db309798e05ef982bd3c4e3d4630c3ba0454efed31c4d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3cad0434e89391e1735db309798e05ef982bd3c4e3d4630c3ba0454efed31c4d" worker2 # [ 793.517285] nix-grpc-daemon[1617]: time=2026-11-07T15:20:48.721Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a6bbfa97b2b617629aa5b162959ef51ca6ae539e55efff23a540954436314a03\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a6bbfa97b2b617629aa5b162959ef51ca6ae539e55efff23a540954436314a03" worker1 # [ 793.955058] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 793.963671] systemd[1]: Started SSH per-connection Daemon (vsock:2:79). worker1 # [ 794.030980] sshd-session[2526]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 794.035385] sshd-session[2526]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 794.041325] sshd-session[2526]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 794.047252] systemd-logind[608]: New session '88' of user 'root' with class 'user' and type 'tty'. worker1 # [ 794.051418] systemd[1]: Started Session 88 of User root. worker1 # [ 794.073541] sshd-session[2532]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 794.075327] sshd-session[2532]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 794.076573] sshd-session[2526]: pam_unix(sshd:session): session closed for user root worker1 # [ 794.080207] systemd[1]: sshd-vsock@79-80-5:22-2:79.service: Deactivated successfully. worker1 # [ 794.083701] systemd[1]: session-88.scope: Deactivated successfully. worker1 # [ 794.087137] systemd-logind[608]: Session 88 logged out. Waiting for processes to exit. worker1 # [ 794.089221] systemd-logind[608]: Removed session 88. worker2 # [ 794.153741] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 794.164256] systemd[1]: Started SSH per-connection Daemon (vsock:2:66). worker2 # [ 794.232499] sshd-session[2425]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 794.237240] sshd-session[2425]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 794.243368] sshd-session[2425]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 794.248735] systemd-logind[555]: New session '74' of user 'root' with class 'user' and type 'tty'. worker2 # [ 794.253355] systemd[1]: Started Session 74 of User root. worker2 # [ 794.275673] sshd-session[2431]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 794.277329] sshd-session[2431]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 794.278581] sshd-session[2425]: pam_unix(sshd:session): session closed for user root worker2 # [ 794.281632] systemd[1]: sshd-vsock@66-67-6:22-2:66.service: Deactivated successfully. worker2 # [ 794.285456] systemd[1]: session-74.scope: Deactivated successfully. worker2 # [ 794.288533] systemd-logind[555]: Session 74 logged out. Waiting for processes to exit. worker2 # [ 794.290341] systemd-logind[555]: Removed session 74. worker2 # [ 794.663320] nix-grpc-daemon[1617]: time=2026-11-07T15:20:49.874Z level=WARN msg="Request failed, retrying" attempt=2 backoff=217.880488ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3cad0434e89391e1735db309798e05ef982bd3c4e3d4630c3ba0454efed31c4d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3cad0434e89391e1735db309798e05ef982bd3c4e3d4630c3ba0454efed31c4d" worker1 # [ 794.859260] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 794.869994] systemd[1]: Started SSH per-connection Daemon (vsock:2:80). worker2 # [ 794.884544] nix-grpc-daemon[1617]: time=2026-11-07T15:20:50.096Z level=WARN msg="Request failed, retrying" attempt=3 backoff=398.264034ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3cad0434e89391e1735db309798e05ef982bd3c4e3d4630c3ba0454efed31c4d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3cad0434e89391e1735db309798e05ef982bd3c4e3d4630c3ba0454efed31c4d" worker1 # [ 794.939956] sshd-session[2537]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 794.945177] sshd-session[2537]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 794.950241] sshd-session[2537]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 794.956521] systemd-logind[608]: New session '89' of user 'root' with class 'user' and type 'tty'. worker1 # [ 794.959504] systemd[1]: Started Session 89 of User root. worker1 # [ 794.981216] sshd-session[2543]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 794.982927] sshd-session[2543]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 794.984276] sshd-session[2537]: pam_unix(sshd:session): session closed for user root worker1 # [ 794.987333] systemd[1]: sshd-vsock@80-81-5:22-2:80.service: Deactivated successfully. worker1 # [ 794.990940] systemd[1]: session-89.scope: Deactivated successfully. worker1 # [ 794.994289] systemd-logind[608]: Session 89 logged out. Waiting for processes to exit. worker1 # [ 794.996217] systemd-logind[608]: Removed session 89. worker2 # [ 795.056165] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 795.066124] systemd[1]: Started SSH per-connection Daemon (vsock:2:67). worker2 # [ 795.132328] sshd-session[2436]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 795.137361] sshd-session[2436]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 795.142726] sshd-session[2436]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 795.149809] systemd-logind[555]: New session '75' of user 'root' with class 'user' and type 'tty'. worker2 # [ 795.152336] systemd[1]: Started Session 75 of User root. worker2 # [ 795.174627] sshd-session[2442]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 795.176314] sshd-session[2442]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 795.177513] sshd-session[2436]: pam_unix(sshd:session): session closed for user root worker2 # [ 795.180629] systemd[1]: sshd-vsock@67-68-6:22-2:67.service: Deactivated successfully. worker2 # [ 795.184480] systemd[1]: session-75.scope: Deactivated successfully. worker2 # [ 795.187171] systemd-logind[555]: Session 75 logged out. Waiting for processes to exit. worker2 # [ 795.189942] systemd-logind[555]: Removed session 75. worker1 # [ 795.760923] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 795.770835] systemd[1]: Started SSH per-connection Daemon (vsock:2:81). worker1 # [ 795.839521] sshd-session[2548]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 795.844123] sshd-session[2548]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 795.849892] sshd-session[2548]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 795.855315] systemd-logind[608]: New session '90' of user 'root' with class 'user' and type 'tty'. worker1 # [ 795.859409] systemd[1]: Started Session 90 of User root. worker1 # [ 795.881911] sshd-session[2554]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 795.883211] sshd-session[2554]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 795.885571] sshd-session[2548]: pam_unix(sshd:session): session closed for user root worker1 # [ 795.888068] systemd[1]: sshd-vsock@81-82-5:22-2:81.service: Deactivated successfully. worker1 # [ 795.891695] systemd[1]: session-90.scope: Deactivated successfully. worker1 # [ 795.894921] systemd-logind[608]: Session 90 logged out. Waiting for processes to exit. worker1 # [ 795.896551] systemd-logind[608]: Removed session 90. worker2 # [ 795.959349] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 795.965955] systemd[1]: Started SSH per-connection Daemon (vsock:2:68). worker2 # [ 796.033639] sshd-session[2447]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 796.038676] sshd-session[2447]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 796.044165] sshd-session[2447]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 796.049541] systemd-logind[555]: New session '76' of user 'root' with class 'user' and type 'tty'. worker2 # [ 796.054373] systemd[1]: Started Session 76 of User root. worker2 # [ 796.077190] sshd-session[2453]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 796.078380] sshd-session[2453]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 796.079691] sshd-session[2447]: pam_unix(sshd:session): session closed for user root worker2 # [ 796.082615] systemd[1]: sshd-vsock@68-69-6:22-2:68.service: Deactivated successfully. worker2 # [ 796.086615] systemd[1]: session-76.scope: Deactivated successfully. worker2 # [ 796.089801] systemd-logind[555]: Session 76 logged out. Waiting for processes to exit. worker2 # [ 796.092111] systemd-logind[555]: Removed session 76. worker2 # [ 796.327198] nix-grpc-daemon[1617]: time=2026-11-07T15:20:51.538Z level=WARN msg="Request failed, retrying" attempt=4 backoff=771.180451ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3cad0434e89391e1735db309798e05ef982bd3c4e3d4630c3ba0454efed31c4d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3cad0434e89391e1735db309798e05ef982bd3c4e3d4630c3ba0454efed31c4d" worker1 # [ 796.660876] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 796.670474] systemd[1]: Started SSH per-connection Daemon (vsock:2:82). worker1 # [ 796.737617] sshd-session[2559]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 796.742132] sshd-session[2559]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 796.747790] sshd-session[2559]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 796.754077] systemd-logind[608]: New session '91' of user 'root' with class 'user' and type 'tty'. worker1 # [ 796.757359] systemd[1]: Started Session 91 of User root. worker1 # [ 796.778951] sshd-session[2565]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 796.780653] sshd-session[2565]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 796.781926] sshd-session[2559]: pam_unix(sshd:session): session closed for user root worker1 # [ 796.784840] systemd[1]: sshd-vsock@82-83-5:22-2:82.service: Deactivated successfully. worker1 # [ 796.788549] systemd[1]: session-91.scope: Deactivated successfully. worker1 # [ 796.791757] systemd-logind[608]: Session 91 logged out. Waiting for processes to exit. worker1 # [ 796.793523] systemd-logind[608]: Removed session 91. worker2 # [ 796.861941] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 796.871270] systemd[1]: Started SSH per-connection Daemon (vsock:2:69). worker2 # [ 796.938696] sshd-session[2458]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 796.943847] sshd-session[2458]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 796.949253] sshd-session[2458]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 796.955241] systemd-logind[555]: New session '77' of user 'root' with class 'user' and type 'tty'. worker2 # [ 796.959349] systemd[1]: Started Session 77 of User root. worker2 # [ 796.981655] sshd-session[2464]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 796.983346] sshd-session[2464]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 796.984616] sshd-session[2458]: pam_unix(sshd:session): session closed for user root worker2 # [ 796.987530] systemd[1]: sshd-vsock@69-70-6:22-2:69.service: Deactivated successfully. worker2 # [ 796.991441] systemd[1]: session-77.scope: Deactivated successfully. worker2 # [ 796.994638] systemd-logind[555]: Session 77 logged out. Waiting for processes to exit. worker2 # [ 796.996240] systemd-logind[555]: Removed session 77. worker2 # [ 797.101806] nix-grpc-daemon[1617]: time=2026-11-07T15:20:52.314Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.696693363s error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3cad0434e89391e1735db309798e05ef982bd3c4e3d4630c3ba0454efed31c4d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3cad0434e89391e1735db309798e05ef982bd3c4e3d4630c3ba0454efed31c4d" worker1 # [ 797.566399] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 797.574182] systemd[1]: Started SSH per-connection Daemon (vsock:2:83). worker1 # [ 797.642749] sshd-session[2570]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 797.647066] sshd-session[2570]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 797.652775] sshd-session[2570]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 797.659137] systemd-logind[608]: New session '92' of user 'root' with class 'user' and type 'tty'. worker1 # [ 797.662498] systemd[1]: Started Session 92 of User root. worker1 # [ 797.684548] sshd-session[2576]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 797.685772] sshd-session[2576]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 797.687160] sshd-session[2570]: pam_unix(sshd:session): session closed for user root worker1 # [ 797.690323] systemd[1]: sshd-vsock@83-84-5:22-2:83.service: Deactivated successfully. worker1 # [ 797.693805] systemd[1]: session-92.scope: Deactivated successfully. worker1 # [ 797.696446] systemd-logind[608]: Session 92 logged out. Waiting for processes to exit. worker1 # [ 797.699213] systemd-logind[608]: Removed session 92. worker2 # [ 797.760640] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 797.764889] systemd[1]: Started SSH per-connection Daemon (vsock:2:70). worker2 # [ 797.812614] sshd-session[2469]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 797.817116] sshd-session[2469]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 797.823208] sshd-session[2469]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 797.828604] systemd-logind[555]: New session '78' of user 'root' with class 'user' and type 'tty'. worker2 # [ 797.833401] systemd[1]: Started Session 78 of User root. worker2 # [ 797.856285] sshd-session[2475]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 797.858101] sshd-session[2475]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 797.859344] sshd-session[2469]: pam_unix(sshd:session): session closed for user root worker2 # [ 797.862494] systemd[1]: sshd-vsock@70-71-6:22-2:70.service: Deactivated successfully. worker2 # [ 797.866435] systemd[1]: session-78.scope: Deactivated successfully. worker2 # [ 797.869650] systemd-logind[555]: Session 78 logged out. Waiting for processes to exit. worker2 # [ 797.871522] systemd-logind[555]: Removed session 78. worker1 # [ 798.468483] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 798.475821] systemd[1]: Started SSH per-connection Daemon (vsock:2:84). worker1 # [ 798.544837] sshd-session[2581]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 798.549192] sshd-session[2581]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 798.555101] sshd-session[2581]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 798.560253] systemd-logind[608]: New session '93' of user 'root' with class 'user' and type 'tty'. worker1 # [ 798.564523] systemd[1]: Started Session 93 of User root. worker1 # [ 798.585962] sshd-session[2587]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 798.587615] sshd-session[2587]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 798.588890] sshd-session[2581]: pam_unix(sshd:session): session closed for user root worker1 # [ 798.591892] systemd[1]: sshd-vsock@84-85-5:22-2:84.service: Deactivated successfully. worker1 # [ 798.595494] systemd[1]: session-93.scope: Deactivated successfully. worker1 # [ 798.598759] systemd-logind[608]: Session 93 logged out. Waiting for processes to exit. worker1 # [ 798.600948] systemd-logind[608]: Removed session 93. worker2 # [ 798.663267] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 798.667197] systemd[1]: Started SSH per-connection Daemon (vsock:2:71). worker2 # [ 798.716297] sshd-session[2480]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 798.721433] sshd-session[2480]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 798.726812] sshd-session[2480]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 798.733414] systemd-logind[555]: New session '79' of user 'root' with class 'user' and type 'tty'. worker2 # [ 798.736385] systemd[1]: Started Session 79 of User root. worker2 # [ 798.758497] nix-grpc-daemon[1617]: time=2026-11-07T15:20:53.970Z level=WARN msg="Request failed, retrying" attempt=2 backoff=199.340677ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a6bbfa97b2b617629aa5b162959ef51ca6ae539e55efff23a540954436314a03\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a6bbfa97b2b617629aa5b162959ef51ca6ae539e55efff23a540954436314a03" worker2 # [ 798.769726] sshd-session[2486]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 798.771215] sshd-session[2486]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 798.772513] sshd-session[2480]: pam_unix(sshd:session): session closed for user root worker2 # [ 798.775812] systemd[1]: sshd-vsock@71-72-6:22-2:71.service: Deactivated successfully. worker2 # [ 798.779615] systemd[1]: session-79.scope: Deactivated successfully. worker2 # [ 798.782834] systemd-logind[555]: Session 79 logged out. Waiting for processes to exit. worker2 # [ 798.784717] systemd-logind[555]: Removed session 79. worker1 # [ 799.371580] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 799.381229] systemd[1]: Started SSH per-connection Daemon (vsock:2:85). worker1 # [ 799.446218] sshd-session[2592]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 799.451141] sshd-session[2592]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 799.456310] sshd-session[2592]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 799.462569] systemd-logind[608]: New session '94' of user 'root' with class 'user' and type 'tty'. worker1 # [ 799.465368] systemd[1]: Started Session 94 of User root. worker1 # [ 799.486912] sshd-session[2598]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 799.488613] sshd-session[2598]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 799.489851] sshd-session[2592]: pam_unix(sshd:session): session closed for user root worker1 # [ 799.492909] systemd[1]: sshd-vsock@85-86-5:22-2:85.service: Deactivated successfully. worker1 # [ 799.496525] systemd[1]: session-94.scope: Deactivated successfully. worker1 # [ 799.499933] systemd-logind[608]: Session 94 logged out. Waiting for processes to exit. worker1 # [ 799.501411] systemd-logind[608]: Removed session 94. worker2 # [ 799.565076] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 799.569386] systemd[1]: Started SSH per-connection Daemon (vsock:2:72). worker2 # [ 799.617620] sshd-session[2491]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 799.622820] sshd-session[2491]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 799.628476] sshd-session[2491]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 799.635074] systemd-logind[555]: New session '80' of user 'root' with class 'user' and type 'tty'. worker2 # [ 799.638419] systemd[1]: Started Session 80 of User root. worker2 # [ 799.660924] sshd-session[2497]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 799.662765] sshd-session[2497]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 799.663978] sshd-session[2491]: pam_unix(sshd:session): session closed for user root worker2 # [ 799.666989] systemd[1]: sshd-vsock@72-73-6:22-2:72.service: Deactivated successfully. worker2 # [ 799.670731] systemd[1]: session-80.scope: Deactivated successfully. worker2 # [ 799.673173] systemd-logind[555]: Session 80 logged out. Waiting for processes to exit. worker2 # [ 799.676171] systemd-logind[555]: Removed session 80. worker2 # [ 799.975467] nix-grpc-daemon[1617]: time=2026-11-07T15:20:55.186Z level=WARN msg="Request failed, retrying" attempt=3 backoff=396.292309ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a6bbfa97b2b617629aa5b162959ef51ca6ae539e55efff23a540954436314a03\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a6bbfa97b2b617629aa5b162959ef51ca6ae539e55efff23a540954436314a03" worker1 # [ 800.272347] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 800.282511] systemd[1]: Started SSH per-connection Daemon (vsock:2:86). worker1 # [ 800.353319] sshd-session[2603]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 800.358293] sshd-session[2603]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 800.363442] sshd-session[2603]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 800.369066] systemd-logind[608]: New session '95' of user 'root' with class 'user' and type 'tty'. worker1 # [ 800.373556] systemd[1]: Started Session 95 of User root. worker1 # [ 800.396141] sshd-session[2609]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 800.397323] sshd-session[2609]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 800.398497] sshd-session[2603]: pam_unix(sshd:session): session closed for user root worker1 # [ 800.401532] systemd[1]: sshd-vsock@86-87-5:22-2:86.service: Deactivated successfully. worker1 # [ 800.405246] systemd[1]: session-95.scope: Deactivated successfully. worker1 # [ 800.408387] systemd-logind[608]: Session 95 logged out. Waiting for processes to exit. worker1 # [ 800.410116] systemd-logind[608]: Removed session 95. worker2 # [ 800.468394] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 800.471882] systemd[1]: Started SSH per-connection Daemon (vsock:2:73). worker2 # [ 800.520580] sshd-session[2502]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 800.525827] sshd-session[2502]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 800.531394] sshd-session[2502]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 800.538246] systemd-logind[555]: New session '81' of user 'root' with class 'user' and type 'tty'. worker2 # [ 800.541359] systemd[1]: Started Session 81 of User root. worker2 # [ 800.564587] sshd-session[2508]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 800.566065] sshd-session[2508]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 800.567401] sshd-session[2502]: pam_unix(sshd:session): session closed for user root worker2 # [ 800.570458] systemd[1]: sshd-vsock@73-74-6:22-2:73.service: Deactivated successfully. worker2 # [ 800.574385] systemd[1]: session-81.scope: Deactivated successfully. worker2 # [ 800.577617] systemd-logind[555]: Session 81 logged out. Waiting for processes to exit. worker2 # [ 800.579686] systemd-logind[555]: Removed session 81. worker1 # [ 801.175561] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 801.182311] systemd[1]: Started SSH per-connection Daemon (vsock:2:87). worker1 # [ 801.251361] sshd-session[2614]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 801.256259] sshd-session[2614]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 801.261095] sshd-session[2614]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 801.266345] systemd-logind[608]: New session '96' of user 'root' with class 'user' and type 'tty'. worker1 # [ 801.271377] systemd[1]: Started Session 96 of User root. worker1 # [ 801.293136] sshd-session[2620]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 801.294686] sshd-session[2620]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 801.296271] sshd-session[2614]: pam_unix(sshd:session): session closed for user root worker1 # [ 801.299244] systemd[1]: sshd-vsock@87-88-5:22-2:87.service: Deactivated successfully. worker1 # [ 801.302820] systemd[1]: session-96.scope: Deactivated successfully. worker1 # [ 801.306163] systemd-logind[608]: Session 96 logged out. Waiting for processes to exit. worker1 # [ 801.308277] systemd-logind[608]: Removed session 96. worker2 # [ 801.368919] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 801.374250] systemd[1]: Started SSH per-connection Daemon (vsock:2:74). worker2 # [ 801.382378] nix-grpc-daemon[1617]: time=2026-11-07T15:20:56.594Z level=WARN msg="Request failed, retrying" attempt=4 backoff=744.459403ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a6bbfa97b2b617629aa5b162959ef51ca6ae539e55efff23a540954436314a03\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a6bbfa97b2b617629aa5b162959ef51ca6ae539e55efff23a540954436314a03" worker2 # [ 801.442446] sshd-session[2513]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 801.447151] sshd-session[2513]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 801.452421] sshd-session[2513]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 801.459115] systemd-logind[555]: New session '82' of user 'root' with class 'user' and type 'tty'. worker2 # [ 801.462426] systemd[1]: Started Session 82 of User root. worker2 # [ 801.483598] sshd-session[2519]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 801.485282] sshd-session[2519]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 801.486568] sshd-session[2513]: pam_unix(sshd:session): session closed for user root worker2 # [ 801.490212] systemd[1]: sshd-vsock@74-75-6:22-2:74.service: Deactivated successfully. worker2 # [ 801.493068] systemd[1]: session-82.scope: Deactivated successfully. worker2 # [ 801.495683] systemd-logind[555]: Session 82 logged out. Waiting for processes to exit. worker2 # [ 801.498197] systemd-logind[555]: Removed session 82. worker1 # [ 802.075994] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 802.084745] systemd[1]: Started SSH per-connection Daemon (vsock:2:88). worker1 # [ 802.150693] sshd-session[2625]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 802.130530] nix-grpc-daemon[1617]: time=2026-11-07T15:20:57.342Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.554516733s error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a6bbfa97b2b617629aa5b162959ef51ca6ae539e55efff23a540954436314a03\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a6bbfa97b2b617629aa5b162959ef51ca6ae539e55efff23a540954436314a03" worker1 # [ 802.155147] sshd-session[2625]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 802.160547] sshd-session[2625]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 802.165627] systemd-logind[608]: New session '97' of user 'root' with class 'user' and type 'tty'. worker1 # [ 802.170328] systemd[1]: Started Session 97 of User root. worker1 # [ 802.191499] sshd-session[2631]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 802.192699] sshd-session[2631]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 802.193911] sshd-session[2625]: pam_unix(sshd:session): session closed for user root worker1 # [ 802.196593] systemd[1]: sshd-vsock@88-89-5:22-2:88.service: Deactivated successfully. worker1 # [ 802.200437] systemd[1]: session-97.scope: Deactivated successfully. worker1 # [ 802.203551] systemd-logind[608]: Session 97 logged out. Waiting for processes to exit. worker1 # [ 802.205086] systemd-logind[608]: Removed session 97. worker2 # [ 802.274720] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 802.282295] systemd[1]: Started SSH per-connection Daemon (vsock:2:75). worker2 # [ 802.349186] sshd-session[2524]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 802.353977] sshd-session[2524]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 802.359356] sshd-session[2524]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 802.365781] systemd-logind[555]: New session '83' of user 'root' with class 'user' and type 'tty'. worker2 # [ 802.369349] systemd[1]: Started Session 83 of User root. worker2 # [ 802.391307] sshd-session[2530]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 802.392968] sshd-session[2530]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 802.394180] sshd-session[2524]: pam_unix(sshd:session): session closed for user root worker2 # [ 802.398099] systemd[1]: sshd-vsock@75-76-6:22-2:75.service: Deactivated successfully. worker2 # [ 802.400712] systemd[1]: session-83.scope: Deactivated successfully. worker2 # [ 802.403950] systemd-logind[555]: Session 83 logged out. Waiting for processes to exit. worker2 # [ 802.405608] systemd-logind[555]: Removed session 83. worker1 # [ 802.975204] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 802.980387] systemd[1]: Started SSH per-connection Daemon (vsock:2:89). worker1 # [ 803.045986] sshd-session[2636]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 803.050844] sshd-session[2636]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 803.055570] sshd-session[2636]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 803.061245] systemd-logind[608]: New session '98' of user 'root' with class 'user' and type 'tty'. worker1 # [ 803.065407] systemd[1]: Started Session 98 of User root. worker1 # [ 803.086566] sshd-session[2642]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 803.088251] sshd-session[2642]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 803.089509] sshd-session[2636]: pam_unix(sshd:session): session closed for user root worker1 # [ 803.092572] systemd[1]: sshd-vsock@89-90-5:22-2:89.service: Deactivated successfully. worker1 # [ 803.096376] systemd[1]: session-98.scope: Deactivated successfully. worker1 # [ 803.099417] systemd-logind[608]: Session 98 logged out. Waiting for processes to exit. worker1 # [ 803.101196] systemd-logind[608]: Removed session 98. worker2 # [ 803.174538] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 803.184172] systemd[1]: Started SSH per-connection Daemon (vsock:2:76). worker2 # [ 803.251322] sshd-session[2535]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 803.256180] sshd-session[2535]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 803.261346] sshd-session[2535]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 803.267078] systemd-logind[555]: New session '84' of user 'root' with class 'user' and type 'tty'. worker2 # [ 803.271411] systemd[1]: Started Session 84 of User root. worker2 # [ 803.293537] sshd-session[2541]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 803.294766] sshd-session[2541]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 803.295984] sshd-session[2535]: pam_unix(sshd:session): session closed for user root worker2 # [ 803.298956] systemd[1]: sshd-vsock@76-77-6:22-2:76.service: Deactivated successfully. worker2 # [ 803.302592] systemd[1]: session-84.scope: Deactivated successfully. worker2 # [ 803.305885] systemd-logind[555]: Session 84 logged out. Waiting for processes to exit. worker2 # [ 803.308141] systemd-logind[555]: Removed session 84. worker2 # [ 803.689844] nix-grpc-daemon[1617]: time=2026-11-07T15:20:58.901Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3cad0434e89391e1735db309798e05ef982bd3c4e3d4630c3ba0454efed31c4d\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 803.719888] nix-daemon[986]: reaped child process 2413, status = succeeded client # [ 803.710534] nix[3598]: lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152048Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=3cad0434e89391e1735db309798e05ef982bd3c4e3d4630c3ba0454efed31c4d": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1 # [ 803.876328] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 803.884067] systemd[1]: Started SSH per-connection Daemon (vsock:2:90). worker1 # [ 803.959534] sshd-session[2647]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 803.964419] sshd-session[2647]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 803.969134] sshd-session[2647]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 803.975065] systemd-logind[608]: New session '99' of user 'root' with class 'user' and type 'tty'. worker1 # [ 803.978377] systemd[1]: Started Session 99 of User root. worker1 # [ 804.000314] sshd-session[2653]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 804.001535] sshd-session[2653]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 804.002804] sshd-session[2647]: pam_unix(sshd:session): session closed for user root worker1 # [ 804.005590] systemd[1]: sshd-vsock@90-91-5:22-2:90.service: Deactivated successfully. worker1 # [ 804.009442] systemd[1]: session-99.scope: Deactivated successfully. worker1 # [ 804.012638] systemd-logind[608]: Session 99 logged out. Waiting for processes to exit. worker1 # [ 804.014259] systemd-logind[608]: Removed session 99. worker2 # [ 804.080534] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 804.087385] systemd[1]: Started SSH per-connection Daemon (vsock:2:77). worker2 # [ 804.157300] sshd-session[2546]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 804.162246] sshd-session[2546]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 804.167642] sshd-session[2546]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 804.174252] systemd-logind[555]: New session '85' of user 'root' with class 'user' and type 'tty'. worker2 # [ 804.177437] systemd[1]: Started Session 85 of User root. worker2 # [ 804.199651] sshd-session[2552]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 804.201429] sshd-session[2552]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 804.202683] sshd-session[2546]: pam_unix(sshd:session): session closed for user root worker2 # [ 804.205751] systemd[1]: sshd-vsock@77-78-6:22-2:77.service: Deactivated successfully. worker2 # [ 804.209639] systemd[1]: session-85.scope: Deactivated successfully. worker2 # [ 804.213175] systemd-logind[555]: Session 85 logged out. Waiting for processes to exit. worker2 # [ 804.214897] systemd-logind[555]: Removed session 85. worker1 # [ 804.780068] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 804.784438] systemd[1]: Started SSH per-connection Daemon (vsock:2:91). worker1 # [ 804.832263] sshd-session[2658]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 804.836954] sshd-session[2658]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 804.841597] sshd-session[2658]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 804.848412] systemd-logind[608]: New session '100' of user 'root' with class 'user' and type 'tty'. worker1 # [ 804.852352] systemd[1]: Started Session 100 of User root. worker1 # [ 804.873844] sshd-session[2664]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 804.875186] sshd-session[2664]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 804.876523] sshd-session[2658]: pam_unix(sshd:session): session closed for user root worker1 # [ 804.880764] systemd[1]: sshd-vsock@91-92-5:22-2:91.service: Deactivated successfully. worker1 # [ 804.883615] systemd[1]: session-100.scope: Deactivated successfully. worker1 # [ 804.886932] systemd-logind[608]: Session 100 logged out. Waiting for processes to exit. worker1 # [ 804.889170] systemd-logind[608]: Removed session 100. worker2 # [ 804.981662] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 804.991351] systemd[1]: Started SSH per-connection Daemon (vsock:2:78). worker2 # [ 805.061399] sshd-session[2557]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 805.066142] sshd-session[2557]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 805.072364] sshd-session[2557]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 805.079117] systemd-logind[555]: New session '86' of user 'root' with class 'user' and type 'tty'. worker2 # [ 805.082408] systemd[1]: Started Session 86 of User root. worker2 # [ 805.105541] sshd-session[2563]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 805.107295] sshd-session[2563]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 805.108527] sshd-session[2557]: pam_unix(sshd:session): session closed for user root worker2 # [ 805.111852] systemd[1]: sshd-vsock@78-79-6:22-2:78.service: Deactivated successfully. worker2 # [ 805.115722] systemd[1]: session-86.scope: Deactivated successfully. worker2 # [ 805.119178] systemd-logind[555]: Session 86 logged out. Waiting for processes to exit. worker2 # [ 805.120888] systemd-logind[555]: Removed session 86. worker1 # [ 805.683112] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 805.687338] systemd[1]: Started SSH per-connection Daemon (vsock:2:92). worker1 # [ 805.734723] sshd-session[2669]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 805.739142] sshd-session[2669]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 805.744821] sshd-session[2669]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 805.750313] systemd-logind[608]: New session '101' of user 'root' with class 'user' and type 'tty'. worker1 # [ 805.754414] systemd[1]: Started Session 101 of User root. worker1 # [ 805.776556] sshd-session[2675]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 805.778242] sshd-session[2675]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 805.779575] sshd-session[2669]: pam_unix(sshd:session): session closed for user root worker1 # [ 805.782635] systemd[1]: sshd-vsock@92-93-5:22-2:92.service: Deactivated successfully. worker1 # [ 805.786565] systemd[1]: session-101.scope: Deactivated successfully. worker1 # [ 805.789697] systemd-logind[608]: Session 101 logged out. Waiting for processes to exit. worker1 # [ 805.791334] systemd-logind[608]: Removed session 101. worker2 # [ 805.882491] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 805.892189] systemd[1]: Started SSH per-connection Daemon (vsock:2:79). worker2 # [ 805.959414] sshd-session[2568]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 805.964131] sshd-session[2568]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 805.970428] sshd-session[2568]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 805.977262] systemd-logind[555]: New session '87' of user 'root' with class 'user' and type 'tty'. worker2 # [ 805.981535] systemd[1]: Started Session 87 of User root. worker2 # [ 806.004905] sshd-session[2574]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 806.006218] sshd-session[2574]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 806.007428] sshd-session[2568]: pam_unix(sshd:session): session closed for user root worker2 # [ 806.010577] systemd[1]: sshd-vsock@79-80-6:22-2:79.service: Deactivated successfully. worker2 # [ 806.014554] systemd[1]: session-87.scope: Deactivated successfully. worker2 # [ 806.017815] systemd-logind[555]: Session 87 logged out. Waiting for processes to exit. worker2 # [ 806.019446] systemd-logind[555]: Removed session 87. worker1 # [ 806.584674] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 806.588825] systemd[1]: Started SSH per-connection Daemon (vsock:2:93). worker1 # [ 806.636437] sshd-session[2680]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 806.641488] sshd-session[2680]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 806.646286] sshd-session[2680]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 806.652257] systemd-logind[608]: New session '102' of user 'root' with class 'user' and type 'tty'. worker1 # [ 806.656422] systemd[1]: Started Session 102 of User root. worker1 # [ 806.678645] sshd-session[2686]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 806.679892] sshd-session[2686]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 806.681124] sshd-session[2680]: pam_unix(sshd:session): session closed for user root worker1 # [ 806.684240] systemd[1]: sshd-vsock@93-94-5:22-2:93.service: Deactivated successfully. worker1 # [ 806.687875] systemd[1]: session-102.scope: Deactivated successfully. worker1 # [ 806.691170] systemd-logind[608]: Session 102 logged out. Waiting for processes to exit. worker1 # [ 806.693223] systemd-logind[608]: Removed session 102. worker2 # [ 806.786427] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 806.796513] systemd[1]: Started SSH per-connection Daemon (vsock:2:80). worker2 # [ 806.865674] sshd-session[2579]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 806.870923] sshd-session[2579]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 806.876479] sshd-session[2579]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 806.883270] systemd-logind[555]: New session '88' of user 'root' with class 'user' and type 'tty'. worker2 # [ 806.887442] systemd[1]: Started Session 88 of User root. worker2 # [ 806.910392] sshd-session[2585]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 806.912133] sshd-session[2585]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 806.913714] sshd-session[2579]: pam_unix(sshd:session): session closed for user root worker2 # [ 806.916477] systemd[1]: sshd-vsock@80-81-6:22-2:80.service: Deactivated successfully. worker2 # [ 806.920892] systemd[1]: session-88.scope: Deactivated successfully. worker2 # [ 806.924092] systemd-logind[555]: Session 88 logged out. Waiting for processes to exit. worker2 # [ 806.925426] systemd-logind[555]: Removed session 88. worker1 # [ 807.487864] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 807.492059] systemd[1]: Started SSH per-connection Daemon (vsock:2:94). worker1 # [ 807.537508] sshd-session[2691]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 807.542270] sshd-session[2691]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 807.546781] sshd-session[2691]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 807.551708] systemd-logind[608]: New session '103' of user 'root' with class 'user' and type 'tty'. worker1 # [ 807.556392] systemd[1]: Started Session 103 of User root. worker1 # [ 807.576985] sshd-session[2697]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 807.578769] sshd-session[2697]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 807.580079] sshd-session[2691]: pam_unix(sshd:session): session closed for user root worker1 # [ 807.582980] systemd[1]: sshd-vsock@94-95-5:22-2:94.service: Deactivated successfully. worker1 # [ 807.586634] systemd[1]: session-103.scope: Deactivated successfully. worker1 # [ 807.589855] systemd-logind[608]: Session 103 logged out. Waiting for processes to exit. worker1 # [ 807.591996] systemd-logind[608]: Removed session 103. worker2 # [ 807.688823] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 807.699191] systemd[1]: Started SSH per-connection Daemon (vsock:2:81). worker2 # [ 807.716603] nix-grpc-daemon[1514]: ts=2026-11-07T15:21:02Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 807.732287] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 807.853843] nix-daemon[986]: accepted connection from pid 2593, user nix-grpc-daemon (trusted) worker2 # [ 807.861419] sshd-session[2590]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 807.872822] sshd-session[2590]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 807.877467] nix-daemon[986]: reaped child process 2599, status = succeeded worker2 # [ 807.884290] sshd-session[2590]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 807.885429] niks3-server[1503]: 2026/11/07 15:21:03 INFO Received push request method=POST path=/api/pushes worker2 # [ 807.889936] systemd-logind[555]: New session '89' of user 'root' with class 'user' and type 'tty'. worker2 # [ 807.892842] nix-grpc-daemon[1617]: time=2026-11-07T15:21:03.104Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 807.897517] nix-grpc-daemon[1617]: time=2026-11-07T15:21:03.105Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" worker2 # [ 807.900082] nix-grpc-daemon[1617]: time=2026-11-07T15:21:03.109Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=531395bb8a566d4c40a8601f3a9677fecf1dc3f8640ba3bf34abf2628b2ae495\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=531395bb8a566d4c40a8601f3a9677fecf1dc3f8640ba3bf34abf2628b2ae495" worker2 # [ 807.908530] nix-grpc-daemon[1617]: time=2026-11-07T15:21:03.110Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=775d7051c5248098b1aa4be1620321565cd43db2c6b7ec95d426660d0ca253d7\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=775d7051c5248098b1aa4be1620321565cd43db2c6b7ec95d426660d0ca253d7" worker2 # [ 807.918263] systemd[1]: Started Session 89 of User root. worker2 # [ 807.940513] sshd-session[2603]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 807.941827] sshd-session[2603]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 807.943245] sshd-session[2590]: pam_unix(sshd:session): session closed for user root worker2 # [ 807.947172] systemd[1]: sshd-vsock@81-82-6:22-2:81.service: Deactivated successfully. worker2 # [ 807.950238] systemd[1]: session-89.scope: Deactivated successfully. worker2 # [ 807.953180] systemd-logind[555]: Session 89 logged out. Waiting for processes to exit. worker2 # [ 807.955310] systemd-logind[555]: Removed session 89. worker2 # [ 808.000086] nix-grpc-daemon[1617]: time=2026-11-07T15:21:03.212Z level=WARN msg="Request failed, retrying" attempt=2 backoff=183.014082ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=775d7051c5248098b1aa4be1620321565cd43db2c6b7ec95d426660d0ca253d7\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=775d7051c5248098b1aa4be1620321565cd43db2c6b7ec95d426660d0ca253d7" worker2 # [ 808.009374] nix-grpc-daemon[1617]: time=2026-11-07T15:21:03.221Z level=WARN msg="Request failed, retrying" attempt=2 backoff=196.306946ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=531395bb8a566d4c40a8601f3a9677fecf1dc3f8640ba3bf34abf2628b2ae495\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=531395bb8a566d4c40a8601f3a9677fecf1dc3f8640ba3bf34abf2628b2ae495" worker2 # [ 808.195165] nix-grpc-daemon[1617]: time=2026-11-07T15:21:03.407Z level=WARN msg="Request failed, retrying" attempt=3 backoff=427.90203ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=775d7051c5248098b1aa4be1620321565cd43db2c6b7ec95d426660d0ca253d7\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=775d7051c5248098b1aa4be1620321565cd43db2c6b7ec95d426660d0ca253d7" worker1 # [ 808.490297] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 808.493589] systemd[1]: Started SSH per-connection Daemon (vsock:2:95). worker1 # [ 808.539421] sshd-session[2702]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 808.544082] sshd-session[2702]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 808.548718] sshd-session[2702]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 808.554234] systemd-logind[608]: New session '104' of user 'root' with class 'user' and type 'tty'. worker1 # [ 808.558402] systemd[1]: Started Session 104 of User root. worker1 # [ 808.580294] sshd-session[2708]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 808.581938] sshd-session[2708]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 808.583209] sshd-session[2702]: pam_unix(sshd:session): session closed for user root worker1 # [ 808.587066] systemd[1]: sshd-vsock@95-96-5:22-2:95.service: Deactivated successfully. worker1 # [ 808.589819] systemd[1]: session-104.scope: Deactivated successfully. worker1 # [ 808.592887] systemd-logind[608]: Session 104 logged out. Waiting for processes to exit. worker1 # [ 808.595206] systemd-logind[608]: Removed session 104. worker2 # [ 808.687320] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 808.691733] systemd[1]: Started SSH per-connection Daemon (vsock:2:82). worker2 # [ 808.739525] sshd-session[2608]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 808.744836] sshd-session[2608]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 808.750482] sshd-session[2608]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 808.757135] systemd-logind[555]: New session '90' of user 'root' with class 'user' and type 'tty'. worker2 # [ 808.760377] systemd[1]: Started Session 90 of User root. worker2 # [ 808.783882] sshd-session[2614]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 808.785622] sshd-session[2614]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 808.786859] sshd-session[2608]: pam_unix(sshd:session): session closed for user root worker2 # [ 808.789789] systemd[1]: sshd-vsock@82-83-6:22-2:82.service: Deactivated successfully. worker2 # [ 808.793625] systemd[1]: session-90.scope: Deactivated successfully. worker2 # [ 808.796936] systemd-logind[555]: Session 90 logged out. Waiting for processes to exit. worker2 # [ 808.798639] systemd-logind[555]: Removed session 90. worker2 # [ 809.254973] nix-grpc-daemon[1617]: time=2026-11-07T15:21:04.466Z level=WARN msg="Request failed, retrying" attempt=3 backoff=392.38612ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=531395bb8a566d4c40a8601f3a9677fecf1dc3f8640ba3bf34abf2628b2ae495\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=531395bb8a566d4c40a8601f3a9677fecf1dc3f8640ba3bf34abf2628b2ae495" worker1 # [ 809.391496] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 809.395352] systemd[1]: Started SSH per-connection Daemon (vsock:2:96). worker1 # [ 809.441886] sshd-session[2713]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 809.446775] sshd-session[2713]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 809.451598] sshd-session[2713]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 809.457063] systemd-logind[608]: New session '105' of user 'root' with class 'user' and type 'tty'. worker1 # [ 809.461402] systemd[1]: Started Session 105 of User root. worker1 # [ 809.482247] sshd-session[2719]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 809.483941] sshd-session[2719]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 809.485229] sshd-session[2713]: pam_unix(sshd:session): session closed for user root worker1 # [ 809.488321] systemd[1]: sshd-vsock@96-97-5:22-2:96.service: Deactivated successfully. worker1 # [ 809.492563] systemd[1]: session-105.scope: Deactivated successfully. worker1 # [ 809.495432] systemd-logind[608]: Session 105 logged out. Waiting for processes to exit. worker1 # [ 809.497204] systemd-logind[608]: Removed session 105. worker2 # [ 809.592534] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 809.602494] systemd[1]: Started SSH per-connection Daemon (vsock:2:83). worker2 # [ 809.677336] sshd-session[2619]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 809.682140] sshd-session[2619]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 809.688267] sshd-session[2619]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 809.695246] systemd-logind[555]: New session '91' of user 'root' with class 'user' and type 'tty'. worker2 # [ 809.698533] systemd[1]: Started Session 91 of User root. worker2 # [ 809.721990] sshd-session[2625]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 809.723702] sshd-session[2625]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 809.724956] sshd-session[2619]: pam_unix(sshd:session): session closed for user root worker2 # [ 809.727863] systemd[1]: sshd-vsock@83-84-6:22-2:83.service: Deactivated successfully. worker2 # [ 809.731782] systemd[1]: session-91.scope: Deactivated successfully. worker2 # [ 809.735112] systemd-logind[555]: Session 91 logged out. Waiting for processes to exit. worker2 # [ 809.736815] systemd-logind[555]: Removed session 91. worker1 # [ 810.294267] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 810.302369] systemd[1]: Started SSH per-connection Daemon (vsock:2:97). worker1 # [ 810.368393] sshd-session[2724]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 810.373228] sshd-session[2724]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 810.378228] sshd-session[2724]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 810.384631] systemd-logind[608]: New session '106' of user 'root' with class 'user' and type 'tty'. worker1 # [ 810.387360] systemd[1]: Started Session 106 of User root. worker1 # [ 810.409802] sshd-session[2730]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 810.411594] sshd-session[2730]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 810.412816] sshd-session[2724]: pam_unix(sshd:session): session closed for user root worker1 # [ 810.415775] systemd[1]: sshd-vsock@97-98-5:22-2:97.service: Deactivated successfully. worker1 # [ 810.419536] systemd[1]: session-106.scope: Deactivated successfully. worker1 # [ 810.422972] systemd-logind[608]: Session 106 logged out. Waiting for processes to exit. worker1 # [ 810.425148] systemd-logind[608]: Removed session 106. worker2 # [ 810.495367] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 810.503971] systemd[1]: Started SSH per-connection Daemon (vsock:2:84). worker2 # [ 810.572742] sshd-session[2630]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 810.577734] sshd-session[2630]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 810.583136] sshd-session[2630]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 810.589690] systemd-logind[555]: New session '92' of user 'root' with class 'user' and type 'tty'. worker2 # [ 810.592261] systemd[1]: Started Session 92 of User root. worker2 # [ 810.614556] sshd-session[2636]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 810.615827] sshd-session[2636]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 810.617272] sshd-session[2630]: pam_unix(sshd:session): session closed for user root worker2 # [ 810.620271] systemd[1]: sshd-vsock@84-85-6:22-2:84.service: Deactivated successfully. worker2 # [ 810.623812] systemd[1]: session-92.scope: Deactivated successfully. worker2 # [ 810.627154] systemd-logind[555]: Session 92 logged out. Waiting for processes to exit. worker2 # [ 810.628708] systemd-logind[555]: Removed session 92. worker2 # [ 810.662416] nix-grpc-daemon[1617]: time=2026-11-07T15:21:05.874Z level=WARN msg="Request failed, retrying" attempt=4 backoff=756.589786ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=531395bb8a566d4c40a8601f3a9677fecf1dc3f8640ba3bf34abf2628b2ae495\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=531395bb8a566d4c40a8601f3a9677fecf1dc3f8640ba3bf34abf2628b2ae495" worker1 # [ 811.198494] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 811.202278] systemd[1]: Started SSH per-connection Daemon (vsock:2:98). worker1 # [ 811.248299] sshd-session[2735]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 811.252978] sshd-session[2735]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 811.257722] sshd-session[2735]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 811.263067] systemd-logind[608]: New session '107' of user 'root' with class 'user' and type 'tty'. worker1 # [ 811.267406] systemd[1]: Started Session 107 of User root. worker1 # [ 811.288230] sshd-session[2741]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 811.289738] sshd-session[2741]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 811.290938] sshd-session[2735]: pam_unix(sshd:session): session closed for user root worker1 # [ 811.293702] systemd[1]: sshd-vsock@98-99-5:22-2:98.service: Deactivated successfully. worker1 # [ 811.297499] systemd[1]: session-107.scope: Deactivated successfully. worker1 # [ 811.300562] systemd-logind[608]: Session 107 logged out. Waiting for processes to exit. worker1 # [ 811.302144] systemd-logind[608]: Removed session 107. worker2 # [ 811.398915] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 811.405878] systemd[1]: Started SSH per-connection Daemon (vsock:2:85). worker2 # [ 811.433298] nix-grpc-daemon[1617]: time=2026-11-07T15:21:06.645Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.753641141s error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=531395bb8a566d4c40a8601f3a9677fecf1dc3f8640ba3bf34abf2628b2ae495\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=531395bb8a566d4c40a8601f3a9677fecf1dc3f8640ba3bf34abf2628b2ae495" worker2 # [ 811.495077] sshd-session[2641]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 811.500129] sshd-session[2641]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 811.505465] sshd-session[2641]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 811.512435] systemd-logind[555]: New session '93' of user 'root' with class 'user' and type 'tty'. worker2 # [ 811.515361] systemd[1]: Started Session 93 of User root. worker2 # [ 811.537473] sshd-session[2647]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 811.539184] sshd-session[2647]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 811.540471] sshd-session[2641]: pam_unix(sshd:session): session closed for user root worker2 # [ 811.543346] systemd[1]: sshd-vsock@85-86-6:22-2:85.service: Deactivated successfully. worker2 # [ 811.547327] systemd[1]: session-93.scope: Deactivated successfully. worker2 # [ 811.550639] systemd-logind[555]: Session 93 logged out. Waiting for processes to exit. worker2 # [ 811.552259] systemd-logind[555]: Removed session 93. worker1 # [ 812.100194] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 812.104371] systemd[1]: Started SSH per-connection Daemon (vsock:2:99). worker1 # [ 812.151264] sshd-session[2746]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 812.156085] sshd-session[2746]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 812.161218] sshd-session[2746]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 812.167406] systemd-logind[608]: New session '108' of user 'root' with class 'user' and type 'tty'. worker1 # [ 812.170338] systemd[1]: Started Session 108 of User root. worker1 # [ 812.191956] sshd-session[2752]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 812.193643] sshd-session[2752]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 812.194874] sshd-session[2746]: pam_unix(sshd:session): session closed for user root worker1 # [ 812.197849] systemd[1]: sshd-vsock@99-100-5:22-2:99.service: Deactivated successfully. worker1 # [ 812.201636] systemd[1]: session-108.scope: Deactivated successfully. worker1 # [ 812.204658] systemd-logind[608]: Session 108 logged out. Waiting for processes to exit. worker1 # [ 812.206380] systemd-logind[608]: Removed session 108. worker2 # [ 812.297531] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 812.306836] systemd[1]: Started SSH per-connection Daemon (vsock:2:86). worker2 # [ 812.376206] sshd-session[2652]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it [e2e] heartbeat t=750s worker2 # [ 812.380982] sshd-session[2652]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 812.386349] sshd-session[2652]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 812.393076] systemd-logind[555]: New session '94' of user 'root' with class 'user' and type 'tty'. worker2 # [ 812.396420] systemd[1]: Started Session 94 of User root. worker2 # [ 812.418438] sshd-session[2658]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 812.419839] sshd-session[2658]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 812.421465] sshd-session[2652]: pam_unix(sshd:session): session closed for user root worker2 # [ 812.424575] systemd[1]: sshd-vsock@86-87-6:22-2:86.service: Deactivated successfully. worker2 # [ 812.428354] systemd[1]: session-94.scope: Deactivated successfully. worker2 # [ 812.431738] systemd-logind[555]: Session 94 logged out. Waiting for processes to exit. worker2 # [ 812.433326] systemd-logind[555]: Removed session 94. worker2 # [ 812.711553] nix-grpc-daemon[1617]: time=2026-11-07T15:21:07.923Z level=WARN msg="Request failed, retrying" attempt=4 backoff=767.339734ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=775d7051c5248098b1aa4be1620321565cd43db2c6b7ec95d426660d0ca253d7\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=775d7051c5248098b1aa4be1620321565cd43db2c6b7ec95d426660d0ca253d7" worker1 # [ 812.999580] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 813.007182] systemd[1]: Started SSH per-connection Daemon (vsock:2:100). worker1 # [ 813.075861] sshd-session[2757]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 813.080892] sshd-session[2757]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 813.085980] sshd-session[2757]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 813.091215] systemd-logind[608]: New session '109' of user 'root' with class 'user' and type 'tty'. worker1 # [ 813.096576] systemd[1]: Started Session 109 of User root. worker1 # [ 813.116235] sshd-session[2763]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 813.117920] sshd-session[2763]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 813.119232] sshd-session[2757]: pam_unix(sshd:session): session closed for user root worker1 # [ 813.122195] systemd[1]: sshd-vsock@100-101-5:22-2:100.service: Deactivated successfully. worker1 # [ 813.125718] systemd[1]: session-109.scope: Deactivated successfully. worker1 # [ 813.128926] systemd-logind[608]: Session 109 logged out. Waiting for processes to exit. worker1 # [ 813.130499] systemd-logind[608]: Removed session 109. worker2 # [ 813.199397] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 813.208963] systemd[1]: Started SSH per-connection Daemon (vsock:2:87). worker2 # [ 813.279912] sshd-session[2663]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 813.284900] sshd-session[2663]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 813.290272] sshd-session[2663]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 813.297242] systemd-logind[555]: New session '95' of user 'root' with class 'user' and type 'tty'. worker2 # [ 813.300371] systemd[1]: Started Session 95 of User root. worker2 # [ 813.322582] sshd-session[2669]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 813.323858] sshd-session[2669]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 813.325235] sshd-session[2663]: pam_unix(sshd:session): session closed for user root worker2 # [ 813.328248] systemd[1]: sshd-vsock@87-88-6:22-2:87.service: Deactivated successfully. worker2 # [ 813.331794] systemd[1]: session-95.scope: Deactivated successfully. worker2 # [ 813.335184] systemd-logind[555]: Session 95 logged out. Waiting for processes to exit. worker2 # [ 813.336895] systemd-logind[555]: Removed session 95. worker1 # [ 813.903756] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 813.907899] systemd[1]: Started SSH per-connection Daemon (vsock:2:101). worker1 # [ 813.952410] sshd-session[2768]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 813.957135] sshd-session[2768]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 813.961713] sshd-session[2768]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 813.968124] systemd-logind[608]: New session '110' of user 'root' with class 'user' and type 'tty'. worker1 # [ 813.970405] systemd[1]: Started Session 110 of User root. worker1 # [ 813.991457] sshd-session[2774]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 813.992658] sshd-session[2774]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 813.993826] sshd-session[2768]: pam_unix(sshd:session): session closed for user root worker1 # [ 813.996739] systemd[1]: sshd-vsock@101-102-5:22-2:101.service: Deactivated successfully. worker1 # [ 814.000725] systemd[1]: session-110.scope: Deactivated successfully. worker1 # [ 814.003728] systemd-logind[608]: Session 110 logged out. Waiting for processes to exit. worker1 # [ 814.005135] systemd-logind[608]: Removed session 110. worker2 # [ 814.100401] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 814.104463] systemd[1]: Started SSH per-connection Daemon (vsock:2:88). worker2 # [ 814.150383] sshd-session[2674]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 814.155297] sshd-session[2674]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 814.160565] sshd-session[2674]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 814.167258] systemd-logind[555]: New session '96' of user 'root' with class 'user' and type 'tty'. worker2 # [ 814.170420] systemd[1]: Started Session 96 of User root. worker2 # [ 814.192516] sshd-session[2680]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 814.193797] sshd-session[2680]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 814.195179] sshd-session[2674]: pam_unix(sshd:session): session closed for user root worker2 # [ 814.198091] systemd[1]: sshd-vsock@88-89-6:22-2:88.service: Deactivated successfully. worker2 # [ 814.201732] systemd[1]: session-96.scope: Deactivated successfully. worker2 # [ 814.205399] systemd-logind[555]: Session 96 logged out. Waiting for processes to exit. worker2 # [ 814.206874] systemd-logind[555]: Removed session 96. worker2 # [ 814.502576] nix-grpc-daemon[1617]: time=2026-11-07T15:21:09.714Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.447035599s error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=775d7051c5248098b1aa4be1620321565cd43db2c6b7ec95d426660d0ca253d7\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=775d7051c5248098b1aa4be1620321565cd43db2c6b7ec95d426660d0ca253d7" worker1 # [ 814.804246] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 814.813204] systemd[1]: Started SSH per-connection Daemon (vsock:2:102). worker1 # [ 814.878746] sshd-session[2779]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 814.883805] sshd-session[2779]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 814.888948] sshd-session[2779]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 814.895066] systemd-logind[608]: New session '111' of user 'root' with class 'user' and type 'tty'. worker1 # [ 814.898398] systemd[1]: Started Session 111 of User root. worker1 # [ 814.920580] sshd-session[2785]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 814.922308] sshd-session[2785]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 814.923512] sshd-session[2779]: pam_unix(sshd:session): session closed for user root worker1 # [ 814.926658] systemd[1]: sshd-vsock@102-103-5:22-2:102.service: Deactivated successfully. worker1 # [ 814.930316] systemd[1]: session-111.scope: Deactivated successfully. worker1 # [ 814.933662] systemd-logind[608]: Session 111 logged out. Waiting for processes to exit. worker1 # [ 814.935089] systemd-logind[608]: Removed session 111. worker2 # [ 815.006372] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 815.016264] systemd[1]: Started SSH per-connection Daemon (vsock:2:89). worker2 # [ 815.087763] sshd-session[2685]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 815.092766] sshd-session[2685]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 815.098125] sshd-session[2685]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 815.104247] systemd-logind[555]: New session '97' of user 'root' with class 'user' and type 'tty'. worker2 # [ 815.108514] systemd[1]: Started Session 97 of User root. worker2 # [ 815.130737] sshd-session[2691]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 815.132562] sshd-session[2691]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 815.133912] sshd-session[2685]: pam_unix(sshd:session): session closed for user root worker2 # [ 815.136920] systemd[1]: sshd-vsock@89-90-6:22-2:89.service: Deactivated successfully. worker2 # [ 815.140756] systemd[1]: session-97.scope: Deactivated successfully. worker2 # [ 815.144539] systemd-logind[555]: Session 97 logged out. Waiting for processes to exit. worker2 # [ 815.148539] systemd-logind[555]: Removed session 97. worker1 # [ 815.709437] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 815.718886] systemd[1]: Started SSH per-connection Daemon (vsock:2:103). worker1 # [ 815.786860] sshd-session[2790]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 815.791657] sshd-session[2790]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 815.796407] sshd-session[2790]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 815.802837] systemd-logind[608]: New session '112' of user 'root' with class 'user' and type 'tty'. worker1 # [ 815.805354] systemd[1]: Started Session 112 of User root. worker1 # [ 815.826529] sshd-session[2796]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 815.828227] sshd-session[2796]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 815.829496] sshd-session[2790]: pam_unix(sshd:session): session closed for user root worker1 # [ 815.833068] systemd[1]: sshd-vsock@103-104-5:22-2:103.service: Deactivated successfully. worker1 # [ 815.835868] systemd[1]: session-112.scope: Deactivated successfully. worker1 # [ 815.838529] systemd-logind[608]: Session 112 logged out. Waiting for processes to exit. worker1 # [ 815.840590] systemd-logind[608]: Removed session 112. worker2 # [ 815.906685] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 815.916204] systemd[1]: Started SSH per-connection Daemon (vsock:2:90). worker2 # [ 815.955765] nix-grpc-daemon[1617]: time=2026-11-07T15:21:11.166Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=775d7051c5248098b1aa4be1620321565cd43db2c6b7ec95d426660d0ca253d7\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 815.981356] nix-daemon[986]: reaped child process 2591, status = succeeded client # [ 815.971830] nix[3598]: lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152103Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=775d7051c5248098b1aa4be1620321565cd43db2c6b7ec95d426660d0ca253d7": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker2 # [ 816.007658] sshd-session[2697]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 816.012698] sshd-session[2697]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 816.017956] sshd-session[2697]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 816.024758] systemd-logind[555]: New session '98' of user 'root' with class 'user' and type 'tty'. worker2 # [ 816.027666] systemd[1]: Started Session 98 of User root. worker2 # [ 816.049281] sshd-session[2703]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 816.050787] sshd-session[2703]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 816.052468] sshd-session[2697]: pam_unix(sshd:session): session closed for user root worker2 # [ 816.055533] systemd[1]: sshd-vsock@90-91-6:22-2:90.service: Deactivated successfully. worker2 # [ 816.059413] systemd[1]: session-98.scope: Deactivated successfully. worker2 # [ 816.062595] systemd-logind[555]: Session 98 logged out. Waiting for processes to exit. worker2 # [ 816.064311] systemd-logind[555]: Removed session 98. worker1 # [ 816.613875] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 816.622342] systemd[1]: Started SSH per-connection Daemon (vsock:2:104). worker1 # [ 816.695835] sshd-session[2801]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 816.700669] sshd-session[2801]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 816.705543] sshd-session[2801]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 816.710786] systemd-logind[608]: New session '113' of user 'root' with class 'user' and type 'tty'. worker1 # [ 816.715397] systemd[1]: Started Session 113 of User root. worker1 # [ 816.736288] sshd-session[2807]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 816.738082] sshd-session[2807]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 816.739393] sshd-session[2801]: pam_unix(sshd:session): session closed for user root worker1 # [ 816.742497] systemd[1]: sshd-vsock@104-105-5:22-2:104.service: Deactivated successfully. worker1 # [ 816.745753] systemd[1]: session-113.scope: Deactivated successfully. worker1 # [ 816.748932] systemd-logind[608]: Session 113 logged out. Waiting for processes to exit. worker1 # [ 816.750405] systemd-logind[608]: Removed session 113. worker2 # [ 816.809893] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 816.819539] systemd[1]: Started SSH per-connection Daemon (vsock:2:91). worker2 # [ 816.886776] sshd-session[2708]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 816.891836] sshd-session[2708]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 816.897232] sshd-session[2708]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 816.903246] systemd-logind[555]: New session '99' of user 'root' with class 'user' and type 'tty'. worker2 # [ 816.907427] systemd[1]: Started Session 99 of User root. worker2 # [ 816.930102] sshd-session[2714]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 816.931459] sshd-session[2714]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 816.932715] sshd-session[2708]: pam_unix(sshd:session): session closed for user root worker2 # [ 816.935660] systemd[1]: sshd-vsock@91-92-6:22-2:91.service: Deactivated successfully. worker2 # [ 816.939480] systemd[1]: session-99.scope: Deactivated successfully. worker2 # [ 816.942704] systemd-logind[555]: Session 99 logged out. Waiting for processes to exit. worker2 # [ 816.944572] systemd-logind[555]: Removed session 99. worker1 # [ 817.512443] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 817.522165] systemd[1]: Started SSH per-connection Daemon (vsock:2:105). worker1 # [ 817.589752] sshd-session[2812]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 817.594127] sshd-session[2812]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 817.599440] sshd-session[2812]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 817.605947] systemd-logind[608]: New session '114' of user 'root' with class 'user' and type 'tty'. worker1 # [ 817.608362] systemd[1]: Started Session 114 of User root. worker1 # [ 817.629329] sshd-session[2818]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 817.630970] sshd-session[2818]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 817.632363] sshd-session[2812]: pam_unix(sshd:session): session closed for user root worker1 # [ 817.635197] systemd[1]: sshd-vsock@105-106-5:22-2:105.service: Deactivated successfully. worker1 # [ 817.638594] systemd[1]: session-114.scope: Deactivated successfully. worker1 # [ 817.641940] systemd-logind[608]: Session 114 logged out. Waiting for processes to exit. worker1 # [ 817.643442] systemd-logind[608]: Removed session 114. worker2 # [ 817.713545] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 817.721257] systemd[1]: Started SSH per-connection Daemon (vsock:2:92). worker2 # [ 817.793403] sshd-session[2719]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 817.798141] sshd-session[2719]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 817.805118] sshd-session[2719]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 817.810543] systemd-logind[555]: New session '100' of user 'root' with class 'user' and type 'tty'. worker2 # [ 817.814561] systemd[1]: Started Session 100 of User root. worker2 # [ 817.837295] sshd-session[2725]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 817.838700] sshd-session[2725]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 817.840278] sshd-session[2719]: pam_unix(sshd:session): session closed for user root worker2 # [ 817.843492] systemd[1]: sshd-vsock@92-93-6:22-2:92.service: Deactivated successfully. worker2 # [ 817.847375] systemd[1]: session-100.scope: Deactivated successfully. worker2 # [ 817.850588] systemd-logind[555]: Session 100 logged out. Waiting for processes to exit. worker2 # [ 817.852234] systemd-logind[555]: Removed session 100. worker1 # [ 818.417308] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 818.425318] systemd[1]: Started SSH per-connection Daemon (vsock:2:106). worker1 # [ 818.489338] sshd-session[2823]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 818.494082] sshd-session[2823]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 818.499094] sshd-session[2823]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 818.503950] systemd-logind[608]: New session '115' of user 'root' with class 'user' and type 'tty'. worker1 # [ 818.507327] systemd[1]: Started Session 115 of User root. worker1 # [ 818.528474] sshd-session[2829]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 818.529934] sshd-session[2829]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 818.531559] sshd-session[2823]: pam_unix(sshd:session): session closed for user root worker1 # [ 818.534475] systemd[1]: sshd-vsock@106-107-5:22-2:106.service: Deactivated successfully. worker1 # [ 818.538083] systemd[1]: session-115.scope: Deactivated successfully. worker1 # [ 818.541126] systemd-logind[608]: Session 115 logged out. Waiting for processes to exit. worker1 # [ 818.542904] systemd-logind[608]: Removed session 115. worker2 # [ 818.614287] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 818.623875] systemd[1]: Started SSH per-connection Daemon (vsock:2:93). worker2 # [ 818.692547] sshd-session[2730]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 818.697144] sshd-session[2730]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 818.703221] sshd-session[2730]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 818.708792] systemd-logind[555]: New session '101' of user 'root' with class 'user' and type 'tty'. worker2 # [ 818.713371] systemd[1]: Started Session 101 of User root. worker2 # [ 818.736218] sshd-session[2736]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 818.737896] sshd-session[2736]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 818.739306] sshd-session[2730]: pam_unix(sshd:session): session closed for user root worker2 # [ 818.742272] systemd[1]: sshd-vsock@93-94-6:22-2:93.service: Deactivated successfully. worker2 # [ 818.745809] systemd[1]: session-101.scope: Deactivated successfully. worker2 # [ 818.749165] systemd-logind[555]: Session 101 logged out. Waiting for processes to exit. worker2 # [ 818.750904] systemd-logind[555]: Removed session 101. worker1 # [ 819.316977] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 819.328085] systemd[1]: Started SSH per-connection Daemon (vsock:2:107). worker1 # [ 819.393849] sshd-session[2834]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 819.398115] sshd-session[2834]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 819.403620] sshd-session[2834]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 819.408892] systemd-logind[608]: New session '116' of user 'root' with class 'user' and type 'tty'. worker1 # [ 819.413513] systemd[1]: Started Session 116 of User root. worker1 # [ 819.434945] sshd-session[2840]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 819.436180] sshd-session[2840]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 819.437430] sshd-session[2834]: pam_unix(sshd:session): session closed for user root worker1 # [ 819.441120] systemd[1]: sshd-vsock@107-108-5:22-2:107.service: Deactivated successfully. worker1 # [ 819.443849] systemd[1]: session-116.scope: Deactivated successfully. worker1 # [ 819.446397] systemd-logind[608]: Session 116 logged out. Waiting for processes to exit. worker1 # [ 819.449161] systemd-logind[608]: Removed session 116. worker2 # [ 819.518208] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 819.526775] systemd[1]: Started SSH per-connection Daemon (vsock:2:94). worker2 # [ 819.596779] sshd-session[2741]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 819.602083] sshd-session[2741]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 819.607512] sshd-session[2741]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 819.614180] systemd-logind[555]: New session '102' of user 'root' with class 'user' and type 'tty'. worker2 # [ 819.617364] systemd[1]: Started Session 102 of User root. worker2 # [ 819.639918] sshd-session[2747]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 819.641631] sshd-session[2747]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 819.642976] sshd-session[2741]: pam_unix(sshd:session): session closed for user root worker2 # [ 819.645898] systemd[1]: sshd-vsock@94-95-6:22-2:94.service: Deactivated successfully. worker2 # [ 819.649597] systemd[1]: session-102.scope: Deactivated successfully. worker2 # [ 819.652897] systemd-logind[555]: Session 102 logged out. Waiting for processes to exit. worker2 # [ 819.654542] systemd-logind[555]: Removed session 102. worker2 # [ 819.977789] nix-grpc-daemon[1514]: ts=2026-11-07T15:21:15Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 819.990265] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 820.099518] nix-daemon[986]: accepted connection from pid 2754, user nix-grpc-daemon (trusted) worker2 # [ 820.113515] nix-daemon[986]: reaped child process 2757, status = succeeded lb # [ 820.122055] niks3-server[1503]: 2026/11/07 15:21:15 INFO Received push request method=POST path=/api/pushes worker2 # [ 820.127899] nix-grpc-daemon[1617]: time=2026-11-07T15:21:15.340Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 820.129639] nix-grpc-daemon[1617]: time=2026-11-07T15:21:15.342Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" worker2 # [ 820.133857] nix-grpc-daemon[1617]: time=2026-11-07T15:21:15.346Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5616d9face490ea1ef23a6b0b45b0fca3a57574c79335530e8bfb70db814d1dc\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5616d9face490ea1ef23a6b0b45b0fca3a57574c79335530e8bfb70db814d1dc" worker2 # [ 820.142287] nix-grpc-daemon[1617]: time=2026-11-07T15:21:15.346Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a8e1894771255ba7dc0751004eade8a3b5702b9909a4258651e31e07bff3b447\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a8e1894771255ba7dc0751004eade8a3b5702b9909a4258651e31e07bff3b447" worker1 # [ 820.222467] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 820.229918] systemd[1]: Started SSH per-connection Daemon (vsock:2:108). worker2 # [ 820.238571] nix-grpc-daemon[1617]: time=2026-11-07T15:21:15.450Z level=WARN msg="Request failed, retrying" attempt=2 backoff=214.763783ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a8e1894771255ba7dc0751004eade8a3b5702b9909a4258651e31e07bff3b447\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a8e1894771255ba7dc0751004eade8a3b5702b9909a4258651e31e07bff3b447" worker2 # [ 820.262092] nix-grpc-daemon[1617]: time=2026-11-07T15:21:15.451Z level=WARN msg="Request failed, retrying" attempt=2 backoff=213.532964ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5616d9face490ea1ef23a6b0b45b0fca3a57574c79335530e8bfb70db814d1dc\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5616d9face490ea1ef23a6b0b45b0fca3a57574c79335530e8bfb70db814d1dc" worker1 # [ 820.302660] sshd-session[2845]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 820.307387] sshd-session[2845]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 820.312200] sshd-session[2845]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 820.318751] systemd-logind[608]: New session '117' of user 'root' with class 'user' and type 'tty'. worker1 # [ 820.321479] systemd[1]: Started Session 117 of User root. worker1 # [ 820.343374] sshd-session[2851]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 820.344803] sshd-session[2851]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 820.346422] sshd-session[2845]: pam_unix(sshd:session): session closed for user root worker1 # [ 820.349470] systemd[1]: sshd-vsock@108-109-5:22-2:108.service: Deactivated successfully. worker1 # [ 820.353160] systemd[1]: session-117.scope: Deactivated successfully. worker1 # [ 820.356093] systemd-logind[608]: Session 117 logged out. Waiting for processes to exit. worker1 # [ 820.358209] systemd-logind[608]: Removed session 117. worker2 # [ 820.419399] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 820.428676] systemd[1]: Started SSH per-connection Daemon (vsock:2:95). worker2 # [ 820.458470] nix-grpc-daemon[1617]: time=2026-11-07T15:21:15.670Z level=WARN msg="Request failed, retrying" attempt=3 backoff=406.824068ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5616d9face490ea1ef23a6b0b45b0fca3a57574c79335530e8bfb70db814d1dc\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5616d9face490ea1ef23a6b0b45b0fca3a57574c79335530e8bfb70db814d1dc" worker2 # [ 820.513371] sshd-session[2759]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 820.518111] sshd-session[2759]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 820.524228] sshd-session[2759]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 820.529841] systemd-logind[555]: New session '103' of user 'root' with class 'user' and type 'tty'. worker2 # [ 820.534522] systemd[1]: Started Session 103 of User root. worker2 # [ 820.557685] sshd-session[2765]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 820.559413] sshd-session[2765]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 820.560807] sshd-session[2759]: pam_unix(sshd:session): session closed for user root worker2 # [ 820.563885] systemd[1]: sshd-vsock@95-96-6:22-2:95.service: Deactivated successfully. worker2 # [ 820.567524] systemd[1]: session-103.scope: Deactivated successfully. worker2 # [ 820.570832] systemd-logind[555]: Session 103 logged out. Waiting for processes to exit. worker2 # [ 820.572543] systemd-logind[555]: Removed session 103. thread 'farm::serial::clean_scheduler_restart_peers_are_told_and_running_builds_survive' (1743) panicked at harness.rs:404:9: not true after 60s: a slow build is running FAILED test farm::serial::dag_build_is_scheduled_across_workers_and_lands_in_the_cache ... worker1 # [ 820.622184] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 820.630577] systemd[1]: Started SSH per-connection Daemon (vsock:2:109). worker1 # [ 820.703500] sshd-session[2856]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 820.708280] sshd-session[2856]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 820.713120] sshd-session[2856]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 820.719234] systemd-logind[608]: New session '118' of user 'root' with class 'user' and type 'tty'. worker1 # [ 820.722369] systemd[1]: Started Session 118 of User root. worker1 # [ 820.742921] sshd-session[2862]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 820.744647] sshd-session[2862]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 820.745959] sshd-session[2856]: pam_unix(sshd:session): session closed for user root worker1 # [ 820.748749] systemd[1]: sshd-vsock@109-110-5:22-2:109.service: Deactivated successfully. worker1 # [ 820.752782] systemd[1]: session-118.scope: Deactivated successfully. worker1 # [ 820.755686] systemd-logind[608]: Session 118 logged out. Waiting for processes to exit. worker1 # [ 820.757319] systemd-logind[608]: Removed session 118. worker2 # [ 820.820165] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 820.830321] systemd[1]: Started SSH per-connection Daemon (vsock:2:96). worker2 # [ 820.869959] nix-grpc-daemon[1617]: time=2026-11-07T15:21:16.082Z level=WARN msg="Request failed, retrying" attempt=4 backoff=772.301431ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5616d9face490ea1ef23a6b0b45b0fca3a57574c79335530e8bfb70db814d1dc\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5616d9face490ea1ef23a6b0b45b0fca3a57574c79335530e8bfb70db814d1dc" worker2 # [ 820.913815] sshd-session[2770]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 820.919073] sshd-session[2770]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 820.924581] sshd-session[2770]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 820.931080] systemd-logind[555]: New session '104' of user 'root' with class 'user' and type 'tty'. worker2 # [ 820.934376] systemd[1]: Started Session 104 of User root. worker2 # [ 820.957660] sshd-session[2776]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 820.959334] sshd-session[2776]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 820.960564] sshd-session[2770]: pam_unix(sshd:session): session closed for user root worker2 # [ 820.963640] systemd[1]: sshd-vsock@96-97-6:22-2:96.service: Deactivated successfully. worker2 # [ 820.967456] systemd[1]: session-104.scope: Deactivated successfully. worker2 # [ 820.970109] systemd-logind[555]: Session 104 logged out. Waiting for processes to exit. worker2 # [ 820.972263] systemd-logind[555]: Removed session 104. lb # [ 821.021465] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. lb # [ 821.027162] systemd[1]: Started SSH per-connection Daemon (vsock:2:34). lb # [ 821.084505] sshd-session[1732]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it lb # [ 821.090167] sshd-session[1732]: Accepted none for root from UNKNOWN port 65535 ssh2 lb # [ 821.096119] sshd-session[1732]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) lb # [ 821.110239] systemd-logind[553]: New session '43' of user 'root' with class 'user' and type 'tty'. lb # [ 821.115451] systemd[1]: Starting User Runtime Directory /run/user/0... lb # [ 821.140339] systemd[1]: Finished User Runtime Directory /run/user/0. lb # [ 821.144353] systemd[1]: Starting User Manager for UID 0... lb # [ 821.160666] (systemd)[1741]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) lb # [ 821.165306] systemd-logind[553]: New session '44' of user 'root' with class 'manager-early' and type 'unspecified'. lb # [ 821.242105] systemd[1741]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 821.314526] systemd[1741]: Queued start job for default target Main User Target. lb # [ 821.316699] systemd[1741]: Failed to adjust io pressure threshold, ignoring: Device or resource busy lb # [ 821.319059] systemd[1741]: Created slice User Application Slice. lb # [ 821.320083] systemd[1741]: Started Daily Cleanup of User's Temporary Directories. lb # [ 821.321183] systemd[1741]: Reached target Paths. lb # [ 821.322207] systemd[1741]: Reached target Timers. lb # [ 821.324885] systemd[1741]: Starting D-Bus User Message Bus Socket... lb # [ 821.326759] systemd[1741]: Starting Create User Files and Directories... lb # [ 821.352290] systemd[1741]: Finished Create User Files and Directories. lb # [ 821.356957] systemd[1741]: Listening on D-Bus User Message Bus Socket. lb # [ 821.357941] systemd[1741]: Reached target Sockets. lb # [ 821.359058] systemd[1741]: Reached target Basic System. lb # [ 821.359841] systemd[1741]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system lb # [ 821.362975] systemd[1741]: Reached target Main User Target. lb # [ 821.363818] systemd[1741]: Startup finished in 180ms. lb # [ 821.364598] systemd[1]: Started User Manager for UID 0. lb # [ 821.365547] systemd[1]: Started Session 43 of User root. lb # [ 821.392577] sshd-session[1754]: Received disconnect from UNKNOWN port 65535:11: disconnected by user lb # [ 821.393886] sshd-session[1754]: Disconnected from user root UNKNOWN port 65535 lb # [ 821.395221] sshd-session[1732]: pam_unix(sshd:session): session closed for user root lb # [ 821.398727] systemd[1]: sshd-vsock@34-35-4:22-2:34.service: Deactivated successfully. lb # [ 821.402733] systemd[1]: session-43.scope: Deactivated successfully. lb # [ 821.404255] systemd[1]: session-43.scope: Consumed 16ms CPU time over 38ms wall clock time, 3.1M memory peak, 4.7K incoming IP traffic, 486B outgoing IP traffic. lb # [ 821.408812] systemd-logind[553]: Session 43 logged out. Waiting for processes to exit. lb # [ 821.410403] systemd-logind[553]: Removed session 43. worker1 # [ 821.424966] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 821.435416] systemd[1]: Started SSH per-connection Daemon (vsock:2:110). worker1 # [ 821.501870] sshd-session[2868]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 821.506714] sshd-session[2868]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 821.511818] sshd-session[2868]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 821.518623] systemd-logind[608]: New session '119' of user 'root' with class 'user' and type 'tty'. worker1 # [ 821.521420] systemd[1]: Started Session 119 of User root. worker1 # [ 821.544375] sshd-session[2874]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 821.546110] sshd-session[2874]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 821.547371] sshd-session[2868]: pam_unix(sshd:session): session closed for user root worker1 # [ 821.550281] systemd[1]: sshd-vsock@110-111-5:22-2:110.service: Deactivated successfully. worker1 # [ 821.553711] systemd[1]: session-119.scope: Deactivated successfully. worker1 # [ 821.555282] systemd[1]: session-119.scope: Consumed 15ms CPU time over 33ms wall clock time, 3.1M memory peak, 17.8K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 821.558280] systemd-logind[608]: Session 119 logged out. Waiting for processes to exit. worker1 # [ 821.560342] systemd-logind[608]: Removed session 119. worker1 # [ 821.623521] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 821.627434] systemd[1]: Started SSH per-connection Daemon (vsock:2:111). worker1 # [ 821.672948] sshd-session[2879]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 821.678143] sshd-session[2879]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 821.683145] sshd-session[2879]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 821.689730] systemd-logind[608]: New session '120' of user 'root' with class 'user' and type 'tty'. worker1 # [ 821.692321] systemd[1]: Started Session 120 of User root. worker1 # [ 821.715227] sshd-session[2885]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 821.716532] sshd-session[2885]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 821.717780] sshd-session[2879]: pam_unix(sshd:session): session closed for user root worker1 # [ 821.720727] systemd[1]: sshd-vsock@111-112-5:22-2:111.service: Deactivated successfully. worker1 # [ 821.724410] systemd[1]: session-120.scope: Deactivated successfully. worker1 # [ 821.725824] systemd[1]: session-120.scope: Consumed 15ms CPU time over 33ms wall clock time, 3.1M memory peak, 17.8K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 821.729768] systemd-logind[608]: Session 120 logged out. Waiting for processes to exit. worker1 # [ 821.731839] systemd-logind[608]: Removed session 120. worker1 # [ 821.823258] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 821.826934] systemd[1]: Started SSH per-connection Daemon (vsock:2:112). worker1 # [ 821.873646] sshd-session[2890]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 821.878127] sshd-session[2890]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 821.883491] sshd-session[2890]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 821.889067] systemd-logind[608]: New session '121' of user 'root' with class 'user' and type 'tty'. worker1 # [ 821.893399] systemd[1]: Started Session 121 of User root. worker1 # [ 821.916602] sshd-session[2896]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 821.917911] sshd-session[2896]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 821.919339] sshd-session[2890]: pam_unix(sshd:session): session closed for user root worker1 # [ 821.922405] systemd[1]: sshd-vsock@112-113-5:22-2:112.service: Deactivated successfully. worker1 # [ 821.926290] systemd[1]: session-121.scope: Deactivated successfully. worker1 # [ 821.928393] systemd[1]: session-121.scope: Consumed 15ms CPU time over 34ms wall clock time, 3.1M memory peak, 17.8K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 821.932254] systemd-logind[608]: Session 121 logged out. Waiting for processes to exit. worker1 # [ 821.933587] systemd-logind[608]: Removed session 121. worker1 # [ 822.026100] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 822.033454] systemd[1]: Started SSH per-connection Daemon (vsock:2:113). worker1 # [ 822.092327] sshd-session[2901]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 822.097116] sshd-session[2901]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 822.103369] sshd-session[2901]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 822.108539] systemd-logind[608]: New session '122' of user 'root' with class 'user' and type 'tty'. worker1 # [ 822.113405] systemd[1]: Started Session 122 of User root. worker1 # [ 822.138543] sshd-session[2907]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 822.139800] sshd-session[2907]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 822.141132] sshd-session[2901]: pam_unix(sshd:session): session closed for user root worker1 # [ 822.145136] systemd[1]: sshd-vsock@113-114-5:22-2:113.service: Deactivated successfully. worker1 # [ 822.147655] systemd[1]: session-122.scope: Deactivated successfully. worker1 # [ 822.149220] systemd[1]: session-122.scope: Consumed 15ms CPU time over 35ms wall clock time, 3.1M memory peak, 17.8K incoming IP traffic, 457B outgoing IP traffic. worker1 # [ 822.152429] systemd-logind[608]: Session 122 logged out. Waiting for processes to exit. worker1 # [ 822.155175] systemd-logind[608]: Removed session 122. worker2 # [ 822.225967] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 822.235095] systemd[1]: Started SSH per-connection Daemon (vsock:2:97). worker2 # [ 822.304608] sshd-session[2782]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 822.309805] sshd-session[2782]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 822.315280] sshd-session[2782]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 822.322243] systemd-logind[555]: New session '105' of user 'root' with class 'user' and type 'tty'. worker2 # [ 822.325430] systemd[1]: Started Session 105 of User root. worker2 # [ 822.350695] sshd-session[2788]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 822.352139] sshd-session[2788]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 822.353295] sshd-session[2782]: pam_unix(sshd:session): session closed for user root worker2 # [ 822.357254] systemd[1]: sshd-vsock@97-98-6:22-2:97.service: Deactivated successfully. worker2 # [ 822.360274] systemd[1]: session-105.scope: Deactivated successfully. worker2 # [ 822.361709] systemd[1]: session-105.scope: Consumed 15ms CPU time over 35ms wall clock time, 3.1M memory peak, 7.7K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 822.365260] systemd-logind[555]: Session 105 logged out. Waiting for processes to exit. worker2 # [ 822.367163] systemd-logind[555]: Removed session 105. worker2 # [ 822.422774] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 822.426586] systemd[1]: Started SSH per-connection Daemon (vsock:2:98). worker2 # [ 822.473810] sshd-session[2793]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 822.478953] sshd-session[2793]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 822.484497] sshd-session[2793]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 822.491251] systemd-logind[555]: New session '106' of user 'root' with class 'user' and type 'tty'. worker2 # [ 822.494407] systemd[1]: Started Session 106 of User root. worker2 # [ 822.502383] nix-grpc-daemon[1617]: time=2026-11-07T15:21:17.714Z level=WARN msg="Request failed, retrying" attempt=3 backoff=414.337886ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a8e1894771255ba7dc0751004eade8a3b5702b9909a4258651e31e07bff3b447\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a8e1894771255ba7dc0751004eade8a3b5702b9909a4258651e31e07bff3b447" worker2 # [ 822.528899] sshd-session[2799]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 822.530581] sshd-session[2799]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 822.531874] sshd-session[2793]: pam_unix(sshd:session): session closed for user root worker2 # [ 822.534943] systemd[1]: sshd-vsock@98-99-6:22-2:98.service: Deactivated successfully. worker2 # [ 822.538640] systemd[1]: session-106.scope: Deactivated successfully. worker2 # [ 822.540308] systemd[1]: session-106.scope: Consumed 16ms CPU time over 45ms wall clock time, 3.1M memory peak, 7.7K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 822.544090] systemd-logind[555]: Session 106 logged out. Waiting for processes to exit. worker2 # [ 822.545630] systemd-logind[555]: Removed session 106. worker2 # [ 822.624538] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 822.630413] systemd[1]: Started SSH per-connection Daemon (vsock:2:99). worker2 # [ 822.687242] sshd-session[2804]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 822.692250] sshd-session[2804]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 822.697895] sshd-session[2804]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 822.704293] systemd-logind[555]: New session '107' of user 'root' with class 'user' and type 'tty'. worker2 # [ 822.707404] systemd[1]: Started Session 107 of User root. worker2 # [ 822.732749] sshd-session[2810]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 822.734180] sshd-session[2810]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 822.735470] sshd-session[2804]: pam_unix(sshd:session): session closed for user root worker2 # [ 822.738468] systemd[1]: sshd-vsock@99-100-6:22-2:99.service: Deactivated successfully. worker2 # [ 822.742460] systemd[1]: session-107.scope: Deactivated successfully. worker2 # [ 822.744294] systemd[1]: session-107.scope: Consumed 15ms CPU time over 36ms wall clock time, 3.1M memory peak, 7.7K incoming IP traffic, 457B outgoing IP traffic. worker2 # [ 822.747825] systemd-logind[555]: Session 107 logged out. Waiting for processes to exit. worker2 # [ 822.749487] systemd-logind[555]: Removed session 107. client # [ 822.828614] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. client # [ 822.837612] systemd[1]: Started SSH per-connection Daemon (vsock:2:214). client # [ 822.902835] sshd-session[3614]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it client # [ 822.907903] sshd-session[3614]: Accepted none for root from UNKNOWN port 65535 ssh2 client # [ 822.913513] sshd-session[3614]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) client # [ 822.929263] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 822.920351] nix-grpc-daemon[1617]: time=2026-11-07T15:21:18.132Z level=WARN msg="Request failed, retrying" attempt=4 backoff=776.722864ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a8e1894771255ba7dc0751004eade8a3b5702b9909a4258651e31e07bff3b447\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a8e1894771255ba7dc0751004eade8a3b5702b9909a4258651e31e07bff3b447" client # [ 822.941970] systemd-logind[465]: New session '216' of user 'root' with class 'user' and type 'tty'. client # [ 822.955723] systemd[1]: Finished User Runtime Directory /run/user/0. client # [ 822.959873] systemd[1]: Starting User Manager for UID 0... client # [ 822.975464] (systemd)[3623]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) client # [ 822.979431] systemd-logind[465]: New session '217' of user 'root' with class 'manager-early' and type 'unspecified'. client # [ 823.055196] systemd[3623]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 823.123738] systemd[3623]: Queued start job for default target Main User Target. client # [ 823.126597] systemd[3623]: Failed to adjust io pressure threshold, ignoring: Device or resource busy client # [ 823.129711] systemd[3623]: Created slice User Application Slice. client # [ 823.130676] systemd[3623]: Started Daily Cleanup of User's Temporary Directories. client # [ 823.131700] systemd[3623]: Reached target Paths. client # [ 823.132451] systemd[3623]: Reached target Timers. client # [ 823.134064] systemd[3623]: Starting D-Bus User Message Bus Socket... client # [ 823.135810] systemd[3623]: Starting Create User Files and Directories... client # [ 823.161160] systemd[3623]: Finished Create User Files and Directories. client # [ 823.164533] systemd[3623]: Listening on D-Bus User Message Bus Socket. client # [ 823.165488] systemd[3623]: Reached target Sockets. client # [ 823.166132] systemd[3623]: Reached target Basic System. client # [ 823.166847] systemd[3623]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system client # [ 823.168110] systemd[3623]: Reached target Main User Target. client # [ 823.168889] systemd[3623]: Startup finished in 174ms. client # [ 823.170476] systemd[1]: Started User Manager for UID 0. client # [ 823.173340] systemd[1]: Started Session 216 of User root. worker1 # [ 823.297201] nix-grpc-daemon[529]: ts=2026-11-07T15:21:18Z level=debug event=rpc_start method=QueryMissing cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 823.304630] nix-grpc-daemon[529]: ts=2026-11-07T15:21:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 823.313608] garage[913]: 2026-11-07T15:21:18.580139Z INFO garage_api_common::generic_server: 127.0.0.1:58738 (key GK0123456789abcdef01234567) HEAD /farm/5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo lb # [ 823.317381] garage[913]: 2026-11-07T15:21:18.585257Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 823.320116] garage[913]: 2026-11-07T15:21:18.588138Z INFO garage_api_common::generic_server: 127.0.0.1:58738 (key GK0123456789abcdef01234567) HEAD /farm/qm96yd1cmricgf2hr21k88syh75l317v.narinfo lb # [ 823.322875] garage[913]: 2026-11-07T15:21:18.588397Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 823.326686] garage[913]: 2026-11-07T15:21:18.594456Z INFO garage_api_common::generic_server: 127.0.0.1:58738 (key GK0123456789abcdef01234567) HEAD /farm/jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo lb # [ 823.330260] garage[913]: 2026-11-07T15:21:18.598120Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 823.338658] nix-grpc-daemon[529]: ts=2026-11-07T15:21:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 823.343128] garage[913]: 2026-11-07T15:21:18.611063Z INFO garage_api_common::generic_server: 127.0.0.1:58738 (key GK0123456789abcdef01234567) HEAD /farm/5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo lb # [ 823.346023] garage[913]: 2026-11-07T15:21:18.611481Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 823.351077] garage[913]: 2026-11-07T15:21:18.618983Z INFO garage_api_common::generic_server: 127.0.0.1:58738 (key GK0123456789abcdef01234567) HEAD /farm/5qgbfb7awggfq3smlyfxgz8zixnqxk2n.narinfo lb # [ 823.354055] garage[913]: 2026-11-07T15:21:18.619256Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 823.357791] nix-grpc-daemon[1514]: ts=2026-11-07T15:21:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44924 lb # [ 823.363246] garage[913]: 2026-11-07T15:21:18.631225Z INFO garage_api_common::generic_server: 127.0.0.1:58738 (key GK0123456789abcdef01234567) HEAD /farm/jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo lb # [ 823.365678] garage[913]: 2026-11-07T15:21:18.631467Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 823.367951] garage[913]: 2026-11-07T15:21:18.636263Z INFO garage_api_common::generic_server: 127.0.0.1:58738 (key GK0123456789abcdef01234567) HEAD /farm/jicn175r0p4806ghnhxdvn7fsa1akkr0.narinfo lb # [ 823.370439] garage[913]: 2026-11-07T15:21:18.636646Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 823.377367] nix-grpc-daemon[529]: ts=2026-11-07T15:21:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:60242 lb # [ 823.381862] garage[913]: 2026-11-07T15:21:18.649848Z INFO garage_api_common::generic_server: 127.0.0.1:58738 (key GK0123456789abcdef01234567) HEAD /farm/qm96yd1cmricgf2hr21k88syh75l317v.narinfo lb # [ 823.384198] garage[913]: 2026-11-07T15:21:18.650118Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 823.386746] garage[913]: 2026-11-07T15:21:18.654814Z INFO garage_api_common::generic_server: 127.0.0.1:58738 (key GK0123456789abcdef01234567) HEAD /farm/qm96yd1cmricgf2hr21k88syh75l317v.narinfo lb # [ 823.389054] garage[913]: 2026-11-07T15:21:18.655005Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker2 # [ 823.392644] nix-grpc-daemon[1514]: ts=2026-11-07T15:21:18Z level=debug event=rpc_start method=QueryValidPaths cn=ci-1 peer=ipv4:192.168.1.2:44924 lb # [ 823.398071] garage[913]: 2026-11-07T15:21:18.666232Z INFO garage_api_common::generic_server: 127.0.0.1:58738 (key GK0123456789abcdef01234567) HEAD /farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.narinfo lb # [ 823.400541] garage[913]: 2026-11-07T15:21:18.666484Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 823.404232] garage[913]: 2026-11-07T15:21:18.672174Z INFO garage_api_common::generic_server: 127.0.0.1:58746 (key GK0123456789abcdef01234567) HEAD /farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.narinfo lb # [ 823.406517] garage[913]: 2026-11-07T15:21:18.672395Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found lb # [ 823.408234] garage[913]: 2026-11-07T15:21:18.672460Z INFO garage_api_common::generic_server: 127.0.0.1:58738 (key GK0123456789abcdef01234567) HEAD /farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.narinfo lb # [ 823.411096] garage[913]: 2026-11-07T15:21:18.679128Z INFO garage_api_common::generic_server: Response: error 404 Not Found, Key not found worker1 # [ 823.418095] nix-grpc-daemon[529]: ts=2026-11-07T15:21:18Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:60242 worker1 # [ 823.431617] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 823.452440] nix-daemon[1026]: accepted connection from pid 529, user nix-grpc-daemon (trusted) worker1 # [ 823.558602] nix-daemon[1026]: accepted connection from pid 2919, user nix-grpc-daemon (trusted) worker1 # [ 823.574187] nix-daemon[1026]: reaped child process 2922, status = succeeded lb # [ 823.583217] niks3-server[1503]: 2026/11/07 15:21:18 INFO Received push request method=POST path=/api/pushes worker1 # [ 823.593676] nix-grpc-daemon[1057]: time=2026-11-07T15:21:18.901Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker1 # [ 823.599335] nix-grpc-daemon[1057]: time=2026-11-07T15:21:18.901Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" worker1 # [ 823.602574] nix-grpc-daemon[1057]: time=2026-11-07T15:21:18.901Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" worker1 # [ 823.604129] nix-grpc-daemon[1057]: time=2026-11-07T15:21:18.901Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" worker1 # [ 823.605703] nix-grpc-daemon[1057]: time=2026-11-07T15:21:18.910Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a58197eef6f6c8fbfc9a362cf3289df0e07bbb86d934a011c19469775b2bda0f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a58197eef6f6c8fbfc9a362cf3289df0e07bbb86d934a011c19469775b2bda0f" worker1 # [ 823.613785] nix-grpc-daemon[1057]: time=2026-11-07T15:21:18.910Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ffd0588330eb0179a0e3c34b423f2f337f112b21dbe858a3909bc8a81939a00\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ffd0588330eb0179a0e3c34b423f2f337f112b21dbe858a3909bc8a81939a00" worker1 # [ 823.622618] nix-grpc-daemon[1057]: time=2026-11-07T15:21:18.910Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=edb7034586bf56c80bcce8b0c2e11d7cebda1c697e17216d00fb47a61aa71f86\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=edb7034586bf56c80bcce8b0c2e11d7cebda1c697e17216d00fb47a61aa71f86" worker1 # [ 823.631199] nix-grpc-daemon[1057]: time=2026-11-07T15:21:18.911Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=403a35a90da8ec274a42d1c891832fadeb9faab29084592766d49f742ae95878\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=403a35a90da8ec274a42d1c891832fadeb9faab29084592766d49f742ae95878" worker1 # [ 823.640033] nix-grpc-daemon[1057]: time=2026-11-07T15:21:18.911Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=82eb7a623378136216c9c0af19b50b420a8e4db6e5b96f5227a7997947b22a37\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=82eb7a623378136216c9c0af19b50b420a8e4db6e5b96f5227a7997947b22a37" worker1 # [ 823.647930] nix-grpc-daemon[1057]: time=2026-11-07T15:21:18.911Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c14c7d1b055e9809ab126557092c0fbd706e56ae8f84a282a0bb16196045b5e\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c14c7d1b055e9809ab126557092c0fbd706e56ae8f84a282a0bb16196045b5e" worker2 # [ 824.742524] nix-grpc-daemon[1617]: time=2026-11-07T15:21:19.954Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.597363755s error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a8e1894771255ba7dc0751004eade8a3b5702b9909a4258651e31e07bff3b447\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a8e1894771255ba7dc0751004eade8a3b5702b9909a4258651e31e07bff3b447" worker1 # [ 824.744731] nix-grpc-daemon[1057]: time=2026-11-07T15:21:20.052Z level=WARN msg="Request failed, retrying" attempt=2 backoff=191.161655ms error="Put \"http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=82eb7a623378136216c9c0af19b50b420a8e4db6e5b96f5227a7997947b22a37\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=82eb7a623378136216c9c0af19b50b420a8e4db6e5b96f5227a7997947b22a37" worker2 # [ 825.766887] nix-grpc-daemon[1617]: time=2026-11-07T15:21:20.978Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.4419869s error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5616d9face490ea1ef23a6b0b45b0fca3a57574c79335530e8bfb70db814d1dc\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5616d9face490ea1ef23a6b0b45b0fca3a57574c79335530e8bfb70db814d1dc" worker1 # [ 825.960178] nix-grpc-daemon[1057]: time=2026-11-07T15:21:21.267Z level=WARN msg="Request failed, retrying" attempt=3 backoff=419.017855ms error="Put \"http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=82eb7a623378136216c9c0af19b50b420a8e4db6e5b96f5227a7997947b22a37\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=82eb7a623378136216c9c0af19b50b420a8e4db6e5b96f5227a7997947b22a37" worker1 # [ 827.112397] nix-grpc-daemon[1057]: time=2026-11-07T15:21:22.420Z level=WARN msg="Request failed, retrying" attempt=2 backoff=185.446013ms error="Put \"http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=edb7034586bf56c80bcce8b0c2e11d7cebda1c697e17216d00fb47a61aa71f86\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=edb7034586bf56c80bcce8b0c2e11d7cebda1c697e17216d00fb47a61aa71f86" worker2 # [ 827.214266] nix-grpc-daemon[1617]: time=2026-11-07T15:21:22.424Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a8e1894771255ba7dc0751004eade8a3b5702b9909a4258651e31e07bff3b447\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 worker2 # [ 827.230753] nix-daemon[986]: reaped child process 2752, status = succeeded client # [ 827.214588] nix[3598]: lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152115Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a8e1894771255ba7dc0751004eade8a3b5702b9909a4258651e31e07bff3b447": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker1 # [ 828.136418] nix-grpc-daemon[1057]: time=2026-11-07T15:21:23.444Z level=WARN msg="Request failed, retrying" attempt=2 backoff=193.027994ms error="Put \"http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=403a35a90da8ec274a42d1c891832fadeb9faab29084592766d49f742ae95878\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=403a35a90da8ec274a42d1c891832fadeb9faab29084592766d49f742ae95878" worker1 # [ 829.160470] nix-grpc-daemon[1057]: time=2026-11-07T15:21:24.468Z level=WARN msg="Request failed, retrying" attempt=2 backoff=219.223476ms error="Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ffd0588330eb0179a0e3c34b423f2f337f112b21dbe858a3909bc8a81939a00\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ffd0588330eb0179a0e3c34b423f2f337f112b21dbe858a3909bc8a81939a00" worker1 # [ 830.376308] nix-grpc-daemon[1057]: time=2026-11-07T15:21:25.683Z level=WARN msg="Request failed, retrying" attempt=3 backoff=401.812746ms error="Put \"http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=edb7034586bf56c80bcce8b0c2e11d7cebda1c697e17216d00fb47a61aa71f86\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=edb7034586bf56c80bcce8b0c2e11d7cebda1c697e17216d00fb47a61aa71f86" worker1 # [ 830.782706] nix-grpc-daemon[1057]: time=2026-11-07T15:21:26.091Z level=WARN msg="Request failed, retrying" attempt=4 backoff=738.810524ms error="Put \"http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=edb7034586bf56c80bcce8b0c2e11d7cebda1c697e17216d00fb47a61aa71f86\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=edb7034586bf56c80bcce8b0c2e11d7cebda1c697e17216d00fb47a61aa71f86" worker2 # [ 831.220833] nix-grpc-daemon[1514]: ts=2026-11-07T15:21:26Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 831.233209] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 831.345124] nix-daemon[986]: accepted connection from pid 2822, user nix-grpc-daemon (trusted) worker2 # [ 831.360091] nix-daemon[986]: reaped child process 2825, status = succeeded lb # [ 831.369929] niks3-server[1503]: 2026/11/07 15:21:26 INFO Received push request method=POST path=/api/pushes worker2 # [ 831.377319] nix-grpc-daemon[1617]: time=2026-11-07T15:21:26.589Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 831.379338] nix-grpc-daemon[1617]: time=2026-11-07T15:21:26.589Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" worker2 # [ 831.382431] nix-grpc-daemon[1617]: time=2026-11-07T15:21:26.594Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0fbed86dbc276130a0f378a978edd5c779c0d993c1fd9394db8850736c4a54d4\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0fbed86dbc276130a0f378a978edd5c779c0d993c1fd9394db8850736c4a54d4" worker2 # [ 831.390768] nix-grpc-daemon[1617]: time=2026-11-07T15:21:26.595Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d50e330cdac83673a8a2b96d33e7d399fcc294b3d7cd8b5570db22959b53ed7c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d50e330cdac83673a8a2b96d33e7d399fcc294b3d7cd8b5570db22959b53ed7c" worker2 # [ 831.485691] nix-grpc-daemon[1617]: time=2026-11-07T15:21:26.698Z level=WARN msg="Request failed, retrying" attempt=2 backoff=201.898428ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0fbed86dbc276130a0f378a978edd5c779c0d993c1fd9394db8850736c4a54d4\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0fbed86dbc276130a0f378a978edd5c779c0d993c1fd9394db8850736c4a54d4" worker2 # [ 831.494532] nix-grpc-daemon[1617]: time=2026-11-07T15:21:26.698Z level=WARN msg="Request failed, retrying" attempt=2 backoff=185.476673ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d50e330cdac83673a8a2b96d33e7d399fcc294b3d7cd8b5570db22959b53ed7c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d50e330cdac83673a8a2b96d33e7d399fcc294b3d7cd8b5570db22959b53ed7c" lb # [ 831.584814] systemd[1]: Stopping User Manager for UID 0... lb # [ 831.594254] systemd[1741]: Activating special unit Exit the Session... lb # [ 831.596449] systemd[1741]: Stopped target Main User Target. lb # [ 831.600483] systemd[1741]: Stopped target Basic System. lb # [ 831.606212] systemd[1741]: Stopped target Paths. lb # [ 831.609197] systemd[1741]: Stopped target Sockets. lb # [ 831.613689] systemd[1741]: Stopped target Timers. lb # [ 831.616305] systemd[1741]: Stopped Daily Cleanup of User's Temporary Directories. lb # [ 831.619646] systemd[1741]: Closed D-Bus User Message Bus Socket. lb # [ 831.623340] systemd[1741]: Stopped Create User Files and Directories. lb # [ 831.626391] systemd[1741]: Removed slice User Application Slice. lb # [ 831.628701] systemd[1741]: Reached target Shutdown. lb # [ 831.630370] systemd[1741]: Finished Exit the Session. lb # [ 831.631897] systemd[1741]: Reached target Exit the Session. lb # [ 831.635428] systemd-logind[553]: Removed session 44. lb # [ 831.643278] systemd[1]: user@0.service: Deactivated successfully. lb # [ 831.645280] systemd[1]: Stopped User Manager for UID 0. lb # [ 831.666563] systemd[1]: Stopping User Runtime Directory /run/user/0... lb # [ 831.684546] systemd[1]: run-user-0.mount: Deactivated successfully. lb # [ 831.686947] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. lb # [ 831.688246] systemd[1]: Stopped User Runtime Directory /run/user/0. worker1 # [ 832.378892] systemd[1]: Stopping User Manager for UID 0... worker1 # [ 832.389373] systemd[2060]: Activating special unit Exit the Session... worker1 # [ 832.392712] systemd[2060]: Stopped target Main User Target. worker1 # [ 832.394663] systemd[2060]: Stopped target Basic System. worker1 # [ 832.398688] systemd[2060]: Stopped target Paths. worker1 # [ 832.400596] systemd[2060]: Stopped target Sockets. worker1 # [ 832.406166] systemd[2060]: Stopped target Timers. worker1 # [ 832.408842] systemd[2060]: Stopped Daily Cleanup of User's Temporary Directories. worker1 # [ 832.412716] systemd[2060]: Closed D-Bus User Message Bus Socket. worker1 # [ 832.416878] systemd[2060]: Stopped Create User Files and Directories. worker1 # [ 832.419989] systemd[2060]: Removed slice User Application Slice. worker1 # [ 832.423818] systemd[2060]: Reached target Shutdown. worker1 # [ 832.428970] nix-grpc-daemon[1057]: time=2026-11-07T15:21:27.732Z level=WARN msg="Request failed, retrying" attempt=3 backoff=438.113331ms error="Put \"http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=403a35a90da8ec274a42d1c891832fadeb9faab29084592766d49f742ae95878\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=403a35a90da8ec274a42d1c891832fadeb9faab29084592766d49f742ae95878" worker1 # [ 832.447945] systemd[2060]: Finished Exit the Session. worker1 # [ 832.450266] systemd[2060]: Reached target Exit the Session. worker1 # [ 832.452305] systemd-logind[608]: Removed session 47. worker1 # [ 832.453374] systemd[1]: user@0.service: Deactivated successfully. worker1 # [ 832.455096] systemd[1]: Stopped User Manager for UID 0. worker1 # [ 832.461982] systemd[1]: Stopping User Runtime Directory /run/user/0... worker1 # [ 832.480907] systemd[1]: run-user-0.mount: Deactivated successfully. worker1 # [ 832.482758] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker1 # [ 832.484377] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 832.679445] nix-grpc-daemon[1617]: time=2026-11-07T15:21:27.891Z level=WARN msg="Request failed, retrying" attempt=3 backoff=402.5261ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d50e330cdac83673a8a2b96d33e7d399fcc294b3d7cd8b5570db22959b53ed7c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d50e330cdac83673a8a2b96d33e7d399fcc294b3d7cd8b5570db22959b53ed7c" worker1 # [ 832.866514] nix-grpc-daemon[1057]: time=2026-11-07T15:21:28.174Z level=WARN msg="Request failed, retrying" attempt=4 backoff=791.858904ms error="Put \"http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=403a35a90da8ec274a42d1c891832fadeb9faab29084592766d49f742ae95878\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=403a35a90da8ec274a42d1c891832fadeb9faab29084592766d49f742ae95878" worker2 # [ 832.983467] systemd[1]: Stopping User Manager for UID 0... worker2 # [ 832.991550] systemd[1951]: Activating special unit Exit the Session... worker2 # [ 832.996365] systemd[1951]: Stopped target Main User Target. worker2 # [ 832.998366] systemd[1951]: Stopped target Basic System. worker2 # [ 833.001617] systemd[1951]: Stopped target Paths. worker2 # [ 833.004945] systemd[1951]: Stopped target Sockets. worker2 # [ 833.007772] systemd[1951]: Stopped target Timers. worker2 # [ 833.011492] systemd[1951]: Stopped Daily Cleanup of User's Temporary Directories. worker2 # [ 833.014467] systemd[1951]: Closed D-Bus User Message Bus Socket. worker2 # [ 833.017904] systemd[1951]: Stopped Create User Files and Directories. worker2 # [ 833.020733] systemd[1951]: Removed slice User Application Slice. worker2 # [ 833.023899] systemd[1951]: Reached target Shutdown. worker2 # [ 833.027782] systemd[1951]: Finished Exit the Session. worker2 # [ 833.029680] systemd[1951]: Reached target Exit the Session. worker2 # [ 833.039685] systemd-logind[555]: Removed session 35. worker2 # [ 833.043154] systemd[1]: user@0.service: Deactivated successfully. worker2 # [ 833.046644] systemd[1]: Stopped User Manager for UID 0. worker2 # [ 833.056089] systemd[1]: Stopping User Runtime Directory /run/user/0... worker2 # [ 833.075302] systemd[1]: run-user-0.mount: Deactivated successfully. worker2 # [ 833.077239] systemd[1]: user-runtime-dir@0.service: Deactivated successfully. worker2 # [ 833.078713] systemd[1]: Stopped User Runtime Directory /run/user/0. worker2 # [ 833.084932] nix-grpc-daemon[1617]: time=2026-11-07T15:21:28.297Z level=WARN msg="Request failed, retrying" attempt=4 backoff=829.167806ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d50e330cdac83673a8a2b96d33e7d399fcc294b3d7cd8b5570db22959b53ed7c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d50e330cdac83673a8a2b96d33e7d399fcc294b3d7cd8b5570db22959b53ed7c" worker1 # [ 833.662890] nix-grpc-daemon[1057]: time=2026-11-07T15:21:28.970Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.759416915s error="Put \"http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=403a35a90da8ec274a42d1c891832fadeb9faab29084592766d49f742ae95878\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=403a35a90da8ec274a42d1c891832fadeb9faab29084592766d49f742ae95878" worker2 # [ 833.918796] nix-grpc-daemon[1617]: time=2026-11-07T15:21:29.130Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.587562321s error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d50e330cdac83673a8a2b96d33e7d399fcc294b3d7cd8b5570db22959b53ed7c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d50e330cdac83673a8a2b96d33e7d399fcc294b3d7cd8b5570db22959b53ed7c" worker1 # [ 835.240449] nix-grpc-daemon[1057]: time=2026-11-07T15:21:30.548Z level=WARN msg="Request failed, retrying" attempt=2 backoff=198.125007ms error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a58197eef6f6c8fbfc9a362cf3289df0e07bbb86d934a011c19469775b2bda0f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a58197eef6f6c8fbfc9a362cf3289df0e07bbb86d934a011c19469775b2bda0f" worker1 # [ 835.623614] nix-grpc-daemon[1057]: time=2026-11-07T15:21:30.932Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.672238873s error="Put \"http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=edb7034586bf56c80bcce8b0c2e11d7cebda1c697e17216d00fb47a61aa71f86\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=edb7034586bf56c80bcce8b0c2e11d7cebda1c697e17216d00fb47a61aa71f86" worker2 # [ 835.815288] nix-grpc-daemon[1617]: time=2026-11-07T15:21:31.026Z level=WARN msg="Request failed, retrying" attempt=3 backoff=376.087552ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0fbed86dbc276130a0f378a978edd5c779c0d993c1fd9394db8850736c4a54d4\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0fbed86dbc276130a0f378a978edd5c779c0d993c1fd9394db8850736c4a54d4" worker2 # [ 837.223373] nix-grpc-daemon[1617]: time=2026-11-07T15:21:32.434Z level=WARN msg="Request failed, retrying" attempt=4 backoff=807.557841ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0fbed86dbc276130a0f378a978edd5c779c0d993c1fd9394db8850736c4a54d4\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0fbed86dbc276130a0f378a978edd5c779c0d993c1fd9394db8850736c4a54d4" worker1 # [ 837.608432] nix-grpc-daemon[1057]: time=2026-11-07T15:21:32.916Z level=WARN msg="Request failed, retrying" attempt=4 backoff=794.817831ms error="Put \"http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=82eb7a623378136216c9c0af19b50b420a8e4db6e5b96f5227a7997947b22a37\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=82eb7a623378136216c9c0af19b50b420a8e4db6e5b96f5227a7997947b22a37" worker2 # [ 838.034261] nix-grpc-daemon[1617]: time=2026-11-07T15:21:33.246Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.716757498s error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0fbed86dbc276130a0f378a978edd5c779c0d993c1fd9394db8850736c4a54d4\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=0fbed86dbc276130a0f378a978edd5c779c0d993c1fd9394db8850736c4a54d4" worker1 # [ 839.464352] nix-grpc-daemon[1057]: time=2026-11-07T15:21:34.772Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.586898738s error="Put \"http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=82eb7a623378136216c9c0af19b50b420a8e4db6e5b96f5227a7997947b22a37\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=82eb7a623378136216c9c0af19b50b420a8e4db6e5b96f5227a7997947b22a37" worker2 # [ 839.758732] nix-grpc-daemon[1617]: time=2026-11-07T15:21:34.968Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d50e330cdac83673a8a2b96d33e7d399fcc294b3d7cd8b5570db22959b53ed7c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=1 client # [ 839.759076] nix[3598]: lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading NAR nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152126Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=d50e330cdac83673a8a2b96d33e7d399fcc294b3d7cd8b5570db22959b53ed7c": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying worker2 # [ 839.786356] nix-daemon[986]: reaped child process 2820, status = succeeded worker1 # [ 840.552430] nix-grpc-daemon[1057]: time=2026-11-07T15:21:35.860Z level=WARN msg="Request failed, retrying" attempt=3 backoff=405.244994ms error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a58197eef6f6c8fbfc9a362cf3289df0e07bbb86d934a011c19469775b2bda0f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a58197eef6f6c8fbfc9a362cf3289df0e07bbb86d934a011c19469775b2bda0f" worker1 # [ 840.615446] nix-grpc-daemon[1057]: time=2026-11-07T15:21:35.924Z level=WARN msg="Request failed, retrying" attempt=3 backoff=376.355805ms error="Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ffd0588330eb0179a0e3c34b423f2f337f112b21dbe858a3909bc8a81939a00\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ffd0588330eb0179a0e3c34b423f2f337f112b21dbe858a3909bc8a81939a00" worker1 # [ 842.024357] nix-grpc-daemon[1057]: time=2026-11-07T15:21:37.332Z level=WARN msg="Request failed, retrying" attempt=4 backoff=851.060207ms error="Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ffd0588330eb0179a0e3c34b423f2f337f112b21dbe858a3909bc8a81939a00\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ffd0588330eb0179a0e3c34b423f2f337f112b21dbe858a3909bc8a81939a00" [e2e] heartbeat t=780s worker1 # [ 842.878719] nix-grpc-daemon[1057]: time=2026-11-07T15:21:38.187Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.460922587s error="Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ffd0588330eb0179a0e3c34b423f2f337f112b21dbe858a3909bc8a81939a00\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ffd0588330eb0179a0e3c34b423f2f337f112b21dbe858a3909bc8a81939a00" worker2 # [ 843.765758] nix-grpc-daemon[1514]: ts=2026-11-07T15:21:38Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 843.778525] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 843.885494] nix-daemon[986]: accepted connection from pid 2833, user nix-grpc-daemon (trusted) worker2 # [ 843.899374] nix-daemon[986]: reaped child process 2836, status = succeeded lb # [ 843.907465] niks3-server[1503]: 2026/11/07 15:21:39 INFO Received push request method=POST path=/api/pushes worker2 # [ 843.914089] nix-grpc-daemon[1617]: time=2026-11-07T15:21:39.126Z level=INFO msg="Uploading 1 paths to lb (0 already cached)" worker2 # [ 843.915861] nix-grpc-daemon[1617]: time=2026-11-07T15:21:39.128Z level=INFO msg="Uploading 2765168rrfa4dbs7pfx66j88710jx2fm-slow-rs.drv (416B)" worker2 # [ 843.919355] nix-grpc-daemon[1617]: time=2026-11-07T15:21:39.131Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=114f23942fc122bbb0f641b0bd372e97156311f92ea5c4e2753158e5f7a29a49\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=114f23942fc122bbb0f641b0bd372e97156311f92ea5c4e2753158e5f7a29a49" worker2 # [ 843.927958] nix-grpc-daemon[1617]: time=2026-11-07T15:21:39.131Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7b67e44efc0451a1d9464111987c43cdd4b82ff6ae7febc7d9ef46f769a64218\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7b67e44efc0451a1d9464111987c43cdd4b82ff6ae7febc7d9ef46f769a64218" worker2 # [ 844.022350] nix-grpc-daemon[1617]: time=2026-11-07T15:21:39.234Z level=WARN msg="Request failed, retrying" attempt=2 backoff=205.867771ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=114f23942fc122bbb0f641b0bd372e97156311f92ea5c4e2753158e5f7a29a49\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=114f23942fc122bbb0f641b0bd372e97156311f92ea5c4e2753158e5f7a29a49" worker2 # [ 844.031027] nix-grpc-daemon[1617]: time=2026-11-07T15:21:39.234Z level=WARN msg="Request failed, retrying" attempt=2 backoff=186.769022ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7b67e44efc0451a1d9464111987c43cdd4b82ff6ae7febc7d9ef46f769a64218\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7b67e44efc0451a1d9464111987c43cdd4b82ff6ae7febc7d9ef46f769a64218" worker1 # [ 844.072382] nix-grpc-daemon[1057]: time=2026-11-07T15:21:39.380Z level=WARN msg="Request failed, retrying" attempt=4 backoff=776.908178ms error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a58197eef6f6c8fbfc9a362cf3289df0e07bbb86d934a011c19469775b2bda0f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a58197eef6f6c8fbfc9a362cf3289df0e07bbb86d934a011c19469775b2bda0f" worker2 # [ 844.212073] nix-grpc-daemon[1617]: time=2026-11-07T15:21:39.424Z level=WARN msg="Request failed, retrying" attempt=3 backoff=438.177655ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7b67e44efc0451a1d9464111987c43cdd4b82ff6ae7febc7d9ef46f769a64218\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7b67e44efc0451a1d9464111987c43cdd4b82ff6ae7febc7d9ef46f769a64218" worker1 # [ 844.853405] nix-grpc-daemon[1057]: time=2026-11-07T15:21:40.161Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.644727286s error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a58197eef6f6c8fbfc9a362cf3289df0e07bbb86d934a011c19469775b2bda0f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=a58197eef6f6c8fbfc9a362cf3289df0e07bbb86d934a011c19469775b2bda0f" worker2 # [ 845.287351] nix-grpc-daemon[1617]: time=2026-11-07T15:21:40.498Z level=WARN msg="Request failed, retrying" attempt=3 backoff=392.445141ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=114f23942fc122bbb0f641b0bd372e97156311f92ea5c4e2753158e5f7a29a49\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=114f23942fc122bbb0f641b0bd372e97156311f92ea5c4e2753158e5f7a29a49" worker2 # [ 846.695324] nix-grpc-daemon[1617]: time=2026-11-07T15:21:41.906Z level=WARN msg="Request failed, retrying" attempt=4 backoff=773.114444ms error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=114f23942fc122bbb0f641b0bd372e97156311f92ea5c4e2753158e5f7a29a49\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=114f23942fc122bbb0f641b0bd372e97156311f92ea5c4e2753158e5f7a29a49" worker2 # [ 847.471521] nix-grpc-daemon[1617]: time=2026-11-07T15:21:42.683Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.529662244s error="Put \"http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=114f23942fc122bbb0f641b0bd372e97156311f92ea5c4e2753158e5f7a29a49\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1p73bzh7zqz68fm48xgidr9p1hfd08x3vp8znnaaycsmagbr8hl6.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=114f23942fc122bbb0f641b0bd372e97156311f92ea5c4e2753158e5f7a29a49" worker1 # [ 848.428447] nix-grpc-daemon[1057]: time=2026-11-07T15:21:43.732Z level=WARN msg="Request failed, retrying" attempt=2 backoff=215.000978ms error="Put \"http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c14c7d1b055e9809ab126557092c0fbd706e56ae8f84a282a0bb16196045b5e\": uploading NAR nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst: uploading NAR nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ffd0588330eb0179a0e3c34b423f2f337f112b21dbe858a3909bc8a81939a00\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7c14c7d1b055e9809ab126557092c0fbd706e56ae8f84a282a0bb16196045b5e" worker1 # [ 848.462684] nix-grpc-daemon[1057]: time=2026-11-07T15:21:43.732Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst: uploading NAR nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ffd0588330eb0179a0e3c34b423f2f337f112b21dbe858a3909bc8a81939a00\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=3 worker1 # [ 848.486902] nix-daemon[1026]: reaped child process 2915, status = succeeded worker2 # [ 848.743317] nix-grpc-daemon[1617]: time=2026-11-07T15:21:43.955Z level=WARN msg="Request failed, retrying" attempt=4 backoff=740.619663ms error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7b67e44efc0451a1d9464111987c43cdd4b82ff6ae7febc7d9ef46f769a64218\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7b67e44efc0451a1d9464111987c43cdd4b82ff6ae7febc7d9ef46f769a64218" worker2 # [ 848.934478] nix-grpc-daemon[1514]: ts=2026-11-07T15:21:44Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 848.945837] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 848.966445] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 849.072406] nix-daemon[986]: accepted connection from pid 2843, user nix-grpc-daemon (trusted) worker2 # [ 849.086625] nix-daemon[986]: reaped child process 2846, status = succeeded lb # [ 849.095744] niks3-server[1503]: 2026/11/07 15:21:44 INFO Received push request method=POST path=/api/pushes worker2 # [ 849.104982] nix-grpc-daemon[1617]: time=2026-11-07T15:21:44.317Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker2 # [ 849.106543] nix-grpc-daemon[1617]: time=2026-11-07T15:21:44.319Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" worker2 # [ 849.108200] nix-grpc-daemon[1617]: time=2026-11-07T15:21:44.320Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" worker2 # [ 849.109979] nix-grpc-daemon[1617]: time=2026-11-07T15:21:44.322Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" worker2 # [ 850.159257] nix-grpc-daemon[1617]: time=2026-11-07T15:21:45.371Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9c6d59244d3e2a4fe812c2f1c9cfd2ebd1a47b1651958497f89426d037cf6a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9c6d59244d3e2a4fe812c2f1c9cfd2ebd1a47b1651958497f89426d037cf6a" worker2 # [ 851.174521] nix-grpc-daemon[1617]: time=2026-11-07T15:21:46.386Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f91c6db48a477d39125130624d28fa914c372f3e02d2cbc5c3539fa8c660944f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f91c6db48a477d39125130624d28fa914c372f3e02d2cbc5c3539fa8c660944f" worker2 # [ 852.198202] nix-grpc-daemon[1617]: time=2026-11-07T15:21:47.410Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b109e9a3ac44089cf81de78749b8c544ba6897c969e8e7ead6d503ab84df382\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b109e9a3ac44089cf81de78749b8c544ba6897c969e8e7ead6d503ab84df382" worker2 # [ 853.222560] nix-grpc-daemon[1617]: time=2026-11-07T15:21:48.434Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e31390028927a5b0b3d504d687d835b5a4ce310492f94bd0a6939c24d235ca72\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e31390028927a5b0b3d504d687d835b5a4ce310492f94bd0a6939c24d235ca72" worker2 # [ 854.246641] nix-grpc-daemon[1617]: time=2026-11-07T15:21:49.458Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e9782aeb0fef73034f9b5dce5088c4482430defa0445ddf8d6c308ccdf78b71\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e9782aeb0fef73034f9b5dce5088c4482430defa0445ddf8d6c308ccdf78b71" worker2 # [ 855.398971] nix-grpc-daemon[1617]: time=2026-11-07T15:21:50.610Z level=WARN msg="Request failed, retrying" attempt=2 backoff=201.01164ms error="Put \"http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e31390028927a5b0b3d504d687d835b5a4ce310492f94bd0a6939c24d235ca72\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e31390028927a5b0b3d504d687d835b5a4ce310492f94bd0a6939c24d235ca72" worker2 # [ 856.294539] nix-grpc-daemon[1617]: time=2026-11-07T15:21:51.506Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3da832e330f2c84d753414acb1ddcd90269f070699ecf4c228d800f36cb0057\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3da832e330f2c84d753414acb1ddcd90269f070699ecf4c228d800f36cb0057" worker2 # [ 857.447310] nix-grpc-daemon[1617]: time=2026-11-07T15:21:52.658Z level=WARN msg="Request failed, retrying" attempt=2 backoff=195.055499ms error="Put \"http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b109e9a3ac44089cf81de78749b8c544ba6897c969e8e7ead6d503ab84df382\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b109e9a3ac44089cf81de78749b8c544ba6897c969e8e7ead6d503ab84df382" worker2 # [ 858.471404] nix-grpc-daemon[1617]: time=2026-11-07T15:21:53.682Z level=WARN msg="Request failed, retrying" attempt=2 backoff=211.931231ms error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3da832e330f2c84d753414acb1ddcd90269f070699ecf4c228d800f36cb0057\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3da832e330f2c84d753414acb1ddcd90269f070699ecf4c228d800f36cb0057" worker2 # [ 859.495400] nix-grpc-daemon[1617]: time=2026-11-07T15:21:54.706Z level=WARN msg="Request failed, retrying" attempt=2 backoff=194.492575ms error="Put \"http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e9782aeb0fef73034f9b5dce5088c4482430defa0445ddf8d6c308ccdf78b71\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e9782aeb0fef73034f9b5dce5088c4482430defa0445ddf8d6c308ccdf78b71" worker2 # [ 860.711440] nix-grpc-daemon[1617]: time=2026-11-07T15:21:55.923Z level=WARN msg="Request failed, retrying" attempt=3 backoff=412.511944ms error="Put \"http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e9782aeb0fef73034f9b5dce5088c4482430defa0445ddf8d6c308ccdf78b71\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e9782aeb0fef73034f9b5dce5088c4482430defa0445ddf8d6c308ccdf78b71" worker2 # [ 861.127311] nix-grpc-daemon[1617]: time=2026-11-07T15:21:56.339Z level=WARN msg="Request failed, retrying" attempt=4 backoff=732.961531ms error="Put \"http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e9782aeb0fef73034f9b5dce5088c4482430defa0445ddf8d6c308ccdf78b71\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e9782aeb0fef73034f9b5dce5088c4482430defa0445ddf8d6c308ccdf78b71" worker2 # [ 861.799245] nix-grpc-daemon[1617]: time=2026-11-07T15:21:57.010Z level=WARN msg="Request failed, retrying" attempt=3 backoff=403.893865ms error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3da832e330f2c84d753414acb1ddcd90269f070699ecf4c228d800f36cb0057\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3da832e330f2c84d753414acb1ddcd90269f070699ecf4c228d800f36cb0057" worker2 # [ 862.886635] nix-grpc-daemon[1617]: time=2026-11-07T15:21:58.098Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.608827877s error="Put \"http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e9782aeb0fef73034f9b5dce5088c4482430defa0445ddf8d6c308ccdf78b71\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=9e9782aeb0fef73034f9b5dce5088c4482430defa0445ddf8d6c308ccdf78b71" worker2 # [ 864.295404] nix-grpc-daemon[1617]: time=2026-11-07T15:21:59.507Z level=WARN msg="Request failed, retrying" attempt=4 backoff=873.182519ms error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3da832e330f2c84d753414acb1ddcd90269f070699ecf4c228d800f36cb0057\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3da832e330f2c84d753414acb1ddcd90269f070699ecf4c228d800f36cb0057" worker2 # [ 864.806511] nix-grpc-daemon[1617]: time=2026-11-07T15:22:00.018Z level=WARN msg="Request failed, retrying" attempt=3 backoff=409.638831ms error="Put \"http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b109e9a3ac44089cf81de78749b8c544ba6897c969e8e7ead6d503ab84df382\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b109e9a3ac44089cf81de78749b8c544ba6897c969e8e7ead6d503ab84df382" worker2 # [ 866.215426] nix-grpc-daemon[1617]: time=2026-11-07T15:22:01.427Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.698207064s error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3da832e330f2c84d753414acb1ddcd90269f070699ecf4c228d800f36cb0057\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f3da832e330f2c84d753414acb1ddcd90269f070699ecf4c228d800f36cb0057" worker2 # [ 867.303460] nix-grpc-daemon[1617]: time=2026-11-07T15:22:02.515Z level=WARN msg="Request failed, retrying" attempt=4 backoff=841.172949ms error="Put \"http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b109e9a3ac44089cf81de78749b8c544ba6897c969e8e7ead6d503ab84df382\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b109e9a3ac44089cf81de78749b8c544ba6897c969e8e7ead6d503ab84df382" worker2 # [ 868.902681] nix-grpc-daemon[1617]: time=2026-11-07T15:22:04.114Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.640426933s error="Put \"http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7b67e44efc0451a1d9464111987c43cdd4b82ff6ae7febc7d9ef46f769a64218\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/2765168rrfa4dbs7pfx66j88710jx2fm.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152139Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=7b67e44efc0451a1d9464111987c43cdd4b82ff6ae7febc7d9ef46f769a64218" worker2 # [ 869.926957] nix-grpc-daemon[1617]: time=2026-11-07T15:22:05.138Z level=WARN msg="Request failed, retrying" attempt=2 backoff=201.953033ms error="Put \"http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9c6d59244d3e2a4fe812c2f1c9cfd2ebd1a47b1651958497f89426d037cf6a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9c6d59244d3e2a4fe812c2f1c9cfd2ebd1a47b1651958497f89426d037cf6a" worker2 # [ 870.951319] nix-grpc-daemon[1617]: time=2026-11-07T15:22:06.162Z level=WARN msg="Request failed, retrying" attempt=2 backoff=190.949184ms error="Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f91c6db48a477d39125130624d28fa914c372f3e02d2cbc5c3539fa8c660944f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f91c6db48a477d39125130624d28fa914c372f3e02d2cbc5c3539fa8c660944f" worker2 # [ 872.167412] nix-grpc-daemon[1617]: time=2026-11-07T15:22:07.379Z level=WARN msg="Request failed, retrying" attempt=3 backoff=430.057844ms error="Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f91c6db48a477d39125130624d28fa914c372f3e02d2cbc5c3539fa8c660944f\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f91c6db48a477d39125130624d28fa914c372f3e02d2cbc5c3539fa8c660944f" [e2e] heartbeat t=810s worker2 # [ 873.191412] nix-grpc-daemon[1617]: time=2026-11-07T15:22:08.403Z level=WARN msg="Request failed, retrying" attempt=3 backoff=398.799314ms error="Put \"http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9c6d59244d3e2a4fe812c2f1c9cfd2ebd1a47b1651958497f89426d037cf6a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9c6d59244d3e2a4fe812c2f1c9cfd2ebd1a47b1651958497f89426d037cf6a" worker2 # [ 874.599464] nix-grpc-daemon[1617]: time=2026-11-07T15:22:09.811Z level=WARN msg="Request failed, retrying" attempt=4 backoff=781.045538ms error="Put \"http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9c6d59244d3e2a4fe812c2f1c9cfd2ebd1a47b1651958497f89426d037cf6a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9c6d59244d3e2a4fe812c2f1c9cfd2ebd1a47b1651958497f89426d037cf6a" worker2 # [ 875.046564] nix-grpc-daemon[1617]: time=2026-11-07T15:22:10.258Z level=WARN msg="Request failed, retrying" attempt=3 backoff=406.210465ms error="Put \"http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e31390028927a5b0b3d504d687d835b5a4ce310492f94bd0a6939c24d235ca72\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e31390028927a5b0b3d504d687d835b5a4ce310492f94bd0a6939c24d235ca72" worker2 # [ 876.390875] nix-grpc-daemon[1617]: time=2026-11-07T15:22:11.602Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.614496846s error="Put \"http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9c6d59244d3e2a4fe812c2f1c9cfd2ebd1a47b1651958497f89426d037cf6a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9c6d59244d3e2a4fe812c2f1c9cfd2ebd1a47b1651958497f89426d037cf6a" worker2 # [ 877.542950] nix-grpc-daemon[1617]: time=2026-11-07T15:22:12.754Z level=WARN msg="Request failed, retrying" attempt=4 backoff=781.854055ms error="Put \"http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e31390028927a5b0b3d504d687d835b5a4ce310492f94bd0a6939c24d235ca72\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e31390028927a5b0b3d504d687d835b5a4ce310492f94bd0a6939c24d235ca72" worker2 # [ 878.009573] nix-grpc-daemon[1617]: time=2026-11-07T15:22:13.222Z level=WARN msg="Request failed, retrying" attempt=4 backoff=799.463568ms error="Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f91c6db48a477d39125130624d28fa914c372f3e02d2cbc5c3539fa8c660944f\": uploading NAR nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst: uploading NAR nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9c6d59244d3e2a4fe812c2f1c9cfd2ebd1a47b1651958497f89426d037cf6a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=f91c6db48a477d39125130624d28fa914c372f3e02d2cbc5c3539fa8c660944f" worker2 # [ 878.046777] nix-grpc-daemon[1617]: time=2026-11-07T15:22:13.256Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.706122744s error="Put \"http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b109e9a3ac44089cf81de78749b8c544ba6897c969e8e7ead6d503ab84df382\": uploading NAR nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst: uploading NAR nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9c6d59244d3e2a4fe812c2f1c9cfd2ebd1a47b1651958497f89426d037cf6a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=5b109e9a3ac44089cf81de78749b8c544ba6897c969e8e7ead6d503ab84df382" worker2 # [ 878.078247] nix-grpc-daemon[1617]: time=2026-11-07T15:22:13.256Z level=ERROR msg="Upload failed" error="uploading objects: uploading NAR nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst: uploading NAR nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst: uploading: request failed after retries: Put \"http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9c6d59244d3e2a4fe812c2f1c9cfd2ebd1a47b1651958497f89426d037cf6a\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" count=3 worker2 # [ 878.089400] nix-daemon[986]: reaped child process 2839, status = succeeded worker2 # [ 879.083721] nix-grpc-daemon[1514]: ts=2026-11-07T15:22:14Z level=debug event=rpc_start method=AddMultipleToStore cn=ci-1 peer=ipv4:192.168.1.2:44924 worker2 # [ 879.096714] nix-daemon[986]: accepted connection from pid 1514, user nix-grpc-daemon (trusted) worker2 # [ 879.207650] nix-daemon[986]: accepted connection from pid 2850, user nix-grpc-daemon (trusted) worker2 # [ 879.222475] nix-daemon[986]: reaped child process 2853, status = succeeded lb # [ 879.231314] niks3-server[1503]: 2026/11/07 15:22:14 INFO Received push request method=POST path=/api/pushes worker2 # [ 879.240424] nix-grpc-daemon[1617]: time=2026-11-07T15:22:14.452Z level=INFO msg="Uploading 3 paths to lb (0 already cached)" worker2 # [ 879.244383] nix-grpc-daemon[1617]: time=2026-11-07T15:22:14.454Z level=INFO msg="Uploading zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv (624B)" worker2 # [ 879.246105] nix-grpc-daemon[1617]: time=2026-11-07T15:22:14.454Z level=INFO msg="Uploading 3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv (504B)" worker2 # [ 879.249107] nix-grpc-daemon[1617]: time=2026-11-07T15:22:14.454Z level=INFO msg="Uploading c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv (752B)" worker2 # [ 879.251073] nix-grpc-daemon[1617]: time=2026-11-07T15:22:14.461Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cee43bbaea8a22455f10145f8b93d17c5f3661fcde8aac1538a91124d30abbea\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/1nf01qbgzkrsqfjd6d2bx60xxkfkbrljmfrvypvjci1c69ad7knd.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=cee43bbaea8a22455f10145f8b93d17c5f3661fcde8aac1538a91124d30abbea" worker2 # [ 880.295429] nix-grpc-daemon[1617]: time=2026-11-07T15:22:15.506Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b5ebde6c0c6290912f20f3012d7265af0a3b5c8328f8c75de358774bf6d0a56\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/zbhcql1mkb05ig74hjj18iqpvqy3rfbp.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8b5ebde6c0c6290912f20f3012d7265af0a3b5c8328f8c75de358774bf6d0a56" worker2 # [ 881.319432] nix-grpc-daemon[1617]: time=2026-11-07T15:22:16.530Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=43ea2db2c5e53bfcb0ff183c7139fb01e0b81ae8ba17abd66437281ac8fdfeb4\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=43ea2db2c5e53bfcb0ff183c7139fb01e0b81ae8ba17abd66437281ac8fdfeb4" worker2 # [ 882.343301] nix-grpc-daemon[1617]: time=2026-11-07T15:22:17.554Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dd2b007e28d29d5481fd9960520d23b6ce86e1d53661b249fedacd67d2ce4016\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dd2b007e28d29d5481fd9960520d23b6ce86e1d53661b249fedacd67d2ce4016" worker2 # [ 883.367349] nix-grpc-daemon[1617]: time=2026-11-07T15:22:18.578Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e52f9f75929cbc110063de4fe46336a64af49330292fc7a7d422baadee18e84c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e52f9f75929cbc110063de4fe46336a64af49330292fc7a7d422baadee18e84c" worker2 # [ 885.542695] nix-grpc-daemon[1617]: time=2026-11-07T15:22:20.754Z level=WARN msg="Request failed, retrying" attempt=2 backoff=191.250264ms error="Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e52f9f75929cbc110063de4fe46336a64af49330292fc7a7d422baadee18e84c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e52f9f75929cbc110063de4fe46336a64af49330292fc7a7d422baadee18e84c" worker2 # [ 886.438121] nix-grpc-daemon[1617]: time=2026-11-07T15:22:21.650Z level=WARN msg="Request failed, retrying" attempt=1 backoff=100ms error="Put \"http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8f18f10042ce6dc00b32c1b0b158922e914ac1d06c493a8b1dc3f063bdd5c56c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8f18f10042ce6dc00b32c1b0b158922e914ac1d06c493a8b1dc3f063bdd5c56c" worker2 # [ 887.591104] nix-grpc-daemon[1617]: time=2026-11-07T15:22:22.802Z level=WARN msg="Request failed, retrying" attempt=2 backoff=184.628782ms error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dd2b007e28d29d5481fd9960520d23b6ce86e1d53661b249fedacd67d2ce4016\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dd2b007e28d29d5481fd9960520d23b6ce86e1d53661b249fedacd67d2ce4016" worker2 # [ 888.807206] nix-grpc-daemon[1617]: time=2026-11-07T15:22:24.018Z level=WARN msg="Request failed, retrying" attempt=3 backoff=406.903237ms error="Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e52f9f75929cbc110063de4fe46336a64af49330292fc7a7d422baadee18e84c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e52f9f75929cbc110063de4fe46336a64af49330292fc7a7d422baadee18e84c" worker2 # [ 889.831094] nix-grpc-daemon[1617]: time=2026-11-07T15:22:25.042Z level=WARN msg="Request failed, retrying" attempt=3 backoff=436.403396ms error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dd2b007e28d29d5481fd9960520d23b6ce86e1d53661b249fedacd67d2ce4016\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dd2b007e28d29d5481fd9960520d23b6ce86e1d53661b249fedacd67d2ce4016" worker2 # [ 891.302491] nix-grpc-daemon[1617]: time=2026-11-07T15:22:26.514Z level=WARN msg="Request failed, retrying" attempt=4 backoff=814.535739ms error="Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e52f9f75929cbc110063de4fe46336a64af49330292fc7a7d422baadee18e84c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e52f9f75929cbc110063de4fe46336a64af49330292fc7a7d422baadee18e84c" worker2 # [ 892.119240] nix-grpc-daemon[1617]: time=2026-11-07T15:22:27.331Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.699943526s error="Put \"http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e52f9f75929cbc110063de4fe46336a64af49330292fc7a7d422baadee18e84c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=e52f9f75929cbc110063de4fe46336a64af49330292fc7a7d422baadee18e84c" worker2 # [ 893.350447] nix-grpc-daemon[1617]: time=2026-11-07T15:22:28.562Z level=WARN msg="Request failed, retrying" attempt=4 backoff=792.444235ms error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dd2b007e28d29d5481fd9960520d23b6ce86e1d53661b249fedacd67d2ce4016\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dd2b007e28d29d5481fd9960520d23b6ce86e1d53661b249fedacd67d2ce4016" worker2 # [ 895.206532] nix-grpc-daemon[1617]: time=2026-11-07T15:22:30.418Z level=WARN msg="Request failed, retrying" attempt=5 backoff=1.484655758s error="Put \"http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dd2b007e28d29d5481fd9960520d23b6ce86e1d53661b249fedacd67d2ce4016\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=dd2b007e28d29d5481fd9960520d23b6ce86e1d53661b249fedacd67d2ce4016" worker2 # [ 897.766482] nix-grpc-daemon[1617]: time=2026-11-07T15:22:32.978Z level=WARN msg="Request failed, retrying" attempt=2 backoff=180.503363ms error="Put \"http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8f18f10042ce6dc00b32c1b0b158922e914ac1d06c493a8b1dc3f063bdd5c56c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8f18f10042ce6dc00b32c1b0b158922e914ac1d06c493a8b1dc3f063bdd5c56c" worker2 # [ 897.950111] nix-grpc-daemon[1617]: time=2026-11-07T15:22:33.162Z level=WARN msg="Request failed, retrying" attempt=3 backoff=394.229927ms error="Put \"http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8f18f10042ce6dc00b32c1b0b158922e914ac1d06c493a8b1dc3f063bdd5c56c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8f18f10042ce6dc00b32c1b0b158922e914ac1d06c493a8b1dc3f063bdd5c56c" timeout reached; test terminating... kill QemuMachine (pid 63) client # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/xahxrjs30p3mw0a42bqg9ikgkikskw8m-python3-3.14.8/bin/python3.14) client # [2026-11-07T15:22:35Z INFO virtiofsd] Client disconnected, shutting down client # [2026-11-07T15:22:35Z INFO virtiofsd] Client disconnected, shutting down client # [2026-11-07T15:22:35Z INFO virtiofsd] Client disconnected, shutting down thread 'farm::serial::dag_build_is_scheduled_across_workers_and_lands_in_the_cache' (2335) panicked at harness.rs:200:5: [client] ssh connection lost: sh -c 'exec "$@" >&2' sh nix build -L --store 'grpc://lb:50051?client-cert=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.pem&client-key=/nix/store/kjf12ih43irkhzfjgzic508ql9hxrk1w-farm-certs/ci.key' --eval-store auto -f /nix/store/k21whgkqjvpyl87rq4aj8qjpawh8ywii-job.nix --argstr tag t1 don't know how to build these paths: /nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv copying 3 paths to 'lb:50051'... copying path '/nix/store/3ijpb6qq7zgbnifk6lc6i1fipl0iqkl1-farm-a.drv' to 'lb:50051'... copying path '/nix/store/zbhcql1mkb05ig74hjj18iqpvqy3rfbp-farm-b.drv' to 'lb:50051'... copying path '/nix/store/c7ysj984j3hnalhcvn7z0328xf5fr0zd-farm-top.drv' to 'lb:50051'... lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst: uploading NAR nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/19sdpvl15ladfjss8gp73f6binhg0wgk0323wmn91mihvj530pxq.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152118Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8ffd0588330eb0179a0e3c34b423f2f337f112b21dbe858a3909bc8a81939a00": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying lb:50051: error: publish failed: error: niks3 push: uploading objects: uploading NAR nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst: uploading NAR nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst: uploading: request failed after retries: Put "http://lb:9000/farm/nar/15vlbxqk65jh0v1qgc8308zz4diydc8wp113i0cc4ylv0zc5w964.nar.zst?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152144Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=ab9c6d59244d3e2a4fe812c2f1c9cfd2ebd1a47b1651958497f89426d037cf6a": dial tcp [2001:db8:1::2]:9000: connect: connection refused, retrying Connection to vsock-mux//build/tmp8959srmw/client_host.socket closed by remote host. client_loop: send disconnect: Broken pipe FAILED test farm::serial::inputs_already_in_the_cache_are_not_sent_to_the_scheduler ... worker1 # [ 899.376966] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker1 # [ 899.387371] systemd[1]: Started SSH per-connection Daemon (vsock:2:114). worker2 # [ 899.367311] nix-grpc-daemon[1617]: time=2026-11-07T15:22:34.578Z level=WARN msg="Request failed, retrying" attempt=4 backoff=760.626823ms error="Put \"http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8f18f10042ce6dc00b32c1b0b158922e914ac1d06c493a8b1dc3f063bdd5c56c\": dial tcp [2001:db8:1::2]:9000: connect: connection refused" url="http://lb:9000/farm/c7ysj984j3hnalhcvn7z0328xf5fr0zd.ls?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=GK0123456789abcdef01234567%2F20261107%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20261107T152214Z&X-Amz-Expires=18000&X-Amz-SignedHeaders=host&X-Amz-Signature=8f18f10042ce6dc00b32c1b0b158922e914ac1d06c493a8b1dc3f063bdd5c56c" worker1 # [ 899.452197] sshd-session[2928]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker1 # [ 899.456911] sshd-session[2928]: Accepted none for root from UNKNOWN port 65535 ssh2 worker1 # [ 899.461514] sshd-session[2928]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 899.471163] systemd[1]: Starting User Runtime Directory /run/user/0... worker1 # [ 899.480874] systemd-logind[608]: New session '123' of user 'root' with class 'user' and type 'tty'. worker1 # [ 899.494259] systemd[1]: Finished User Runtime Directory /run/user/0. worker1 # [ 899.498732] systemd[1]: Starting User Manager for UID 0... worker1 # [ 899.512849] (systemd)[2936]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker1 # [ 899.516635] systemd-logind[608]: New session '124' of user 'root' with class 'manager-early' and type 'unspecified'. worker1 # [ 899.589750] systemd[2936]: Failed to adjust io pressure threshold, ignoring: Device or resource busy kill QemuMachine (pid 62) lb # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/xahxrjs30p3mw0a42bqg9ikgkikskw8m-python3-3.14.8/bin/python3.14) lb # [2026-11-07T15:22:36Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-11-07T15:22:36Z INFO virtiofsd] Client disconnected, shutting down lb # [2026-11-07T15:22:36Z INFO virtiofsd] Client disconnected, shutting down worker1 # [ 899.648746] systemd[2936]: Queued start job for default target Main User Target. worker1 # [ 899.651689] systemd[2936]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker1 # [ 899.653880] systemd[2936]: Created slice User Application Slice. worker1 # [ 899.655148] systemd[2936]: Started Daily Cleanup of User's Temporary Directories. worker1 # [ 899.656863] systemd[2936]: Reached target Paths. worker1 # [ 899.657580] systemd[2936]: Reached target Timers. worker1 # [ 899.658742] systemd[2936]: Starting D-Bus User Message Bus Socket... worker1 # [ 899.661535] systemd[2936]: Starting Create User Files and Directories... worker1 # [ 899.686251] systemd[2936]: Finished Create User Files and Directories. worker1 # [ 899.688904] systemd[2936]: Listening on D-Bus User Message Bus Socket. worker1 # [ 899.690145] systemd[2936]: Reached target Sockets. worker1 # [ 899.691100] systemd[2936]: Reached target Basic System. worker1 # [ 899.691809] systemd[2936]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker1 # [ 899.693904] systemd[2936]: Reached target Main User Target. worker1 # [ 899.695969] systemd[1]: Started User Manager for UID 0. worker1 # [ 899.696744] systemd[2936]: Startup finished in 167ms. worker1 # [ 899.698385] systemd[1]: Started Session 123 of User root. worker1 # [ 899.719132] sshd-session[2949]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker1 # [ 899.720335] sshd-session[2949]: Disconnected from user root UNKNOWN port 65535 worker1 # [ 899.721544] sshd-session[2928]: pam_unix(sshd:session): session closed for user root worker1 # [ 899.724325] systemd[1]: sshd-vsock@114-115-5:22-2:114.service: Deactivated successfully. worker1 # [ 899.727768] systemd[1]: session-123.scope: Deactivated successfully. worker1 # [ 899.730989] systemd-logind[608]: Session 123 logged out. Waiting for processes to exit. worker1 # [ 899.732613] systemd-logind[608]: Removed session 123. worker2 # [ 899.776800] systemd[1]: SSH Host Keys Generation skipped, no trigger condition checks were met. worker2 # [ 899.787155] systemd[1]: Started SSH per-connection Daemon (vsock:2:100). worker2 # [ 899.852387] sshd-session[2855]: pam_unix(sshd:auth): user [root] has blank password; authenticated without it worker2 # [ 899.857132] sshd-session[2855]: Accepted none for root from UNKNOWN port 65535 ssh2 worker2 # [ 899.862147] sshd-session[2855]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 899.872417] systemd[1]: Starting User Runtime Directory /run/user/0... worker2 # [ 899.880691] systemd-logind[555]: New session '108' of user 'root' with class 'user' and type 'tty'. worker2 # [ 899.895592] systemd[1]: Finished User Runtime Directory /run/user/0. worker2 # [ 899.900520] systemd[1]: Starting User Manager for UID 0... worker2 # [ 899.915281] (systemd)[2863]: pam_unix(systemd-user:session): session opened for user root(uid=0) by (uid=0) worker2 # [ 899.919697] systemd-logind[555]: New session '109' of user 'root' with class 'manager-early' and type 'unspecified'. worker2 # [ 899.994390] systemd[2863]: Failed to adjust io pressure threshold, ignoring: Device or resource busy kill QemuMachine (pid 65) worker1 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/xahxrjs30p3mw0a42bqg9ikgkikskw8m-python3-3.14.8/bin/python3.14) worker1 # [2026-11-07T15:22:36Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-11-07T15:22:36Z INFO virtiofsd] Client disconnected, shutting down worker1 # [2026-11-07T15:22:36Z INFO virtiofsd] Client disconnected, shutting down worker2 # [ 900.060727] systemd[2863]: Queued start job for default target Main User Target. worker2 # [ 900.063683] systemd[2863]: Failed to adjust io pressure threshold, ignoring: Device or resource busy worker2 # [ 900.065838] systemd[2863]: Created slice User Application Slice. worker2 # [ 900.066835] systemd[2863]: Started Daily Cleanup of User's Temporary Directories. worker2 # [ 900.068068] systemd[2863]: Reached target Paths. worker2 # [ 900.068735] systemd[2863]: Reached target Timers. worker2 # [ 900.073083] systemd[2863]: Starting D-Bus User Message Bus Socket... worker2 # [ 900.074696] systemd[1]: Starting Cleanup of Temporary Directories... worker2 # [ 900.080076] systemd[2863]: Starting Create User Files and Directories... worker2 # [ 900.116684] systemd[2863]: Listening on D-Bus User Message Bus Socket. worker2 # [ 900.118175] systemd[2863]: Reached target Sockets. worker2 # [ 900.119827] systemd[2863]: Finished Create User Files and Directories. worker2 # [ 900.120967] systemd[2863]: Reached target Basic System. worker2 # [ 900.122142] systemd[2863]: Run user-specific NixOS activation skipped, unmet condition check ConditionUser=!@system worker2 # [ 900.123690] systemd[1]: Started User Manager for UID 0. worker2 # [ 900.124656] systemd[2863]: Reached target Main User Target. worker2 # [ 900.126553] systemd[2863]: Startup finished in 195ms. worker2 # [ 900.131251] systemd[1]: Started Session 108 of User root. worker2 # [ 900.176408] sshd-session[2877]: Received disconnect from UNKNOWN port 65535:11: disconnected by user worker2 # [ 900.178250] sshd-session[2877]: Disconnected from user root UNKNOWN port 65535 worker2 # [ 900.180274] sshd-session[2855]: pam_unix(sshd:session): session closed for user root worker2 # [ 900.183946] systemd[1]: sshd-vsock@100-101-6:22-2:100.service: Deactivated successfully. worker2 # [ 900.187685] systemd[1]: session-108.scope: Deactivated successfully. worker2 # [ 900.191668] systemd-logind[555]: Session 108 logged out. Waiting for processes to exit. worker2 # [ 900.193958] systemd-logind[555]: Removed session 108. worker2 # [ 900.203904] systemd[1]: systemd-tmpfiles-clean.service: Deactivated successfully. worker2 # [ 900.205532] systemd[1]: Finished Cleanup of Temporary Directories. kill QemuMachine (pid 64) worker2 # qemu-system-x86_64: terminating on signal 15 from pid 39 (/nix/store/xahxrjs30p3mw0a42bqg9ikgkikskw8m-python3-3.14.8/bin/python3.14) worker2 # [2026-11-07T15:22:36Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-11-07T15:22:36Z INFO virtiofsd] Client disconnected, shutting down worker2 # [2026-11-07T15:22:36Z INFO virtiofsd] Client disconnected, shutting down thread 'farm::serial::inputs_already_in_the_cache_are_not_sent_to_the_scheduler' (2395) panicked at harness.rs:200:5: [lb] ssh connection lost: curl -sf localhost:9901/clusters Failed to receive OK from /build/tmp8959srmw/lb_host.socket: Connection reset by peer mm_receive_fd: recvmsg: expected received 1 got 0 proxy dialer did not pass back a connection FAILED test farm::serial::interrupting_the_client_stops_the_build_on_the_worker ... thread 'farm::serial::interrupting_the_client_stops_the_build_on_the_worker' (2414) panicked at harness.rs:200:5: [worker1] ssh connection lost: sh -c 'systemctl is-active -q nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service' Failed to receive OK from /build/tmp8959srmw/worker1_host.socket: Connection reset by peer mm_receive_fd: recvmsg: expected received 1 got 0 proxy dialer did not pass back a connection FAILED test farm::serial::low_disk_drains_a_worker_and_builds_go_to_the_other ... thread 'farm::serial::low_disk_drains_a_worker_and_builds_go_to_the_other' (2419) panicked at harness.rs:200:5: [worker1] ssh connection lost: sh -c 'systemctl is-active -q nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service' Failed to receive OK from /build/tmp8959srmw/worker1_host.socket: Connection reset by peer mm_receive_fd: recvmsg: expected received 1 got 0 proxy dialer did not pass back a connection FAILED test farm::serial::one_node_schedules_and_both_builders_hold_a_worker_session ... thread 'farm::serial::one_node_schedules_and_both_builders_hold_a_worker_session' (2424) panicked at harness.rs:200:5: [worker1] ssh connection lost: sh -c 'systemctl is-active -q nix-grpc-daemon.service || systemctl start nix-grpc-daemon.service' Failed to receive OK from /build/tmp8959srmw/worker1_host.socket: Connection reset by peer mm_receive_fd: recvmsg: expected received 1 got 0 proxy dialer did not pass back a connection FAILED test farm::serial::queue_gauges_show_a_burst_while_every_build_blocks ... Terminated /nix/store/wx6y9w86d3p5p9zn5gfghi93a6yghl5m-nixos-test-driver-nix-grpc-farm/bin/nixos-test-driver -o $out